-- Logs begin at Wed 2022-10-12 07:59:24 UTC, end at Wed 2022-10-12 10:31:13 UTC. -- Oct 12 08:33:48.767360 n-d-858383-10 systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 08:33:48.776434 n-d-858383-10 devstack@n-api.service[111095]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 08:33:48 2022] *** Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: nodename: n-d-858383-10 Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: machine: x86_64 Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: clock source: unix Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: pcre jit disabled Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: detected number of CPU cores: 4 Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: current working directory: / Oct 12 08:33:48.778430 n-d-858383-10 devstack@n-api.service[111095]: detected binary path: /usr/bin/uwsgi-core Oct 12 08:33:48.779017 n-d-858383-10 devstack@n-api.service[111095]: your processes number limit is 47680 Oct 12 08:33:48.779017 n-d-858383-10 devstack@n-api.service[111095]: your memory page size is 4096 bytes Oct 12 08:33:48.779017 n-d-858383-10 devstack@n-api.service[111095]: detected max file descriptor number: 2048 Oct 12 08:33:48.779017 n-d-858383-10 devstack@n-api.service[111095]: lock engine: pthread robust mutexes Oct 12 08:33:48.779017 n-d-858383-10 devstack@n-api.service[111095]: thunder lock: enabled Oct 12 08:33:48.779017 n-d-858383-10 devstack@n-api.service[111095]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 08:33:48.779017 n-d-858383-10 devstack@n-api.service[111095]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 08:33:48.817494 n-d-858383-10 devstack@n-api.service[111095]: Python main interpreter initialized at 0x5632f46319c0 Oct 12 08:33:48.817494 n-d-858383-10 devstack@n-api.service[111095]: python threads support enabled Oct 12 08:33:48.817494 n-d-858383-10 devstack@n-api.service[111095]: your server socket listen backlog is limited to 100 connections Oct 12 08:33:48.817494 n-d-858383-10 devstack@n-api.service[111095]: your mercy for graceful operations on workers is 90 seconds Oct 12 08:33:48.817827 n-d-858383-10 devstack@n-api.service[111095]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 08:33:48.817908 n-d-858383-10 devstack@n-api.service[111095]: *** Operational MODE: preforking *** Oct 12 08:33:48.818159 n-d-858383-10 devstack@n-api.service[111095]: *** uWSGI is running in multiple interpreter mode *** Oct 12 08:33:48.818159 n-d-858383-10 devstack@n-api.service[111095]: spawned uWSGI master process (pid: 111095) Oct 12 08:33:48.818355 n-d-858383-10 systemd[1]: Started Devstack devstack@n-api.service. Oct 12 08:33:48.820655 n-d-858383-10 devstack@n-api.service[111095]: spawned uWSGI worker 1 (pid: 111096, cores: 1) Oct 12 08:33:48.820655 n-d-858383-10 devstack@n-api.service[111095]: spawned uWSGI worker 2 (pid: 111097, cores: 1) Oct 12 08:33:48.820655 n-d-858383-10 devstack@n-api.service[111095]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 08:33:49.456987 n-d-858383-10 devstack@n-api.service[111096]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 08:33:49.463086 n-d-858383-10 devstack@n-api.service[111097]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 08:33:50.509998 n-d-858383-10 devstack@n-api.service[111097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 08:33:50.509998 n-d-858383-10 devstack@n-api.service[111097]: from cryptography.utils import int_from_bytes Oct 12 08:33:50.510715 n-d-858383-10 devstack@n-api.service[111096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 08:33:50.510715 n-d-858383-10 devstack@n-api.service[111096]: from cryptography.utils import int_from_bytes Oct 12 08:33:50.511105 n-d-858383-10 devstack@n-api.service[111097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 08:33:50.511105 n-d-858383-10 devstack@n-api.service[111097]: from cryptography.utils import int_from_bytes Oct 12 08:33:50.511214 n-d-858383-10 devstack@n-api.service[111096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 08:33:50.511214 n-d-858383-10 devstack@n-api.service[111096]: from cryptography.utils import int_from_bytes Oct 12 08:33:52.989617 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 08:33:52.990220 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 08:33:52.990399 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 08:33:52.990692 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 08:33:52.990853 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 08:33:52.991244 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 08:33:52.991323 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 08:33:52.991398 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.991533 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 08:33:52.991687 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.991888 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 08:33:52.992019 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.992114 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 08:33:52.992183 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.992501 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.992643 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.992773 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.992858 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.993114 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.993278 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.993521 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.993653 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.993739 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.993834 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.994003 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.994148 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.994293 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.994405 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.994589 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.994690 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.994894 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.994995 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.995172 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.995269 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.995476 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.995565 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.995780 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.995864 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.996073 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.996163 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.996378 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.996472 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.996674 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.996758 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.996981 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.997149 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.997263 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998364 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998473 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998473 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998612 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998677 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998739 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998822 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998888 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.998951 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.999013 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.999075 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.999258 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.999388 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.999574 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.999665 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.999879 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:52.999969 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.000173 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.000255 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.000485 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.000607 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.000785 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.000914 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.001100 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.001215 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.001403 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.001542 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.001876 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.002004 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.002185 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.002281 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.002489 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.002593 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.002794 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.002879 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.003197 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.003283 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.003497 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.003583 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.003801 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.003891 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.004112 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.004201 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.004420 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.004516 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.004720 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.004812 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.005012 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.005096 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.005311 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.005394 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.005637 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.005732 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.005946 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.006026 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.006244 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.006334 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.006539 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.006633 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.006780 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.006873 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.007079 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.007170 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.007390 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.007492 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.007700 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.007790 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.007942 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.008026 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.008240 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.008333 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.008483 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.008568 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.008791 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.008874 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.009099 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.009185 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.009378 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.009482 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.009649 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.009748 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.009961 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.010046 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.010271 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.010353 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.010569 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.010652 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.010862 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.010944 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.011157 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.011247 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.011453 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.011544 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.011749 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.011832 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.012048 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.012143 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.012346 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.012431 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.012647 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.012729 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.012953 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.013035 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.013262 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.013353 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.013588 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.013675 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.013887 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.013970 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.014199 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.014282 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.014509 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.014599 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.014810 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.014903 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.015109 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.015191 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.015416 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.015499 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.015716 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.015822 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.016013 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.016099 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.016308 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.016392 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.016616 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.016709 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.016914 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.017003 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.017213 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.017296 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.017500 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.017604 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.017794 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.017881 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.018088 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.018177 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.018395 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.018537 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.018685 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.018768 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.018979 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.019063 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.019278 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.019363 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.019568 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.019659 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.019879 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.019975 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.020156 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.020242 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.020454 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.020536 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.020747 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.020830 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.021040 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.021123 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.021334 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.021416 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.021656 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.021743 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.021953 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.022073 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.022247 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.022344 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.022538 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.022630 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.022832 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.022915 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.023132 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.023215 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.023427 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.023522 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.023722 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.023804 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.024016 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.024105 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.024310 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.024398 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.024614 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.024707 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.024905 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.024987 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.025199 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.025291 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.025521 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.025608 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.025820 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.025905 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.026114 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.026208 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.026411 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.026501 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.026706 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.026788 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.027000 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.027093 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.027294 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.027376 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.027584 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.027666 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.027880 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.027972 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.028176 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.028266 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.028469 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.028551 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.028762 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.028852 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.029052 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.029135 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.029341 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.029447 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.029655 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.029741 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.029949 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.030033 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.030238 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.030323 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.030527 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.030612 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.030814 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.030905 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.031110 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.031193 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.031405 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.031488 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.031699 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.031781 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.031992 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.032134 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.032284 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.032370 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.032590 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.032674 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.032890 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.033025 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.033244 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.033328 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.033567 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.033668 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.033882 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:33:53.033984 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.034211 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.034296 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.034530 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.034612 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.034838 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.034940 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.035142 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.035225 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.035446 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.035530 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.035761 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.035845 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.036062 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.036157 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.036362 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.036446 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.036664 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.036748 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.036971 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.037062 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.037277 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.037360 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.037607 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.037721 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.037917 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.038002 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.038218 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.038300 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.038527 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.038612 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.038829 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.038920 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.039134 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.039218 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.039443 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.039528 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.039752 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.039842 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.040052 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.040136 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.040359 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.040455 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.040679 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.040763 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.040990 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.041086 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.041294 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.041377 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.041627 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.041712 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.041934 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.042107 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.042236 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.042363 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.042538 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.042630 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.042867 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.042960 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.043170 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.043253 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.043469 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.043551 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.043771 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.043862 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.044070 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.044160 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.044383 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.044466 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.044687 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.044807 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.044990 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.045075 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.045294 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.045377 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.045620 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.045705 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.045920 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.046004 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.046225 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.046308 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.046531 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.046621 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.046838 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.046930 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.047139 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.047222 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.047442 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.047527 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.047750 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.047840 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.048052 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.048141 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.048353 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.048444 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.048678 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.048776 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.048975 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.049068 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.049269 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.049352 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.049595 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.049683 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.049894 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.049991 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.050189 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.050274 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.050488 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.050572 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.051161 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.051266 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.051457 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.051541 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.051756 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.051838 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.052070 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.052166 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.052370 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.052462 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.052670 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.052753 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.052969 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.053054 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.053266 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.053350 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.053593 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.053695 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.053894 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.054029 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.054190 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.054275 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.054491 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.054573 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.054788 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.054906 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.055085 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.055169 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.055381 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.055464 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.055682 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.055765 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.055981 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.056072 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.056281 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.056373 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.056581 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.056664 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.056881 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.056965 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.057180 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.057271 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.057505 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.057636 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.057812 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.057908 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.058113 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.058216 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.058415 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.058534 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.058717 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.058810 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.059034 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.059129 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.059328 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.059423 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.059631 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.059722 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.059944 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.060028 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.060251 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.060335 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.060543 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.060627 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.060843 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.060933 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.061137 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.061221 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.061442 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.061541 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.061751 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.061836 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.062055 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.062139 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.062347 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.062432 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.062641 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.062728 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.062934 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.063018 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.063228 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.063326 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.063522 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.063608 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.063816 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.063900 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.064115 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.064226 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.064458 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.064551 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.064755 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.064838 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.065045 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.065137 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.065357 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.065498 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.065686 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.065772 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.065983 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.066077 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.066279 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.066370 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.066612 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.066696 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.066908 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.067007 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.067212 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.067304 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.067517 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.067609 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.067818 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.067903 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.068118 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.068208 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.068421 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.068513 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.068719 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.068803 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.069027 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.069111 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.069326 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.069421 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.069657 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.069742 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.069954 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.070037 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.070263 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.070347 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.070563 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.070650 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.070871 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.070955 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.071164 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.071270 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.071466 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.071557 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.071769 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.071852 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.072083 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.072176 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.072385 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.072469 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.072694 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.072781 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.072995 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.073089 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.073298 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.073383 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.073621 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.073707 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.073920 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.074017 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.074219 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.074303 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.074517 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.074600 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.074825 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.074910 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.075126 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.075210 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.075431 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.075524 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.075727 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.075817 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.076037 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.076120 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.076333 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.076415 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.076640 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.076728 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.076935 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.077020 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.077237 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.077322 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.077560 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.077658 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.077874 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.077958 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.078172 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.078265 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.078472 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.078558 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.078783 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.078874 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.079085 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.079183 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.079385 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.079468 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.079684 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.079768 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.080004 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.080096 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.080301 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.080385 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.080598 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.080681 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.080901 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.080993 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.081200 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.081285 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.081529 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.081615 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.081834 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.081919 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.082143 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.082226 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.082448 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.082533 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.082751 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.082836 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.083043 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.083127 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.083346 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.083430 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.083646 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.083730 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.083944 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.084028 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.084238 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.084365 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.084543 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.084629 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.084837 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.084920 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.085131 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.085216 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.085483 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.085572 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.085766 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.085850 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.086063 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.086206 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.086359 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.086444 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.086650 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.086733 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.086965 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.087056 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.087262 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.087346 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.087556 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.087646 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.087848 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.087940 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.088163 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.088254 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.088464 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.088548 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.088762 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.088853 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.089063 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.089154 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.089364 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.089467 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.089698 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.089784 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.090003 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.090093 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.090303 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.090391 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.090608 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.090722 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.090911 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.090999 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.091215 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.091305 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.091516 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.091602 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.091823 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.091908 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.092121 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.092204 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.092424 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.092508 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.092726 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.092823 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.093019 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.093119 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.093319 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.093403 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.093651 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.093741 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.093957 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.094211 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.094296 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.094538 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.094628 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.094845 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.094928 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.095155 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.095404 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.095542 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.095787 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.095880 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.096104 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.096228 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.096424 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.096512 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.096740 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.096822 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.097038 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.097131 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.097340 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.097463 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.097661 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.097745 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.097957 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.098040 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.098260 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.098360 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.098558 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.098653 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.098853 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.098951 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.099151 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.099255 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.099450 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.099534 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.099744 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.099833 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.100036 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.100122 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.100331 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.100416 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.100628 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.100730 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.100925 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.101008 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.101217 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.101299 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.101545 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.101631 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.101838 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.101921 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.102147 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.102229 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.102445 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.102527 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.102740 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.102824 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.103035 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.103126 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.103327 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.103419 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.103635 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.103718 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.103936 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.104017 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.104233 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.104322 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.104531 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.104614 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.104867 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.104950 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.105166 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.105262 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.105477 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.105561 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.105798 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.105892 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.106097 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.106183 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.106393 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.106487 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.106688 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.106772 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.106987 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.107071 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.107285 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.107370 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.107580 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.107671 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.107882 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.107973 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.108180 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.108263 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.108526 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.108637 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.108780 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.108891 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.109072 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.109157 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.109369 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.109479 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.109689 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.109776 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.109988 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.110079 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.110283 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.110375 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.110575 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.110659 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.110867 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.110958 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.111191 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.111287 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.111493 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.111583 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.111785 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.111868 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.112079 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.112174 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.112369 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.112460 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.112671 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.112754 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.112969 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.113106 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.113255 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.113341 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.113570 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.113658 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.113870 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.113957 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.114166 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.114249 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.114457 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.114555 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.114756 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.114851 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.115057 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.115142 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.115351 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.115434 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.115646 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.115731 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.115942 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.116027 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.116237 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.116321 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.116530 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.116614 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.116827 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.116912 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.117131 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.117224 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.117430 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.117526 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.117749 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.117832 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.118050 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.118143 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.118347 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.118432 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.118642 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.118733 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.118937 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.119030 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.119234 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.119318 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.119529 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.119621 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.119822 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.119933 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.120116 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.120218 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.120410 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.120494 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.120704 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.120788 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.121001 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.121085 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.121296 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.121387 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.121649 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.121732 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.121909 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.121995 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.122216 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.122300 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.122517 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.122603 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.122815 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.122906 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.123115 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.123200 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.123410 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.123496 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.123742 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.123834 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.124038 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.124132 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.124359 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.124445 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.124678 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.124781 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.124967 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.125070 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.125257 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.125341 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.125584 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.125671 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.125886 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.125988 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.126190 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.126276 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.126487 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.126572 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.126831 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.126927 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.127137 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.127220 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.127437 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.127521 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.127739 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.127832 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.128038 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.128123 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.128363 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.128451 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.128650 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.128736 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.128944 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.129086 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.129244 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.129329 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.129566 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.129672 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.129864 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.129955 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.130165 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.130250 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.130468 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.130553 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.130770 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.130861 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.131070 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.131154 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.131372 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.131464 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.131674 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.131761 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.131979 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.132075 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.132277 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.132361 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.132578 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.132662 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.132880 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.132972 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.133174 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.133300 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.133504 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.133616 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.133797 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.133899 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.134091 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.134175 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.134387 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.134469 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.134680 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.134762 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.134980 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.135060 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.135276 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.135375 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.135581 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.135686 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.135879 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.135991 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.136183 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.136292 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.136494 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.136584 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.136872 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.136954 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.137171 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.137254 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.137500 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.137601 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.137801 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.137884 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.138094 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.138185 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.138398 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.138480 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.138708 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.138790 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.139015 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.139126 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.139317 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.139416 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.139648 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.139742 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.139939 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.140036 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.140238 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.140321 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.140551 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.140634 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.140847 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.140939 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.141144 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.141235 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.141456 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.141554 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.141767 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.141858 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.142063 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.142146 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.142385 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.142467 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.142685 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.142769 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.143002 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.143097 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.143303 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.143468 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.143615 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.143750 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.144008 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.144147 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.144307 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.144441 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.144603 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.144733 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.144913 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.145069 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.145230 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.145317 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.145531 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.145621 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.145838 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.145924 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.146140 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.146227 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.146451 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.146536 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.146764 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.146859 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.147065 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.147157 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.147374 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.147468 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.147669 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.147754 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.147982 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.148067 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.148290 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.148383 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.148588 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.148673 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.148888 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.148979 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.149209 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.149327 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.149551 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.149645 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.149860 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.149965 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.150175 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.150268 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.150493 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.150591 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.150788 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.150888 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.151081 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.151174 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.151380 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.151481 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.151675 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.151766 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.151975 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.152069 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.152286 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.152379 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.152581 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.152665 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.152884 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.152969 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.153188 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.153271 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.153509 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.153621 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.153806 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.153898 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.154098 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.154183 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.154400 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.154491 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.154692 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.154782 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.154986 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.155069 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.155285 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.155389 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.155591 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.155674 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.155889 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.155973 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.156184 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.156285 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.156496 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.156579 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.156794 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.156880 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.157086 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.157171 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.157380 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.157486 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.157695 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.157790 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.158077 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.158162 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.158374 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.158464 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.158671 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.158754 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.158970 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.159055 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.159300 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.159389 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.159597 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.159680 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.159911 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.160003 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.160230 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.160312 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.160542 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.160638 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.160844 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.160927 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.161153 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.161236 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.161484 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.161586 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.161787 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.161871 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.162082 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.162165 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.162382 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.162481 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.162680 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.162763 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.162975 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.163062 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.163270 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.163362 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.163572 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.163666 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.163861 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.163944 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.164154 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.164238 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.164448 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.164533 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.164748 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.164836 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.165043 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.165126 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.165341 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.165484 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.165665 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.165752 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.165959 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.166046 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.166256 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.166340 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.166548 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.166634 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.166857 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.166944 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.167158 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.167241 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.167457 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.167551 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.167753 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.167843 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.168064 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.168154 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.168373 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.168467 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.168681 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.168773 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.168984 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.169067 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.169290 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.169397 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.169623 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.169720 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.169930 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.170074 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.170235 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.170375 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.170534 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.170662 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.170843 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.170980 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.171149 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.171290 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.171460 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.171586 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.171766 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.171966 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.172102 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.172285 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.172417 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.172591 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.172719 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.172897 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.173163 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.173300 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.173511 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.173667 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.173867 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.173959 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.174171 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.174259 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.174473 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.174558 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.174773 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.174867 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.175076 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.175168 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.175379 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.175517 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.176018 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.176117 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.176330 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.176421 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.176635 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.176731 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.176950 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.177045 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.177257 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.177341 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.177587 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.177674 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.177904 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.177991 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.178223 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.178313 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.178533 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.178617 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.178829 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.178913 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.179135 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.179227 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.179442 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.179538 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.179749 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.179832 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.180054 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.180138 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.180356 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.180447 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.180661 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.180743 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.180962 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.181045 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.181264 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.181348 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.181590 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.181677 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.181898 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.181981 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.182201 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.182285 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.182505 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.182589 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.182810 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.182894 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.183116 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.183201 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.183427 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.183510 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.183744 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.183840 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.184067 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.184152 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.184379 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.184576 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.184687 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.184883 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.184995 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.185206 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.185289 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.185545 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.185835 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.185929 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.186149 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.186233 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.186454 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.186535 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.186771 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.186863 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.187069 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.187153 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.187366 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.187457 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.187666 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.187750 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.187965 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.188050 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.188264 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.188348 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.188568 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.188651 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.188864 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.188945 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.189175 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.189258 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.189499 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.189601 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.189802 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.189884 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.190109 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.190324 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.190420 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.190664 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.190748 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.190976 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.191067 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.191292 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.191508 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.191612 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.191845 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.191929 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.192157 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.192249 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.192475 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.192559 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.192796 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.192880 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.193091 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.193182 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.193395 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.193501 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.193722 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.193805 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.194017 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.194109 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.194313 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.194396 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.194615 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.194698 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.194915 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.195005 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.195211 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.195293 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.195510 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.195592 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.195803 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.195889 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.196101 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.196191 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.196399 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.196483 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.196692 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.196775 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.196984 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.197073 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.197282 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.197364 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.197598 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.197685 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.197897 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.197989 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.198193 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.198289 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.198488 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.198572 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.198783 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.198865 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.199074 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.199164 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.199372 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.199454 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.199664 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.199746 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.199965 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.200061 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.200259 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.200344 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.200561 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.200644 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.200860 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.200953 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.201165 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.201248 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.201483 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.201579 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.201777 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.201868 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.202109 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.202198 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.202411 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.202493 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.202710 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.202795 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.203009 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.203093 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.203307 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.203391 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.203610 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.203700 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.203925 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.204015 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.204229 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.204439 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.204536 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.204760 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.204902 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.205123 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.205206 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.205470 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.205762 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.205845 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.206076 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.206158 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.206375 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.206470 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.206671 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.206754 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.206988 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.207070 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.207289 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.207385 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.207591 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.207673 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.207889 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.207972 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.208188 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.208280 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.208489 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.208572 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.208788 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.208871 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.209087 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.209171 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.209388 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.209490 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.209714 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.209807 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.210015 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.210100 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.210316 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.210399 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.210616 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.210698 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.210917 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.211009 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.211213 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.211295 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.211512 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.211608 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.211813 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.211896 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.212114 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.212197 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.212417 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.212511 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.212722 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.212820 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.213029 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.213124 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.213329 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.213422 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.213653 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.213738 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.213955 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.214046 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.214255 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.214338 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.214560 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.214643 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.214860 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.214951 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.215161 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.215252 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.215452 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.215534 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.215762 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.216085 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.216185 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.216391 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.216475 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.216688 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.216779 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.217009 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.217315 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.217398 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.217651 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.217734 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.217968 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.218064 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.218285 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.218369 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.218596 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.218713 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.218913 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.219016 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.219230 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.219327 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.219536 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.219624 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.219852 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.219946 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.220181 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.220278 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.220477 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.220575 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.220775 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.220862 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.221073 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.221160 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.221374 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.221480 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.221707 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.221794 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.222010 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.222095 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.222305 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.222403 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.222603 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.222688 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.222903 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.222985 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.223198 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.223308 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.223494 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.223585 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.223787 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.223870 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.224080 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.224174 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.224420 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.224543 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.224668 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.224761 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.224965 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.225059 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.225258 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.225351 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.225576 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.225665 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.225876 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.225976 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.226172 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.226268 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.226468 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.226552 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.226760 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.226844 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.227054 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.227139 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.227348 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.227433 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.227639 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.227731 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.227931 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.228015 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.228227 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.228320 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.228523 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.228609 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.228820 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.228906 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.229113 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.229207 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.229450 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.229536 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.229769 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.229853 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.230068 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.230166 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.230380 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.230464 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.230687 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.230783 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.230987 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.231148 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.231289 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.231375 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.231602 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.231687 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.231906 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.232003 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.232207 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.232292 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.232510 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.232594 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.232810 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.232896 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.233108 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.233201 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.233407 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.233512 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.233736 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.233822 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.234040 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.234124 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.234334 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.234430 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.234636 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.234732 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.234939 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.235023 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.235249 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.235343 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.235554 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.235638 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.235852 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.235935 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.236222 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.236343 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.236528 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.236623 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.236831 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.236924 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.237129 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.237231 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.237430 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.237534 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.237748 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.237832 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.238052 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.238138 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.238350 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.238432 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.238649 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.238733 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.238950 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.239034 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.239251 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.239334 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.239554 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.239638 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.239860 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.239982 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.240158 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.240243 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.240464 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.240547 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.240778 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.240869 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.241096 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.241179 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.241399 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.241526 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.241742 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.241826 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.242060 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.242143 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.242363 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.242454 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.242666 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.242756 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.242963 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.243047 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.243201 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 08:33:53.243319 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.243616 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.243921 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.244220 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:33:53.244456 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 08:33:53.398453 n-d-858383-10 devstack@n-api.service[111097]: INFO dbcounter [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Registered counter for database nova_api Oct 12 08:33:53.400559 n-d-858383-10 devstack@n-api.service[111096]: INFO dbcounter [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Registered counter for database nova_api Oct 12 08:33:53.421569 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_db.sqlalchemy.engines [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:33:53.423348 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_db.sqlalchemy.engines [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:33:53.429092 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writer thread running {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:33:53.430810 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writer thread running {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:33:53.484035 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.context [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) {{(pid=111097) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 08:33:53.485922 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.context [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) {{(pid=111096) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 08:33:53.488016 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:33:53.488482 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:33:53.489783 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_concurrency.lockutils [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:33:53.490064 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:33:53.490227 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_concurrency.lockutils [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:33:53.490783 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:33:53.491215 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:33:53.491815 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_concurrency.lockutils [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:33:53.492538 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_concurrency.lockutils [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:33:53.492973 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_concurrency.lockutils [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:33:53.493151 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:33:53.494985 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_concurrency.lockutils [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:33:53.495154 n-d-858383-10 devstack@n-api.service[111097]: INFO dbcounter [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Registered counter for database nova_cell0 Oct 12 08:33:53.496959 n-d-858383-10 devstack@n-api.service[111096]: INFO dbcounter [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Registered counter for database nova_cell0 Oct 12 08:33:53.499134 n-d-858383-10 devstack@n-api.service[111097]: INFO dbcounter [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Registered counter for database nova_cell1 Oct 12 08:33:53.500895 n-d-858383-10 devstack@n-api.service[111096]: INFO dbcounter [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Registered counter for database nova_cell1 Oct 12 08:33:53.506575 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_db.sqlalchemy.engines [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:33:53.508414 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_db.sqlalchemy.engines [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:33:53.511369 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writer thread running {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:33:53.512017 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_db.sqlalchemy.engines [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:33:53.513824 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writer thread running {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:33:53.514460 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_db.sqlalchemy.engines [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:33:53.651545 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writer thread running {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:33:53.655100 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writer thread running {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:33:53.660296 n-d-858383-10 devstack@n-api.service[111097]: INFO dbcounter [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Registered counter for database nova_cell0 Oct 12 08:33:53.664301 n-d-858383-10 devstack@n-api.service[111096]: INFO dbcounter [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Registered counter for database nova_cell0 Oct 12 08:33:53.669725 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_db.sqlalchemy.engines [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:33:53.673075 n-d-858383-10 devstack@n-api.service[111096]: DEBUG oslo_db.sqlalchemy.engines [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:33:53.675320 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writer thread running {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:33:53.678372 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writer thread running {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:33:54.008817 n-d-858383-10 devstack@n-api.service[111097]: WARNING keystonemiddleware.auth_token [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 08:33:54.010827 n-d-858383-10 devstack@n-api.service[111096]: WARNING keystonemiddleware.auth_token [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 08:33:54.015947 n-d-858383-10 devstack@n-api.service[111097]: WARNING keystonemiddleware.auth_token [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 08:33:54.018129 n-d-858383-10 devstack@n-api.service[111096]: WARNING keystonemiddleware.auth_token [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 08:33:54.355160 n-d-858383-10 devstack@n-api.service[111097]: WARNING keystonemiddleware.auth_token [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 08:33:54.361106 n-d-858383-10 devstack@n-api.service[111096]: WARNING keystonemiddleware.auth_token [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 08:33:54.361245 n-d-858383-10 devstack@n-api.service[111097]: WARNING keystonemiddleware.auth_token [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 08:33:54.366395 n-d-858383-10 devstack@n-api.service[111097]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632f46319c0 pid: 111097 (default app) Oct 12 08:33:54.367048 n-d-858383-10 devstack@n-api.service[111096]: WARNING keystonemiddleware.auth_token [None req-df842e20-a799-42ae-be90-8d5063b2c65a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 08:33:54.368439 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:33:54.369629 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001700 Oct 12 08:33:54.370031 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Wed Oct 12 08:33:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:33:54.372269 n-d-858383-10 devstack@n-api.service[111096]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632f46319c0 pid: 111096 (default app) Oct 12 08:35:15.496047 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:15.497062 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 12 08:35:15.497424 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:15.510077 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writing DB stats nova_api:SELECT=3 {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:15.510937 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writing DB stats nova_cell0:SELECT=3 {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:15.511640 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writing DB stats nova_cell1:SELECT=3 {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:15.513933 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:16.394219 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-8d7b8a0b-25a5-49e0-9069-e3920092374f admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:16.427937 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-8d7b8a0b-25a5-49e0-9069-e3920092374f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923212 Oct 12 08:35:16.428836 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 08:35:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:35:19.022602 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:19.023645 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-58e99971-8f61-4834-b809-5a3707c0ed64 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 12 08:35:19.024168 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:19.470504 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-30f3224e-ba00-42db-b746-172504b80868 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "disk": 1, "name": "cirros256", "id": "c1", "vcpus": 1}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:19.519436 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-30f3224e-ba00-42db-b746-172504b80868 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489092 Oct 12 08:35:19.519990 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:19.533930 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writing DB stats nova_api:SELECT=3 {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:19.535014 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writing DB stats nova_cell1:SELECT=3 {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:19.536927 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writing DB stats nova_cell0:SELECT=3 {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:19.537712 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:19.744746 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-c4a7d0a3-09a6-4607-853c-ec0b2391d9a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:19.815560 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-c4a7d0a3-09a6-4607-853c-ec0b2391d9a4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286892 Oct 12 08:35:19.816443 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 12 08:35:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:35:22.483668 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-30f3224e-ba00-42db-b746-172504b80868 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:22.485533 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-30f3224e-ba00-42db-b746-172504b80868 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002266 Oct 12 08:35:22.486131 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:23.318060 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-e9b81011-64d5-436e-a149-7282e843ff4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "name": "ds512M"}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:23.369008 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-e9b81011-64d5-436e-a149-7282e843ff4f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.876458 Oct 12 08:35:23.370200 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:23.394310 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-dc76b95c-c907-4983-8705-57a626096c05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:23.450525 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-dc76b95c-c907-4983-8705-57a626096c05 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063116 Oct 12 08:35:23.451713 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 12 08:35:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:35:26.282154 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-e9b81011-64d5-436e-a149-7282e843ff4f admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:26.283177 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-e9b81011-64d5-436e-a149-7282e843ff4f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Oct 12 08:35:26.283923 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:26.741753 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-e218caf2-9aa0-4f5c-b765-1e1049960c3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "name": "ds1G", "swap": 0}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:26.767845 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-e218caf2-9aa0-4f5c-b765-1e1049960c3e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477893 Oct 12 08:35:26.768393 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:26.780428 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-c64f2ae8-523f-424d-be58-519149139ff4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:26.810274 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-c64f2ae8-523f-424d-be58-519149139ff4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033387 Oct 12 08:35:26.811424 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 12 08:35:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:35:29.381769 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-e218caf2-9aa0-4f5c-b765-1e1049960c3e admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:29.382640 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-e218caf2-9aa0-4f5c-b765-1e1049960c3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 12 08:35:29.383292 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:29.859210 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-249ea5ec-535a-4752-a551-9b95c7a380cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G"}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:29.885970 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-249ea5ec-535a-4752-a551-9b95c7a380cd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495214 Oct 12 08:35:29.886455 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:29.901539 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-8172353e-aadb-4e48-a1bb-8d9498337ae7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:29.933382 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-8172353e-aadb-4e48-a1bb-8d9498337ae7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037912 Oct 12 08:35:29.935060 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 12 08:35:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:35:32.546320 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-249ea5ec-535a-4752-a551-9b95c7a380cd admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:32.547936 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-249ea5ec-535a-4752-a551-9b95c7a380cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002637 Oct 12 08:35:32.557841 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:32.982047 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-122b6e24-8078-4098-9884-44ea8f362034 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:33.004576 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-122b6e24-8078-4098-9884-44ea8f362034 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449893 Oct 12 08:35:33.018528 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-bb845c29-ace1-42f0-843a-2be073a305b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:33.023679 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:33.049417 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-bb845c29-ace1-42f0-843a-2be073a305b1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034731 Oct 12 08:35:33.069476 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Wed Oct 12 08:35:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:35:35.689882 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-122b6e24-8078-4098-9884-44ea8f362034 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:35.690976 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-122b6e24-8078-4098-9884-44ea8f362034 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Oct 12 08:35:35.691432 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:36.112474 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-157ee1d0-1166-427c-80c9-7406d02e891a admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:36.139091 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-157ee1d0-1166-427c-80c9-7406d02e891a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.441289 Oct 12 08:35:36.139656 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 08:35:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:35:38.868776 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-122b6e24-8078-4098-9884-44ea8f362034 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:38.869847 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-122b6e24-8078-4098-9884-44ea8f362034 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 12 08:35:38.870276 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:39.285547 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-d9aeab6b-125a-4c15-be41-a13fc46e8f45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "ram": 512, "vcpus": 1, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:39.313561 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-d9aeab6b-125a-4c15-be41-a13fc46e8f45 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.436492 Oct 12 08:35:39.314263 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:39.328503 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-e5d69e46-e802-457f-ac12-52924845dc99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:39.361257 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-e5d69e46-e802-457f-ac12-52924845dc99 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037686 Oct 12 08:35:39.362114 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 12 08:35:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:35:42.100421 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-d9aeab6b-125a-4c15-be41-a13fc46e8f45 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:42.101474 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-d9aeab6b-125a-4c15-be41-a13fc46e8f45 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 12 08:35:42.101876 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:42.501239 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-9b8cd7ad-a591-49a7-8b66-8991086451d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:42.520457 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-9b8cd7ad-a591-49a7-8b66-8991086451d4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412295 Oct 12 08:35:42.521331 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:42.533688 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-6c2acf99-cb46-4ec7-ab79-f9db75791936 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:42.557469 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-6c2acf99-cb46-4ec7-ab79-f9db75791936 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027528 Oct 12 08:35:42.558049 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 12 08:35:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:35:45.141360 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-9b8cd7ad-a591-49a7-8b66-8991086451d4 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:45.142438 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-9b8cd7ad-a591-49a7-8b66-8991086451d4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Oct 12 08:35:45.143010 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:45.553620 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-96d4abea-cf30-4c25-833c-24ea132c2145 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "id": "3", "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:45.575770 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-96d4abea-cf30-4c25-833c-24ea132c2145 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.426452 Oct 12 08:35:45.576063 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:45.588715 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-6a7070a4-aeaf-46df-92f1-367a900484b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:45.593784 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:45.621985 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-6a7070a4-aeaf-46df-92f1-367a900484b7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037454 Oct 12 08:35:45.622587 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 12 08:35:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:35:48.275893 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-96d4abea-cf30-4c25-833c-24ea132c2145 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:48.277796 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-96d4abea-cf30-4c25-833c-24ea132c2145 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002284 Oct 12 08:35:48.283326 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:48 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:48.724532 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-07917533-2ad6-478c-beb5-7dc77342a3ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:48.747119 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-07917533-2ad6-478c-beb5-7dc77342a3ae admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462512 Oct 12 08:35:48.747757 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:48.759920 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-e0ead4c0-5097-4dd4-89a6-022a7d4a2a28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:48.784705 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-e0ead4c0-5097-4dd4-89a6-022a7d4a2a28 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028444 Oct 12 08:35:48.786270 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 12 08:35:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:35:51.365057 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-07917533-2ad6-478c-beb5-7dc77342a3ae admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:35:51.366345 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-07917533-2ad6-478c-beb5-7dc77342a3ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001786 Oct 12 08:35:51.366735 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:35:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:35:51.791663 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-08fceda1-0a79-4336-9f33-d1c0e41a6f07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:51.800117 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:35:51.817025 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-08fceda1-0a79-4336-9f33-d1c0e41a6f07 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.444170 Oct 12 08:35:51.817942 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Wed Oct 12 08:35:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:35:51.830180 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-e449011f-fbd5-438b-82ce-0a425c33b8b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:35:51.862575 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-e449011f-fbd5-438b-82ce-0a425c33b8b0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035994 Oct 12 08:35:51.863441 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Wed Oct 12 08:35:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:36:12.060547 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-08fceda1-0a79-4336-9f33-d1c0e41a6f07 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:12.061890 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-08fceda1-0a79-4336-9f33-d1c0e41a6f07 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Oct 12 08:36:12.062454 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:12.076769 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:36:12.480134 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-21d913b4-d0cd-49ba-bda0-bb17aa8387f1 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:12.498801 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-21d913b4-d0cd-49ba-bda0-bb17aa8387f1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.426518 Oct 12 08:36:12.499331 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 08:36:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:36:13.802228 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-08fceda1-0a79-4336-9f33-d1c0e41a6f07 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:13.803250 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-08fceda1-0a79-4336-9f33-d1c0e41a6f07 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 12 08:36:13.803643 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:14.399310 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-9531c073-afa0-4ad8-9ba7-2148d296b980 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:14.407115 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.wsgi [None req-9531c073-afa0-4ad8-9ba7-2148d296b980 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-9531c073-afa0-4ad8-9ba7-2148d296b980 admin admin] Request method failure captured: Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: Accept: application/json Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: Accept-Encoding: gzip, deflate Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: Connection: keep-alive Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: Content-Length: 0 Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: Host: 10.222.0.40 Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: Openstack-Api-Version: compute 2.92 Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: Openstack-System-Scope: None Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: User-Agent: python-novaclient Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Auth-Token: gAAAAABjRnx9ZMKDxOdxaijobDS3rntCSdutwJeUhkTVFNEeRXCHgiLFstdJQJcOnl9F-7VYPjwVRADrELFQrlkg2PuFmm0NBzuH0Yj6mnrYMdjSd1-itVnQ6fJGDV7iLIWpaEuU2XJY2Q6nkceAQwpin-qzWjAIVfURLgAXbtwoVSiGC0M1kAo Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Domain-Id: None Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Domain-Name: None Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Identity-Status: Confirmed Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Is-Admin-Project: True Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Domain-Id: default Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Domain-Name: Default Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Name: admin Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Role: member,reader,admin Oct 12 08:36:14.411601 n-d-858383-10 devstack@n-api.service[111096]: X-Roles: member,reader,admin Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}] Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant: admin Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant-Name: admin Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-User: admin Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-User-Domain-Id: default Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-User-Domain-Name: Default Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-User-Id: db1a64377ee24acd853e4d041172d5f9 Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: X-User-Name: admin Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: method: > Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: exception: Flavor 42 could not be found. Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: action_args: {'id': '42'} Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:36:14.413153 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:14.414082 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.415453 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-9531c073-afa0-4ad8-9ba7-2148d296b980 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:36:14.416941 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-9531c073-afa0-4ad8-9ba7-2148d296b980 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.449242 Oct 12 08:36:14.416941 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 12 08:36:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:36:14.423559 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-dc298822-d492-460d-913d-cd68771491a0 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:14.448737 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-dc298822-d492-460d-913d-cd68771491a0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028708 Oct 12 08:36:14.449288 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 12 08:36:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:36:14.465309 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-fd4238d3-2277-4438-88e9-730855e5e48a admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:14.487407 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-fd4238d3-2277-4438-88e9-730855e5e48a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026814 Oct 12 08:36:14.487908 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 12 08:36:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:36:14.497533 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-6d2d83a3-521d-4e88-b325-d6b5412f736b admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:14.502939 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.wsgi [None req-6d2d83a3-521d-4e88-b325-d6b5412f736b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-6d2d83a3-521d-4e88-b325-d6b5412f736b admin admin] Request method failure captured: Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: Accept: application/json Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: Accept-Encoding: gzip, deflate Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: Connection: keep-alive Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: Content-Length: 0 Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: Host: 10.222.0.40 Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: Openstack-Api-Version: compute 2.92 Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: Openstack-System-Scope: None Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: User-Agent: python-novaclient Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Auth-Token: gAAAAABjRnx9ZMKDxOdxaijobDS3rntCSdutwJeUhkTVFNEeRXCHgiLFstdJQJcOnl9F-7VYPjwVRADrELFQrlkg2PuFmm0NBzuH0Yj6mnrYMdjSd1-itVnQ6fJGDV7iLIWpaEuU2XJY2Q6nkceAQwpin-qzWjAIVfURLgAXbtwoVSiGC0M1kAo Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Domain-Id: None Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Domain-Name: None Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Identity-Status: Confirmed Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Is-Admin-Project: True Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Domain-Id: default Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Domain-Name: Default Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Name: admin Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Role: member,reader,admin Oct 12 08:36:14.506228 n-d-858383-10 devstack@n-api.service[111097]: X-Roles: member,reader,admin Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}] Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant: admin Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant-Name: admin Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-User: admin Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-User-Domain-Id: default Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-User-Domain-Name: Default Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-User-Id: db1a64377ee24acd853e4d041172d5f9 Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: X-User-Name: admin Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: method: > Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: exception: Flavor 42 could not be found. Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: action_args: {'id': '42'} Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:36:14.507689 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:14.508781 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:14.510087 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-6d2d83a3-521d-4e88-b325-d6b5412f736b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:36:14.511241 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-6d2d83a3-521d-4e88-b325-d6b5412f736b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013720 Oct 12 08:36:14.511241 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 12 08:36:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 12 08:36:15.730247 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-fd4238d3-2277-4438-88e9-730855e5e48a admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:15.731266 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-fd4238d3-2277-4438-88e9-730855e5e48a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 12 08:36:15.731652 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:16.286557 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-abfdd302-0fc0-4594-9d3a-9385f39bc5a1 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:16.291889 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.wsgi [None req-abfdd302-0fc0-4594-9d3a-9385f39bc5a1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-abfdd302-0fc0-4594-9d3a-9385f39bc5a1 admin admin] Request method failure captured: Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: Accept: application/json Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: Accept-Encoding: gzip, deflate Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: Connection: keep-alive Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: Content-Length: 0 Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: Host: 10.222.0.40 Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: Openstack-Api-Version: compute 2.92 Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: Openstack-System-Scope: None Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: User-Agent: python-novaclient Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Auth-Token: gAAAAABjRnx_4nqBxaah23PA3q8iQD6jUsAX7DkagX_k7S0KavzIT5ttuAC_S2TTcgV5KYFs-ef2NPFCq3Yb7ZGEZH15fxPhFogJ1kXHP73850UPe7Pr7szrQqzQq1d-uYgIBMASMQXlg_dG_YW7A1otHtdzJ3rwQf21EmloAh6aaqVXTqw7-cE Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Domain-Id: None Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Domain-Name: None Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Identity-Status: Confirmed Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Is-Admin-Project: True Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Domain-Id: default Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Domain-Name: Default Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Name: admin Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Role: member,reader,admin Oct 12 08:36:16.293793 n-d-858383-10 devstack@n-api.service[111097]: X-Roles: member,reader,admin Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}] Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant: admin Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant-Name: admin Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-User: admin Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-User-Domain-Id: default Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-User-Domain-Name: Default Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-User-Id: db1a64377ee24acd853e4d041172d5f9 Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: X-User-Name: admin Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: method: > Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: exception: Flavor 84 could not be found. Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: action_args: {'id': '84'} Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:36:16.295112 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:16.295920 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.297134 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-abfdd302-0fc0-4594-9d3a-9385f39bc5a1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:36:16.298394 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-abfdd302-0fc0-4594-9d3a-9385f39bc5a1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.429098 Oct 12 08:36:16.298394 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 12 08:36:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:36:16.305477 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-26f3c22f-2f4f-4aeb-b31d-8438a4563aec admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:16.320334 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-26f3c22f-2f4f-4aeb-b31d-8438a4563aec admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018632 Oct 12 08:36:16.320851 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 12 08:36:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:36:16.330339 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-7cc1c288-3a12-47a7-8b2f-fc03ed59d2c2 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:16.346445 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-7cc1c288-3a12-47a7-8b2f-fc03ed59d2c2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019676 Oct 12 08:36:16.346977 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 12 08:36:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:36:16.356484 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-ad3d9c0b-0d08-4796-9b8d-a51d2e738ac0 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:16.361657 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.wsgi [None req-ad3d9c0b-0d08-4796-9b8d-a51d2e738ac0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-ad3d9c0b-0d08-4796-9b8d-a51d2e738ac0 admin admin] Request method failure captured: Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: Accept: application/json Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: Accept-Encoding: gzip, deflate Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: Connection: keep-alive Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: Content-Length: 0 Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: Host: 10.222.0.40 Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: Openstack-Api-Version: compute 2.92 Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: Openstack-System-Scope: None Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: User-Agent: python-novaclient Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Auth-Token: gAAAAABjRnx_4nqBxaah23PA3q8iQD6jUsAX7DkagX_k7S0KavzIT5ttuAC_S2TTcgV5KYFs-ef2NPFCq3Yb7ZGEZH15fxPhFogJ1kXHP73850UPe7Pr7szrQqzQq1d-uYgIBMASMQXlg_dG_YW7A1otHtdzJ3rwQf21EmloAh6aaqVXTqw7-cE Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Domain-Id: None Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Domain-Name: None Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Identity-Status: Confirmed Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Is-Admin-Project: True Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Domain-Id: default Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Domain-Name: Default Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Name: admin Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Role: member,reader,admin Oct 12 08:36:16.363156 n-d-858383-10 devstack@n-api.service[111096]: X-Roles: member,reader,admin Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}] Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant: admin Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant-Name: admin Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-User: admin Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-User-Domain-Id: default Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-User-Domain-Name: Default Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-User-Id: db1a64377ee24acd853e4d041172d5f9 Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: X-User-Name: admin Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: method: > Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: exception: Flavor 84 could not be found. Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: action_args: {'id': '84'} Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:36:16.364683 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:16.365654 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:16.366927 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-ad3d9c0b-0d08-4796-9b8d-a51d2e738ac0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:36:16.368221 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-ad3d9c0b-0d08-4796-9b8d-a51d2e738ac0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011582 Oct 12 08:36:16.368221 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 12 08:36:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:36:17.567104 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-7cc1c288-3a12-47a7-8b2f-fc03ed59d2c2 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:17.568457 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-7cc1c288-3a12-47a7-8b2f-fc03ed59d2c2 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 Oct 12 08:36:17.568952 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:18.126126 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-e83de6dd-df37-47bb-9382-2bd91eee1009 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:18.131949 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.wsgi [None req-e83de6dd-df37-47bb-9382-2bd91eee1009 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-e83de6dd-df37-47bb-9382-2bd91eee1009 admin admin] Request method failure captured: Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: Accept: application/json Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: Accept-Encoding: gzip, deflate Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: Connection: keep-alive Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: Content-Length: 0 Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: Host: 10.222.0.40 Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: Openstack-Api-Version: compute 2.92 Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: Openstack-System-Scope: None Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: User-Agent: python-novaclient Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Auth-Token: gAAAAABjRnyBkryHPMShzOquAqHF-aG6tJgQCrZQKsO3ncBxqt3TSYi6RkUSdfD68jmeKA7JFebyz5j_aFOVHWPVMgVTXNUIBkV45PN9vtajUEQWRIiMrEVy-QiQW9LPdoooMJ_fDo-8KXW2gz6DbHYrqXpM8cZRKRMNiLSeWrMsR1XpCVW_zfs Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Domain-Id: None Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Domain-Name: None Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Identity-Status: Confirmed Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Is-Admin-Project: True Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Domain-Id: default Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Domain-Name: Default Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Project-Name: admin Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Role: member,reader,admin Oct 12 08:36:18.133601 n-d-858383-10 devstack@n-api.service[111096]: X-Roles: member,reader,admin Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}] Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant: admin Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-Tenant-Name: admin Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-User: admin Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-User-Domain-Id: default Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-User-Domain-Name: Default Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-User-Id: db1a64377ee24acd853e4d041172d5f9 Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: X-User-Name: admin Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: method: > Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: exception: Flavor 451 could not be found. Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: action_args: {'id': '451'} Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:36:18.134969 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:18.135901 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.137618 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-e83de6dd-df37-47bb-9382-2bd91eee1009 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:36:18.138622 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-e83de6dd-df37-47bb-9382-2bd91eee1009 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.422177 Oct 12 08:36:18.138622 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 12 08:36:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:36:18.146017 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-def57209-47c7-43c0-a14c-31b9d37db985 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:18.162426 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-def57209-47c7-43c0-a14c-31b9d37db985 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019978 Oct 12 08:36:18.163215 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 12 08:36:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:36:18.174069 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:18.189388 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019000 Oct 12 08:36:18.189964 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Wed Oct 12 08:36:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:36:18.199756 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-5bd7094b-1005-4192-a4e8-a11a5918ce69 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:18.205004 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.wsgi [None req-5bd7094b-1005-4192-a4e8-a11a5918ce69 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-5bd7094b-1005-4192-a4e8-a11a5918ce69 admin admin] Request method failure captured: Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: Accept: application/json Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: Accept-Encoding: gzip, deflate Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: Connection: keep-alive Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: Content-Length: 0 Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: Host: 10.222.0.40 Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: Openstack-Api-Version: compute 2.92 Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: Openstack-System-Scope: None Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: User-Agent: python-novaclient Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Auth-Token: gAAAAABjRnyBkryHPMShzOquAqHF-aG6tJgQCrZQKsO3ncBxqt3TSYi6RkUSdfD68jmeKA7JFebyz5j_aFOVHWPVMgVTXNUIBkV45PN9vtajUEQWRIiMrEVy-QiQW9LPdoooMJ_fDo-8KXW2gz6DbHYrqXpM8cZRKRMNiLSeWrMsR1XpCVW_zfs Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Domain-Id: None Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Domain-Name: None Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Identity-Status: Confirmed Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Is-Admin-Project: True Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Domain-Id: default Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Domain-Name: Default Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Project-Name: admin Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Role: member,reader,admin Oct 12 08:36:18.206531 n-d-858383-10 devstack@n-api.service[111097]: X-Roles: member,reader,admin Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_343b914af1a947d9af1653c0aa3ce79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/343b914af1a947d9af1653c0aa3ce79e"}]}] Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant: admin Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant-Id: 343b914af1a947d9af1653c0aa3ce79e Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-Tenant-Name: admin Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-User: admin Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-User-Domain-Id: default Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-User-Domain-Name: Default Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-User-Id: db1a64377ee24acd853e4d041172d5f9 Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: X-User-Name: admin Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: method: > Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: exception: Flavor 451 could not be found. Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: action_args: {'id': '451'} Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:36:18.208212 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:18.209124 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: ERROR nova.api.openstack.wsgi Oct 12 08:36:18.210515 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-5bd7094b-1005-4192-a4e8-a11a5918ce69 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:36:18.211868 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-5bd7094b-1005-4192-a4e8-a11a5918ce69 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011817 Oct 12 08:36:18.211868 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 12 08:36:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:36:19.433759 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:19.434820 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Oct 12 08:36:19.435211 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:19.987138 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-64c26453-219d-4717-9920-2406b2e6f0e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:36:20.009705 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-64c26453-219d-4717-9920-2406b2e6f0e4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.437158 Oct 12 08:36:20.010232 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Oct 12 08:36:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:36:21.236593 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:21.237707 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 12 08:36:21.238098 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:36:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:21.803726 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-c6b9689f-f6f5-41dd-9810-c7733d249616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:36:21.826819 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-c6b9689f-f6f5-41dd-9810-c7733d249616 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.448052 Oct 12 08:36:21.827365 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Oct 12 08:36:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:36:23.038117 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:23.039153 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 12 08:36:23.039574 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:23.576454 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-a35581fe-942e-45d5-a725-c8f6bbdba33c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:36:23.599556 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-a35581fe-942e-45d5-a725-c8f6bbdba33c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.425738 Oct 12 08:36:23.600120 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Oct 12 08:36:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:36:24.819004 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:24.820042 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 12 08:36:24.820507 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:25.387589 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-e2e3c509-c256-4bf7-b76e-3a25c078ed56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:36:25.409747 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-e2e3c509-c256-4bf7-b76e-3a25c078ed56 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.445067 Oct 12 08:36:25.410291 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Wed Oct 12 08:36:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:36:26.629242 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:26.630316 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 12 08:36:26.630701 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:36:27.176425 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-95c01335-0b50-49fa-89cd-86d9b60a1ca3 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:36:27.202307 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-95c01335-0b50-49fa-89cd-86d9b60a1ca3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.437507 Oct 12 08:36:27.202813 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Wed Oct 12 08:36:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:37:23.618036 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:37:23.619192 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-b6bcb838-771c-4dae-a765-35b078a09491 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Oct 12 08:37:23.619747 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Wed Oct 12 08:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:37:23.630773 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:37:24.043620 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-69eb8b0a-c67c-43ee-98f6-33d20eac02c1 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:37:24.064674 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-69eb8b0a-c67c-43ee-98f6-33d20eac02c1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.438471 Oct 12 08:37:24.065226 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 08:37:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:37:24.087805 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writing DB stats nova_api:SELECT=14 {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:37:24.094128 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-f4e2211d-87b8-4dc4-9ad4-f056822ada54 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:37:24.102138 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-f4e2211d-87b8-4dc4-9ad4-f056822ada54 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016774 Oct 12 08:37:24.102621 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Wed Oct 12 08:37:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:37:24.117013 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-5056d8b2-7ad9-4034-912d-16c7ecadc47c admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:37:24.127452 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-5056d8b2-7ad9-4034-912d-16c7ecadc47c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016397 Oct 12 08:37:24.128086 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Wed Oct 12 08:37:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:37:24.139268 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-6f1a6f9c-7e03-4c1e-8ef2-830b9d8ce492 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:37:24.146367 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-6f1a6f9c-7e03-4c1e-8ef2-830b9d8ce492 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010609 Oct 12 08:37:24.146910 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Wed Oct 12 08:37:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:37:24.158271 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-3fa4ec6a-3eee-48e1-8b30-9b57d640198f admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:37:24.166186 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-3fa4ec6a-3eee-48e1-8b30-9b57d640198f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011409 Oct 12 08:37:24.166694 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Wed Oct 12 08:37:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:42:49.121040 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-6f1a6f9c-7e03-4c1e-8ef2-830b9d8ce492 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:42:49.122083 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-6f1a6f9c-7e03-4c1e-8ef2-830b9d8ce492 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 12 08:42:49.122477 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:42:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:42:49.257466 n-d-858383-10 devstack@n-api.service[111097]: DEBUG dbcounter [-] [111097] Writing DB stats nova_api:SELECT=6 {{(pid=111097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:42:49.418641 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-1451e282-246b-47c6-8cb4-a1b200859107 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:42:49.423465 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-1451e282-246b-47c6-8cb4-a1b200859107 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:42:49.423940 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-1451e282-246b-47c6-8cb4-a1b200859107 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:42:49.424352 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-1451e282-246b-47c6-8cb4-a1b200859107 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:42:49.425140 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-1451e282-246b-47c6-8cb4-a1b200859107 admin admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:42:49.425633 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-1451e282-246b-47c6-8cb4-a1b200859107 admin admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:42:49.426044 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-1451e282-246b-47c6-8cb4-a1b200859107 admin admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:42:49.464283 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-1451e282-246b-47c6-8cb4-a1b200859107 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.207937 Oct 12 08:42:49.465064 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 12 08:42:49 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:42:50.532349 n-d-858383-10 devstack@n-api.service[111096]: DEBUG nova.api.openstack.wsgi [None req-6f1a6f9c-7e03-4c1e-8ef2-830b9d8ce492 admin admin] Calling method '>' {{(pid=111096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:42:50.533375 n-d-858383-10 devstack@n-api.service[111096]: INFO nova.api.openstack.requestlog [None req-6f1a6f9c-7e03-4c1e-8ef2-830b9d8ce492 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 12 08:42:50.533799 n-d-858383-10 devstack@n-api.service[111096]: [pid: 111096|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Wed Oct 12 08:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:42:50.726293 n-d-858383-10 devstack@n-api.service[111097]: DEBUG nova.api.openstack.wsgi [None req-06df9f7f-b257-4e89-8cda-963f42e57056 admin admin] Calling method '>' {{(pid=111097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:42:50.729811 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-06df9f7f-b257-4e89-8cda-963f42e57056 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:42:50.730315 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-06df9f7f-b257-4e89-8cda-963f42e57056 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:42:50.730742 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-06df9f7f-b257-4e89-8cda-963f42e57056 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:42:50.731456 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-06df9f7f-b257-4e89-8cda-963f42e57056 admin admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:42:50.731899 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-06df9f7f-b257-4e89-8cda-963f42e57056 admin admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:42:50.732323 n-d-858383-10 devstack@n-api.service[111097]: DEBUG oslo_concurrency.lockutils [None req-06df9f7f-b257-4e89-8cda-963f42e57056 admin admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:42:50.755398 n-d-858383-10 devstack@n-api.service[111097]: INFO nova.api.openstack.requestlog [None req-06df9f7f-b257-4e89-8cda-963f42e57056 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.086137 Oct 12 08:42:50.755842 n-d-858383-10 devstack@n-api.service[111097]: [pid: 111097|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 12 08:42:50 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:43:36.815256 n-d-858383-10 devstack@n-api.service[111095]: Wed Oct 12 08:43:36 2022 - graceful shutdown triggered... Oct 12 08:43:36.815299 n-d-858383-10 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 12 08:43:36.816623 n-d-858383-10 devstack@n-api.service[111096]: Gracefully killing worker 1 (pid: 111096)... Oct 12 08:43:36.817073 n-d-858383-10 devstack@n-api.service[111097]: Gracefully killing worker 2 (pid: 111097)... Oct 12 08:43:36.948668 n-d-858383-10 devstack@n-api.service[111096]: DEBUG dbcounter [-] [111096] Writing DB stats nova_api:SELECT=4 {{(pid=111096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:43:37.817759 n-d-858383-10 devstack@n-api.service[111095]: worker 1 buried after 1 seconds Oct 12 08:43:37.817759 n-d-858383-10 devstack@n-api.service[111095]: worker 2 buried after 1 seconds Oct 12 08:43:37.817759 n-d-858383-10 devstack@n-api.service[111095]: goodbye to uWSGI. Oct 12 08:43:37.820269 n-d-858383-10 systemd[1]: devstack@n-api.service: Succeeded. Oct 12 08:43:37.821171 n-d-858383-10 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 12 08:43:37.825740 n-d-858383-10 systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 08:43:37.849840 n-d-858383-10 devstack@n-api.service[126989]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 08:43:37 2022] *** Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: nodename: n-d-858383-10 Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: machine: x86_64 Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: clock source: unix Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: pcre jit disabled Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: detected number of CPU cores: 4 Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: current working directory: / Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: detected binary path: /usr/bin/uwsgi-core Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: your processes number limit is 47680 Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: your memory page size is 4096 bytes Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: detected max file descriptor number: 2048 Oct 12 08:43:37.862260 n-d-858383-10 devstack@n-api.service[126989]: lock engine: pthread robust mutexes Oct 12 08:43:37.863398 n-d-858383-10 devstack@n-api.service[126989]: thunder lock: enabled Oct 12 08:43:37.863398 n-d-858383-10 devstack@n-api.service[126989]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 08:43:37.863398 n-d-858383-10 devstack@n-api.service[126989]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 08:43:37.902397 n-d-858383-10 devstack@n-api.service[126989]: Python main interpreter initialized at 0x55cf3d4b69c0 Oct 12 08:43:37.902397 n-d-858383-10 devstack@n-api.service[126989]: python threads support enabled Oct 12 08:43:37.902397 n-d-858383-10 devstack@n-api.service[126989]: your server socket listen backlog is limited to 100 connections Oct 12 08:43:37.902397 n-d-858383-10 devstack@n-api.service[126989]: your mercy for graceful operations on workers is 90 seconds Oct 12 08:43:37.902825 n-d-858383-10 devstack@n-api.service[126989]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 08:43:37.902825 n-d-858383-10 devstack@n-api.service[126989]: *** Operational MODE: preforking *** Oct 12 08:43:37.903033 n-d-858383-10 devstack@n-api.service[126989]: *** uWSGI is running in multiple interpreter mode *** Oct 12 08:43:37.903033 n-d-858383-10 devstack@n-api.service[126989]: spawned uWSGI master process (pid: 126989) Oct 12 08:43:37.903290 n-d-858383-10 systemd[1]: Started Devstack devstack@n-api.service. Oct 12 08:43:37.909493 n-d-858383-10 devstack@n-api.service[126989]: spawned uWSGI worker 1 (pid: 127006, cores: 1) Oct 12 08:43:37.909493 n-d-858383-10 devstack@n-api.service[126989]: spawned uWSGI worker 2 (pid: 127007, cores: 1) Oct 12 08:43:37.909493 n-d-858383-10 devstack@n-api.service[126989]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 08:43:38.554160 n-d-858383-10 devstack@n-api.service[127007]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 08:43:38.556891 n-d-858383-10 devstack@n-api.service[127006]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 08:43:39.702864 n-d-858383-10 devstack@n-api.service[127007]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 08:43:39.702864 n-d-858383-10 devstack@n-api.service[127007]: from cryptography.utils import int_from_bytes Oct 12 08:43:39.703543 n-d-858383-10 devstack@n-api.service[127006]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 08:43:39.703543 n-d-858383-10 devstack@n-api.service[127006]: from cryptography.utils import int_from_bytes Oct 12 08:43:39.703973 n-d-858383-10 devstack@n-api.service[127007]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 08:43:39.703973 n-d-858383-10 devstack@n-api.service[127007]: from cryptography.utils import int_from_bytes Oct 12 08:43:39.704113 n-d-858383-10 devstack@n-api.service[127006]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 08:43:39.704113 n-d-858383-10 devstack@n-api.service[127006]: from cryptography.utils import int_from_bytes Oct 12 08:43:42.089153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 08:43:42.089744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 08:43:42.089941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 08:43:42.090336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 08:43:42.090561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 08:43:42.090978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.091306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.091597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.092131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.092226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.092608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.092876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.093248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.093559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.093786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.094138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.094613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.094941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.095249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.095566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.095736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 08:43:42.096128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.096226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 08:43:42.096349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.096445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 08:43:42.096536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.096769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.096925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 08:43:42.097021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 08:43:42.097414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.097559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.098594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.098703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.098785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.098869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.098949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.099973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.100073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.100232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.100325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.100550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.100639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.101005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.101110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.101332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.101424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.101664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.101775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.101963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.102114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.102305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.102425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.102592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.102689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.102921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.103055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.103283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.103398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.103625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.103739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.103926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.104035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.104255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.104394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.104565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.104678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.104886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.104997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.105228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.105364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.105555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.105664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.105867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.105970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.106176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.106293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.106482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.106583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.106787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.106878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.107092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.107198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.107344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.107487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.107655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.107799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.107982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.108112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.108306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.108529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.108625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.108842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.108931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.109110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.109207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.109469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.109618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.109779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.109878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.110090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.110179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.110398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.110495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.110716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.110807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.111028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.111143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.111339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.111449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.111644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.111750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.111949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.112053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.112256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.112366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.112573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.112677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.112902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.113003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.113210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.113314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.113481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.113585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.113795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.113944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.114120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.114263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.114450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.114570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.114776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.114880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.115022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.115123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.115276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.115418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.115595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.115730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.115917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.116052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.116228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.116375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.116542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.116687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.116849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.116994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.117158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.117301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.117486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.117650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.117796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.117990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.118106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.118299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.118416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.118553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.118741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.118860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.119057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.119166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.119381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.119491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.119690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.119786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.120011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.120116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.120340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.120445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.120650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.120778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.120957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.121060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.121267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.121364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.121602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.121709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.121912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.122014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.122222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.122326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.122532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.122628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.122840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.122934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.123148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.123263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.123451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.123546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.123754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.123848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.124077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.124178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.124386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.124523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.124654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.124755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.124927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.125017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.125233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.125332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.125576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.125668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.125888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.125979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.126197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.126294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.126506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.126611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.126810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.126910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.127119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.127218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.127424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.127521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.127729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.127828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.128036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.128126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.128342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.128437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.128721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.128822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.129026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.129115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.129334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.129421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.129668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.129780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.129976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.130064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.130289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.130403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.130599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.130732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.130903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.131019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.131273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.131402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.131519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.131640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.131804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.131917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.132147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.132387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.132500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.132608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.132698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.132788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.133017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.133118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.133324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.133413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.133655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.133759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.133962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.134049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.134271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.134361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.134578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.134687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.134896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.134995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.135202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.135293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.135508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.135607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.135826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.135921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.136134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.136222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.136441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.136539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.136744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.136882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.137051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.137147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.137359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.137481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.137691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.137790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.137994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.138093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.138299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.138390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.138598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.138687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.138918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.139008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.139240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.139337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.139551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.139640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.139859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.139947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.140167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.140257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.140489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 08:43:42.140585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.140808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.140922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.141138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.141227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.141479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.141571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.141799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.141917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.142136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.142238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.142472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.142573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.142790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.142879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.143103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.143207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.143418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.143507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.143734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.143829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.144050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.144146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.144387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.144476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.144701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.144804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.145022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.145115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.145337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.145428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.145691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.145794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.146003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.146090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.146319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.146406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.146634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.146735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.146945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.147032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.147291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.147388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.147575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.147678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.147889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.147987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.148202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.148289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.148530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.148627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.148855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.148944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.149173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.149262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.149510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.149620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.149832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.149931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.150143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.150238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.150453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.150541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.150764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.150858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.151070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.151158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.151377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.151474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.151684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.151776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.151996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.152093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.152302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.152407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.152649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.152742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.152927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.153023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.153240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.153330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.153577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.153684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.153894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.153997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.154208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.154308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.154518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.154616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.154833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.154935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.155142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.155244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.155458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.155547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.155769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.155870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.156076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.156171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.156385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.156481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.156702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.156805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.157006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.157093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.157311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.157406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.157646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.157746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.157955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.158051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.158265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.158359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.158574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.158664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.158885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.158974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.159201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.159297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.159515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.159614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.159891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.159980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.160203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.160291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.160517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.160621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.160831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.160919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.161149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.161250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.161482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.161585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.161800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.161900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.162113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.162210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.162422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.162511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.162728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.162868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.163041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.163143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.163342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.163437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.163646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.163734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.163952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.164059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.164259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.164345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.164559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.164653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.164867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.164959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.165174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.165307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.165506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.165640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.165818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.165932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.166140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.166236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.166449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.166547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.166755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.166852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.167061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.167199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.167366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.167456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.167704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.167806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.168009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.168105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.168347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.168448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.168682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.168772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.168974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.169062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.169291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.169389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.169623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.169722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.169931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.170021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.170238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.170335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.170551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.170647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.170857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.170953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.171169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.171266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.171474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.171568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.171780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.171876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.172087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.172186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.172402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.172491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.172716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.172865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.173023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.173119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.173329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.173417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.173660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.173799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.173977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.174073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.174302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.174403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.174644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.174731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.174965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.175062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.175290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.175424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.175632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.175730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.175947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.176034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.176258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.176389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.176571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.176707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.176881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.176968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.177191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.177285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.177527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.177633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.177838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.177926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.178155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.178242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.178464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.178564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.178782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.178870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.179091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.179178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.179410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.179507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.179718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.179807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.180024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.180110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.180344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.180433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.180684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.180771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.180999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.181095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.181316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.181412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.181668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.181765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.181984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.182104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.182299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.182422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.182719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.182852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.182962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.183067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.183208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.183330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.183519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.183610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.183836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.183928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.184144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.184232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.184457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.184551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.184765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.184867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.185085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.185181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.185394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.185571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.185729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.185827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.186032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.186119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.186344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.186439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.186670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.186771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.186985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.187081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.187302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.187396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.187618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.187719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.187923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.188010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.188232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.188362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.188545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.188666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.188855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.188944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.189535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.189647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.189847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.189979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.190155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.190242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.190469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.190559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.190785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.190886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.191157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.191244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.191480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.191584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.191796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.191890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.192107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.192204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.192413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.192510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.192720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.192809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.193030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.193117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.193354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.193498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.193694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.193793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.194007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.194094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.194324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.194490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.194630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.194718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.194938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.195034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.195251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.195348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.195561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.195662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.195869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.195958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.196174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.196270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.196480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.196568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.196786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.196881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.197101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.197194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.197420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.197536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.197761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.198039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.198139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.198380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.198512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.198696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.198831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.199016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.199148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.199332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.199436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.199658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.199759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.199976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.200073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.200293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.200382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.200607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.200704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.200915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.201011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.201230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.201319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.201563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.201668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.201873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.201964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.202186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.202285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.202495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.202592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.202804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.202894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.203110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.203207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.203420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.203550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.203728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.203851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.204037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.204301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.204394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.204640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.204728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.204958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.205059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.205268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.205366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.205628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.205763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.205939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.206043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.206269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.206370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.206597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.206700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.206917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.207014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.207223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.207319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.208934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.209023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.209150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.209306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.209480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.209645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.209792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.209956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.210121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.210268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.210445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.210579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.210756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.210888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.211065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.211217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.211378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.211530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.211697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.211848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.212003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.212158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.212316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.212485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.212630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.212801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.212944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.213110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.213256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.213418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.213594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.213755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.213910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.214103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.214235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.214414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.214511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.214756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.214846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.215091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.215185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.215411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.215499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.215727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.215857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.216029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.216118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.216334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.216422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.216646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.216737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.216949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.217035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.217256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.217344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.217586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.217731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.217898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.217994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.218200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.218296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.218511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.218650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.218820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.218918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.219125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.219222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.219435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.219529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.219740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.219836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.220044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.220141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.220348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.220435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.220664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.220759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.220970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.221068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.221275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.221364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.221601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.221702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.221916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.222006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.222248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.222373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.222586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.222786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.222885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.223189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.223313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.223550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.223747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.223859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.224168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.224302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.224477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.224678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.224776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.225071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.225207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.225380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.225513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.225718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.225807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.226029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.226120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.226334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.226420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.226641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.226729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.226953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.227084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.227260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.227383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.227566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.227705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.227875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.227973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.228183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.228286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.228501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.228589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.228806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.228937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.229116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.229245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.229421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.229592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.229749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.229839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.230056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.230159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.230368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.230471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.230676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.230765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.230980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.231068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.231289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.231459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.231596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.231728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.231904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.232002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.232231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.232380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.232544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.232640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.232851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.232946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.233154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.233243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.233476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.233583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.233807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.233897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.234121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.234208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.234450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.234545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.234780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.234874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.235088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.235179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.235405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.235484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.235715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.235803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.236024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.236192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.236354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.236448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.236636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.236734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.236947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.237036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.237260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.237355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.237594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.237699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.237927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.238017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.238235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.238325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.238545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.238643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.238859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.238954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.239171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.239263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.239480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.239571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.239804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.239893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.240115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.240211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.240421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.240519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.240735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.240830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.241045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.241142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.241360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.241487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.241699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.241790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.242078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.242212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.242393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.242489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.242707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.242803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.243021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.243206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.243339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.243458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.243649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.243779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.243959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.244251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.244346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.244571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.244661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.244880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.244978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.245209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.245300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.245547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.245644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.245860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.245966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.246176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.246274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.246486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.246574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.246801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.246904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.247300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.247435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.247435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.247631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.247752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.247882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.248056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.248153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.248368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.248472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.248696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.248796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.249009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.249107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.249338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.249495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.249677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.249801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.249988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.250123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.250413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.250503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.250729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.250850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.251046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.251169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.251364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.251488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.251673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.251817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.251981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.252145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.252297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.252476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.252626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.252788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.252936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.253107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.253243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.253426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.253613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.253830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.253944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.254164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.254269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.254482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.254616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.254806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.254977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.255119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.255296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.255450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.255608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.255779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.256031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.256136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.256351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.256448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.256667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.256825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.256996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.257160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.257322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.257500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.257673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.257835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.257984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.258169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.258302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.258480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.258618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.258791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.258946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.259111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.259271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.259423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.259587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.259737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.259907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.260066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.260216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.260384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.260543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.260703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.260871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.261020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.261195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.261336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.261543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.261682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.261970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.262069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.262299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.262396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.262608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.262705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.262935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.263024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.263251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.263346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.263562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.263660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.263872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.263962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.264189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.264284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.264496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.264598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.264807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.264898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.265110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.265205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.265489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.265633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.265758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.265853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.266077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.266186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.266370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.266467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.266679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.266775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.266986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.267076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.267315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.267405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.267624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.267719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.267948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.268038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.268266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.268392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.268593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.268692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.268906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.268996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.269241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.269338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.269590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.269684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.269897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.270009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.270202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.270298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.270510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.270636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.270814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.270913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.271122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.271213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.271431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.271529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.271747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.271850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.272056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.272146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.272395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.272498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.272672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.272838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.273000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.273094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.273311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.273408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.273663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.273756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.273975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.274072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.274282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.274370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.274594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.274684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.274902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.275001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.275207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.275303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.275522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.275647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.275828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.275953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.276136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.276235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.276442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.276532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.276758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.276848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.277065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.277164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.277373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.277483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.277705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.277796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.278031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.278130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.278343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.278439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.278658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.278754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.278973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.279075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.279281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.279371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.279591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.279692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.279898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.279997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.280246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.280453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.280544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.280785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.280884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.281107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.281198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.281425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.281574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.281764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.281875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.282082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.282180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.282399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.282489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.282719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.282823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.283034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.283125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.283351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.283439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.283663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.283753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.283976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.284063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.284293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.284389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.284614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.284779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.285000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.285123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.285321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.285566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.285677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.285899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.285988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.286217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.286314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.286535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.286633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.286851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.286942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.287169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.287259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.287486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.287590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.287802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.287891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.288118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.288217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.288431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.288521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.288751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.288839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.289072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.289176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.289387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.289506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.289729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.289819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.290049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.290149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.290372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.290462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.290689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.290781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.291011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.291117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.291330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.291426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.291655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.291750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.291973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.292072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.292292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.292389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.292607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.292707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.292924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.293131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.293242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.293470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.293564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.293815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.293914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.294147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.294238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.294476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.294566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.294790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.294887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.295105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.295195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.295419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.295519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.295730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.295833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.296042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.296132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.296359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.296451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.296674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.296764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.296983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.297072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.297297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.297395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.297637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.297727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.297992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.298170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.298269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.298497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.298587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.298839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.299092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.299190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.299449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.299552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.299772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.299870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.300104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.300201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.300464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.300558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.300788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.300877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.301098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.301186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.301415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.301554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.301753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.301844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.302060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.302148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.302381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.302473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.302696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.302785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.303003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.303093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.303312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.303402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.303627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.303715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.303936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.304166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.304258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.304521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.304610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.304833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.304966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.305163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.305250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.305512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.305615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.305838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.305935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.306149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.306248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.306467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.306565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.306774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.306873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.307081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.307170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.307386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.307489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.307698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.307798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.308002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.308089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.308309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.308406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.308623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.308721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.308935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.309025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.309242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.309331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.309578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.309688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.309888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.309977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.310220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.310308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.310529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.310633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.310839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.310930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.311154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.311242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.311467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.311557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.311776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.311871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.312082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.312172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.312390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.312481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.312697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.312788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.313011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.313110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.313320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.313411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.313744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.313907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.314056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.314615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.314737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.314942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.315097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.315283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.315414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.315619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.315764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.315930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.316119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.316334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.316473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.316593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.316744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.316915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.317065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.317231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.317394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.317578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.317745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.317894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.318062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.318210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.318377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.318512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.318733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.318867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.319041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.319157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.319424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.319585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.319738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.319922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.320046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.320245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.320375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.320582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.320706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.320915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.321030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.322122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.322430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.322556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.322666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.322773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.322889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.323943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.324975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.325075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.325295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.325375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.325632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.325743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.325960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.326056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.326277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.326368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.326592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.326696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.326911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.327001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.327257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.327347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.327577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.327676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.327898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.327988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.328210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.328307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.328527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.328630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.328857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.328998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.329155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.329256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.329498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.329605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.329800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.329891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.330119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.330207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.330451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.330551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.330763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.330860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.331072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.331175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.331382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.331516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.331737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.331855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.332050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.332203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.332360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.332523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.332669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.332759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.332983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.333083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.333291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.333381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.333663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.333766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.333975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.334073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.334284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.334384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.334597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.334686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.334904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.334995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.335212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.335346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.335522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.335652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.335829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.335927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.336136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.336227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.336443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.336540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.336756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.336853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.337064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.337155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.337372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.337541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.337708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.337799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.338017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.338106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.338331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.338429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.338638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.338727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.338949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.339076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.339261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.339373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.339566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.339659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.339876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.339966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.340180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.340278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.340487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.340578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.340797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.340887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.341109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.341207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.341417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.341568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.341758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.341860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.342070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.342162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.342376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.342469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.342683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.342774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.342985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.343072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.343292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.343417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.343597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.343688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.343908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.344008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.344243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.344335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.344560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.344657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.344873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.344995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.345204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.345310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.345544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.346257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.346437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.346600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.346600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.346893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.347041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.347199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.347402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.347551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.347699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.347845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.348001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.348150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.348310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.348465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.348613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.348768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.348925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.349165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.349335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.349514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.349617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.349884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.349975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.350055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.350055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.350197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.350268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.350481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.350582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.350808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.350905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.351138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.351234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.351453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.351578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.351771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.351897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.352086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.352177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.352421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.352511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.352734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.352825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.353046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.353140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.353360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.353531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.353735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.353891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.354054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.354209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.354367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.354532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.354655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 08:43:42.354847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.355221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.355473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.355794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.356125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.356454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.356768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.357100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.357430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.357804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.358119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.358476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.358809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.359228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.359439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.359808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 08:43:42.360041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 08:43:42.416031 n-d-858383-10 devstack@n-api.service[127006]: INFO dbcounter [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Registered counter for database nova_api Oct 12 08:43:42.421026 n-d-858383-10 devstack@n-api.service[127007]: INFO dbcounter [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Registered counter for database nova_api Oct 12 08:43:42.436654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_db.sqlalchemy.engines [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:43:42.442011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_db.sqlalchemy.engines [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:43:42.444283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writer thread running {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:43:42.448690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writer thread running {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:43:42.501793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.context [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) {{(pid=127006) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 08:43:42.504015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.context [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) {{(pid=127007) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 08:43:42.505935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:43:42.506409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:43:42.508060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:43:42.508196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:43:42.508537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:43:42.508762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:43:42.509260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:43:42.510125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:43:42.510877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:43:42.511330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:43:42.511464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:43:42.513349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:43:42.513614 n-d-858383-10 devstack@n-api.service[127006]: INFO dbcounter [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Registered counter for database nova_cell0 Oct 12 08:43:42.515425 n-d-858383-10 devstack@n-api.service[127007]: INFO dbcounter [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Registered counter for database nova_cell0 Oct 12 08:43:42.518280 n-d-858383-10 devstack@n-api.service[127006]: INFO dbcounter [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Registered counter for database nova_cell1 Oct 12 08:43:42.519541 n-d-858383-10 devstack@n-api.service[127007]: INFO dbcounter [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Registered counter for database nova_cell1 Oct 12 08:43:42.526546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_db.sqlalchemy.engines [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:43:42.528085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_db.sqlalchemy.engines [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:43:42.530449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_db.sqlalchemy.engines [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:43:42.531959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_db.sqlalchemy.engines [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:43:42.535336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writer thread running {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:43:42.539460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writer thread running {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:43:42.540929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writer thread running {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:43:42.673805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writer thread running {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:43:42.684981 n-d-858383-10 devstack@n-api.service[127007]: INFO dbcounter [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Registered counter for database nova_cell0 Oct 12 08:43:42.692456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_db.sqlalchemy.engines [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:43:42.695022 n-d-858383-10 devstack@n-api.service[127006]: INFO dbcounter [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Registered counter for database nova_cell0 Oct 12 08:43:42.697289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writer thread running {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:43:42.701866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_db.sqlalchemy.engines [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 08:43:42.706531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writer thread running {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 08:43:43.017423 n-d-858383-10 devstack@n-api.service[127007]: WARNING keystonemiddleware.auth_token [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 08:43:43.024825 n-d-858383-10 devstack@n-api.service[127007]: WARNING keystonemiddleware.auth_token [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 08:43:43.025636 n-d-858383-10 devstack@n-api.service[127006]: WARNING keystonemiddleware.auth_token [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 08:43:43.032973 n-d-858383-10 devstack@n-api.service[127006]: WARNING keystonemiddleware.auth_token [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 08:43:43.370526 n-d-858383-10 devstack@n-api.service[127007]: WARNING keystonemiddleware.auth_token [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 08:43:43.376571 n-d-858383-10 devstack@n-api.service[127007]: WARNING keystonemiddleware.auth_token [None req-398a6a95-40c9-4684-a286-8ae06cd256f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 08:43:43.379473 n-d-858383-10 devstack@n-api.service[127006]: WARNING keystonemiddleware.auth_token [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 08:43:43.381916 n-d-858383-10 devstack@n-api.service[127007]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf3d4b69c0 pid: 127007 (default app) Oct 12 08:43:43.385557 n-d-858383-10 devstack@n-api.service[127006]: WARNING keystonemiddleware.auth_token [None req-92517fa9-cfaa-411c-a8ff-7c9b425a6657 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 08:43:43.390856 n-d-858383-10 devstack@n-api.service[127006]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cf3d4b69c0 pid: 127006 (default app) Oct 12 08:44:22.365475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:22.366997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:22.366997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:22.367717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:23.168297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:23.170012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:23.171051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:23.172012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:23.534033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1650fbe-51fa-4661-abb9-6f5c8709606c tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-599873162", "ram": 512, "vcpus": 1, "disk": 10, "id": 353688717, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:23.591853 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a1650fbe-51fa-4661-abb9-6f5c8709606c tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 1.235623 Oct 12 08:44:23.592741 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:22 2022] POST /compute/v2.1/flavors => generated 412 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:44:24.014394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d00e5e2b-49c2-41d6-8413-4dfaab330dac tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:24.036535 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d00e5e2b-49c2-41d6-8413-4dfaab330dac tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] HTTP exception thrown: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d00e5e2b-49c2-41d6-8413-4dfaab330dac tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Request method failure captured: Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/flavors/353688717/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5kxwhiKRHZ3bIjkZMAggFyAnR8aY4R0G4HnqjboQFCDPsGgFzwIK1-3AkaJHY5wYiwr3_EQtixqKhk2K7EpVb_LmkYFBRgxhtXtWDkIowTCS1W9Wq3NPgxmpd60o0nZQH2-aawAat01ke_OexKgiYAXVHThFexrse73v4JIsFOlBk Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2337da639dba47eeae0bfbe53ed83865 Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:44:24.038838 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2337da639dba47eeae0bfbe53ed83865"}]}] Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2337da639dba47eeae0bfbe53ed83865 Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 787ed96dd6cd4cd9901e7300c1188f4e Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:44:24.040508 n-d-858383-10 devstack@n-api.service[127007]: exception: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'flavor_id': '353688717', 'id': 'hw:cpu_thread_policy'} Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:24.045807 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d00e5e2b-49c2-41d6-8413-4dfaab330dac tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Returning 404 to user: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d00e5e2b-49c2-41d6-8413-4dfaab330dac tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] 10.222.0.40 "GET /compute/v2.1/flavors/353688717/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.436966 Oct 12 08:44:24.047247 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:44:23 2022] GET /compute/v2.1/flavors/353688717/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:44:24.047873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d00e5e2b-49c2-41d6-8413-4dfaab330dac tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:24.047873 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d00e5e2b-49c2-41d6-8413-4dfaab330dac tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001179 Oct 12 08:44:24.047873 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3/3] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 12 08:44:24 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 08:44:24.257973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '.version_select at 0x7f984a34c0d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:24.266695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) {{(pid=127007) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 12 08:44:24.267793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:24.268417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:24.269001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:24.300412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:24.301213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:24.301899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:24.316985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:24.317819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:24.318444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:24.325550 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33cca800-c3f5-477e-bf2b-2470560cdff9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.279144 Oct 12 08:44:24.326420 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 4/4] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 12 08:44:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:24.372414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cdc222f-8978-46f6-b3b8-988cf19c4a3f tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132 tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:24.375565 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6cdc222f-8978-46f6-b3b8-988cf19c4a3f tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132 tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cdc222f-8978-46f6-b3b8-988cf19c4a3f tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132 tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132-project-admin] Request method failure captured: Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5nNw16LsrMYSxUZ3loleLFmi_J7yu38w815XlcxJQmzwbyeUJ-rXhwXEcYaIRreRJqfVyH_9cGAQcbjMkE4QUqJLxsu2L9qWU2kspJH-diMlLVze9DpaCdjUassNi23Hdv8DRj8JgliPb5AzXSndVKfHAs6hRvko_pxB0d-azkxEM Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: d4efd44b438e4a1587ebe40063b8a9ff Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132 Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:44:24.385701 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d4efd44b438e4a1587ebe40063b8a9ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d4efd44b438e4a1587ebe40063b8a9ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d4efd44b438e4a1587ebe40063b8a9ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d4efd44b438e4a1587ebe40063b8a9ff"}]}] Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132 Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: d4efd44b438e4a1587ebe40063b8a9ff Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132 Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132-project-admin Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: a35418ca5fe445f5877248fbbfde6298 Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132-project-admin Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:24.414444 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid timestamp for date invalid_time Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'invalid_time'} Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:24.416678 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cdc222f-8978-46f6-b3b8-988cf19c4a3f tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132 tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:24.419558 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cdc222f-8978-46f6-b3b8-988cf19c4a3f tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132 tempest-InstanceUsageAuditLogNegativeTestJSON-1727441132-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 1.229614 Oct 12 08:44:24.425901 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1/5] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Oct 12 08:44:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 1232 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 08:44:24.425901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a76c6b46-de0e-4517-92c4-46d5c6c78618 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:24.425901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a76c6b46-de0e-4517-92c4-46d5c6c78618 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '787ed96dd6cd4cd9901e7300c1188f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2337da639dba47eeae0bfbe53ed83865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:24.425901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a76c6b46-de0e-4517-92c4-46d5c6c78618 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Request method failure captured: Oct 12 08:44:24.425901 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/flavors/353688717/os-extra_specs HTTP/1.1 Oct 12 08:44:24.425901 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 66 Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5kxwhiKRHZ3bIjkZMAggFyAnR8aY4R0G4HnqjboQFCDPsGgFzwIK1-3AkaJHY5wYiwr3_EQtixqKhk2K7EpVb_LmkYFBRgxhtXtWDkIowTCS1W9Wq3NPgxmpd60o0nZQH2-aawAat01ke_OexKgiYAXVHThFexrse73v4JIsFOlBk Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2337da639dba47eeae0bfbe53ed83865 Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:24.426373 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2337da639dba47eeae0bfbe53ed83865"}]}] Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2337da639dba47eeae0bfbe53ed83865 Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 787ed96dd6cd4cd9901e7300c1188f4e Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'flavor_id': '353688717', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:44:24.428561 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.431637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a76c6b46-de0e-4517-92c4-46d5c6c78618 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a76c6b46-de0e-4517-92c4-46d5c6c78618 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] 10.222.0.40 "POST /compute/v2.1/flavors/353688717/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.017725 Oct 12 08:44:24.433373 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2/6] 10.222.0.40 () {60 vars in 1221 bytes} [Wed Oct 12 08:44:24 2022] POST /compute/v2.1/flavors/353688717/os-extra_specs => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:24.600357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae3a25ec-fbe6-41a2-80eb-ec08e8b2997f tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1057109844", "ram": 512, "vcpus": 1, "disk": 10, "id": 1476530710, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:24.621758 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae3a25ec-fbe6-41a2-80eb-ec08e8b2997f tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.294018 Oct 12 08:44:24.622369 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 5/7] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:24 2022] POST /compute/v2.1/flavors => generated 416 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:24.667969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0d95f284-d29c-4cba-8e86-49d0241eda7f tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:24.670447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d95f284-d29c-4cba-8e86-49d0241eda7f tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:24.671171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d95f284-d29c-4cba-8e86-49d0241eda7f tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:24.671611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d95f284-d29c-4cba-8e86-49d0241eda7f tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:24.672477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d95f284-d29c-4cba-8e86-49d0241eda7f tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:24.672932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d95f284-d29c-4cba-8e86-49d0241eda7f tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:24.673350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d95f284-d29c-4cba-8e86-49d0241eda7f tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:24.724345 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0d95f284-d29c-4cba-8e86-49d0241eda7f tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.314672 Oct 12 08:44:24.725048 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3/8] 10.222.0.40 () {58 vars in 1164 bytes} [Wed Oct 12 08:44:24 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:24.736825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6aafa28-eb9d-44d8-942a-8f5537ca428b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-26706826", "name": "tempest-test_aggregate-1050842965"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:24.782885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.aggregate [None req-e6aafa28-eb9d-44d8-942a-8f5537ca428b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid 5e2d1c53-b9a1-45f5-8754-fdb2dbb05b83 for aggregate {{(pid=127006) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:44:24.816213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c5c4bb8-55d4-4b8d-be9a-ae2c19b2caae tempest-AZAdminNegativeTestJSON-1343116376 tempest-AZAdminNegativeTestJSON-1343116376-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:24.819397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7c5c4bb8-55d4-4b8d-be9a-ae2c19b2caae tempest-AZAdminNegativeTestJSON-1343116376 tempest-AZAdminNegativeTestJSON-1343116376-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c8c7142d22bc492783bf25ea8d20f919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71df1ea934fe43ac9ad0c978e21998b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c5c4bb8-55d4-4b8d-be9a-ae2c19b2caae tempest-AZAdminNegativeTestJSON-1343116376 tempest-AZAdminNegativeTestJSON-1343116376-project] Request method failure captured: Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5lkidIOmC3EJsGenEY9H1wAYHKF4YetCv0_VSI68uldIVXJt5octWI_Y_PjVzEVcd0a1WqP_BLvmFiNbiOlIQR6XugAXqyTxwEK4suYWwPLfqj4ZThYaBXsoYlBaunTDPx5YMSYhQiN3CMusb7JyeO7mvZL3B1CXQ9K6B3m_y4u4M Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 71df1ea934fe43ac9ad0c978e21998b4 Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1343116376 Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:44:24.829037 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71df1ea934fe43ac9ad0c978e21998b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/71df1ea934fe43ac9ad0c978e21998b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_71df1ea934fe43ac9ad0c978e21998b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71df1ea934fe43ac9ad0c978e21998b4"}]}] Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AZAdminNegativeTestJSON-1343116376 Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 71df1ea934fe43ac9ad0c978e21998b4 Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1343116376 Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AZAdminNegativeTestJSON-1343116376-project Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c8c7142d22bc492783bf25ea8d20f919 Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AZAdminNegativeTestJSON-1343116376-project Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 08:44:24.830183 n-d-858383-10 devstack@n-api.service[127007]: action_args: {} Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:24.830708 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:24.831496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c5c4bb8-55d4-4b8d-be9a-ae2c19b2caae tempest-AZAdminNegativeTestJSON-1343116376 tempest-AZAdminNegativeTestJSON-1343116376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:24.833185 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7c5c4bb8-55d4-4b8d-be9a-ae2c19b2caae tempest-AZAdminNegativeTestJSON-1343116376 tempest-AZAdminNegativeTestJSON-1343116376-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.197555 Oct 12 08:44:24.833185 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 6/9] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 12 08:44:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:24.902391 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6aafa28-eb9d-44d8-942a-8f5537ca428b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.173274 Oct 12 08:44:24.908372 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4/10] 10.222.0.40 () {60 vars in 1165 bytes} [Wed Oct 12 08:44:24 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:24.913249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-488b80c9-8906-48c7-83a0-8c940313b274 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:24.968917 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-488b80c9-8906-48c7-83a0-8c940313b274 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/353688717/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059458 Oct 12 08:44:24.969537 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 5/11] 10.222.0.40 () {60 vars in 1221 bytes} [Wed Oct 12 08:44:24 2022] POST /compute/v2.1/flavors/353688717/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:24.979349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc18cd4c-d5d5-4295-902b-bfbd108e6697 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.018018 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc18cd4c-d5d5-4295-902b-bfbd108e6697 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1476530710/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042186 Oct 12 08:44:25.018827 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 6/12] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 12 08:44:24 2022] POST /compute/v2.1/flavors/1476530710/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:25.023640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f21afed-46d7-4594-8259-7fdc00233573 tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.026422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f21afed-46d7-4594-8259-7fdc00233573 tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:25.027261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f21afed-46d7-4594-8259-7fdc00233573 tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:25.027950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f21afed-46d7-4594-8259-7fdc00233573 tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:25.029106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f21afed-46d7-4594-8259-7fdc00233573 tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:25.029785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f21afed-46d7-4594-8259-7fdc00233573 tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:25.030431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f21afed-46d7-4594-8259-7fdc00233573 tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:25.060786 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f21afed-46d7-4594-8259-7fdc00233573 tempest-AZAdminV2TestJSON-1425939393 tempest-AZAdminV2TestJSON-1425939393-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.040580 Oct 12 08:44:25.061933 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 12 08:44:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:25.067980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5fe9975-bc3a-4497-84a6-f83cfd0ffcb5 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.087972 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5fe9975-bc3a-4497-84a6-f83cfd0ffcb5 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.024476 Oct 12 08:44:25.095239 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 8/14] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:44:25 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:25.095239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba6be2ef-34fd-48a3-a0b8-0c4a8dd418ec tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.096600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba6be2ef-34fd-48a3-a0b8-0c4a8dd418ec tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '787ed96dd6cd4cd9901e7300c1188f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2337da639dba47eeae0bfbe53ed83865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba6be2ef-34fd-48a3-a0b8-0c4a8dd418ec tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Request method failure captured: Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5kxwhiKRHZ3bIjkZMAggFyAnR8aY4R0G4HnqjboQFCDPsGgFzwIK1-3AkaJHY5wYiwr3_EQtixqKhk2K7EpVb_LmkYFBRgxhtXtWDkIowTCS1W9Wq3NPgxmpd60o0nZQH2-aawAat01ke_OexKgiYAXVHThFexrse73v4JIsFOlBk Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2337da639dba47eeae0bfbe53ed83865 Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:25.098722 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2337da639dba47eeae0bfbe53ed83865"}]}] Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2337da639dba47eeae0bfbe53ed83865 Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 787ed96dd6cd4cd9901e7300c1188f4e Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:25.099676 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'flavor_id': '353688717', 'id': 'hw:numa_nodes'} Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:25.100180 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.101126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba6be2ef-34fd-48a3-a0b8-0c4a8dd418ec tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:25.101904 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ba6be2ef-34fd-48a3-a0b8-0c4a8dd418ec tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] 10.222.0.40 "DELETE /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010256 Oct 12 08:44:25.101904 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 9/15] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 08:44:25 2022] DELETE /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:25.196748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c0c7b2d-0805-4e04-87ee-00a645686439 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.199003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8c0c7b2d-0805-4e04-87ee-00a645686439 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3c416c81bee44a36aa73970cc9f1be99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d4911f4962440f8700a3875c20df51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c0c7b2d-0805-4e04-87ee-00a645686439 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] Request method failure captured: Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5kx-vZ5YM73vRomTuLzceKT9NsIDp8Bs9Vv89pxzZcaHBB9npTH-pOyK9smuMqq8tRw9TbmXqdLa5OlPfZ5wC_HvvgN23RmwB8MDKHII0S8bKCSyiTHv2FKgRsBfn8h_-XbBIqdMm7pwl6UckMamEhDxEhgTL7WR89Nazw7Q9HE6E Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: d0d4911f4962440f8700a3875c20df51 Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:44:25.201134 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0d4911f4962440f8700a3875c20df51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0d4911f4962440f8700a3875c20df51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0d4911f4962440f8700a3875c20df51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0d4911f4962440f8700a3875c20df51"}]}] Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: d0d4911f4962440f8700a3875c20df51 Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3c416c81bee44a36aa73970cc9f1be99 Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project Oct 12 08:44:25.203006 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: action_args: {} Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:25.203614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 12 08:44:25.205178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.206169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c0c7b2d-0805-4e04-87ee-00a645686439 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:25.206169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8c0c7b2d-0805-4e04-87ee-00a645686439 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.370897 Oct 12 08:44:25.209359 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 7/16] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 12 08:44:24 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 377 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:25.214388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8d7804d-9bef-409f-9b55-33004c62a706 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.244471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8d7804d-9bef-409f-9b55-33004c62a706 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:25.244955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8d7804d-9bef-409f-9b55-33004c62a706 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:25.245387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8d7804d-9bef-409f-9b55-33004c62a706 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:25.598866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df5ff6af-268d-4aa6-b325-3b476510d4cb tempest-FlavorsExtraSpecsTestJSON-1798743914 tempest-FlavorsExtraSpecsTestJSON-1798743914-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.620025 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df5ff6af-268d-4aa6-b325-3b476510d4cb tempest-FlavorsExtraSpecsTestJSON-1798743914 tempest-FlavorsExtraSpecsTestJSON-1798743914-project] 10.222.0.40 "GET /compute/v2.1/flavors/1476530710/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.517896 Oct 12 08:44:25.621060 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 10/17] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 12 08:44:25 2022] GET /compute/v2.1/flavors/1476530710/os-extra_specs => generated 66 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:25.625561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53a2a2f3-5ca2-4240-b643-6f5cf10157c1 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.653780 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53a2a2f3-5ca2-4240-b643-6f5cf10157c1 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/353688717/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031437 Oct 12 08:44:25.659656 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 11/18] 10.222.0.40 () {60 vars in 1221 bytes} [Wed Oct 12 08:44:25 2022] POST /compute/v2.1/flavors/353688717/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:25.659656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79ec5a64-37a6-4c19-bbba-19913cc451c7 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.660919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-79ec5a64-37a6-4c19-bbba-19913cc451c7 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3c416c81bee44a36aa73970cc9f1be99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d4911f4962440f8700a3875c20df51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79ec5a64-37a6-4c19-bbba-19913cc451c7 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] Request method failure captured: Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2008:44:25 HTTP/1.1 Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5kx-vZ5YM73vRomTuLzceKT9NsIDp8Bs9Vv89pxzZcaHBB9npTH-pOyK9smuMqq8tRw9TbmXqdLa5OlPfZ5wC_HvvgN23RmwB8MDKHII0S8bKCSyiTHv2FKgRsBfn8h_-XbBIqdMm7pwl6UckMamEhDxEhgTL7WR89Nazw7Q9HE6E Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: d0d4911f4962440f8700a3875c20df51 Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:25.662663 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0d4911f4962440f8700a3875c20df51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0d4911f4962440f8700a3875c20df51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0d4911f4962440f8700a3875c20df51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0d4911f4962440f8700a3875c20df51"}]}] Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: d0d4911f4962440f8700a3875c20df51 Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3c416c81bee44a36aa73970cc9f1be99 Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project Oct 12 08:44:25.663940 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2022-10-12 08:44:25'} Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:25.664429 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 12 08:44:25.665544 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.666490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79ec5a64-37a6-4c19-bbba-19913cc451c7 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:25.666490 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79ec5a64-37a6-4c19-bbba-19913cc451c7 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668 tempest-InstanceUsageAuditLogNegativeTestJSON-1050574668-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12 08:44:25" status: 403 len: 128 microversion: 2.1 time: 0.008438 Oct 12 08:44:25.666490 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 12/19] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 08:44:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2008%3A44%3A25 => generated 128 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:25.673618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b27030a-82ad-4add-abf8-ae5cd9814d3c tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.701260 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b27030a-82ad-4add-abf8-ae5cd9814d3c tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1476530710/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031748 Oct 12 08:44:25.701980 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 13/20] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 12 08:44:25 2022] POST /compute/v2.1/flavors/1476530710/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:25.710981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52a8e2f1-d79c-4b56-815e-26324ea6c24c tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.714209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-52a8e2f1-d79c-4b56-815e-26324ea6c24c tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '787ed96dd6cd4cd9901e7300c1188f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2337da639dba47eeae0bfbe53ed83865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52a8e2f1-d79c-4b56-815e-26324ea6c24c tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Request method failure captured: Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 22 Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5kxwhiKRHZ3bIjkZMAggFyAnR8aY4R0G4HnqjboQFCDPsGgFzwIK1-3AkaJHY5wYiwr3_EQtixqKhk2K7EpVb_LmkYFBRgxhtXtWDkIowTCS1W9Wq3NPgxmpd60o0nZQH2-aawAat01ke_OexKgiYAXVHThFexrse73v4JIsFOlBk Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2337da639dba47eeae0bfbe53ed83865 Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:25.715833 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2337da639dba47eeae0bfbe53ed83865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2337da639dba47eeae0bfbe53ed83865"}]}] Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2337da639dba47eeae0bfbe53ed83865 Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 787ed96dd6cd4cd9901e7300c1188f4e Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: {"hw:numa_nodes": "1"} Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:25.717117 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'flavor_id': '353688717', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:25.717905 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 12 08:44:25.723340 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.724817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52a8e2f1-d79c-4b56-815e-26324ea6c24c tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:25.724817 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-52a8e2f1-d79c-4b56-815e-26324ea6c24c tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302 tempest-FlavorsExtraSpecsNegativeTestJSON-1574910302-project] 10.222.0.40 "PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010997 Oct 12 08:44:25.724817 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 14/21] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:44:25 2022] PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:25.724817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f03a095-a572-4bc6-b37b-632b26f42f9c tempest-FlavorsExtraSpecsTestJSON-1798743914 tempest-FlavorsExtraSpecsTestJSON-1798743914-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.737027 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f03a095-a572-4bc6-b37b-632b26f42f9c tempest-FlavorsExtraSpecsTestJSON-1798743914 tempest-FlavorsExtraSpecsTestJSON-1798743914-project] 10.222.0.40 "GET /compute/v2.1/flavors/1476530710/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017690 Oct 12 08:44:25.737801 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 15/22] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 08:44:25 2022] GET /compute/v2.1/flavors/1476530710/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:25.741946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9757fe0f-a151-44b7-aac8-a2137f59f5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.749590 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9757fe0f-a151-44b7-aac8-a2137f59f5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] HTTP exception thrown: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9757fe0f-a151-44b7-aac8-a2137f59f5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Request method failure captured: Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/flavors/353688717/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5mzxhlPs38EkVczF4sP7BxQoguTttwncGpkCvJH7-Qvm2KTeMOcE2gpZQIPr8e5Q8hvuNRUVMikEC1xy25XjSn7ltVEmW7yzW6PbCMZriCgoDdNUXeofqktngjmq8Xxr2jRjh-EoEA5KyV0h_ybjPhBFeBzQItv3rTwo1_Yh2o-qM Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 6ba3b1c5285b4700ae73e60080882776 Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:44:25.750964 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ba3b1c5285b4700ae73e60080882776"}]}] Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 6ba3b1c5285b4700ae73e60080882776 Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 94bbc02155824bd28f041db0c4b98b85 Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:25.752009 n-d-858383-10 devstack@n-api.service[127006]: exception: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'flavor_id': '353688717', 'id': 'hw:cpu_thread_policy'} Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.752555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.753746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.753746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.753746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.753746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:25.753746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:25.753746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. Oct 12 08:44:25.753746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.753746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9757fe0f-a151-44b7-aac8-a2137f59f5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Returning 404 to user: Flavor 353688717 has no extra specs with key hw:cpu_thread_policy. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:25.760395 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9757fe0f-a151-44b7-aac8-a2137f59f5d8 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/353688717/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.013725 Oct 12 08:44:25.766874 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 16/23] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 08:44:25 2022] DELETE /compute/v2.1/flavors/353688717/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:25.774945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b8dd26b7-ee63-4522-96d8-11fa0cce41f0 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.813240 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b8dd26b7-ee63-4522-96d8-11fa0cce41f0 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1476530710/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044983 Oct 12 08:44:25.814539 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 17/24] 10.222.0.40 () {60 vars in 1224 bytes} [Wed Oct 12 08:44:25 2022] POST /compute/v2.1/flavors/1476530710/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:25.823681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3df87d21-2a94-4d03-aaf1-ff41c26c19f0 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.828595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3df87d21-2a94-4d03-aaf1-ff41c26c19f0 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3df87d21-2a94-4d03-aaf1-ff41c26c19f0 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Request method failure captured: Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 27 Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5mzxhlPs38EkVczF4sP7BxQoguTttwncGpkCvJH7-Qvm2KTeMOcE2gpZQIPr8e5Q8hvuNRUVMikEC1xy25XjSn7ltVEmW7yzW6PbCMZriCgoDdNUXeofqktngjmq8Xxr2jRjh-EoEA5KyV0h_ybjPhBFeBzQItv3rTwo1_Yh2o-qM Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 6ba3b1c5285b4700ae73e60080882776 Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:44:25.830730 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ba3b1c5285b4700ae73e60080882776"}]}] Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 6ba3b1c5285b4700ae73e60080882776 Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 94bbc02155824bd28f041db0c4b98b85 Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: {"hw:cpu_policy": "shared"} Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:25.831967 n-d-858383-10 devstack@n-api.service[127006]: exception: Request body and URI mismatch Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'flavor_id': '353688717', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.832566 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.833534 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:25.833534 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:25.833534 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 12 08:44:25.833534 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.835944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3df87d21-2a94-4d03-aaf1-ff41c26c19f0 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:25.838135 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3df87d21-2a94-4d03-aaf1-ff41c26c19f0 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.020980 Oct 12 08:44:25.845790 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 18/25] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:44:25 2022] PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:44:25.852771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bafbbd6-3e14-40d8-84e1-efef4334366e tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:25.869341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3bafbbd6-3e14-40d8-84e1-efef4334366e tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1476530710/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021362 Oct 12 08:44:25.870826 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 19/26] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 12 08:44:25 2022] GET /compute/v2.1/flavors/1476530710/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:25.877426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b85ba438-f543-47b1-8fc5-63d12fb81ca1 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b85ba438-f543-47b1-8fc5-63d12fb81ca1 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Request method failure captured: Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 49 Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5mzxhlPs38EkVczF4sP7BxQoguTttwncGpkCvJH7-Qvm2KTeMOcE2gpZQIPr8e5Q8hvuNRUVMikEC1xy25XjSn7ltVEmW7yzW6PbCMZriCgoDdNUXeofqktngjmq8Xxr2jRjh-EoEA5KyV0h_ybjPhBFeBzQItv3rTwo1_Yh2o-qM Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 6ba3b1c5285b4700ae73e60080882776 Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:44:25.884435 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6ba3b1c5285b4700ae73e60080882776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6ba3b1c5285b4700ae73e60080882776"}]}] Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 6ba3b1c5285b4700ae73e60080882776 Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 94bbc02155824bd28f041db0c4b98b85 Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 12 08:44:25.885526 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'flavor_id': '353688717', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance: Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 12 08:44:25.886157 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.887351 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:25.888528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:25.888528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:25.888528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:44:25.888528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:44:25.888528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 12 08:44:25.888528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:25.890694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b85ba438-f543-47b1-8fc5-63d12fb81ca1 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:25.891732 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b85ba438-f543-47b1-8fc5-63d12fb81ca1 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.019446 Oct 12 08:44:25.892679 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 20/27] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:44:25 2022] PUT /compute/v2.1/flavors/353688717/os-extra_specs/hw:numa_nodes => generated 117 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:44:25.898735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1343647a-a6b5-40ae-b235-ba79a872a872 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:25.975901 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1343647a-a6b5-40ae-b235-ba79a872a872 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1476530710/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.078636 Oct 12 08:44:25.977720 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 21/28] 10.222.0.40 () {60 vars in 1265 bytes} [Wed Oct 12 08:44:25 2022] PUT /compute/v2.1/flavors/1476530710/os-extra_specs/hw:numa_nodes => generated 22 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:25.989930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22d25e48-b34f-493d-bbc8-b1b314b03d83 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:26.023624 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-22d25e48-b34f-493d-bbc8-b1b314b03d83 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/353688717" status: 202 len: 0 microversion: 2.1 time: 0.040307 Oct 12 08:44:26.027460 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 22/29] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:44:25 2022] DELETE /compute/v2.1/flavors/353688717 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:44:26.034608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d55f466-9754-4fb7-a710-61699c359e23 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:26.043289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:SAVEPOINT=12,nova_api:RELEASE=12,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:26.049893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d55f466-9754-4fb7-a710-61699c359e23 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1476530710/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022981 Oct 12 08:44:26.054051 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 23/30] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 12 08:44:26 2022] GET /compute/v2.1/flavors/1476530710/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:26.064294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa070d12-23fd-4759-bf39-633d76b9a60c tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:26.143079 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa070d12-23fd-4759-bf39-633d76b9a60c tempest-FlavorsExtraSpecsNegativeTestJSON-136551783 tempest-FlavorsExtraSpecsNegativeTestJSON-136551783-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.087431 Oct 12 08:44:26.144891 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 24/31] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:26 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:26.156058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a72bde1b-8caf-4cb2-a479-8bcc3b7dc9a9 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:26.201310 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a72bde1b-8caf-4cb2-a479-8bcc3b7dc9a9 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1476530710/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.054893 Oct 12 08:44:26.203510 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 25/32] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 08:44:26 2022] DELETE /compute/v2.1/flavors/1476530710/os-extra_specs/hw:numa_nodes => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:44:26.212282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45e79c1d-84a7-4ada-8981-acc6f52a44dc tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:26.248026 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45e79c1d-84a7-4ada-8981-acc6f52a44dc tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1476530710/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.040116 Oct 12 08:44:26.251508 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 26/33] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 08:44:26 2022] DELETE /compute/v2.1/flavors/1476530710/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 08:44:26.272795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4405d855-397c-49f4-a201-15d8ef1b3384 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:26.283926 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4405d855-397c-49f4-a201-15d8ef1b3384 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1476530710/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029816 Oct 12 08:44:26.284501 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 27/34] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 12 08:44:26 2022] GET /compute/v2.1/flavors/1476530710/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 08:44:26.295742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4cea89da-2962-4ec7-b388-bdbc099468d0 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:26.333919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4cea89da-2962-4ec7-b388-bdbc099468d0 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1476530710" status: 202 len: 0 microversion: 2.1 time: 0.041934 Oct 12 08:44:26.334790 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 28/35] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:44:26 2022] DELETE /compute/v2.1/flavors/1476530710 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:44:26.342507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c305f4ad-f5fb-4477-9042-893087641a52 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:26.370432 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c305f4ad-f5fb-4477-9042-893087641a52 tempest-FlavorsExtraSpecsTestJSON-297103963 tempest-FlavorsExtraSpecsTestJSON-297103963-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031317 Oct 12 08:44:26.373479 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 29/36] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:26.452969 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8d7804d-9bef-409f-9b55-33004c62a706 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 1.242290 Oct 12 08:44:26.454083 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 8/37] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:44:25 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:27.441369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2034050878", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "availability_zone": "tempest-test_az-26706826"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:27.463095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:27.463860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:27.464490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:27.465897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:27.466678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:27.467117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:28.903274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:44:29.179658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:44:29.180522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:44:29.181215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:44:29.182006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:44:29.182628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:44:29.202594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:29.203292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:29.203976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:29.205650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:29.206321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:29.206998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:29.246393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Getting quotas for project cb9700f762654d3b8029348771a812e2. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:44:29.255926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Getting quotas for user d3a7ae2797b8472c9e9fc8b612d68b5b and project cb9700f762654d3b8029348771a812e2. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:44:29.269387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:44:29.278830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:44:29.343831 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b8ba018d-53ee-4a21-9ccc-4672a47013d1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.555885 Oct 12 08:44:29.344653 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 30/38] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:44:29.358239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-477551db-bedd-4b78-8b10-0ae3d32cc320 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:29.359131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-477551db-bedd-4b78-8b10-0ae3d32cc320 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:30.373683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3653587e-437a-428f-910d-7ab654c8b8b0 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1522753488", "id": 799755731, "os-flavor-access:is_public": "False"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:30.397767 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3653587e-437a-428f-910d-7ab654c8b8b0 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.513131 Oct 12 08:44:30.398488 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 31/39] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:29 2022] POST /compute/v2.1/flavors => generated 436 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:44:30.413321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e2da8d75-c771-4274-9186-2574fa429c37 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:30.527408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-477551db-bedd-4b78-8b10-0ae3d32cc320 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:30.552246 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-477551db-bedd-4b78-8b10-0ae3d32cc320 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1241 microversion: 2.1 time: 1.199330 Oct 12 08:44:30.554552 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 9/40] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:29 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1241 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:31.082961 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e2da8d75-c771-4274-9186-2574fa429c37 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/799755731/action" status: 200 len: 96 microversion: 2.1 time: 0.673386 Oct 12 08:44:31.084104 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 32/41] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 12 08:44:30 2022] POST /compute/v2.1/flavors/799755731/action => generated 96 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 08:44:31.095667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10738cc6-959a-458d-b2e3-c54fc7b6faea tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:31.578118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:31.578770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:31.593459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:31.594349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:31.594951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:31.595661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:31.596404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:31.597064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:31.803854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:31.820801 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0761cd33-846c-415a-b650-9dffa15f324c tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1233 microversion: 2.1 time: 0.246896 Oct 12 08:44:31.848923 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 33/42] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:31 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1233 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:31.881381 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-10738cc6-959a-458d-b2e3-c54fc7b6faea tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project e6cbd716bb8f4913953b9fcb5d058a2f combination. Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10738cc6-959a-458d-b2e3-c54fc7b6faea tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Request method failure captured: Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/flavors/799755731/action HTTP/1.1 Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 67 Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5rZBgvXvO0hJcUN2fUgP0-EaYnWWk1cedeV9S8wwAbyI8cypbxDFsqj8lg9wL47rz4dc3vpKAJV5J7FKRWzZKew1ozi7-M3kJQAcj4aGFjPHESzUEJuEQhA59rHW2cajYi5C6t1Swjk453uwrZHt4ZmuRbsS4tYOY6xvw9jahcFmE Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 923dc9f0b2174549a19020a8f67ca98e Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:44:31.907730 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/923dc9f0b2174549a19020a8f67ca98e"}]}] Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 923dc9f0b2174549a19020a8f67ca98e Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 6528ba0e39324eb6806ed05a0027af7a Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: {"addTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} Oct 12 08:44:31.908851 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: exception: Flavor access already exists for flavor 17 and project e6cbd716bb8f4913953b9fcb5d058a2f combination. Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '799755731', 'body': {'addTenantAccess': {'tenant': 'e6cbd716bb8f4913953b9fcb5d058a2f'}}} Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result.read() Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 08:44:31.909918 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-e6cbd716bb8f4913953b9fcb5d058a2f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 08:44:31.910745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 08:44:31.911602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 08:44:31.912404 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result.read() Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-e6cbd716bb8f4913953b9fcb5d058a2f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 8, 44, 31, 872368), 'updated_at': None, 'flavor_id': 17, 'project_id': 'e6cbd716bb8f4913953b9fcb5d058a2f'}] Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:31.913267 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project e6cbd716bb8f4913953b9fcb5d058a2f combination. Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:31.914621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project e6cbd716bb8f4913953b9fcb5d058a2f combination. Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:31.915645 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:31.916788 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project e6cbd716bb8f4913953b9fcb5d058a2f combination. Oct 12 08:44:31.916788 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:31.916788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10738cc6-959a-458d-b2e3-c54fc7b6faea tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project e6cbd716bb8f4913953b9fcb5d058a2f combination. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:31.916788 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10738cc6-959a-458d-b2e3-c54fc7b6faea tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/799755731/action" status: 409 len: 152 microversion: 2.1 time: 0.818969 Oct 12 08:44:31.916788 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 10/43] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 12 08:44:31 2022] POST /compute/v2.1/flavors/799755731/action => generated 152 bytes in 820 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:44:31.920550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c751d776-a4a1-48f5-8bbd-f22387246ea9 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:32.700240 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c751d776-a4a1-48f5-8bbd-f22387246ea9 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/799755731/action" status: 200 len: 21 microversion: 2.1 time: 0.784352 Oct 12 08:44:32.701226 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 34/44] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 12 08:44:31 2022] POST /compute/v2.1/flavors/799755731/action => generated 21 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:32.713734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fbd7f3b2-8dc4-4bfb-8593-0d0b36fa5a06 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:32.757817 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fbd7f3b2-8dc4-4bfb-8593-0d0b36fa5a06 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/799755731" status: 202 len: 0 microversion: 2.1 time: 0.050041 Oct 12 08:44:32.758678 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 35/45] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:44:32 2022] DELETE /compute/v2.1/flavors/799755731 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:44:32.767651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ff90d449-2b9b-4f18-a5d3-7018995d4dc8 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:32.794100 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ff90d449-2b9b-4f18-a5d3-7018995d4dc8 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030126 Oct 12 08:44:32.795887 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 36/46] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:32.818026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d9b19533-8eb8-4b5b-b8ca-04e14d88118d tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-140212802", "id": 784248211, "os-flavor-access:is_public": "True"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:32.841257 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d9b19533-8eb8-4b5b-b8ca-04e14d88118d tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.027056 Oct 12 08:44:32.842408 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 37/47] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:32 2022] POST /compute/v2.1/flavors => generated 434 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:44:32.857775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c5a23e2-2054-4d8b-a2c3-f3e504c68741 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:32.874783 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6c5a23e2-2054-4d8b-a2c3-f3e504c68741 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c5a23e2-2054-4d8b-a2c3-f3e504c68741 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Request method failure captured: Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/flavors/784248211/os-flavor-access HTTP/1.1 Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5rZBgvXvO0hJcUN2fUgP0-EaYnWWk1cedeV9S8wwAbyI8cypbxDFsqj8lg9wL47rz4dc3vpKAJV5J7FKRWzZKew1ozi7-M3kJQAcj4aGFjPHESzUEJuEQhA59rHW2cajYi5C6t1Swjk453uwrZHt4ZmuRbsS4tYOY6xvw9jahcFmE Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 923dc9f0b2174549a19020a8f67ca98e Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:44:32.878550 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/923dc9f0b2174549a19020a8f67ca98e"}]}] Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 923dc9f0b2174549a19020a8f67ca98e Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 6528ba0e39324eb6806ed05a0027af7a Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: exception: Access list not available for public flavors. Oct 12 08:44:32.879900 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'flavor_id': '784248211'} Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 12 08:44:32.880614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:32.881853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c5a23e2-2054-4d8b-a2c3-f3e504c68741 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:32.881853 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c5a23e2-2054-4d8b-a2c3-f3e504c68741 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/784248211/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029185 Oct 12 08:44:32.885720 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 38/48] 10.222.0.40 () {58 vars in 1206 bytes} [Wed Oct 12 08:44:32 2022] GET /compute/v2.1/flavors/784248211/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:44:32.891164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:32.892232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:32.901132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:32.902045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:32.902727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:32.903590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:32.904220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:32.904889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:33.113993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:33.126148 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3fee12c-16b1-4624-9af3-79d5e777cb34 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1295 microversion: 2.1 time: 0.237635 Oct 12 08:44:33.128447 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 39/49] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:32 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1295 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:33.137920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2bef3cfd-6cd5-45d7-84d0-ea40a00a0d0f tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:33.186479 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2bef3cfd-6cd5-45d7-84d0-ea40a00a0d0f tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/784248211" status: 202 len: 0 microversion: 2.1 time: 0.055640 Oct 12 08:44:33.187676 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 40/50] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:44:33 2022] DELETE /compute/v2.1/flavors/784248211 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:44:33.203935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-48eea42f-6d55-4e8d-a3e9-d4f2e231cf59 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:33.258113 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-48eea42f-6d55-4e8d-a3e9-d4f2e231cf59 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064636 Oct 12 08:44:33.276364 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 41/51] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:33.289905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adf6454c-e7c1-45df-bf44-143559dd37d7 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1009014547", "id": 851239767, "os-flavor-access:is_public": "False"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:33.303799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c4047397-1d1b-48ee-82e3-fb4367b9c13f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Calling method '.version_select at 0x7f984977ff70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:33.311141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4047397-1d1b-48ee-82e3-fb4367b9c13f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:33.312191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4047397-1d1b-48ee-82e3-fb4367b9c13f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:33.314430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4047397-1d1b-48ee-82e3-fb4367b9c13f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:33.316753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4047397-1d1b-48ee-82e3-fb4367b9c13f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:33.318888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4047397-1d1b-48ee-82e3-fb4367b9c13f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:33.319561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4047397-1d1b-48ee-82e3-fb4367b9c13f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:33.336321 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-adf6454c-e7c1-45df-bf44-143559dd37d7 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.058640 Oct 12 08:44:33.346215 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 42/52] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:33 2022] POST /compute/v2.1/flavors => generated 436 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:33.391793 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c4047397-1d1b-48ee-82e3-fb4367b9c13f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.820061 Oct 12 08:44:33.400021 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 11/53] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 12 08:44:32 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:33.405218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a7997ab-a17b-43b1-91ca-0dcc9b39a8f4 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Calling method '.version_select at 0x7f984978cca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:33.412245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7997ab-a17b-43b1-91ca-0dcc9b39a8f4 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:33.414469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7997ab-a17b-43b1-91ca-0dcc9b39a8f4 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:33.416174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7997ab-a17b-43b1-91ca-0dcc9b39a8f4 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:33.417140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7997ab-a17b-43b1-91ca-0dcc9b39a8f4 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:33.419487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7997ab-a17b-43b1-91ca-0dcc9b39a8f4 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:33.420564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7997ab-a17b-43b1-91ca-0dcc9b39a8f4 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:33.477492 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a7997ab-a17b-43b1-91ca-0dcc9b39a8f4 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.075980 Oct 12 08:44:33.487654 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 12/54] 10.222.0.40 () {58 vars in 1139 bytes} [Wed Oct 12 08:44:33 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:33.507025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-338a8faa-44cd-4946-a75a-95752f488f18 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Calling method '.version_select at 0x7f9849796dc0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:33.516130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-338a8faa-44cd-4946-a75a-95752f488f18 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:33.517655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-338a8faa-44cd-4946-a75a-95752f488f18 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:33.518566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-338a8faa-44cd-4946-a75a-95752f488f18 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:33.521262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-338a8faa-44cd-4946-a75a-95752f488f18 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:33.524212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-338a8faa-44cd-4946-a75a-95752f488f18 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:33.524914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-338a8faa-44cd-4946-a75a-95752f488f18 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:33.593598 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-338a8faa-44cd-4946-a75a-95752f488f18 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.103645 Oct 12 08:44:33.603795 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 13/55] 10.222.0.40 () {58 vars in 1145 bytes} [Wed Oct 12 08:44:33 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:33.982606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44810b7a-4120-4505-b0e5-dafcc44aa701 tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:33.993787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-44810b7a-4120-4505-b0e5-dafcc44aa701 tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '03d66a1196714c498e97559c58e02eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6cbd716bb8f4913953b9fcb5d058a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44810b7a-4120-4505-b0e5-dafcc44aa701 tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] Request method failure captured: Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/flavors/851239767/action HTTP/1.1 Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 67 Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5oVRuhYhUtpbLPOF21QWG5OSEbiWldSBcpKbVkTIhoS5VDZouhmClvyPS092pbDwjt5QQ36CcNEfvcSqmLiTFILEurXAVGfmdlm9T3LTP0L9ZtLxV9glll7mHPJ-KI-jABv1d6LCbijoesTpjYQt0Ba0YJbRovo4DGUL6F5OJ4lj0 Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e6cbd716bb8f4913953b9fcb5d058a2f Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1116497087 Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:33.997218 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6cbd716bb8f4913953b9fcb5d058a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e6cbd716bb8f4913953b9fcb5d058a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e6cbd716bb8f4913953b9fcb5d058a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6cbd716bb8f4913953b9fcb5d058a2f"}]}] Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1116497087 Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e6cbd716bb8f4913953b9fcb5d058a2f Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1116497087 Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsAccessNegativeTestJSON-1116497087-project Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 03d66a1196714c498e97559c58e02eef Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1116497087-project Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: {"addTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} Oct 12 08:44:33.998336 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '851239767', 'body': {'addTenantAccess': {'tenant': 'e6cbd716bb8f4913953b9fcb5d058a2f'}}} Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:33.999043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 12 08:44:33.999930 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:34.000845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44810b7a-4120-4505-b0e5-dafcc44aa701 tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:34.000845 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-44810b7a-4120-4505-b0e5-dafcc44aa701 tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] 10.222.0.40 "POST /compute/v2.1/flavors/851239767/action" status: 403 len: 130 microversion: 2.1 time: 0.648390 Oct 12 08:44:34.003555 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 43/56] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 12 08:44:33 2022] POST /compute/v2.1/flavors/851239767/action => generated 130 bytes in 654 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:34.007639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75a51502-2d57-4a32-9ae8-9c4d736c1284 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:34.074581 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-75a51502-2d57-4a32-9ae8-9c4d736c1284 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/851239767" status: 202 len: 0 microversion: 2.1 time: 0.070750 Oct 12 08:44:34.075407 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 14/57] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:44:34 2022] DELETE /compute/v2.1/flavors/851239767 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:44:34.084604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bbedd9ab-cb5c-438d-8ed4-803142e4c742 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:34.146440 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bbedd9ab-cb5c-438d-8ed4-803142e4c742 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066499 Oct 12 08:44:34.149975 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 44/58] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:34.150863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:34.151615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:34.169138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:34.169675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:34.170121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:34.176143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:34.177207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:34.178433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36066d1b-fd6b-4687-a9b0-efd23451aa9e tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1241704238", "id": 462394192, "os-flavor-access:is_public": "False"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:34.182320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:34.201146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=79,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=12,nova_api:INSERT=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:34.223774 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-36066d1b-fd6b-4687-a9b0-efd23451aa9e tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.057708 Oct 12 08:44:34.225979 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 45/59] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:34 2022] POST /compute/v2.1/flavors => generated 436 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:34.245855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-50223584-7455-418d-8976-46e36d0617ec tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:34.645642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:34.670159 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-edb93906-a91e-48b0-91c8-25fd27f4fec2 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.518926 Oct 12 08:44:34.683609 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 15/60] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:34 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:35.697851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:35.699581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:35.722934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:35.732493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:35.735152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:35.736136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:35.736775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:35.742341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:35.900425 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-50223584-7455-418d-8976-46e36d0617ec tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/462394192/action" status: 200 len: 96 microversion: 2.1 time: 1.666543 Oct 12 08:44:35.933173 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 46/61] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 12 08:44:34 2022] POST /compute/v2.1/flavors/462394192/action => generated 96 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 08:44:36.439957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:36.454738 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a2be99f-e3e9-42eb-8d39-8486c598d6df tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.761763 Oct 12 08:44:36.472033 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 16/62] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:35 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:36.486051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aa4fff22-bef2-4c26-8a25-82643b6740ee tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:36.494205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aa4fff22-bef2-4c26-8a25-82643b6740ee tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '03d66a1196714c498e97559c58e02eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6cbd716bb8f4913953b9fcb5d058a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aa4fff22-bef2-4c26-8a25-82643b6740ee tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] Request method failure captured: Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/flavors/462394192/action HTTP/1.1 Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 70 Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5oVRuhYhUtpbLPOF21QWG5OSEbiWldSBcpKbVkTIhoS5VDZouhmClvyPS092pbDwjt5QQ36CcNEfvcSqmLiTFILEurXAVGfmdlm9T3LTP0L9ZtLxV9glll7mHPJ-KI-jABv1d6LCbijoesTpjYQt0Ba0YJbRovo4DGUL6F5OJ4lj0 Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e6cbd716bb8f4913953b9fcb5d058a2f Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1116497087 Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:44:36.499851 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6cbd716bb8f4913953b9fcb5d058a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e6cbd716bb8f4913953b9fcb5d058a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e6cbd716bb8f4913953b9fcb5d058a2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6cbd716bb8f4913953b9fcb5d058a2f"}]}] Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1116497087 Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e6cbd716bb8f4913953b9fcb5d058a2f Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1116497087 Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FlavorsAccessNegativeTestJSON-1116497087-project Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 03d66a1196714c498e97559c58e02eef Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1116497087-project Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: {"removeTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} Oct 12 08:44:36.501091 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '462394192', 'body': {'removeTenantAccess': {'tenant': 'e6cbd716bb8f4913953b9fcb5d058a2f'}}} Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can( Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:36.501726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 12 08:44:36.502765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:36.513011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aa4fff22-bef2-4c26-8a25-82643b6740ee tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:36.523923 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aa4fff22-bef2-4c26-8a25-82643b6740ee tempest-FlavorsAccessNegativeTestJSON-1116497087 tempest-FlavorsAccessNegativeTestJSON-1116497087-project] 10.222.0.40 "POST /compute/v2.1/flavors/462394192/action" status: 403 len: 133 microversion: 2.1 time: 0.040633 Oct 12 08:44:36.523923 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 17/63] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 12 08:44:36 2022] POST /compute/v2.1/flavors/462394192/action => generated 133 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:36.863812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1224504520", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:37.010062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:44:37.444736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-038a6249-b056-4c3e-b98e-16629fb57405 tempest-NetworksTest-783800060 tempest-NetworksTest-783800060-project-admin] Calling method '.version_select at 0x7f984968f700>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:37.555889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:44:37.556310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:44:37.556968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:44:37.557553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:44:37.558121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:44:37.574011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:37.576759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:37.578403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:37.583876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:37.584582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:37.585189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:37.629157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Getting quotas for project 5568d3dd87fc4fc69b3ef8539fa45fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:44:37.649597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Getting quotas for user 088ae1b875ce4e68a12c234e5cf405b2 and project 5568d3dd87fc4fc69b3ef8539fa45fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:44:37.673420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:44:37.681735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:44:37.777236 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed7541af-26fc-4709-8f8e-7f98c1fc353f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.842045 Oct 12 08:44:37.777948 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 47/64] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:44:37.797139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a66f58b-2dc2-43b4-84ad-6bc9efdd90af tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e6cbd716bb8f4913953b9fcb5d058a2f"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:37.943093 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-038a6249-b056-4c3e-b98e-16629fb57405 tempest-NetworksTest-783800060 tempest-NetworksTest-783800060-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 2633 microversion: 2.1 time: 1.424867 Oct 12 08:44:37.948742 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 18/65] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:44:36 2022] GET /compute/v2.1/os-networks => generated 2633 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:37.955566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:37.962182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:38.013750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:38.014687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:38.015381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:38.018483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:38.020552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:38.023226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:38.240193 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5a66f58b-2dc2-43b4-84ad-6bc9efdd90af tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/462394192/action" status: 200 len: 21 microversion: 2.1 time: 0.453609 Oct 12 08:44:38.248095 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 48/66] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 12 08:44:37 2022] POST /compute/v2.1/flavors/462394192/action => generated 21 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:44:38.447252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc97b33f-b316-42e4-94a3-a3bca3711fde tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Calling method '.version_select at 0x7f98498038b0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:38.449175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc97b33f-b316-42e4-94a3-a3bca3711fde tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '0f1d1b3399964b92b5ae446364a6a656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752ac489be24478f91ec5c0ff8fd2dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc97b33f-b316-42e4-94a3-a3bca3711fde tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Request method failure captured: Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5xJ-caBgCbup4cSrgjqJ52rW5OOj4DvM2Nrh_KzW62ToxxucMABKuQ9bKW8CLe-OnU-ZXnb0yydN9TOzDTUd44ChDqAJ-BNMV46Rl4PWpreodrn9yfO_juZtzKeBDKtKpdbRNwfsol-xpZHD3UuZRHlkbAVVu0G9N1sFxWUK4sKgg Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:38.458718 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}] Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 0f1d1b3399964b92b5ae446364a6a656 Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 08:44:38.460335 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:38.461374 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 12 08:44:38.462665 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:38.463996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc97b33f-b316-42e4-94a3-a3bca3711fde tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:38.470649 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc97b33f-b316-42e4-94a3-a3bca3711fde tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.220445 Oct 12 08:44:38.471270 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 49/67] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 12 08:44:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:38.566945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0494996f-4d26-4db4-b663-98f24edb4385 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Action: 'create', calling method: .version_select at 0x7f98497e55e0>, body: {"keypair": {"name": "tempest-keypair-2122816170", "type": "ssh", "user_id": "52ef08ec7e0c47ca92eb4954f1cd4be6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPQ9EZAOZyiOchIzD95Y7SJYAahm1A63sf8EiAZGNDnk4/bVTT6VpUPH16RpFgm4OCQxW0YZ7Oa2ttH1rVepY/7+FjAUFLGsWLAzA/RFv3GwLgZeUinbg9J9oqoPSnnSA=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:38.593864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0494996f-4d26-4db4-b663-98f24edb4385 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Getting quotas for project a987e5e7a4a34e5bafa6e67fa1631a2d. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:44:38.598212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0494996f-4d26-4db4-b663-98f24edb4385 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Getting quotas for user a6bbe0d94272488986a3fc2c819f60c0 and project a987e5e7a4a34e5bafa6e67fa1631a2d. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:44:38.637155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:38.645194 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0494996f-4d26-4db4-b663-98f24edb4385 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.162384 Oct 12 08:44:38.649885 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 50/68] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 08:44:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 08:44:38.670209 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c814d6f-28cd-42a6-b9ed-724b8c7da8a5 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.718771 Oct 12 08:44:38.671546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 19/69] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:37 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:38.697315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-790125e7-45ea-4db8-a5b6-094dfdeac14c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:38.698505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-790125e7-45ea-4db8-a5b6-094dfdeac14c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:38.701071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7ee88e5-b8b8-4e44-a985-6210daadd671 tempest-NetworksTest-783800060 tempest-NetworksTest-783800060-project-admin] Calling method '.version_select at 0x7f98497414c0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:38.858987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-790125e7-45ea-4db8-a5b6-094dfdeac14c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:38.883972 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-790125e7-45ea-4db8-a5b6-094dfdeac14c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1220 microversion: 2.1 time: 0.232638 Oct 12 08:44:38.907150 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 51/70] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:38 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:38.912814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-603ae971-ccfd-4a4c-8235-3b4ea94b9991 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:38.954860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-603ae971-ccfd-4a4c-8235-3b4ea94b9991 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/462394192" status: 202 len: 0 microversion: 2.1 time: 0.045941 Oct 12 08:44:38.955955 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 52/71] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:44:38 2022] DELETE /compute/v2.1/flavors/462394192 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:44:38.970076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd034027-98a7-4393-bc5c-5d82713e39fc tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Calling method '.version_select at 0x7f98498690d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:38.972864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd034027-98a7-4393-bc5c-5d82713e39fc tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '0f1d1b3399964b92b5ae446364a6a656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752ac489be24478f91ec5c0ff8fd2dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd034027-98a7-4393-bc5c-5d82713e39fc tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Request method failure captured: Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5xJ-caBgCbup4cSrgjqJ52rW5OOj4DvM2Nrh_KzW62ToxxucMABKuQ9bKW8CLe-OnU-ZXnb0yydN9TOzDTUd44ChDqAJ-BNMV46Rl4PWpreodrn9yfO_juZtzKeBDKtKpdbRNwfsol-xpZHD3UuZRHlkbAVVu0G9N1sFxWUK4sKgg Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:38.980492 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}] Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 0f1d1b3399964b92b5ae446364a6a656 Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 08:44:38.982157 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:38.982971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 12 08:44:38.984646 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:38.986038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd034027-98a7-4393-bc5c-5d82713e39fc tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:38.986038 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd034027-98a7-4393-bc5c-5d82713e39fc tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.026644 Oct 12 08:44:38.986555 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 53/72] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:39.000845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-808f399d-809d-41c9-82d4-1beac0320662 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Action: 'create', calling method: .version_select at 0x7f984982faf0>, body: {"keypair": {"name": "tempest-keypair-295402626", "type": "ssh", "user_id": "52ef08ec7e0c47ca92eb4954f1cd4be6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXpNm9RZm0ztmpgcEJuxwQ5O3QkWrNzwFR4gtfYSGWLDkLgr/4tpsR37OIhB8DNim9FdOyGpfrgg0oBEgDGFk6Bp93TJ9OkB3sIwum65PTuUGCscgI8zNTj4STmQqnpnA=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:39.044667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-808f399d-809d-41c9-82d4-1beac0320662 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Getting quotas for project a987e5e7a4a34e5bafa6e67fa1631a2d. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:44:39.054947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-808f399d-809d-41c9-82d4-1beac0320662 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Getting quotas for user a6bbe0d94272488986a3fc2c819f60c0 and project a987e5e7a4a34e5bafa6e67fa1631a2d. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:44:39.110136 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-808f399d-809d-41c9-82d4-1beac0320662 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.120453 Oct 12 08:44:39.111832 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 54/73] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 08:44:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 08:44:39.130060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-152bf3ff-9a5d-473b-bae8-e56d2624557f tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:39.174253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-152bf3ff-9a5d-473b-bae8-e56d2624557f tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061175 Oct 12 08:44:39.182237 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 55/74] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:39.191662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71ed406c-e39d-4368-8189-9f57fe1b50a2 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Calling method '.version_select at 0x7f984982f4c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:39.198976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71ed406c-e39d-4368-8189-9f57fe1b50a2 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '0f1d1b3399964b92b5ae446364a6a656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752ac489be24478f91ec5c0ff8fd2dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71ed406c-e39d-4368-8189-9f57fe1b50a2 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Request method failure captured: Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5xJ-caBgCbup4cSrgjqJ52rW5OOj4DvM2Nrh_KzW62ToxxucMABKuQ9bKW8CLe-OnU-ZXnb0yydN9TOzDTUd44ChDqAJ-BNMV46Rl4PWpreodrn9yfO_juZtzKeBDKtKpdbRNwfsol-xpZHD3UuZRHlkbAVVu0G9N1sFxWUK4sKgg Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:39.205514 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}] Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 0f1d1b3399964b92b5ae446364a6a656 Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 08:44:39.206834 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:39.207545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 12 08:44:39.208612 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.211135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71ed406c-e39d-4368-8189-9f57fe1b50a2 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:39.212279 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71ed406c-e39d-4368-8189-9f57fe1b50a2 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.028793 Oct 12 08:44:39.213501 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 56/75] 10.222.0.40 () {58 vars in 1179 bytes} [Wed Oct 12 08:44:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:39.224457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe349b49-2be8-465a-bf36-118a995d4f39 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Calling method '.version_select at 0x7f98497f6f70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:39.262104 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe349b49-2be8-465a-bf36-118a995d4f39 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-2122816170?user_id=52ef08ec7e0c47ca92eb4954f1cd4be6" status: 200 len: 512 microversion: 2.10 time: 0.047281 Oct 12 08:44:39.273380 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 57/76] 10.222.0.40 () {60 vars in 1340 bytes} [Wed Oct 12 08:44:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2122816170?user_id=52ef08ec7e0c47ca92eb4954f1cd4be6 => generated 512 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:44:39.278783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad3ada57-8de0-49ba-96ee-83d9d0e8365b tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-651409249", "id": 488697953, "os-flavor-access:is_public": "False"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:39.327047 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad3ada57-8de0-49ba-96ee-83d9d0e8365b tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.051527 Oct 12 08:44:39.327263 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 58/77] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:39.360981 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7ee88e5-b8b8-4e44-a985-6210daadd671 tempest-NetworksTest-783800060 tempest-NetworksTest-783800060-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks/29c8ef46-7259-4303-bca0-4940f77b8940" status: 200 len: 652 microversion: 2.1 time: 0.687992 Oct 12 08:44:39.361994 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 20/78] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 08:44:38 2022] GET /compute/v2.1/os-networks/29c8ef46-7259-4303-bca0-4940f77b8940 => generated 652 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:39.372024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9987ed1-7cb8-443a-aef1-c4cc0bbb6e31 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Action: 'create', calling method: .version_select at 0x7f98496c8820>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-830018280", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxAw6ATQoRyoTPBsLj9W+C4TmsYHtdj5oqNrFKfTFKVB9GApPQGCKyd2cDerslSC6g3sWUSNftga33ZdswLErWgWFpgcflvUdnZ2HIYMlXEdX99AASqqfHXGr4UbxMV6Q=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:39.452141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a9987ed1-7cb8-443a-aef1-c4cc0bbb6e31 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Getting quotas for project a987e5e7a4a34e5bafa6e67fa1631a2d. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:44:39.458026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Calling method '.version_select at 0x7f98497f6ee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:39.463326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a9987ed1-7cb8-443a-aef1-c4cc0bbb6e31 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Getting quotas for user a6bbe0d94272488986a3fc2c819f60c0 and project a987e5e7a4a34e5bafa6e67fa1631a2d. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:44:39.496524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) {{(pid=127006) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 12 08:44:39.503805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:39.504758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:39.508740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:39.539846 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9987ed1-7cb8-443a-aef1-c4cc0bbb6e31 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.176500 Oct 12 08:44:39.540897 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 21/79] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 08:44:39 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 08:44:39.556242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07c7006e-5997-44ad-8d74-6c5d286e7a72 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "914140581914405185201298d98f66b6"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:39.623298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:39.624977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:39.626868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:39.668837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:39.669645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:39.671273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:39.684306 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c4241fc-d5cf-416f-8358-eed404c9660b tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.355651 Oct 12 08:44:39.694122 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 59/80] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:39.694321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-07c7006e-5997-44ad-8d74-6c5d286e7a72 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] HTTP exception thrown: Flavor access not found for 21 / 914140581914405185201298d98f66b6 combination. Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07c7006e-5997-44ad-8d74-6c5d286e7a72 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Request method failure captured: Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/flavors/488697953/action HTTP/1.1 Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 70 Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5rZBgvXvO0hJcUN2fUgP0-EaYnWWk1cedeV9S8wwAbyI8cypbxDFsqj8lg9wL47rz4dc3vpKAJV5J7FKRWzZKew1ozi7-M3kJQAcj4aGFjPHESzUEJuEQhA59rHW2cajYi5C6t1Swjk453uwrZHt4ZmuRbsS4tYOY6xvw9jahcFmE Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 923dc9f0b2174549a19020a8f67ca98e Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:44:39.695990 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_923dc9f0b2174549a19020a8f67ca98e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/923dc9f0b2174549a19020a8f67ca98e"}]}] Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 923dc9f0b2174549a19020a8f67ca98e Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-648387292 Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 6528ba0e39324eb6806ed05a0027af7a Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: {"removeTenantAccess": {"tenant": "914140581914405185201298d98f66b6"}} Oct 12 08:44:39.697049 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: exception: Flavor access not found for 21 / 914140581914405185201298d98f66b6 combination. Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '488697953', 'body': {'removeTenantAccess': {'tenant': '914140581914405185201298d98f66b6'}}} Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 12 08:44:39.697691 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 914140581914405185201298d98f66b6 combination. Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 914140581914405185201298d98f66b6 combination. Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.698589 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 914140581914405185201298d98f66b6 combination. Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07c7006e-5997-44ad-8d74-6c5d286e7a72 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Returning 404 to user: Flavor access not found for 21 / 914140581914405185201298d98f66b6 combination. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07c7006e-5997-44ad-8d74-6c5d286e7a72 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/488697953/action" status: 404 len: 124 microversion: 2.1 time: 0.154806 Oct 12 08:44:39.700081 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 22/81] 10.222.0.40 () {60 vars in 1197 bytes} [Wed Oct 12 08:44:39 2022] POST /compute/v2.1/flavors/488697953/action => generated 124 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:39.708544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a1f369b5-2ebb-4fd1-94e7-2b44a7debcc4 tempest-NetworksTest-783800060 tempest-NetworksTest-783800060-project-admin] Calling method '.version_select at 0x7f984982f790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:39.724163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d06ad18-0079-4408-a873-1dff2ef7944a tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Calling method '.version_select at 0x7f984978cb80>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:39.737030 n-d-858383-10 devstack@n-api.service[127007]: WARNING oslo_db.sqlalchemy.utils [None req-1d06ad18-0079-4408-a873-1dff2ef7944a tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 08:44:39.749216 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1d06ad18-0079-4408-a873-1dff2ef7944a tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs?user_id=52ef08ec7e0c47ca92eb4954f1cd4be6" status: 200 len: 725 microversion: 2.10 time: 0.050152 Oct 12 08:44:39.757768 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 23/82] 10.222.0.40 () {60 vars in 1259 bytes} [Wed Oct 12 08:44:39 2022] GET /compute/v2.1/os-keypairs?user_id=52ef08ec7e0c47ca92eb4954f1cd4be6 => generated 725 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:44:39.766223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6104514c-785f-4c3c-89d3-0d1aad723115 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Calling method '.version_select at 0x7f98496601f0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:39.782046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6104514c-785f-4c3c-89d3-0d1aad723115 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '0f1d1b3399964b92b5ae446364a6a656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752ac489be24478f91ec5c0ff8fd2dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6104514c-785f-4c3c-89d3-0d1aad723115 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Request method failure captured: Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5xJ-caBgCbup4cSrgjqJ52rW5OOj4DvM2Nrh_KzW62ToxxucMABKuQ9bKW8CLe-OnU-ZXnb0yydN9TOzDTUd44ChDqAJ-BNMV46Rl4PWpreodrn9yfO_juZtzKeBDKtKpdbRNwfsol-xpZHD3UuZRHlkbAVVu0G9N1sFxWUK4sKgg Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:44:39.808283 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}] Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 0f1d1b3399964b92b5ae446364a6a656 Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1'} Oct 12 08:44:39.809548 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:39.810249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 12 08:44:39.811150 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:44:39.812051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6104514c-785f-4c3c-89d3-0d1aad723115 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:39.812051 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6104514c-785f-4c3c-89d3-0d1aad723115 tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.050809 Oct 12 08:44:39.812051 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 24/83] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 12 08:44:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:39.831760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:39.846313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:39.869836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:39.872812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:39.873630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:39.876807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:39.878015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:39.879874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:40.171706 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a1f369b5-2ebb-4fd1-94e7-2b44a7debcc4 tempest-NetworksTest-783800060 tempest-NetworksTest-783800060-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 2633 microversion: 2.1 time: 0.476342 Oct 12 08:44:40.176472 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 60/84] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:44:39 2022] GET /compute/v2.1/os-networks => generated 2633 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:40.211549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-17076e9f-6586-4245-a0b3-e72c5d5330a8 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:40.298173 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-17076e9f-6586-4245-a0b3-e72c5d5330a8 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/488697953" status: 202 len: 0 microversion: 2.1 time: 0.124300 Oct 12 08:44:40.303223 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 61/85] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:44:40 2022] DELETE /compute/v2.1/flavors/488697953 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:44:40.314497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6b5e38e-8ff6-47b2-aa73-65922afdccc9 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Calling method '.version_select at 0x7f984988a160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:40.356767 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6b5e38e-8ff6-47b2-aa73-65922afdccc9 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-830018280" status: 204 len: 0 microversion: 2.10 time: 0.051854 Oct 12 08:44:40.358691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 62/86] 10.222.0.40 () {60 vars in 1322 bytes} [Wed Oct 12 08:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-830018280 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:44:40.373146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a08a52ce-ec74-4826-8c20-905b88bbcd4c tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Calling method '.version_select at 0x7f984985ea60>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:40.377266 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a08a52ce-ec74-4826-8c20-905b88bbcd4c tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] HTTP exception thrown: Hypervisor with ID '466ebfe2-9091-4eae-b40a-00f9b6b6742e' could not be found. Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a08a52ce-ec74-4826-8c20-905b88bbcd4c tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Request method failure captured: Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hypervisors/466ebfe2-9091-4eae-b40a-00f9b6b6742e/uptime HTTP/1.1 Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn513xBIGVZNF1HdinpsIbxHTQKyLnOIb7erbHXzYsSlJcoTedfvgFBJ6kbEDCvo26Du4n2r8aM2y1O5_ollUwGjusYYU3j0CtC313pBOCteI4oCZOBLd5tY14K4pWyMohw4TZftACujpV9GqUy4kotcrXBGVZiMFrKlUfTdHy3FJAg Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 4fcaeac200314e37b8a82b37ab76d137 Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-375151914 Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:44:40.399464 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4fcaeac200314e37b8a82b37ab76d137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4fcaeac200314e37b8a82b37ab76d137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4fcaeac200314e37b8a82b37ab76d137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4fcaeac200314e37b8a82b37ab76d137"}]}] Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-375151914 Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 4fcaeac200314e37b8a82b37ab76d137 Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-375151914 Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d52959802b2a47ca92345d94d9ce1145 Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: exception: Hypervisor with ID '466ebfe2-9091-4eae-b40a-00f9b6b6742e' could not be found. Oct 12 08:44:40.400947 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '466ebfe2-9091-4eae-b40a-00f9b6b6742e'} Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '466ebfe2-9091-4eae-b40a-00f9b6b6742e' Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 12 08:44:40.401741 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '466ebfe2-9091-4eae-b40a-00f9b6b6742e' could not be found. Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:40.403079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.404375 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:40.404375 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:40.404375 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:40.404375 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:40.404375 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:40.404375 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '466ebfe2-9091-4eae-b40a-00f9b6b6742e' could not be found. Oct 12 08:44:40.404375 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:40.410355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a08a52ce-ec74-4826-8c20-905b88bbcd4c tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Returning 404 to user: Hypervisor with ID '466ebfe2-9091-4eae-b40a-00f9b6b6742e' could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:40.412261 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a08a52ce-ec74-4826-8c20-905b88bbcd4c tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/466ebfe2-9091-4eae-b40a-00f9b6b6742e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.051427 Oct 12 08:44:40.413401 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 63/87] 10.222.0.40 () {58 vars in 1278 bytes} [Wed Oct 12 08:44:40 2022] GET /compute/v2.1/os-hypervisors/466ebfe2-9091-4eae-b40a-00f9b6b6742e/uptime => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:40.424200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:40.425208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:40.450933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:40.455189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:40.455189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:40.455189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:40.455189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:40.456033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:40.582257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:40.595997 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-448fac13-0dba-462b-8249-37b3751a45d8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1272 microversion: 2.1 time: 0.178884 Oct 12 08:44:40.619235 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 64/88] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:40 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:40.633006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-abc881bb-4260-4b39-9b54-c3a6f35b0f13 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:40.679524 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-abc881bb-4260-4b39-9b54-c3a6f35b0f13 tempest-FlavorsAccessNegativeTestJSON-648387292 tempest-FlavorsAccessNegativeTestJSON-648387292-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058820 Oct 12 08:44:40.681928 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 65/89] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:40.710337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23c5119b-4b22-481b-b8b0-353e31afd9e8 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Calling method '.version_select at 0x7f98497e5d30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:40.774647 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-23c5119b-4b22-481b-b8b0-353e31afd9e8 tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-295402626?user_id=52ef08ec7e0c47ca92eb4954f1cd4be6" status: 204 len: 0 microversion: 2.10 time: 0.091086 Oct 12 08:44:40.778755 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 66/90] 10.222.0.40 () {60 vars in 1340 bytes} [Wed Oct 12 08:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-295402626?user_id=52ef08ec7e0c47ca92eb4954f1cd4be6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:44:40.786288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Calling method '.version_select at 0x7f984988a160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:40.824665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:40.826532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:40.827871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:40.882458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=83,nova_api:DELETE=9 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:40.909602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:40.910496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:40.910948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:40.947281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:40.947780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:40.948224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:40.963846 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f169b156-e8ae-45bb-a690-22d792b73b49 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.183657 Oct 12 08:44:40.965707 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 67/91] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:44:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:40.979646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aaa423de-631a-4157-a7f9-f345b90389ae tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] Calling method '.version_select at 0x7f9849876670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:41.035394 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aaa423de-631a-4157-a7f9-f345b90389ae tempest-KeyPairsV210TestJSON-1611286829 tempest-KeyPairsV210TestJSON-1611286829-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122816170?user_id=52ef08ec7e0c47ca92eb4954f1cd4be6" status: 204 len: 0 microversion: 2.10 time: 0.068436 Oct 12 08:44:41.042304 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 68/92] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 08:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122816170?user_id=52ef08ec7e0c47ca92eb4954f1cd4be6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:44:41.047685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3270e82-1cb9-4f1f-b987-0176a1e996bb tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Calling method '.version_select at 0x7f984a2d6e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:41.054566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c3270e82-1cb9-4f1f-b987-0176a1e996bb tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '0f1d1b3399964b92b5ae446364a6a656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752ac489be24478f91ec5c0ff8fd2dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3270e82-1cb9-4f1f-b987-0176a1e996bb tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Request method failure captured: Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5xJ-caBgCbup4cSrgjqJ52rW5OOj4DvM2Nrh_KzW62ToxxucMABKuQ9bKW8CLe-OnU-ZXnb0yydN9TOzDTUd44ChDqAJ-BNMV46Rl4PWpreodrn9yfO_juZtzKeBDKtKpdbRNwfsol-xpZHD3UuZRHlkbAVVu0G9N1sFxWUK4sKgg Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:44:41.056308 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_752ac489be24478f91ec5c0ff8fd2dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/752ac489be24478f91ec5c0ff8fd2dcc"}]}] Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 752ac489be24478f91ec5c0ff8fd2dcc Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944 Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 0f1d1b3399964b92b5ae446364a6a656 Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1488602944-project Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '1'} Oct 12 08:44:41.057486 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:44:41.058159 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 12 08:44:41.059954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.060948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3270e82-1cb9-4f1f-b987-0176a1e996bb tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:41.060948 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3270e82-1cb9-4f1f-b987-0176a1e996bb tempest-HypervisorAdminNegativeTestJSON-1488602944 tempest-HypervisorAdminNegativeTestJSON-1488602944-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.014230 Oct 12 08:44:41.070717 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 69/93] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:44:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:41.081245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2ca910ae-3e4c-4186-a3c1-a6a273478de4 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Calling method '.version_select at 0x7f984977c550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:41.087877 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-2ca910ae-3e4c-4186-a3c1-a6a273478de4 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] HTTP exception thrown: Hypervisor with ID '754673be-4ec1-4b1f-9d6d-3addbce857d9' could not be found. Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2ca910ae-3e4c-4186-a3c1-a6a273478de4 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Request method failure captured: Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hypervisors/754673be-4ec1-4b1f-9d6d-3addbce857d9 HTTP/1.1 Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn513xBIGVZNF1HdinpsIbxHTQKyLnOIb7erbHXzYsSlJcoTedfvgFBJ6kbEDCvo26Du4n2r8aM2y1O5_ollUwGjusYYU3j0CtC313pBOCteI4oCZOBLd5tY14K4pWyMohw4TZftACujpV9GqUy4kotcrXBGVZiMFrKlUfTdHy3FJAg Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 4fcaeac200314e37b8a82b37ab76d137 Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-375151914 Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:44:41.094160 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4fcaeac200314e37b8a82b37ab76d137"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4fcaeac200314e37b8a82b37ab76d137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4fcaeac200314e37b8a82b37ab76d137"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4fcaeac200314e37b8a82b37ab76d137"}]}] Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-375151914 Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 4fcaeac200314e37b8a82b37ab76d137 Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-375151914 Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d52959802b2a47ca92345d94d9ce1145 Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: exception: Hypervisor with ID '754673be-4ec1-4b1f-9d6d-3addbce857d9' could not be found. Oct 12 08:44:41.095346 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '754673be-4ec1-4b1f-9d6d-3addbce857d9'} Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '754673be-4ec1-4b1f-9d6d-3addbce857d9' Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 12 08:44:41.095988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:44:41.097171 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '754673be-4ec1-4b1f-9d6d-3addbce857d9' could not be found. Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '754673be-4ec1-4b1f-9d6d-3addbce857d9' could not be found. Oct 12 08:44:41.099639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:44:41.143531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2ca910ae-3e4c-4186-a3c1-a6a273478de4 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] Returning 404 to user: Hypervisor with ID '754673be-4ec1-4b1f-9d6d-3addbce857d9' could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:44:41.151658 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2ca910ae-3e4c-4186-a3c1-a6a273478de4 tempest-HypervisorAdminNegativeTestJSON-375151914 tempest-HypervisorAdminNegativeTestJSON-375151914-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/754673be-4ec1-4b1f-9d6d-3addbce857d9" status: 404 len: 123 microversion: 2.1 time: 0.079578 Oct 12 08:44:41.154067 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 70/94] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 12 08:44:41 2022] GET /compute/v2.1/os-hypervisors/754673be-4ec1-4b1f-9d6d-3addbce857d9 => generated 123 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:44:41.344610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:41.361224 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-74855496-e36a-4911-b4c0-f20c91b09e39 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 1.545023 Oct 12 08:44:41.378353 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 25/95] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:39 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:41.624295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:41.626876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:41.643363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:41.644363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:41.645026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:41.646047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:41.646693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:41.648513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:42.032307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:42.044898 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a002211-1f28-455a-8880-4a9b3e3dfb51 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1278 microversion: 2.1 time: 0.424364 Oct 12 08:44:42.060547 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 26/96] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:41 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1278 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:42.141307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-686d2415-e5b9-49b8-9491-0fbffba87bff req-d1cfa257-8736-4112-9a15-87ac5b026155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6206e61f-f266-4fec-9216-f8e828a5f4e1", "tag": "df60d857-e6f7-4e12-9237-0111a8ee90eb"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:42.180126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-686d2415-e5b9-49b8-9491-0fbffba87bff req-d1cfa257-8736-4112-9a15-87ac5b026155 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:42.187895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-686d2415-e5b9-49b8-9491-0fbffba87bff req-d1cfa257-8736-4112-9a15-87ac5b026155 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:42.189494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-686d2415-e5b9-49b8-9491-0fbffba87bff req-d1cfa257-8736-4112-9a15-87ac5b026155 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:42.245298 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-686d2415-e5b9-49b8-9491-0fbffba87bff req-d1cfa257-8736-4112-9a15-87ac5b026155 service nova] Creating event network-changed:df60d857-e6f7-4e12-9237-0111a8ee90eb for instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 on n-h1-858383-10 Oct 12 08:44:42.250518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-686d2415-e5b9-49b8-9491-0fbffba87bff req-d1cfa257-8736-4112-9a15-87ac5b026155 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:44:42.250518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-686d2415-e5b9-49b8-9491-0fbffba87bff req-d1cfa257-8736-4112-9a15-87ac5b026155 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:44:42.251246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:42.251770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:42.254156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:42.257076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:42.258371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:42.260603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:42.286592 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.compute.rpcapi [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 12 08:44:42.292921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] Releasing lock "compute-rpcapi-router" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:44:42.329409 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd49def3-52c9-4073-9d99-f72860a59a0f None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.854553 Oct 12 08:44:42.332868 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 71/97] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:42.391922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:42.393335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:42.403615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:42.416251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:42.419874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:42.420866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:42.427619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:42.430229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:43.080921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:43.082309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:43.095367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:43.095855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:43.096316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:43.097220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:43.103672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:43.104418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:43.349391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:43.357964 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3bc63383-4b8a-40fb-8e2c-7977157315fb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.970702 Oct 12 08:44:43.364217 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 27/98] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:42 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:43.405376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:43.414381 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38b2b314-07e5-463c-8583-a71dbf14695e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1278 microversion: 2.1 time: 0.345309 Oct 12 08:44:43.420561 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 72/99] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:43 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:44.380352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:44.381035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:44.389296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:44.392449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:44.393171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:44.393875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:44.395136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:44.395756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:44.396340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:44.444727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:44.446827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:44.466886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:44.467762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:44.470760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:44.471649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:44.472287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:44.473547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:44.728328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:44.767215 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0557faa3-a18e-409c-b449-28e29c9ef224 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.389043 Oct 12 08:44:44.784730 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 28/100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:44 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:45.697889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:45.712206 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b834793b-cd34-4a80-98a4-70a3a166c7e7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 1.266783 Oct 12 08:44:45.726116 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 73/101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:44 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:45.806738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:45.808295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:45.818399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:45.819738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:45.820398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:45.822353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:45.823153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:45.824301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:46.281474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:46.295684 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33d850fa-49ae-4a6d-8eea-04d300cf6238 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.495716 Oct 12 08:44:46.297241 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 29/102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:45 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:46.738468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:46.740131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:46.760524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:46.764826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:46.765847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:46.776220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:46.779510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:46.783097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:47.322031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:47.322995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:47.341254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:47.344268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:47.346772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:47.351285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:47.354338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:47.359118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:47.775651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:47.787330 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1de792bf-3983-4230-90fc-a23268f74167 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 1.053564 Oct 12 08:44:47.808135 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 74/103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:46 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:48.194951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:48.205222 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8bbfc1c-1f26-45ac-bc01-baa66da377a1 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.888240 Oct 12 08:44:48.225726 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 30/104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:47 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:48.823638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:48.825171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:48.840160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:48.840658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:48.841096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:48.841873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:48.842296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:48.842726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:49.078827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=22 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:49.235018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:49.236454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:49.250254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:49.251354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:49.258530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:49.260028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:49.260713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:49.262818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:49.494504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:49.704497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:49.714658 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eb9234b7-9879-4e8a-9d07-455705dfe8ae tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.485990 Oct 12 08:44:49.731078 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 31/105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:49 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:50.103254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:50.125034 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-986e896e-1318-4291-b285-bc70f3251498 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 1.309059 Oct 12 08:44:50.144201 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 75/106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:48 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:50.751283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:50.752717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:50.763569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:50.764497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:50.766332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:50.767398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:50.786706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:50.789592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:51.156066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:51.156676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:51.175160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:51.177330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:51.184164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:51.184936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:51.186837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:51.192053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:51.323661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:51.342830 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fbb1c69d-42eb-49fc-b8da-bd76eb756dc8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.605532 Oct 12 08:44:51.361942 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 32/107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:50 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:51.877272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:51.893954 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-baddc554-5937-4a60-a566-6fd7789a922b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 0.742358 Oct 12 08:44:51.909464 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 76/108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:51 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:52.170086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2015391020", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:52.285528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=12 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:52.322368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:44:52.827729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-928f0caf-526a-4b2b-9db0-7f1342b16e00 req-841c58f2-51b6-4574-acd6-93dc1b264a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92a4de5-5552-4f10-afa8-0d986c065129", "tag": "72842084-74f4-4dfe-8c26-792e4895425d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:52.849977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-928f0caf-526a-4b2b-9db0-7f1342b16e00 req-841c58f2-51b6-4574-acd6-93dc1b264a88 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:52.853232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-928f0caf-526a-4b2b-9db0-7f1342b16e00 req-841c58f2-51b6-4574-acd6-93dc1b264a88 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:52.853967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-928f0caf-526a-4b2b-9db0-7f1342b16e00 req-841c58f2-51b6-4574-acd6-93dc1b264a88 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:52.908100 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-928f0caf-526a-4b2b-9db0-7f1342b16e00 req-841c58f2-51b6-4574-acd6-93dc1b264a88 service nova] Creating event network-changed:72842084-74f4-4dfe-8c26-792e4895425d for instance e92a4de5-5552-4f10-afa8-0d986c065129 on n-h2-858383-10 Oct 12 08:44:52.941906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-928f0caf-526a-4b2b-9db0-7f1342b16e00 req-841c58f2-51b6-4574-acd6-93dc1b264a88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.038915 Oct 12 08:44:52.945015 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 77/109] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:44:52.967376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:52.969805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:52.976847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:44:52.977268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:44:52.978031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:44:52.978436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:44:52.978848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:44:52.983489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:52.987477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:52.988242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:52.989994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:52.993717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:52.994567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:53.000889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:53.011831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:53.012243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:53.012681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:53.023450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:53.024087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:53.024539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:53.088111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=83 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:53.140463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Getting quotas for project b4cc976e520e4b7ea741cdc605abccc6. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:44:53.147698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Getting quotas for user 12321f04fa1844098fb5c2585caae367 and project b4cc976e520e4b7ea741cdc605abccc6. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:44:53.178888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:44:53.185674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:44:53.324192 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-76dfb087-824c-4fb9-8a40-2d88c236305c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.690332 Oct 12 08:44:53.341762 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 33/110] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:44:53.363424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:53.364303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:53.380492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:53.381248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:53.383718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:53.384702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:53.385309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:53.386596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:53.759823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:53.771878 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e2d508f0-f39d-4a0d-90c2-571d5951b98f tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 0.420224 Oct 12 08:44:53.787026 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 34/111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:53 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:53.792348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1893211414", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:53.889406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:44:54.003581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:54.005996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=81 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:44:54.017280 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-44db39d3-4f7f-4188-abfa-7ddb50b70acb tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 1.068715 Oct 12 08:44:54.037819 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 78/112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:52 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:54.292682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:44:54.293420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:44:54.294319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:44:54.295038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:44:54.295758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:44:54.306706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:54.307194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:54.307626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:54.308342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:54.308949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:54.309568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:54.336709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Getting quotas for project b4cc976e520e4b7ea741cdc605abccc6. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:44:54.341921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Getting quotas for user 12321f04fa1844098fb5c2585caae367 and project b4cc976e520e4b7ea741cdc605abccc6. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:44:54.365896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:44:54.369371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:44:54.434802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-30c210d4-a085-4f8d-a856-922347a04d7e req-27df6bf2-ed2d-42c4-81d5-668961fbbd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6206e61f-f266-4fec-9216-f8e828a5f4e1", "name": "network-vif-plugged", "status": "completed", "tag": "df60d857-e6f7-4e12-9237-0111a8ee90eb"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:54.472572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-30c210d4-a085-4f8d-a856-922347a04d7e req-27df6bf2-ed2d-42c4-81d5-668961fbbd88 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:54.479631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-30c210d4-a085-4f8d-a856-922347a04d7e req-27df6bf2-ed2d-42c4-81d5-668961fbbd88 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:54.481244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-30c210d4-a085-4f8d-a856-922347a04d7e req-27df6bf2-ed2d-42c4-81d5-668961fbbd88 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:54.514731 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-554bbd95-ff69-4f1a-9868-f5b889fe6eed tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725831 Oct 12 08:44:54.515831 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 35/113] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:44:54.519139 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-30c210d4-a085-4f8d-a856-922347a04d7e req-27df6bf2-ed2d-42c4-81d5-668961fbbd88 service nova] Creating event network-vif-plugged:df60d857-e6f7-4e12-9237-0111a8ee90eb for instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 on n-h1-858383-10 Oct 12 08:44:54.539394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f507c72-9a60-4fff-acf1-fbb6455e87d1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:54.540505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f507c72-9a60-4fff-acf1-fbb6455e87d1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:54.552020 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-30c210d4-a085-4f8d-a856-922347a04d7e req-27df6bf2-ed2d-42c4-81d5-668961fbbd88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.436110 Oct 12 08:44:54.558725 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 79/114] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:44:54.676305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f507c72-9a60-4fff-acf1-fbb6455e87d1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:54.688729 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f507c72-9a60-4fff-acf1-fbb6455e87d1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1214 microversion: 2.1 time: 0.163210 Oct 12 08:44:54.705000 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 36/115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:54 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:54.797918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:54.798950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:54.814998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:54.818550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:54.820569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:54.821544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:54.823908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:54.825115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:55.295923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1718610452", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:55.307954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:55.322174 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3daef87f-2e11-4957-a390-1d3bbac9a791 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 0.529009 Oct 12 08:44:55.325395 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 80/116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:54 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:55.344265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:55.355276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:55.376969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:55.377611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:55.378157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:55.379111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:55.379569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:55.380057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:55.428712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:44:55.848409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:44:55.848835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:44:55.849315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:44:55.850495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:44:55.850914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:44:55.877843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:55.878403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:55.878836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:55.879563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:55.880017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:55.880440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:55.926730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:44:55.931366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for user 5631063704964af4a1d7780077789e48 and project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:44:55.966369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:44:55.968630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:44:56.041615 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed2c8cbb-451e-4fec-9408-0aad15d11009 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043695 Oct 12 08:44:56.049252 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 37/117] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:44:56.056105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:56.056900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:56.064771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:56.066040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:56.066675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:56.067546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:56.068167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:56.068788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:56.148714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:56.163301 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-540d2e71-9477-4b1f-b8be-65ffbc65f527 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1218 microversion: 2.1 time: 0.109500 Oct 12 08:44:56.163809 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 38/118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:56 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:56.283327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:56.293009 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3bf08afa-c151-413e-b9b6-80dfd9cc0056 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1337 microversion: 2.1 time: 0.965631 Oct 12 08:44:56.302601 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 81/119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:55 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1337 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:56.308096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f63ae19-8c99-4aab-b7c2-16dbfa2516e3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:56.308709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9f63ae19-8c99-4aab-b7c2-16dbfa2516e3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:56.481242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f14d4748-7656-48b7-a90d-45efe23c8a08 tempest-FlavorsV255TestJSON-1200803681 tempest-FlavorsV255TestJSON-1200803681-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1532072409", "id": 1046670061, "os-flavor-access:is_public": "True"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:56.523542 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f14d4748-7656-48b7-a90d-45efe23c8a08 tempest-FlavorsV255TestJSON-1200803681 tempest-FlavorsV255TestJSON-1200803681-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.358622 Oct 12 08:44:56.536027 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 39/120] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:44:56 2022] POST /compute/v2.1/flavors => generated 449 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:44:56.549218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:56.550312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:56.561381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f63ae19-8c99-4aab-b7c2-16dbfa2516e3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:56.571403 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f63ae19-8c99-4aab-b7c2-16dbfa2516e3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1213 microversion: 2.1 time: 0.267292 Oct 12 08:44:56.572002 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 82/121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:56 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1213 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:56.590785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:56.591271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:56.597565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:56.599544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:56.603686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:56.604292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:56.775186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf9c28bc-bf53-4c96-816e-74a0105070b6 tempest-FlavorsV255TestJSON-1070436273 tempest-FlavorsV255TestJSON-1070436273-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:56.790672 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf9c28bc-bf53-4c96-816e-74a0105070b6 tempest-FlavorsV255TestJSON-1070436273 tempest-FlavorsV255TestJSON-1070436273-project] 10.222.0.40 "GET /compute/v2.1/flavors/1046670061" status: 200 len: 449 microversion: 2.55 time: 0.198097 Oct 12 08:44:56.791262 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 83/122] 10.222.0.40 () {60 vars in 1199 bytes} [Wed Oct 12 08:44:56 2022] GET /compute/v2.1/flavors/1046670061 => generated 449 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:44:56.813238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51069d36-103f-4615-b19e-4375e00a508d tempest-FlavorsV255TestJSON-1200803681 tempest-FlavorsV255TestJSON-1200803681-project-admin] Action: 'update', calling method: .version_select at 0x7f984a837b80>, body: {"flavor": {"description": "new"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:44:56.935789 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51069d36-103f-4615-b19e-4375e00a508d tempest-FlavorsV255TestJSON-1200803681 tempest-FlavorsV255TestJSON-1200803681-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1046670061" status: 200 len: 450 microversion: 2.55 time: 0.132237 Oct 12 08:44:56.945855 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 84/123] 10.222.0.40 () {62 vars in 1219 bytes} [Wed Oct 12 08:44:56 2022] PUT /compute/v2.1/flavors/1046670061 => generated 450 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:44:56.952198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4e91f7e-4fcc-4ed0-b351-ad43a5e86591 tempest-FlavorsV255TestJSON-1070436273 tempest-FlavorsV255TestJSON-1070436273-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:57.009846 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4e91f7e-4fcc-4ed0-b351-ad43a5e86591 tempest-FlavorsV255TestJSON-1070436273 tempest-FlavorsV255TestJSON-1070436273-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.062211 Oct 12 08:44:57.011059 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 85/124] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 12 08:44:56 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:44:57.033470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88512d74-8158-4f60-81d4-453c78004313 tempest-FlavorsV255TestJSON-1070436273 tempest-FlavorsV255TestJSON-1070436273-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:57.088299 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88512d74-8158-4f60-81d4-453c78004313 tempest-FlavorsV255TestJSON-1070436273 tempest-FlavorsV255TestJSON-1070436273-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.059677 Oct 12 08:44:57.091600 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 86/125] 10.222.0.40 () {60 vars in 1166 bytes} [Wed Oct 12 08:44:57 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:44:57.111838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-405cb298-bdad-4962-b329-a8c32ed10387 tempest-FlavorsV255TestJSON-1200803681 tempest-FlavorsV255TestJSON-1200803681-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:57.151558 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-405cb298-bdad-4962-b329-a8c32ed10387 tempest-FlavorsV255TestJSON-1200803681 tempest-FlavorsV255TestJSON-1200803681-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1046670061" status: 202 len: 0 microversion: 2.55 time: 0.045881 Oct 12 08:44:57.152699 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 87/126] 10.222.0.40 () {60 vars in 1202 bytes} [Wed Oct 12 08:44:57 2022] DELETE /compute/v2.1/flavors/1046670061 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:44:57.166645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd7c5add-d955-4b0a-a16a-8733c71f3662 tempest-FlavorsV255TestJSON-1200803681 tempest-FlavorsV255TestJSON-1200803681-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:57.237842 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd7c5add-d955-4b0a-a16a-8733c71f3662 tempest-FlavorsV255TestJSON-1200803681 tempest-FlavorsV255TestJSON-1200803681-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.077933 Oct 12 08:44:57.240988 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 88/127] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 12 08:44:57 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:44:57.253671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:57.264483 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9faec968-79ac-4a9f-8434-a6b23823d56e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 0.727264 Oct 12 08:44:57.266450 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 40/128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:56 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:57.273992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:57.284063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:57.298946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:57.299475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:57.300005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:57.300739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:57.301195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:57.306473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:57.318141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:57.319305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:57.327868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:57.332932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:57.333713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:57.334714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:57.335371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:57.336014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:57.448583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:57.461108 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47362d32-40d0-4c55-a901-cd5c3ebeb8f8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1266 microversion: 2.1 time: 0.199735 Oct 12 08:44:57.481947 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 89/129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:57 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:57.595366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:57.596173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:57.612582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:57.617427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:57.618248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:57.620289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:57.622007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:57.624142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:57.722469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:57.738731 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37778605-2440-44f6-a450-cc849b99ecc6 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1487 microversion: 2.1 time: 0.425894 Oct 12 08:44:57.745545 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 41/130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:57 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1487 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:57.770559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:57.771440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:57.783994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:57.789420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:57.792867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:57.795524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:57.797423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:57.800582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:58.024240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:58.038045 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-445448ed-e13a-4ffe-9ce5-afff96af9a99 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1229 microversion: 2.1 time: 0.447261 Oct 12 08:44:58.040499 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 90/131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:57 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1229 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:58.288818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:58.289742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:58.316650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:58.321620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:58.324170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:58.326650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:58.329895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:58.334726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:58.727430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:58.738850 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a1ad1db0-f9ad-4171-9044-c72399f426d7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 0.454158 Oct 12 08:44:58.741263 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 91/132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:58 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:44:58.751636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:58.752587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:58.759451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:58.767282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:58.768369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:58.769504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:58.770244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:58.770891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:58.859908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:58.872896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0e1c461-9015-45d2-8fa5-760cc6cb56d9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1272 microversion: 2.1 time: 0.127691 Oct 12 08:44:58.874074 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 92/133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:58 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:59.071522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:59.072397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:59.080384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:59.081167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:59.081878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:59.082652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:59.083165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:59.083645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:59.188664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:44:59.199381 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cbc870d-9513-4e89-b984-59079f83a92d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1291 microversion: 2.1 time: 0.137090 Oct 12 08:44:59.219466 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 93/134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:59 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1291 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:44:59.764825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:44:59.766238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:44:59.773423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:59.774431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:59.775159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:44:59.776135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:44:59.777141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:44:59.777869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.077711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:00.085688 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-305089ae-2e5a-4456-8aca-6c4be3ac3e0d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 0.325788 Oct 12 08:45:00.090074 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 94/135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:59 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:00.095729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:00.100025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:00.115347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.119556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.120214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.122263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.125071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.125760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.202839 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-08942722-ca92-44a2-940a-9985a0e9861c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1640 microversion: 2.1 time: 2.436499 Oct 12 08:45:00.207616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 42/136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:44:57 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1640 bytes in 2442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:00.223300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:00.224166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:00.245296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.245942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.246407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.247155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.247798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.248382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.294655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:00.306823 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b7364788-9874-4f35-9d61-e71a4d3a58d4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1272 microversion: 2.1 time: 0.214667 Oct 12 08:45:00.307880 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 95/137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:00 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:00.322582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:00.323331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:00.335846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.338679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.339373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.343480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.344223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.345048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.398945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:45:00.563912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:00.589700 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8dc961bc-fac0-4664-8075-eea121265f3e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1291 microversion: 2.1 time: 0.355296 Oct 12 08:45:00.590682 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 43/138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:00 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1291 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:00.600992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-54c05e2f-8956-490d-a2bf-dc80b2ef76cd req-3cc62044-2e7e-4964-9ebf-8359748a6e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b362992b-616f-4d7e-98f1-7465d511f00b", "tag": "1867b80e-5e98-4292-963e-36458a1a69d0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:00.633021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-54c05e2f-8956-490d-a2bf-dc80b2ef76cd req-3cc62044-2e7e-4964-9ebf-8359748a6e86 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.637677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-54c05e2f-8956-490d-a2bf-dc80b2ef76cd req-3cc62044-2e7e-4964-9ebf-8359748a6e86 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.638244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-54c05e2f-8956-490d-a2bf-dc80b2ef76cd req-3cc62044-2e7e-4964-9ebf-8359748a6e86 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.696372 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-54c05e2f-8956-490d-a2bf-dc80b2ef76cd req-3cc62044-2e7e-4964-9ebf-8359748a6e86 service nova] Creating event network-changed:1867b80e-5e98-4292-963e-36458a1a69d0 for instance b362992b-616f-4d7e-98f1-7465d511f00b on n-h2-858383-10 Oct 12 08:45:00.697016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-54c05e2f-8956-490d-a2bf-dc80b2ef76cd req-3cc62044-2e7e-4964-9ebf-8359748a6e86 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:45:00.697410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-54c05e2f-8956-490d-a2bf-dc80b2ef76cd req-3cc62044-2e7e-4964-9ebf-8359748a6e86 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:45:00.698556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.699015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.699442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.700161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.700616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.701033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.710064 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-108cab2d-6b18-4f65-af00-756a9713e58b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 204 len: 0 microversion: 2.1 time: 0.400598 Oct 12 08:45:00.714568 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 96/139] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:45:00 2022] DELETE /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:45:00.719482 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.compute.rpcapi [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 12 08:45:00.720082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:00.723157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:00.727538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:45:00.737612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.738103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.739435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.740921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.740921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.741235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.751277 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30eea171-d32f-47de-aa84-98b7f8eb47a2 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159396 Oct 12 08:45:00.751904 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 44/140] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:00.852922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ed740e52-0a99-434d-b4af-994adea5ccc6 req-f641af7b-d0e9-473b-a2de-8e7a0efe4b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92a4de5-5552-4f10-afa8-0d986c065129", "name": "network-vif-plugged", "status": "completed", "tag": "72842084-74f4-4dfe-8c26-792e4895425d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:00.874171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ed740e52-0a99-434d-b4af-994adea5ccc6 req-f641af7b-d0e9-473b-a2de-8e7a0efe4b9d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:00.874939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ed740e52-0a99-434d-b4af-994adea5ccc6 req-f641af7b-d0e9-473b-a2de-8e7a0efe4b9d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:00.875557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ed740e52-0a99-434d-b4af-994adea5ccc6 req-f641af7b-d0e9-473b-a2de-8e7a0efe4b9d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:00.889556 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ed740e52-0a99-434d-b4af-994adea5ccc6 req-f641af7b-d0e9-473b-a2de-8e7a0efe4b9d service nova] Creating event network-vif-plugged:72842084-74f4-4dfe-8c26-792e4895425d for instance e92a4de5-5552-4f10-afa8-0d986c065129 on n-h2-858383-10 Oct 12 08:45:00.895633 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ed740e52-0a99-434d-b4af-994adea5ccc6 req-f641af7b-d0e9-473b-a2de-8e7a0efe4b9d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050822 Oct 12 08:45:00.897080 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 45/141] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:01.116470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:01.117328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:01.125569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:01.126056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:01.126490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:01.127391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:01.128186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:01.128929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:01.189968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:01.202542 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5e5d9c2-1837-46e4-8672-a313f49af7d8 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1493 microversion: 2.1 time: 0.485786 Oct 12 08:45:01.203229 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 97/142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:00 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1493 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:01.331679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:01.332295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:01.338886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:01.339368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:01.339800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:01.340504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:01.341031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:01.341375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:01.413912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:01.422432 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-938e3ba7-0e54-4789-9643-e7115494629b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1272 microversion: 2.1 time: 0.094682 Oct 12 08:45:01.423002 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 98/143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:01 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:01.624621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:01.625673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:01.633033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:01.633829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:01.634359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:01.635121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:01.635641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:01.636124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:01.683130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:01.700182 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02f3bf87-d415-42d8-9924-8513159eab9b tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 0.591375 Oct 12 08:45:01.705674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:01.706745 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 46/144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:01 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:01.713396 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cce68d88-4068-4000-97c4-088444d6f50b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1291 microversion: 2.1 time: 0.094408 Oct 12 08:45:01.715172 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 99/145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:01 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1291 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:02.233645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:02.234264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:02.241427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:02.250903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:02.253016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:02.254683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:02.255966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:02.256636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:02.453399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:02.454095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:02.469465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:02.470611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:02.472598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:02.473835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:02.474508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:02.475133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:02.849699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:02.864078 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-96f3cb17-6fd5-4035-b645-5260973df3e1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.421597 Oct 12 08:45:02.866238 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 100/146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:02 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:02.881936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:02.887690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:02.888315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:02.901142 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-61d7e84d-16f3-4f43-88a0-9b4cc8792ec4 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1493 microversion: 2.1 time: 0.671538 Oct 12 08:45:02.908412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 47/147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:02 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1493 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:02.920551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:02.921057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:02.923489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:02.926518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:02.927631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:02.928121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:02.928786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:02.929645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:02.950701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:02.950942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:02.952064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:02.954363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:02.956381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:02.958937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:02.960372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:03.102890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:03.114836 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8be03edd-47a3-4dca-81f7-42e7294b9a6c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1291 microversion: 2.1 time: 0.204033 Oct 12 08:45:03.131887 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 48/148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:02 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1291 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:03.485903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:03.513406 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb2be33e-c018-4fe6-aafc-b2817532b7b3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1320 microversion: 2.1 time: 0.645199 Oct 12 08:45:03.524674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b892eb2d-41fb-4e09-9c10-543d37cafdcf req-ad4c407e-1ac4-471a-b4ac-5100d8f840fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6206e61f-f266-4fec-9216-f8e828a5f4e1", "name": "network-vif-deleted", "tag": "df60d857-e6f7-4e12-9237-0111a8ee90eb"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:03.542635 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 101/149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:02 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1320 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:03.546390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b892eb2d-41fb-4e09-9c10-543d37cafdcf req-ad4c407e-1ac4-471a-b4ac-5100d8f840fc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:03.547821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b892eb2d-41fb-4e09-9c10-543d37cafdcf req-ad4c407e-1ac4-471a-b4ac-5100d8f840fc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:03.548987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b892eb2d-41fb-4e09-9c10-543d37cafdcf req-ad4c407e-1ac4-471a-b4ac-5100d8f840fc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:03.576902 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b892eb2d-41fb-4e09-9c10-543d37cafdcf req-ad4c407e-1ac4-471a-b4ac-5100d8f840fc service nova] Creating event network-vif-deleted:df60d857-e6f7-4e12-9237-0111a8ee90eb for instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 on n-h1-858383-10 Oct 12 08:45:03.586687 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b892eb2d-41fb-4e09-9c10-543d37cafdcf req-ad4c407e-1ac4-471a-b4ac-5100d8f840fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065524 Oct 12 08:45:03.587296 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 49/150] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:03.892318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:03.892926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:03.903442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:03.903851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:03.911498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:03.912334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:03.912826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:03.923679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:03.934499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:03.935774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:03.961990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:03.963802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:03.966419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:03.967331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:03.967819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:03.968252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:04.083592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:04.085998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:04.086611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:04.087260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lazy-loading 'fault' on Instance uuid 6206e61f-f266-4fec-9216-f8e828a5f4e1 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:04.268803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a7ae2797b8472c9e9fc8b612d68b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9700f762654d3b8029348771a812e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:04.282219 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a2b31aac-51db-495c-9378-0e641c28e5fa tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 200 len: 1327 microversion: 2.1 time: 0.352486 Oct 12 08:45:04.286074 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 50/151] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:03 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 1327 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:04.296324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:04.297118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:04.308055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:04.312393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:04.313041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:04.313939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:04.314399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:04.316760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:04.578481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:04.586427 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a8350bc-18d9-4bb5-8dd4-efe5a0c1e28b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.698793 Oct 12 08:45:04.590131 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 102/152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:03 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:04.599170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:04.602510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:04.617497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:04.618244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:04.618872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:04.619745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:04.620375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:04.620966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:04.943931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:04.955198 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec74674f-d3be-4275-b518-1726d6c004c8 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1468 microversion: 2.1 time: 0.363169 Oct 12 08:45:04.971625 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 103/153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:04 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1468 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:05.190646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:05.191585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:05.199652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.200489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.201124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.202128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.203066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.203719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.298370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:45:05.505844 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-659b8457-5bd5-4f9e-8546-703f7f96cc68 tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 204 len: 0 microversion: 2.1 time: 0.522652 Oct 12 08:45:05.507233 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 104/154] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:45:04 2022] DELETE /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:45:05.516105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:05.517551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:05.524764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:UPDATE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:05.527533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.528824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.529476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.530366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.531359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.532231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.539488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:05.554141 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] HTTP exception thrown: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Request method failure captured: Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 HTTP/1.1 Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5lRRPKWdInQbx8M7BsLVp4F3QuQZe42j_DQ4flUih2_k09NvJOTLqeAMay9bVH_BG0AeBa_VnrR2LNzThLxeqJYOpQw7wOuQpbrDKFVOgjvyumupkBbJ944LAUs7K9Q7uDA6cJ9_CQgum5dSi7wBvWcZP6jJvBZ47fAvUEJQADX_g Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: cb9700f762654d3b8029348771a812e2 Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:45:05.560002 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb9700f762654d3b8029348771a812e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cb9700f762654d3b8029348771a812e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cb9700f762654d3b8029348771a812e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb9700f762654d3b8029348771a812e2"}]}] Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: cb9700f762654d3b8029348771a812e2 Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminTestJSON-81662548-project Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d3a7ae2797b8472c9e9fc8b612d68b5b Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminTestJSON-81662548-project Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:05.561699 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '6206e61f-f266-4fec-9216-f8e828a5f4e1'} Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:05.562361 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:05.563386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:05.565741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Returning 404 to user: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:05.565741 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c1bf7d9-5c76-41d2-942f-8eaaa4f5cb7f tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 404 len: 111 microversion: 2.1 time: 0.053614 Oct 12 08:45:05.565741 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 105/155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:05 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:05.570014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:05.570127 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e425bf57-0026-4177-9c89-a2d652e33cb9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1333 microversion: 2.1 time: 1.280966 Oct 12 08:45:05.570648 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 51/156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:04 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1333 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:05.570750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:05.579193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.579906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.581581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.582107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.582865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.583468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.594679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bfeef90f-73d5-41a5-8341-d98f01876de1 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:05.626297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfeef90f-73d5-41a5-8341-d98f01876de1 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.628595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfeef90f-73d5-41a5-8341-d98f01876de1 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.629539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfeef90f-73d5-41a5-8341-d98f01876de1 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.829075 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bfeef90f-73d5-41a5-8341-d98f01876de1 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.1 time: 0.257335 Oct 12 08:45:05.830426 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 52/157] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:45:05 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:05.837280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:05.845779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:05.864122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.864887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.865756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.866897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:05.867565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:05.868258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:05.947352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=20 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:06.261565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:06.271441 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f9038cb-e891-4d52-a5fc-14f507b7e5ec tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1474 microversion: 2.1 time: 0.707363 Oct 12 08:45:06.272033 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 106/158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:05 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1474 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:06.283209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ee0c18fe-5d99-4d6a-a32f-34e0b8bd211c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:06.344903 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ee0c18fe-5d99-4d6a-a32f-34e0b8bd211c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.071806 Oct 12 08:45:06.348607 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 107/159] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:06 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:06.565954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:06.574198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3a3b3bc-ca9c-4a7d-bb6c-c7813e459fae tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:06.584965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3a3b3bc-ca9c-4a7d-bb6c-c7813e459fae tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.235044 Oct 12 08:45:06.588814 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 108/160] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:45:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:06.601170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-83ce7d69-bdee-4139-ae52-2803883181a6 req-9af580fb-a139-4a2e-8b61-b06827f0c1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c784c0e6-f80d-4d62-8238-7d0977b08110", "tag": "0fd5e509-91df-45aa-8954-38a9aed1874e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:06.636181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83ce7d69-bdee-4139-ae52-2803883181a6 req-9af580fb-a139-4a2e-8b61-b06827f0c1a8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:06.636664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83ce7d69-bdee-4139-ae52-2803883181a6 req-9af580fb-a139-4a2e-8b61-b06827f0c1a8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:06.637094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83ce7d69-bdee-4139-ae52-2803883181a6 req-9af580fb-a139-4a2e-8b61-b06827f0c1a8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:06.648985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:06.657272 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-83ce7d69-bdee-4139-ae52-2803883181a6 req-9af580fb-a139-4a2e-8b61-b06827f0c1a8 service nova] Creating event network-changed:0fd5e509-91df-45aa-8954-38a9aed1874e for instance c784c0e6-f80d-4d62-8238-7d0977b08110 on n-h2-858383-10 Oct 12 08:45:06.660700 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5a889dee-7cf9-4057-b5c7-822b5a9dff46 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.828718 Oct 12 08:45:06.661344 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 53/161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:05 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:06.664669 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-83ce7d69-bdee-4139-ae52-2803883181a6 req-9af580fb-a139-4a2e-8b61-b06827f0c1a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074397 Oct 12 08:45:06.665257 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 109/162] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:06.674104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5df462a2-be0a-411d-842e-f3ca71d9c0c5 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1262209449"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:06.681594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-5df462a2-be0a-411d-842e-f3ca71d9c0c5 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid 75a32f4b-6bd0-4ff9-a73c-3e1d23c6f716 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:06.698183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:06.699119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:06.715141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:06.715642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:06.716078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:06.716788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:06.722175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:06.722804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:06.738427 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5df462a2-be0a-411d-842e-f3ca71d9c0c5 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075292 Oct 12 08:45:06.739549 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 54/163] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:06.911955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc4dcc34-d8ec-45a8-9f84-f9fc051051eb tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1435122911", "id": 2050110167, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:06.926122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=11,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:06.961189 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc4dcc34-d8ec-45a8-9f84-f9fc051051eb tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.219573 Oct 12 08:45:06.963856 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 55/164] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:45:06 2022] POST /compute/v2.1/flavors => generated 425 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:06.976881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-980e8fb5-0c7b-405a-8f13-3074bcb78390 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:06.999138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-980e8fb5-0c7b-405a-8f13-3074bcb78390 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:07.000038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-980e8fb5-0c7b-405a-8f13-3074bcb78390 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:07.000674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-980e8fb5-0c7b-405a-8f13-3074bcb78390 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:07.209597 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-980e8fb5-0c7b-405a-8f13-3074bcb78390 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.244140 Oct 12 08:45:07.211685 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 56/165] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:45:06 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:07.216868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35ccc95b-19e2-4e60-b8bd-d59d6b57de84 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:07.238469 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35ccc95b-19e2-4e60-b8bd-d59d6b57de84 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025435 Oct 12 08:45:07.239465 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 57/166] 10.222.0.40 () {58 vars in 1182 bytes} [Wed Oct 12 08:45:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:07.245496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7cefdf50-614b-4158-9ea8-8a22d924dc4d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:07.271092 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7cefdf50-614b-4158-9ea8-8a22d924dc4d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.029886 Oct 12 08:45:07.272462 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 58/167] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:45:07 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:07.278856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cbf9fb62-f054-4085-aefa-66fa0a31bd55 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-335273439", "id": 81276253, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:07.321214 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cbf9fb62-f054-4085-aefa-66fa0a31bd55 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.047112 Oct 12 08:45:07.334934 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 59/168] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:45:07 2022] POST /compute/v2.1/flavors => generated 418 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:07.344162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:07.350206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1218bb40-9201-475b-873f-16fa7f686739 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:07.362698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1218bb40-9201-475b-873f-16fa7f686739 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:07.363844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1218bb40-9201-475b-873f-16fa7f686739 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:07.364443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1218bb40-9201-475b-873f-16fa7f686739 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:07.367971 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45e22da5-b12a-40a4-bcbb-0551ab2b6c10 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.672362 Oct 12 08:45:07.370882 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 110/169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:06 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:07.395353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:07.395992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:07.408557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:07.409116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:07.410671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:07.412670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:07.415450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:07.418370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:07.561493 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1218bb40-9201-475b-873f-16fa7f686739 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.225286 Oct 12 08:45:07.564712 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 60/170] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:45:07 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:07.576202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7690c016-2329-4184-9b3a-ac6d12e110a9 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:07.592355 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7690c016-2329-4184-9b3a-ac6d12e110a9 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025417 Oct 12 08:45:07.593486 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 61/171] 10.222.0.40 () {58 vars in 1182 bytes} [Wed Oct 12 08:45:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:07.624117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e69ac573-a4ad-404d-92f0-ec739382c0a0 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:07.670691 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e69ac573-a4ad-404d-92f0-ec739382c0a0 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.075835 Oct 12 08:45:07.671629 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 62/172] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:07 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:07.680759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6d8b1cf-018e-4c4f-a4f6-12e188217e72 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Action: 'create', calling method: .version_select at 0x7f98494c6160>, body: {"keypair": {"name": "tempest-keypair-1094760699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5JBsE5iqKC4W6q8N7/HhH6bzqQtCSEsgcUIFT5TT/f8VHeT+bn+wcM0Y9ri0yV/DZ9o37mjXreTNY/EZxC/RmsBMd8fvUZZQ1jZzwmrP6X3vxToV6tb/qd9nvqbjn82g=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:07.722312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-c6d8b1cf-018e-4c4f-a4f6-12e188217e72 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Getting quotas for project 2fc11687869b49f697bd3a37b5f3e23e. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:45:07.733236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-c6d8b1cf-018e-4c4f-a4f6-12e188217e72 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Getting quotas for user bdcf977edf9f49cb8c2b3a645fd7db7f and project 2fc11687869b49f697bd3a37b5f3e23e. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:45:07.784141 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6d8b1cf-018e-4c4f-a4f6-12e188217e72 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111338 Oct 12 08:45:07.789255 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 63/173] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:45:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:07.791383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ecfcc658-3b3a-4bd5-a67d-7398fe7ad392 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2025866662"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:07.796880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-ecfcc658-3b3a-4bd5-a67d-7398fe7ad392 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid e8aa66cb-3cae-4fc2-98ee-84b965ee6255 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:07.823320 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ecfcc658-3b3a-4bd5-a67d-7398fe7ad392 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036415 Oct 12 08:45:07.830122 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 64/174] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:07.830560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:07.831365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:07.847376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:07.847883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:07.848326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:07.849072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:07.849571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:07.850001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:07.865201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:08.318209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:08.335446 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1257b7d-a626-410c-9d73-40d89b39e71e tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1474 microversion: 2.1 time: 0.948016 Oct 12 08:45:08.336478 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 111/175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:07 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1474 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:08.344822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0cefc726-f038-4c89-86b9-f7df8e2c86eb tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:08.391574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cefc726-f038-4c89-86b9-f7df8e2c86eb tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:08.392275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cefc726-f038-4c89-86b9-f7df8e2c86eb tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:08.392886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cefc726-f038-4c89-86b9-f7df8e2c86eb tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:08.722183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:08.731768 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-98a4497e-fe7c-4b1c-94a7-a43e0960dda6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.906560 Oct 12 08:45:08.734142 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 65/176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:07 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:08.769415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:08.771985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:08.833695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:08.834356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:08.838085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:08.839091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:08.839535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:08.839942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.160259 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0cefc726-f038-4c89-86b9-f7df8e2c86eb tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.821185 Oct 12 08:45:09.162353 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 112/177] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:45:08 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:09.176285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-edfc3655-45a9-4653-b25a-0ecabc8858c6 req-e843cb64-df4e-466d-8c31-f9320ffc315d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744cfd99-597c-4504-af66-6ba5723fcbee", "tag": "865792b9-525d-4c68-888b-8212face2199"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:09.198114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edfc3655-45a9-4653-b25a-0ecabc8858c6 req-e843cb64-df4e-466d-8c31-f9320ffc315d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.199017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edfc3655-45a9-4653-b25a-0ecabc8858c6 req-e843cb64-df4e-466d-8c31-f9320ffc315d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.199865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edfc3655-45a9-4653-b25a-0ecabc8858c6 req-e843cb64-df4e-466d-8c31-f9320ffc315d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.238710 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-edfc3655-45a9-4653-b25a-0ecabc8858c6 req-e843cb64-df4e-466d-8c31-f9320ffc315d service nova] Creating event network-changed:865792b9-525d-4c68-888b-8212face2199 for instance 744cfd99-597c-4504-af66-6ba5723fcbee on n-h1-858383-10 Oct 12 08:45:09.251609 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-edfc3655-45a9-4653-b25a-0ecabc8858c6 req-e843cb64-df4e-466d-8c31-f9320ffc315d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087140 Oct 12 08:45:09.255132 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 113/178] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:09.270811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1ce200e8-d893-4696-967b-86777764f02f req-c4fc7826-50f3-42c3-b249-c34b9ef9edda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92a4de5-5552-4f10-afa8-0d986c065129", "name": "network-vif-deleted", "tag": "72842084-74f4-4dfe-8c26-792e4895425d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:09.308186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ce200e8-d893-4696-967b-86777764f02f req-c4fc7826-50f3-42c3-b249-c34b9ef9edda service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.308888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ce200e8-d893-4696-967b-86777764f02f req-c4fc7826-50f3-42c3-b249-c34b9ef9edda service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.309325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ce200e8-d893-4696-967b-86777764f02f req-c4fc7826-50f3-42c3-b249-c34b9ef9edda service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.314724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:09.322991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2e4b0470-ab32-43d5-b3a9-412ce2dac1f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.571435 Oct 12 08:45:09.323670 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1ce200e8-d893-4696-967b-86777764f02f req-c4fc7826-50f3-42c3-b249-c34b9ef9edda service nova] Creating event network-vif-deleted:72842084-74f4-4dfe-8c26-792e4895425d for instance e92a4de5-5552-4f10-afa8-0d986c065129 on n-h2-858383-10 Oct 12 08:45:09.330363 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 66/179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:08 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:09.342066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9444ebe7-57a3-4c9f-bf88-ecf2a87eebaa tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:09.343207 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1ce200e8-d893-4696-967b-86777764f02f req-c4fc7826-50f3-42c3-b249-c34b9ef9edda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086391 Oct 12 08:45:09.349135 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 114/180] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:09.360859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a6147004-9bbb-4839-8549-9672c39d5513 req-bf6a8569-8788-43fa-9172-6c39bf4f8f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b362992b-616f-4d7e-98f1-7465d511f00b", "name": "network-vif-plugged", "status": "completed", "tag": "1867b80e-5e98-4292-963e-36458a1a69d0"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:09.367009 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9444ebe7-57a3-4c9f-bf88-ecf2a87eebaa tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.035021 Oct 12 08:45:09.370626 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 67/181] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:45:09 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:09.376285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a6147004-9bbb-4839-8549-9672c39d5513 req-bf6a8569-8788-43fa-9172-6c39bf4f8f39 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.377275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a6147004-9bbb-4839-8549-9672c39d5513 req-bf6a8569-8788-43fa-9172-6c39bf4f8f39 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.378061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a6147004-9bbb-4839-8549-9672c39d5513 req-bf6a8569-8788-43fa-9172-6c39bf4f8f39 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.385736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:09.390277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:09.395630 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a6147004-9bbb-4839-8549-9672c39d5513 req-bf6a8569-8788-43fa-9172-6c39bf4f8f39 service nova] Creating event network-vif-plugged:1867b80e-5e98-4292-963e-36458a1a69d0 for instance b362992b-616f-4d7e-98f1-7465d511f00b on n-h2-858383-10 Oct 12 08:45:09.401515 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a6147004-9bbb-4839-8549-9672c39d5513 req-bf6a8569-8788-43fa-9172-6c39bf4f8f39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050631 Oct 12 08:45:09.402478 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 115/182] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:09.407684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.408448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.409353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.411051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.411463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85c409e1-75de-4603-adee-5763e61a818c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:09.411975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.412472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.425581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85c409e1-75de-4603-adee-5763e61a818c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.426531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85c409e1-75de-4603-adee-5763e61a818c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.428572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85c409e1-75de-4603-adee-5763e61a818c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.490694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.491181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.491615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.492078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lazy-loading 'fault' on Instance uuid e92a4de5-5552-4f10-afa8-0d986c065129 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:09.624674 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85c409e1-75de-4603-adee-5763e61a818c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.220443 Oct 12 08:45:09.628979 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 116/183] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:45:09 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:09.641389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3942ebba-b11a-4f7a-96f8-d6d3400123c3 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:09.683933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3942ebba-b11a-4f7a-96f8-d6d3400123c3 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.047069 Oct 12 08:45:09.685757 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 117/184] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:09 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:09.703532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b9ce2bc6-d8c6-45b1-823d-1875450dbac6 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1583401901"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:09.711761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.aggregate [None req-b9ce2bc6-d8c6-45b1-823d-1875450dbac6 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid 2446eb53-8cd2-47dd-b787-c8d3d4b041b3 for aggregate {{(pid=127006) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:09.762068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b9ce2bc6-d8c6-45b1-823d-1875450dbac6 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061953 Oct 12 08:45:09.762771 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 118/185] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:09.767069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:09.776603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82678e6c-c7ba-4940-b702-49ae3cac6a03 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1310 microversion: 2.1 time: 0.404527 Oct 12 08:45:09.778882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:09.779701 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 68/186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:09 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1310 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:09.787958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:09.791756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f8c26497-bbd3-4e80-89e8-94425301461c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:09.808229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.809222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.810542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.811632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.813632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.814287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:09.822109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8c26497-bbd3-4e80-89e8-94425301461c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:09.822610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8c26497-bbd3-4e80-89e8-94425301461c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:09.823050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8c26497-bbd3-4e80-89e8-94425301461c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.039003 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f8c26497-bbd3-4e80-89e8-94425301461c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.254816 Oct 12 08:45:10.039984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 69/187] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:45:09 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:10.051566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-304f88c7-df0c-4092-be3b-d6f8a87ba14b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:10.085909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-304f88c7-df0c-4092-be3b-d6f8a87ba14b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.086603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-304f88c7-df0c-4092-be3b-d6f8a87ba14b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.087236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-304f88c7-df0c-4092-be3b-d6f8a87ba14b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.274167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:10.288163 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80d793ba-667e-434d-8764-080bf9f90251 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.521761 Oct 12 08:45:10.290160 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 119/188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:09 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:10.340643 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-304f88c7-df0c-4092-be3b-d6f8a87ba14b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.291373 Oct 12 08:45:10.341769 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 70/189] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:45:10 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:10.357948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b9f0121-98f8-4951-bc51-dbb753487f54 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.370250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.371960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:10.385270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.396118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.399713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.400631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.405266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.406430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.426124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b9f0121-98f8-4951-bc51-dbb753487f54 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.069778 Oct 12 08:45:10.430270 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 120/190] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:10 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:10.446139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a9b7314-0a00-4c14-90fb-98bb6cf416cd tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-790470769"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:10.454501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.aggregate [None req-4a9b7314-0a00-4c14-90fb-98bb6cf416cd tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid 6336f21a-7a8e-430f-9de5-b9822a089784 for aggregate {{(pid=127006) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:10.500247 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a9b7314-0a00-4c14-90fb-98bb6cf416cd tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.065994 Oct 12 08:45:10.501532 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 121/191] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:10 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:10.514801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a8a7dfe3-4f03-42a6-a9c6-21e43f6bb73b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.559612 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a8a7dfe3-4f03-42a6-a9c6-21e43f6bb73b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.050611 Oct 12 08:45:10.567236 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 122/192] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 08:45:10.572129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c17da352-39c9-481c-a9a0-9e8d97eb7f13 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Calling method '.version_select at 0x7f9849876670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.586639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17da352-39c9-481c-a9a0-9e8d97eb7f13 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.587126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17da352-39c9-481c-a9a0-9e8d97eb7f13 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.592006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17da352-39c9-481c-a9a0-9e8d97eb7f13 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.592972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17da352-39c9-481c-a9a0-9e8d97eb7f13 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.593534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17da352-39c9-481c-a9a0-9e8d97eb7f13 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.594510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17da352-39c9-481c-a9a0-9e8d97eb7f13 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.663740 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c17da352-39c9-481c-a9a0-9e8d97eb7f13 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.094572 Oct 12 08:45:10.664812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 123/193] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 12 08:45:10 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:10.672276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a421aab2-5461-4447-a639-416b1b8f140c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.695686 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a421aab2-5461-4447-a639-416b1b8f140c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a421aab2-5461-4447-a639-416b1b8f140c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Request method failure captured: Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5nu41wcJayPzO5wGk25yqCoTHW5SvL4SQkSVkLUGmw_U1lA1xKQXKjaTpPBzWOzEnqZQW7wG0BhV3FIXq3_t5R2BKpq0dXkEM87pH00YzSjm_cf1et_BxHlEAiif833OaeS_o0VdbrWCCK8iPpNxpEUdfFDZYww5rTYB4xVhZtBqo Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 653f8f009951490e9ea08965be52259b Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:10.700354 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/653f8f009951490e9ea08965be52259b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/653f8f009951490e9ea08965be52259b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_653f8f009951490e9ea08965be52259b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/653f8f009951490e9ea08965be52259b"}]}] Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 653f8f009951490e9ea08965be52259b Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminTestJSON-812209153-project-admin Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: ec9beaa659804f59926c1393600683c1 Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminTestJSON-812209153-project-admin Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: exception: Aggregate 5 could not be found. Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5'} Oct 12 08:45:10.701946 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:10.702936 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 12 08:45:10.704342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.707123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a421aab2-5461-4447-a639-416b1b8f140c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:10.708244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a421aab2-5461-4447-a639-416b1b8f140c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.042451 Oct 12 08:45:10.709322 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 124/194] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:45:10 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:45:10.718570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:10.727035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-774a6ba5-f6e1-42c9-882e-512ed9de8b75 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Calling method '.version_select at 0x7f98494dc790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.734344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774a6ba5-f6e1-42c9-882e-512ed9de8b75 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.735093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774a6ba5-f6e1-42c9-882e-512ed9de8b75 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.735693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774a6ba5-f6e1-42c9-882e-512ed9de8b75 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.738769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774a6ba5-f6e1-42c9-882e-512ed9de8b75 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.739397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774a6ba5-f6e1-42c9-882e-512ed9de8b75 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.741942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774a6ba5-f6e1-42c9-882e-512ed9de8b75 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.787405 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-774a6ba5-f6e1-42c9-882e-512ed9de8b75 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.076493 Oct 12 08:45:10.789777 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 125/195] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:10 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:10.794950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b310adf5-4fa0-4cc2-bdd0-159b2948a035 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.832875 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-b310adf5-4fa0-4cc2-bdd0-159b2948a035 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b310adf5-4fa0-4cc2-bdd0-159b2948a035 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Request method failure captured: Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5nu41wcJayPzO5wGk25yqCoTHW5SvL4SQkSVkLUGmw_U1lA1xKQXKjaTpPBzWOzEnqZQW7wG0BhV3FIXq3_t5R2BKpq0dXkEM87pH00YzSjm_cf1et_BxHlEAiif833OaeS_o0VdbrWCCK8iPpNxpEUdfFDZYww5rTYB4xVhZtBqo Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 653f8f009951490e9ea08965be52259b Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:10.835284 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/653f8f009951490e9ea08965be52259b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/653f8f009951490e9ea08965be52259b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_653f8f009951490e9ea08965be52259b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/653f8f009951490e9ea08965be52259b"}]}] Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 653f8f009951490e9ea08965be52259b Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminTestJSON-812209153-project-admin Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: ec9beaa659804f59926c1393600683c1 Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminTestJSON-812209153-project-admin Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: exception: Aggregate 5 could not be found. Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5'} Oct 12 08:45:10.836898 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:10.837800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:10.839061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:10.840357 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:10.840357 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:10.840357 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:10.840357 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 12 08:45:10.840357 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:10.842363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b310adf5-4fa0-4cc2-bdd0-159b2948a035 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:10.843373 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b310adf5-4fa0-4cc2-bdd0-159b2948a035 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.052467 Oct 12 08:45:10.845021 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 126/196] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:45:10.852597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-456ccdaf-c36b-419f-9d56-bd936339484f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Calling method '.version_select at 0x7f98499a5c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.856458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-456ccdaf-c36b-419f-9d56-bd936339484f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.857113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-456ccdaf-c36b-419f-9d56-bd936339484f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.857726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-456ccdaf-c36b-419f-9d56-bd936339484f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.858614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-456ccdaf-c36b-419f-9d56-bd936339484f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.859249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-456ccdaf-c36b-419f-9d56-bd936339484f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.859814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-456ccdaf-c36b-419f-9d56-bd936339484f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.900606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-456ccdaf-c36b-419f-9d56-bd936339484f tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.054288 Oct 12 08:45:10.901347 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 127/197] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 12 08:45:10 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:10.906185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:10.907067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:10.923956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.924943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.927314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.928522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:10.929193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:10.929843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:10.950718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:10.961713 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3052a62-1378-4f3b-9dfc-736bbf91da30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.604074 Oct 12 08:45:10.964090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 71/198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:10 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:10.977804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e15a6ebe-c627-43c8-bca1-904556a2ced8 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-440295761", "name": "tempest-test_aggregate-10351874"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:11.006800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:11.007428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:11.007971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:11.015598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-e15a6ebe-c627-43c8-bca1-904556a2ced8 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid ccf5bdd4-acb5-4a49-9ee2-0aa3352ec704 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:11.016500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lazy-loading 'fault' on Instance uuid e92a4de5-5552-4f10-afa8-0d986c065129 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:11.073955 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e15a6ebe-c627-43c8-bca1-904556a2ced8 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.108293 Oct 12 08:45:11.076211 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 72/199] 10.222.0.40 () {60 vars in 1165 bytes} [Wed Oct 12 08:45:10 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:11.083104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ff104135-c21f-4ad4-9fd2-1770682d16d0 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Calling method '.version_select at 0x7f9849660670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.092659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff104135-c21f-4ad4-9fd2-1770682d16d0 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:11.093557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff104135-c21f-4ad4-9fd2-1770682d16d0 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:11.094868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff104135-c21f-4ad4-9fd2-1770682d16d0 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:11.110334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff104135-c21f-4ad4-9fd2-1770682d16d0 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:11.111183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff104135-c21f-4ad4-9fd2-1770682d16d0 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:11.111890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff104135-c21f-4ad4-9fd2-1770682d16d0 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:11.146168 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ff104135-c21f-4ad4-9fd2-1770682d16d0 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-h1-858383-10" status: 200 len: 471 microversion: 2.1 time: 0.068510 Oct 12 08:45:11.147809 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 73/200] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 12 08:45:11 2022] GET /compute/v2.1/os-hosts/n-h1-858383-10 => generated 471 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:11.156236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1f6e0528-5eec-4dc4-b37b-79f24cb62cf2 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.189186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1f6e0528-5eec-4dc4-b37b-79f24cb62cf2 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.039076 Oct 12 08:45:11.191491 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 74/201] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:11 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:11.197459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4e2cc9ef-9143-453f-892f-ab22ad7f5394 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Calling method '.version_select at 0x7f9849660310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.209076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2cc9ef-9143-453f-892f-ab22ad7f5394 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:11.209926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2cc9ef-9143-453f-892f-ab22ad7f5394 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:11.210574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2cc9ef-9143-453f-892f-ab22ad7f5394 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:11.222819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=86,nova_api:DELETE=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:11.227459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2cc9ef-9143-453f-892f-ab22ad7f5394 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:11.228259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2cc9ef-9143-453f-892f-ab22ad7f5394 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:11.228902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2cc9ef-9143-453f-892f-ab22ad7f5394 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:11.254848 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4e2cc9ef-9143-453f-892f-ab22ad7f5394 tempest-HostsAdminTestJSON-1241090801 tempest-HostsAdminTestJSON-1241090801-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-h2-858383-10" status: 200 len: 603 microversion: 2.1 time: 0.061127 Oct 12 08:45:11.261969 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 75/202] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 12 08:45:11 2022] GET /compute/v2.1/os-hosts/n-h2-858383-10 => generated 603 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:11.265251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:11.276375 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2259e5ac-f72c-4504-9a95-f9cf26a2d1bf tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 200 len: 1310 microversion: 2.1 time: 0.373680 Oct 12 08:45:11.279499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-79d1d028-62e8-4d15-acfa-26096a5f050c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.280665 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 128/203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:10 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 1310 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:11.290040 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-79d1d028-62e8-4d15-acfa-26096a5f050c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-79d1d028-62e8-4d15-acfa-26096a5f050c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Request method failure captured: Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5nu41wcJayPzO5wGk25yqCoTHW5SvL4SQkSVkLUGmw_U1lA1xKQXKjaTpPBzWOzEnqZQW7wG0BhV3FIXq3_t5R2BKpq0dXkEM87pH00YzSjm_cf1et_BxHlEAiif833OaeS_o0VdbrWCCK8iPpNxpEUdfFDZYww5rTYB4xVhZtBqo Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 653f8f009951490e9ea08965be52259b Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:45:11.296101 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/653f8f009951490e9ea08965be52259b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/653f8f009951490e9ea08965be52259b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_653f8f009951490e9ea08965be52259b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/653f8f009951490e9ea08965be52259b"}]}] Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 653f8f009951490e9ea08965be52259b Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminTestJSON-812209153-project-admin Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: ec9beaa659804f59926c1393600683c1 Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminTestJSON-812209153-project-admin Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: exception: Aggregate 6 could not be found. Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '6'} Oct 12 08:45:11.297473 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:11.298510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 12 08:45:11.299701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.301367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-79d1d028-62e8-4d15-acfa-26096a5f050c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:11.302456 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-79d1d028-62e8-4d15-acfa-26096a5f050c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.045513 Oct 12 08:45:11.303213 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 76/204] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:45:11 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:45:11.313936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63e2b396-d8d5-40b1-b204-5198b3ddfe5d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.323702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.324651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:11.335235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:11.336128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:11.336786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:11.338033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:11.338695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:11.339455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:11.346781 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-63e2b396-d8d5-40b1-b204-5198b3ddfe5d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63e2b396-d8d5-40b1-b204-5198b3ddfe5d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Request method failure captured: Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5nu41wcJayPzO5wGk25yqCoTHW5SvL4SQkSVkLUGmw_U1lA1xKQXKjaTpPBzWOzEnqZQW7wG0BhV3FIXq3_t5R2BKpq0dXkEM87pH00YzSjm_cf1et_BxHlEAiif833OaeS_o0VdbrWCCK8iPpNxpEUdfFDZYww5rTYB4xVhZtBqo Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 653f8f009951490e9ea08965be52259b Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:11.348487 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/653f8f009951490e9ea08965be52259b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/653f8f009951490e9ea08965be52259b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_653f8f009951490e9ea08965be52259b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/653f8f009951490e9ea08965be52259b"}]}] Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 653f8f009951490e9ea08965be52259b Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-812209153 Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminTestJSON-812209153-project-admin Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: ec9beaa659804f59926c1393600683c1 Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminTestJSON-812209153-project-admin Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: exception: Aggregate 6 could not be found. Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '6'} Oct 12 08:45:11.349901 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:11.350736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:11.351910 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:11.353269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:11.353269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:11.353269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:11.353269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 12 08:45:11.353269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:11.354328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63e2b396-d8d5-40b1-b204-5198b3ddfe5d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:11.355337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-63e2b396-d8d5-40b1-b204-5198b3ddfe5d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.046967 Oct 12 08:45:11.356455 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 129/205] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:11 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 08:45:11.365927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d02b880-9ef7-4432-867d-1cc54642386b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1671233571"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:11.371388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.aggregate [None req-6d02b880-9ef7-4432-867d-1cc54642386b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid 86cec96b-60e0-4f71-8802-101614a91709 for aggregate {{(pid=127006) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:11.417698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d02b880-9ef7-4432-867d-1cc54642386b tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056139 Oct 12 08:45:11.418483 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 130/206] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:11.430165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-679f2654-736a-4b22-a656-c04e7ba5f63e tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.450538 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-679f2654-736a-4b22-a656-c04e7ba5f63e tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 227 microversion: 2.1 time: 0.024376 Oct 12 08:45:11.451435 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 131/207] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:45:11 2022] GET /compute/v2.1/os-aggregates/7 => generated 227 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:11.463261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b907c4ac-687d-4dba-8abd-9a354011cc4d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:11.508473 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b907c4ac-687d-4dba-8abd-9a354011cc4d tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 265 microversion: 2.1 time: 0.048846 Oct 12 08:45:11.509525 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 132/208] 10.222.0.40 () {60 vars in 1191 bytes} [Wed Oct 12 08:45:11 2022] POST /compute/v2.1/os-aggregates/7/action => generated 265 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:11.522124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0519637-ad27-4e6c-a665-3df33434e3f3 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.525976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:11.546521 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0519637-ad27-4e6c-a665-3df33434e3f3 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 241 microversion: 2.1 time: 0.028999 Oct 12 08:45:11.548322 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 133/209] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:45:11 2022] GET /compute/v2.1/os-aggregates/7 => generated 241 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:11.560787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0174bf62-76cf-449f-9894-3aeae73a71c5 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.605429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0174bf62-76cf-449f-9894-3aeae73a71c5 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.048803 Oct 12 08:45:11.611168 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 134/210] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:11.624848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7b5a8052-9540-452e-bb17-ac9b9b06b965 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1387970407", "availability_zone": "tempest-test_az-2066508438"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:11.635441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.aggregate [None req-7b5a8052-9540-452e-bb17-ac9b9b06b965 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid c1b12588-8044-410f-aa7e-7787aff12e11 for aggregate {{(pid=127006) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:11.702407 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7b5a8052-9540-452e-bb17-ac9b9b06b965 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.087365 Oct 12 08:45:11.703230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 135/211] 10.222.0.40 () {60 vars in 1165 bytes} [Wed Oct 12 08:45:11 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:11.717531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-538d74ec-0885-4b7d-820a-925a3aee294f tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1387970407_new", "availability_zone": "tempest-test_az-2066508438_new"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:11.874910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-538d74ec-0885-4b7d-820a-925a3aee294f tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:11.875401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-538d74ec-0885-4b7d-820a-925a3aee294f tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:11.876311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-538d74ec-0885-4b7d-820a-925a3aee294f tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:11.920835 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-538d74ec-0885-4b7d-820a-925a3aee294f tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/8" status: 200 len: 336 microversion: 2.1 time: 0.206456 Oct 12 08:45:11.924135 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 136/212] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:45:11 2022] PUT /compute/v2.1/os-aggregates/8 => generated 336 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:11.937046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d246888f-c945-4d8e-8aa2-325753f734c1 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.945371 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d246888f-c945-4d8e-8aa2-325753f734c1 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.013363 Oct 12 08:45:11.946346 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 137/213] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:45:11 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:11.959869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed2c8885-873f-4ac2-82d3-dbcd98e79de9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:11.993341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed2c8885-873f-4ac2-82d3-dbcd98e79de9 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.038472 Oct 12 08:45:11.994480 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 138/214] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:12.000762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:12.001469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:12.011362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:12.011595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:12.011854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:12.012803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:12.013263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:12.013710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:12.199234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:12.207677 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5277ee27-1b67-41cb-8930-e298027e1949 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.888321 Oct 12 08:45:12.222210 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 77/215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:11 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:12.230392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-743792a3-aa51-4aa9-a960-f6b87ab6398c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1342801783"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:12.235148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-743792a3-aa51-4aa9-a960-f6b87ab6398c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Generated uuid cae8dd9d-0b80-42b6-8212-cb3c40576efe for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:12.268417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:12.272247 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-743792a3-aa51-4aa9-a960-f6b87ab6398c tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047274 Oct 12 08:45:12.273545 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 78/216] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:12.278053 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66d61163-4b1a-4a98-b854-14fd68c11222 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.282386 Oct 12 08:45:12.296356 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 139/217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:11 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:12.306944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d8045f0-7808-49e8-ba6d-665b505f7480 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:12.309243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:12.309904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:12.318803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:12.319222 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d8045f0-7808-49e8-ba6d-665b505f7480 tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.038919 Oct 12 08:45:12.320794 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 79/218] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:45:12 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:12.321004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:12.321510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:12.327327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:12.327814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:12.329542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:12.332930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a657c8f-0401-409c-bc37-4994dee537ee tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:12.368092 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] HTTP exception thrown: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Request method failure captured: Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 HTTP/1.1 Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5vMWpvxCxSvLidP5ngALHrhXV_yZx9DwHVHwptP3vVEMgnB_w8iEd6U-Rt8Ca9RMbz2l9LtU8_hEwsRXoQ-7UkmMa_0CwH9aI2XbLQ59UyxHdmixV5aGAFMCCbSZ9NfLc-K6FvC4AoMr7mfEeZP-v1RKrPdfeauO1CTWKJwB_uIHg Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:45:12.369679 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}] Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 088ae1b875ce4e68a12c234e5cf405b2 Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:12.370896 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'e92a4de5-5552-4f10-afa8-0d986c065129'} Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:12.371573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:12.376615 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.377876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Returning 404 to user: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:12.377876 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0731fb81-ef68-4697-9c7a-7917ea1fbd0a tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 404 len: 111 microversion: 2.1 time: 0.066312 Oct 12 08:45:12.401426 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 140/219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:12 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:12.405392 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7a657c8f-0401-409c-bc37-4994dee537ee tempest-AggregatesAdminTestJSON-812209153 tempest-AggregatesAdminTestJSON-812209153-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.077680 Oct 12 08:45:12.406719 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 80/220] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:12 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 08:45:12.415584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:12.416362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:12.425116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:12.425909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:12.426548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:12.427499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:12.428290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:12.428880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:12.446972 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] HTTP exception thrown: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Request method failure captured: Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 HTTP/1.1 Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn5lRRPKWdInQbx8M7BsLVp4F3QuQZe42j_DQ4flUih2_k09NvJOTLqeAMay9bVH_BG0AeBa_VnrR2LNzThLxeqJYOpQw7wOuQpbrDKFVOgjvyumupkBbJ944LAUs7K9Q7uDA6cJ9_CQgum5dSi7wBvWcZP6jJvBZ47fAvUEJQADX_g Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: cb9700f762654d3b8029348771a812e2 Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:45:12.449222 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb9700f762654d3b8029348771a812e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cb9700f762654d3b8029348771a812e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cb9700f762654d3b8029348771a812e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb9700f762654d3b8029348771a812e2"}]}] Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: cb9700f762654d3b8029348771a812e2 Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminTestJSON-81662548-project Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d3a7ae2797b8472c9e9fc8b612d68b5b Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminTestJSON-81662548-project Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.450658 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '6206e61f-f266-4fec-9216-f8e828a5f4e1'} Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:12.451635 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.453000 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.455581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Returning 404 to user: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:12.456705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-adcb2472-4af8-4172-8175-15cac38a4c65 tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 404 len: 111 microversion: 2.1 time: 0.045508 Oct 12 08:45:12.457880 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 141/221] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:45:12 2022] DELETE /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:12.469983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:12.470814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] [instance: 6206e61f-f266-4fec-9216-f8e828a5f4e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:12.480680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:12.481512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:12.482134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:12.483164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:12.483931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:12.484642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:12.515857 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] HTTP exception thrown: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Request method failure captured: Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 HTTP/1.1 Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5lRRPKWdInQbx8M7BsLVp4F3QuQZe42j_DQ4flUih2_k09NvJOTLqeAMay9bVH_BG0AeBa_VnrR2LNzThLxeqJYOpQw7wOuQpbrDKFVOgjvyumupkBbJ944LAUs7K9Q7uDA6cJ9_CQgum5dSi7wBvWcZP6jJvBZ47fAvUEJQADX_g Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: cb9700f762654d3b8029348771a812e2 Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:12.525389 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb9700f762654d3b8029348771a812e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cb9700f762654d3b8029348771a812e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cb9700f762654d3b8029348771a812e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb9700f762654d3b8029348771a812e2"}]}] Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: cb9700f762654d3b8029348771a812e2 Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-81662548 Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminTestJSON-81662548-project Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d3a7ae2797b8472c9e9fc8b612d68b5b Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminTestJSON-81662548-project Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.526602 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '6206e61f-f266-4fec-9216-f8e828a5f4e1'} Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:12.527246 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. Oct 12 08:45:12.528243 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:12.532398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] Returning 404 to user: Instance 6206e61f-f266-4fec-9216-f8e828a5f4e1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:12.533570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-706b9cd0-cb59-4999-a981-2c38e386e55b tempest-AggregatesAdminTestJSON-81662548 tempest-AggregatesAdminTestJSON-81662548-project] 10.222.0.40 "GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1" status: 404 len: 111 microversion: 2.1 time: 0.070506 Oct 12 08:45:12.537310 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 81/222] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:12 2022] GET /compute/v2.1/servers/6206e61f-f266-4fec-9216-f8e828a5f4e1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:12.567338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-84186384", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:12.641161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:45:13.242279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:13.243517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:13.261416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:13.262278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:13.263663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:13.266527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:13.271027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:13.274846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:13.484929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:45:13.486269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:45:13.487742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:45:13.488442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:45:13.489693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:45:13.512360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:13.514561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:13.517495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:13.518632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:13.521626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:13.522237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:13.555007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:13.578251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Getting quotas for project 5568d3dd87fc4fc69b3ef8539fa45fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:45:13.619521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Getting quotas for user 088ae1b875ce4e68a12c234e5cf405b2 and project 5568d3dd87fc4fc69b3ef8539fa45fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:45:13.656100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:45:13.659231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:45:13.722891 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c034152-72ae-4898-9b99-8e5e6c916b79 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160117 Oct 12 08:45:13.729713 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 142/223] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:45:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:45:13.741478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:13.743948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:13.758110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:13.759994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:13.759994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:13.760749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:13.761114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:13.761693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:14.155386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:14.170168 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f55f2067-6914-42a1-949e-346dcf4d36a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.939438 Oct 12 08:45:14.195624 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 82/224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:13 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:14.251885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32f02c10-7917-4465-adbe-cbc718448f42 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:14.265949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-32f02c10-7917-4465-adbe-cbc718448f42 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:14.353068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:14.373087 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-600951ab-fb6e-43fb-aea4-7d4125a84ce8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.647431 Oct 12 08:45:14.374485 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 143/225] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:13 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:14.507902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-32f02c10-7917-4465-adbe-cbc718448f42 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:14.520248 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32f02c10-7917-4465-adbe-cbc718448f42 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1218 microversion: 2.1 time: 0.321410 Oct 12 08:45:14.526483 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 83/226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:14 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1218 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:15.201641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:15.202553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:15.216009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:15.217588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:15.218275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:15.220357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:15.224123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:15.225523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:15.396416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:15.397025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:15.405186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:15.412502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:15.413066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:15.413942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:15.414409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:15.414831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:15.981345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:15.992092 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1eeac223-f807-4b0b-9a72-cc4327250890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.796378 Oct 12 08:45:15.992690 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 144/227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:15 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:16.007081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:16.014279 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f0a44152-f396-4010-93ba-98092bfaf24a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.620989 Oct 12 08:45:16.017006 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 84/228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:15 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:16.040289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:16.041358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:16.060156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:16.060649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:16.061086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:16.061869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:16.062490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:16.063013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:16.796205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:16.807958 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-41f3c072-b629-4389-a670-6b8260d1a59c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1276 microversion: 2.1 time: 0.814201 Oct 12 08:45:16.808559 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 145/229] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:15 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1276 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:17.027341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:17.028499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:17.042910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:17.043837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:17.097039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:17.097538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:17.097996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:17.101483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:17.102037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:17.110546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:17.113644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:17.116616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:17.117184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:17.117686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:17.118210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:17.122822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:17.942358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:17.951274 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-670492e7-f137-4166-9002-8656a93a0ec3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.914510 Oct 12 08:45:17.953164 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 146/230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:17 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:17.959247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2146997413", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "81276253", "adminPass": "***", "networks": [{"uuid": "c94bb784-0634-4fb2-8a38-492c7a8c22d8"}], "security_groups": [{"name": "tempest-securitygroup--2013115360"}], "key_name": "tempest-keypair-1094760699", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:17.973385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:17.983932 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-09b08ffd-3df5-4d13-91c7-f34c4a6268a6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.968501 Oct 12 08:45:17.984841 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 85/231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:17 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:17.992010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:17.998747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:18.029873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:18.030455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:18.030812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:18.031522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:18.031971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:18.032395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:18.279514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] validate_networks() for [('c94bb784-0634-4fb2-8a38-492c7a8c22d8', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:45:18.426289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:18.452669 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-60cda65d-bd6a-4356-bc3b-1a6d57a10f87 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1276 microversion: 2.1 time: 0.463266 Oct 12 08:45:18.454088 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 86/232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:17 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1276 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:18.465828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b0df70d1-764e-4be2-81d0-81a1a40d54b1 req-6863ccd5-02f7-42f2-9c3b-b54bb8a9cc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c784c0e6-f80d-4d62-8238-7d0977b08110", "name": "network-vif-plugged", "status": "completed", "tag": "0fd5e509-91df-45aa-8954-38a9aed1874e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:18.501299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b0df70d1-764e-4be2-81d0-81a1a40d54b1 req-6863ccd5-02f7-42f2-9c3b-b54bb8a9cc2f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:18.503254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b0df70d1-764e-4be2-81d0-81a1a40d54b1 req-6863ccd5-02f7-42f2-9c3b-b54bb8a9cc2f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:18.505159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b0df70d1-764e-4be2-81d0-81a1a40d54b1 req-6863ccd5-02f7-42f2-9c3b-b54bb8a9cc2f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:18.553252 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b0df70d1-764e-4be2-81d0-81a1a40d54b1 req-6863ccd5-02f7-42f2-9c3b-b54bb8a9cc2f service nova] Creating event network-vif-plugged:0fd5e509-91df-45aa-8954-38a9aed1874e for instance c784c0e6-f80d-4d62-8238-7d0977b08110 on n-h2-858383-10 Oct 12 08:45:18.574284 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b0df70d1-764e-4be2-81d0-81a1a40d54b1 req-6863ccd5-02f7-42f2-9c3b-b54bb8a9cc2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116705 Oct 12 08:45:18.577309 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 87/233] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:18.982917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:18.984414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:18.999648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:19.002020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:19.013925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:19.013925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:19.013925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:19.014257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:19.520553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:45:19.521907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:45:19.522403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:45:19.522806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:45:19.523211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:45:19.533826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:19.534425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:19.534929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:19.535721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:19.536244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:19.536736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:19.554463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Getting quotas for project 2fc11687869b49f697bd3a37b5f3e23e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:45:19.558733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Getting quotas for user bdcf977edf9f49cb8c2b3a645fd7db7f and project 2fc11687869b49f697bd3a37b5f3e23e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:45:19.571002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:45:19.573655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:45:19.632334 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0202598d-a39c-429b-aa1c-6347243f4d77 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.677608 Oct 12 08:45:19.633885 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 147/234] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:45:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:45:19.640164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:19.640969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:19.660094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:19.661462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:19.662350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:19.663250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:19.663998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:19.664701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:19.816817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:19.831262 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ced9f46-3380-48f9-8e1c-61c2ed46578d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.851593 Oct 12 08:45:19.853546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 88/235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:18 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:19.932891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:19.951307 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc0e2d49-f418-4110-b3a9-c3ca517624f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1314 microversion: 2.1 time: 0.314063 Oct 12 08:45:19.952223 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 148/236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:19 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:19.971229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:19.972407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:19.999870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.001629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.006174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.007813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.008879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.009590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.232913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f9849375af0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:20.238417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.239439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.240240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.263303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.263972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.264802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.318367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:20.336376 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5e0b2c9b-347d-477f-b69c-c0aa5e7cf13c tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.378510 Oct 12 08:45:20.337430 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 149/237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:19 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:20.405142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.411341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.415526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.453887 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-904e68ec-3ed6-460b-a0b0-04220b7b9289 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.596060 Oct 12 08:45:20.458150 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 89/238] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:20.480066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2684b6f6-ed15-4b5e-95e9-b1eebc61006d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:20.480844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2684b6f6-ed15-4b5e-95e9-b1eebc61006d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:20.545041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Calling method '.version_select at 0x7f98494009d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:20.549561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.555077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.555530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.586823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.587315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.587923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.605540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.606258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.607057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.616424 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04e7c113-a333-4e0b-ab6c-e50387ef4cc1 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1429 microversion: 2.41 time: 0.277198 Oct 12 08:45:20.617097 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 150/239] 10.222.0.40 () {60 vars in 1208 bytes} [Wed Oct 12 08:45:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1429 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:20.633684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2684b6f6-ed15-4b5e-95e9-b1eebc61006d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:20.637669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f9849400ee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:20.640188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.640815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.641710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.643821 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2684b6f6-ed15-4b5e-95e9-b1eebc61006d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1261 microversion: 2.1 time: 0.168394 Oct 12 08:45:20.645736 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 90/240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:20 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:20.651774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6034f1ef-4db3-450a-8672-2d2100ee46b0 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2053417193"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:20.658476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-6034f1ef-4db3-450a-8672-2d2100ee46b0 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Generated uuid e069e836-6900-4f01-9070-526f29f6d7ac for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:20.687307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.688207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.688828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.700218 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6034f1ef-4db3-450a-8672-2d2100ee46b0 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.053127 Oct 12 08:45:20.701492 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 91/241] 10.222.0.40 () {62 vars in 1205 bytes} [Wed Oct 12 08:45:20 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:20.722240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f929b73d-28d6-4bb2-b963-190b4e830a46 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-555904397"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:20.723735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.724459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.726224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.737505 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f48b3fba-3eec-4676-86f3-5ae43e698e28 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.118923 Oct 12 08:45:20.738411 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 151/242] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 12 08:45:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:20.756302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f9849400b80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:20.758191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.758678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.759210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.789207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=4,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:20.790589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.791078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.791613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.825300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.825718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.826159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.846298 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45302586-88ef-45f5-91fe-f17c4a6d850a tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.093361 Oct 12 08:45:20.847242 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 152/243] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:20.870947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54e3f0b5-1151-4b48-85da-c0c8239785da tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f98494d8820>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:20.873051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54e3f0b5-1151-4b48-85da-c0c8239785da tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.873864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54e3f0b5-1151-4b48-85da-c0c8239785da tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.874454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54e3f0b5-1151-4b48-85da-c0c8239785da tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.904518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54e3f0b5-1151-4b48-85da-c0c8239785da tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.905279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54e3f0b5-1151-4b48-85da-c0c8239785da tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.905893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54e3f0b5-1151-4b48-85da-c0c8239785da tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.913373 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-54e3f0b5-1151-4b48-85da-c0c8239785da tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.046787 Oct 12 08:45:20.914762 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 153/244] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:20.919748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:20.920629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:20.930288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.931129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.931957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.932877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:20.933662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:20.934238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:20.996646 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f929b73d-28d6-4bb2-b963-190b4e830a46 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 299 microversion: 2.41 time: 0.280568 Oct 12 08:45:21.005834 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 92/245] 10.222.0.40 () {62 vars in 1213 bytes} [Wed Oct 12 08:45:20 2022] PUT /compute/v2.1/os-aggregates/10 => generated 299 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:21.011312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9fba8c1-b6f9-4fef-9f58-49f4bd799e5b tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f984937fe50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:21.014835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9fba8c1-b6f9-4fef-9f58-49f4bd799e5b tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.015557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9fba8c1-b6f9-4fef-9f58-49f4bd799e5b tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.016140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9fba8c1-b6f9-4fef-9f58-49f4bd799e5b tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.061070 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9fba8c1-b6f9-4fef-9f58-49f4bd799e5b tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.052937 Oct 12 08:45:21.071719 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 93/246] 10.222.0.40 () {58 vars in 1179 bytes} [Wed Oct 12 08:45:21 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:21.080974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:21.084030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:21.102534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.103041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.104731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.104731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.104731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.104731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.265215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:21.273678 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-929cbc30-8f07-4cab-8386-9d48d444b78d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.357493 Oct 12 08:45:21.280481 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 154/247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:20 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:21.291409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-afbb8f72-64ac-4875-893f-babcd3cd8638 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:21.307270 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-afbb8f72-64ac-4875-893f-babcd3cd8638 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 299 microversion: 2.41 time: 0.025259 Oct 12 08:45:21.310230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 155/248] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 12 08:45:21 2022] GET /compute/v2.1/os-aggregates/10 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:21.321300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f9849876e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:21.323325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.323856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.328571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.360549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.361049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.361524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.374840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.375670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.376245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.384203 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cb2360a6-fc5f-47a2-abf6-4870fb3ac12f tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.072730 Oct 12 08:45:21.385312 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 156/249] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:21.394464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-49c7a235-a096-426c-b93c-22f8f5da6109 req-ebaaf347-33e2-426a-9620-08a2cfd2a3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744cfd99-597c-4504-af66-6ba5723fcbee", "name": "network-vif-plugged", "status": "completed", "tag": "865792b9-525d-4c68-888b-8212face2199"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:21.405868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-49c7a235-a096-426c-b93c-22f8f5da6109 req-ebaaf347-33e2-426a-9620-08a2cfd2a3ac service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.406662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-49c7a235-a096-426c-b93c-22f8f5da6109 req-ebaaf347-33e2-426a-9620-08a2cfd2a3ac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.407296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-49c7a235-a096-426c-b93c-22f8f5da6109 req-ebaaf347-33e2-426a-9620-08a2cfd2a3ac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.420148 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-49c7a235-a096-426c-b93c-22f8f5da6109 req-ebaaf347-33e2-426a-9620-08a2cfd2a3ac service nova] Creating event network-vif-plugged:865792b9-525d-4c68-888b-8212face2199 for instance 744cfd99-597c-4504-af66-6ba5723fcbee on n-h1-858383-10 Oct 12 08:45:21.428697 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-49c7a235-a096-426c-b93c-22f8f5da6109 req-ebaaf347-33e2-426a-9620-08a2cfd2a3ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041351 Oct 12 08:45:21.429611 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 157/250] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:21.435724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d2b1eb7-6a3e-42d4-8b7c-624f68ec5947 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:21.448144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d2b1eb7-6a3e-42d4-8b7c-624f68ec5947 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.448892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d2b1eb7-6a3e-42d4-8b7c-624f68ec5947 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.449573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d2b1eb7-6a3e-42d4-8b7c-624f68ec5947 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.641301 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d2b1eb7-6a3e-42d4-8b7c-624f68ec5947 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 315 microversion: 2.41 time: 0.210164 Oct 12 08:45:21.650428 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 158/251] 10.222.0.40 () {62 vars in 1235 bytes} [Wed Oct 12 08:45:21 2022] POST /compute/v2.1/os-aggregates/10/action => generated 315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:21.655287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:21.656164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:21.670365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.671516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.672175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.673887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.674882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.675600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.712064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:21.730315 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8333f9c1-ccbf-4c51-83bb-569c292a6540 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1464 microversion: 2.1 time: 0.657263 Oct 12 08:45:21.731523 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 94/252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:21 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1464 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:21.736171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9f15dd4b-a96c-4511-84ce-f3fbacac06dd tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f984937f040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:21.738443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f15dd4b-a96c-4511-84ce-f3fbacac06dd tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.739171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f15dd4b-a96c-4511-84ce-f3fbacac06dd tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.739464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f15dd4b-a96c-4511-84ce-f3fbacac06dd tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.742636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:21.785594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f15dd4b-a96c-4511-84ce-f3fbacac06dd tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.786967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f15dd4b-a96c-4511-84ce-f3fbacac06dd tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.787617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f15dd4b-a96c-4511-84ce-f3fbacac06dd tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.794852 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9f15dd4b-a96c-4511-84ce-f3fbacac06dd tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.062135 Oct 12 08:45:21.806038 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 95/253] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:21.811484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ecbf88de-4e60-4a1b-9be8-e211a5f575d3 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:21.823981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ecbf88de-4e60-4a1b-9be8-e211a5f575d3 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.824666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ecbf88de-4e60-4a1b-9be8-e211a5f575d3 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.825203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ecbf88de-4e60-4a1b-9be8-e211a5f575d3 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.930615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:21.955708 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c5094380-0b7b-4058-b6e7-262f7cb658dd tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.308109 Oct 12 08:45:21.956855 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 159/254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:21 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:21.963009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:21.963900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:21.977339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.978129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.979271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:21.980610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:21.981264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:21.983624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.037676 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ecbf88de-4e60-4a1b-9be8-e211a5f575d3 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 299 microversion: 2.41 time: 0.227757 Oct 12 08:45:22.039428 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 96/255] 10.222.0.40 () {62 vars in 1235 bytes} [Wed Oct 12 08:45:21 2022] POST /compute/v2.1/os-aggregates/10/action => generated 299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:22.061933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:22.064121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:22.090325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.092920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.095000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.096521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.097706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.102438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.158459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:22.178246 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e8439bbe-338a-4fc1-9a9c-8ce9d6f1c766 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1331 microversion: 2.1 time: 0.219697 Oct 12 08:45:22.179745 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 160/256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:21 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1331 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:22.186363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1caf941-928c-44ba-9b4a-ee71eb9ccf5d tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f984989eaf0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:22.188690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1caf941-928c-44ba-9b4a-ee71eb9ccf5d tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.189362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1caf941-928c-44ba-9b4a-ee71eb9ccf5d tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.190758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1caf941-928c-44ba-9b4a-ee71eb9ccf5d tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.224855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1caf941-928c-44ba-9b4a-ee71eb9ccf5d tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.226001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1caf941-928c-44ba-9b4a-ee71eb9ccf5d tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.231173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1caf941-928c-44ba-9b4a-ee71eb9ccf5d tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.239221 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d1caf941-928c-44ba-9b4a-ee71eb9ccf5d tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.058269 Oct 12 08:45:22.240755 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 161/257] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:22 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:22.251976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a920cfe-5d0b-450a-82d5-ba375e088218 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:22.287955 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a920cfe-5d0b-450a-82d5-ba375e088218 tempest-AggregatesAdminTestV241-2017821792 tempest-AggregatesAdminTestV241-2017821792-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.41 time: 0.045779 Oct 12 08:45:22.292814 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 162/258] 10.222.0.40 () {60 vars in 1196 bytes} [Wed Oct 12 08:45:22 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:22.312861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Calling method '.version_select at 0x7f984979a3a0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:22.317738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.320190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.321355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.358433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.358932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.359376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.389111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.389631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.390059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.393325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:22.473312 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86090548-da2e-4247-a0f4-5c453ddcf2a7 tempest-HypervisorAdminTestJSON-4779407 tempest-HypervisorAdminTestJSON-4779407-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.183077 Oct 12 08:45:22.481668 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 163/259] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 12 08:45:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:22.487490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:22.490247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:22.505907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.506653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.507830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.509337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.510476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.511215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.880786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:22.891119 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f912882-0f6a-4aac-8989-1c03c5d1da74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1313 microversion: 2.1 time: 0.408013 Oct 12 08:45:22.892049 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 164/260] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:22 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:22.981060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:22.981788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:22.991121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.992110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.992831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:22.994436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:22.995696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:22.996372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:23.327136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:23.342535 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4c958a74-c40d-49d3-ac86-cf65176a3871 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1464 microversion: 2.1 time: 1.301713 Oct 12 08:45:23.344518 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 97/261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:22 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1464 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:23.357124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:23.358085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:23.388897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:23.389426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:23.389946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:23.391088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:23.391691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:23.392264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:23.462680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:23.472582 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae44a876-bc87-4231-a966-a26985a55052 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.496588 Oct 12 08:45:23.473165 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 165/262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:22 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:23.572245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1767816424", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b362992b-616f-4d7e-98f1-7465d511f00b"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:23.586419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:23.595480 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f813227c-05e5-46b0-b19c-b5b167a66530 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1319 microversion: 2.1 time: 0.248682 Oct 12 08:45:23.599760 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 98/263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:23 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:23.653803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:45:23.917596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:23.918667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:23.925457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:23.926272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:23.927178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:23.928541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:23.929897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:23.932056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:24.063968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:45:24.064448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:45:24.068787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:45:24.069239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:45:24.069836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:45:24.080052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:24.080813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:24.081415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:24.082360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:24.082982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:24.083569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:24.109200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Getting quotas for project b4cc976e520e4b7ea741cdc605abccc6. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:45:24.116109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Getting quotas for user 12321f04fa1844098fb5c2585caae367 and project b4cc976e520e4b7ea741cdc605abccc6. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:45:24.133039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:45:24.136374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:45:24.195820 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0aa42d0-d1bd-4cbe-a344-cfbfbc972a41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631412 Oct 12 08:45:24.205093 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 166/264] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:45:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:45:24.212847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b6e0c383-2427-4c5f-84ab-8404e2f3f55b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:24.218416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b6e0c383-2427-4c5f-84ab-8404e2f3f55b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:24.305259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b6e0c383-2427-4c5f-84ab-8404e2f3f55b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:24.316676 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b6e0c383-2427-4c5f-84ab-8404e2f3f55b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1214 microversion: 2.1 time: 0.109074 Oct 12 08:45:24.317761 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 167/265] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:24 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:24.323665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ce56ca52-9f13-4606-8525-bad4fcead7d6 req-c8b95060-9736-4a2c-a70d-81b7b0598977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8eccbb-4ef3-4137-b92e-1542c10d2d0a", "tag": "19ab9c16-8c97-4f5f-9937-a5c9f12435a5"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:24.335391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce56ca52-9f13-4606-8525-bad4fcead7d6 req-c8b95060-9736-4a2c-a70d-81b7b0598977 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:24.336150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce56ca52-9f13-4606-8525-bad4fcead7d6 req-c8b95060-9736-4a2c-a70d-81b7b0598977 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:24.336789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce56ca52-9f13-4606-8525-bad4fcead7d6 req-c8b95060-9736-4a2c-a70d-81b7b0598977 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:24.349956 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ce56ca52-9f13-4606-8525-bad4fcead7d6 req-c8b95060-9736-4a2c-a70d-81b7b0598977 service nova] Creating event network-changed:19ab9c16-8c97-4f5f-9937-a5c9f12435a5 for instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a on n-h1-858383-10 Oct 12 08:45:24.355818 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ce56ca52-9f13-4606-8525-bad4fcead7d6 req-c8b95060-9736-4a2c-a70d-81b7b0598977 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036648 Oct 12 08:45:24.356804 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 168/266] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:24.500994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:24.502282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:24.516219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:24.517000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:24.517976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:24.518894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:24.520712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:24.522521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:24.835640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:24.847338 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e1a6ba92-ccd2-4526-8e56-14ce893648eb tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.354460 Oct 12 08:45:24.861597 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 169/267] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:24 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:24.861597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:24.861597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:24.875491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:24.876388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:24.876914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:24.877816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:24.878344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:24.878835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:24.930091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:24.953985 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05f96ccb-3385-4d87-9966-ba106e651f62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1463 microversion: 2.1 time: 1.035376 Oct 12 08:45:24.955588 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 99/268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:23 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1463 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:24.984346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:25.012133 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e370bd3c-f1ac-4081-9382-3b74799a0d1c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1319 microversion: 2.1 time: 0.162513 Oct 12 08:45:25.023330 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 170/269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:24 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:25.345159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:25.346636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:25.347319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:25.347991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:25.359987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:25.360776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:25.361160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:25.361739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:25.363411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:25.363534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:25.364382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:25.365946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:25.366059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:25.366595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:25.366725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:25.367046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:25.488979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:25.498685 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-156ce160-1f5b-4f22-9bea-22b92e025d7e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1266 microversion: 2.1 time: 0.159670 Oct 12 08:45:25.499990 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 171/270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:25 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:25.873075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:25.873842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:25.885837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:25.886863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:25.887553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:25.888848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:25.889647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:25.890427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:26.459167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:26.476095 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6f6f32b5-42f8-40c7-9dc2-70ad4a19b6e0 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.607009 Oct 12 08:45:26.478894 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 172/271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:25 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:26.486462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:26.487092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:26.494199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:26.494681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:26.495112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:26.495813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:26.496268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:26.496743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:26.886882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:26.899391 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b1add4d-0f86-4abd-a8cf-0e452eb7a7a1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1387 microversion: 2.1 time: 0.420514 Oct 12 08:45:26.910232 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 173/272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:26 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1387 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:26.917196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:26.917196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:26.950579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:26.952443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:26.954458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:26.956063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:26.958985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:26.959799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:27.157615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:27.159068 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-66abe66c-518a-4030-97d4-e560e8850097 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1616 microversion: 2.1 time: 2.182363 Oct 12 08:45:27.164749 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 100/273] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:24 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1616 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:27.170648 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24f82335-4a92-4166-843b-861f6bd8b24b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1272 microversion: 2.1 time: 0.259842 Oct 12 08:45:27.172866 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 174/274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:26 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:27.193659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:27.194289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:27.208672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:27.218856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:27.220834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:27.229068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:27.230977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:27.231522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:27.468815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'aefd7aaea5564dccac221b08755a4bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569b8de08dc140fa949d9c6b7a33887b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:27.469574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] flavor_id is None. Assuming migration. {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 12 08:45:27.470113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 08:45:27.865586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-961198545", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3ff61c2d-1adb-4df2-9b11-32c76cd9be4b"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:27.968075 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e25bb0b4-0e6d-4475-a9a4-5af9421f6e24 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee/action" status: 202 len: 0 microversion: 2.1 time: 0.777524 Oct 12 08:45:27.968718 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 175/275] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:45:27 2022] POST /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:45:27.992468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:27.993809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:28.014999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:28.015502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:28.015951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:28.016675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:28.017129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:28.025867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:28.387748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:28.398119 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a446376-92f1-460e-96ba-06a8106808ad tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.422561 Oct 12 08:45:28.398941 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 176/276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:27 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:28.430751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:28.437221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:28.451428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:28.452051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] validate_networks() for [('3ff61c2d-1adb-4df2-9b11-32c76cd9be4b', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:45:28.453813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:28.455843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:28.459901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:28.460550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:28.461158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:28.794832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:28.803508 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d628eb90-bd69-4d5b-bb56-8f212ac361cb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1387 microversion: 2.1 time: 0.386642 Oct 12 08:45:28.807408 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 177/277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:28 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1387 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:28.819697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:28.826673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:28.843178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:28.843733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:28.846261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:28.847117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:28.847608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:28.848217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:29.134272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:29.142556 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a458923-71a4-4cce-8e76-f5050e2309f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1472 microversion: 2.1 time: 0.333938 Oct 12 08:45:29.143147 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 178/278] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:28 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:29.152335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:29.157503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:29.173082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:29.173581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:29.174127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:29.179124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:29.179867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:29.180305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:30.225168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:30.253892 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b7be4687-c4c0-4706-9437-48a05d3f8345 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1314 microversion: 2.1 time: 1.109592 Oct 12 08:45:30.265339 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 179/279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:29 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1314 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:30.639858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:31.017886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ab8348ce-481c-44a5-8436-b7eca9758262 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:31.022053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8348ce-481c-44a5-8436-b7eca9758262 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.022549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8348ce-481c-44a5-8436-b7eca9758262 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.022983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8348ce-481c-44a5-8436-b7eca9758262 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.023728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8348ce-481c-44a5-8436-b7eca9758262 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.024184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8348ce-481c-44a5-8436-b7eca9758262 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.024635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8348ce-481c-44a5-8436-b7eca9758262 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.091823 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ab8348ce-481c-44a5-8436-b7eca9758262 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.828366 Oct 12 08:45:31.092400 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 180/280] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 08:45:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:31.105864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3ebf9bd9-901c-4219-a948-6cf0b3c8fc76 req-04977e8c-36a3-4080-afef-9cb692f969dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b61b844-e46c-4f3f-ad00-c631ed41e36e", "tag": "da4a8b0f-0c3e-460f-b35b-9824a7b3d8a0"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:31.126740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ebf9bd9-901c-4219-a948-6cf0b3c8fc76 req-04977e8c-36a3-4080-afef-9cb692f969dc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.127270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ebf9bd9-901c-4219-a948-6cf0b3c8fc76 req-04977e8c-36a3-4080-afef-9cb692f969dc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.129671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ebf9bd9-901c-4219-a948-6cf0b3c8fc76 req-04977e8c-36a3-4080-afef-9cb692f969dc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.148704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3ebf9bd9-901c-4219-a948-6cf0b3c8fc76 req-04977e8c-36a3-4080-afef-9cb692f969dc service nova] Creating event network-changed:da4a8b0f-0c3e-460f-b35b-9824a7b3d8a0 for instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e on n-h2-858383-10 Oct 12 08:45:31.170231 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3ebf9bd9-901c-4219-a948-6cf0b3c8fc76 req-04977e8c-36a3-4080-afef-9cb692f969dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072325 Oct 12 08:45:31.170851 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 181/281] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:31.199984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:31.200587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:31.212683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:31.227383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.227923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.228310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.229016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.229485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.229912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.282149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:31.385488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:45:31.385931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:45:31.386411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:45:31.387785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:45:31.388546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:45:31.407912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.408509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.410882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.411686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.414246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.415523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.444812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:45:31.450672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for user 008f3287ba094f53971db283b5f303c5 and project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:45:31.464492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:45:31.468255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:45:31.537631 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6352caec-ef19-4abd-bfb8-542c6fd65369 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.366199 Oct 12 08:45:31.545258 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 101/282] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4380 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:45:31.582617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:31.583291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:31.605288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.608146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.608596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.610725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.611224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.611690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.625484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:31.644982 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-008a61f0-001e-4256-a3c6-a4b1dff67852 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.458739 Oct 12 08:45:31.650844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 182/283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:31 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:31.657564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:31.658374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:31.664719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.666569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.667164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.668071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:31.669030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:31.677871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:31.975394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:31.987520 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e7b9d2d7-09e7-484e-a915-54e5b541201d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1387 microversion: 2.1 time: 0.440746 Oct 12 08:45:31.988101 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 102/284] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:31 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1387 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:32.006497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-6ae764bb-bb40-4d19-8e52-ff27dfbb3434 req-53b44a30-2fa9-454a-b35e-015bf6451a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2097f23a-de33-42bd-b1d9-4c9fbbf9f553", "tag": "f261bcbd-3b91-4089-a880-324a5143feae"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:32.018537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:32.033113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ae764bb-bb40-4d19-8e52-ff27dfbb3434 req-53b44a30-2fa9-454a-b35e-015bf6451a26 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.035760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ae764bb-bb40-4d19-8e52-ff27dfbb3434 req-53b44a30-2fa9-454a-b35e-015bf6451a26 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.036400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ae764bb-bb40-4d19-8e52-ff27dfbb3434 req-53b44a30-2fa9-454a-b35e-015bf6451a26 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.065999 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-6ae764bb-bb40-4d19-8e52-ff27dfbb3434 req-53b44a30-2fa9-454a-b35e-015bf6451a26 service nova] Creating event network-changed:f261bcbd-3b91-4089-a880-324a5143feae for instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 on n-h2-858383-10 Oct 12 08:45:32.076052 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-6ae764bb-bb40-4d19-8e52-ff27dfbb3434 req-53b44a30-2fa9-454a-b35e-015bf6451a26 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081683 Oct 12 08:45:32.076688 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 103/285] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:32.092011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee171be4-e1b3-45d7-8088-e6d586059131 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1612038607"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:32.100611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-ee171be4-e1b3-45d7-8088-e6d586059131 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid 197e196f-d240-4da8-93dc-911296cd1e56 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:32.164448 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee171be4-e1b3-45d7-8088-e6d586059131 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.080897 Oct 12 08:45:32.174026 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 104/286] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:32 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:32.207211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:32.218580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:32.231508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.232079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.232602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.234238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.239487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.240103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.372425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:32.380307 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61a3288d-8a50-4199-a6ff-45c56e99adc6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1472 microversion: 2.1 time: 0.727954 Oct 12 08:45:32.386045 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 183/287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:31 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1472 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:32.593111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:32.607169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0337f4ab-281d-4cae-a82e-91dfa4e90ac9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1314 microversion: 2.1 time: 0.430890 Oct 12 08:45:32.619749 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 105/288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:32 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:32.630563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7a8bfac-bcba-4813-a11b-e264adecfbfc tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Action: 'update', calling method: .version_select at 0x7f98494d8820>, body: {"quota_set": {"ram": "5120"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:32.635332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:32.635949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:32.663722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.666220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.667683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.671619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.672342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.672933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.734918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a8bfac-bcba-4813-a11b-e264adecfbfc tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.736485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a8bfac-bcba-4813-a11b-e264adecfbfc tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.738610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a8bfac-bcba-4813-a11b-e264adecfbfc tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.741192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a8bfac-bcba-4813-a11b-e264adecfbfc tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.741885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a8bfac-bcba-4813-a11b-e264adecfbfc tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.744131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a8bfac-bcba-4813-a11b-e264adecfbfc tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.765005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=15 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:32.859673 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7a8bfac-bcba-4813-a11b-e264adecfbfc tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/a13da7e7b2a24cb69bd7cb04dd1bede0" status: 200 len: 240 microversion: 2.36 time: 0.472146 Oct 12 08:45:32.860917 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 184/289] 10.222.0.40 () {62 vars in 1303 bytes} [Wed Oct 12 08:45:32 2022] PUT /compute/v2.1/os-quota-sets/a13da7e7b2a24cb69bd7cb04dd1bede0 => generated 240 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:32.867421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39c22938-3dd0-4075-bd66-186c11ada71f tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:32.890927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39c22938-3dd0-4075-bd66-186c11ada71f tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.895264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39c22938-3dd0-4075-bd66-186c11ada71f tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.896254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39c22938-3dd0-4075-bd66-186c11ada71f tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.909200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:32.923952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:32.935492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:32.938421 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1bb0de0a-951c-4bc5-8154-62cb2e896924 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1257 microversion: 2.25 time: 0.314765 Oct 12 08:45:32.940689 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 106/290] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:32 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1257 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:32.965393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:32.975626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:32.984886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.985924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.986619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:32.987554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:32.988217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:32.990269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:33.190563 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39c22938-3dd0-4075-bd66-186c11ada71f tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.328016 Oct 12 08:45:33.191895 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 185/291] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:32 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:33.203420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3c857f5-4932-453f-a8ba-f1be050294db tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Calling method '.version_select at 0x7f98492e9af0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:33.303100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3c857f5-4932-453f-a8ba-f1be050294db tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:33.303788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3c857f5-4932-453f-a8ba-f1be050294db tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:33.304275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3c857f5-4932-453f-a8ba-f1be050294db tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:33.305210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3c857f5-4932-453f-a8ba-f1be050294db tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:33.305871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3c857f5-4932-453f-a8ba-f1be050294db tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:33.306449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3c857f5-4932-453f-a8ba-f1be050294db tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:33.333293 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b3c857f5-4932-453f-a8ba-f1be050294db tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/a13da7e7b2a24cb69bd7cb04dd1bede0/detail" status: 200 len: 672 microversion: 2.36 time: 0.139793 Oct 12 08:45:33.334508 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 186/292] 10.222.0.40 () {60 vars in 1304 bytes} [Wed Oct 12 08:45:33 2022] GET /compute/v2.1/os-quota-sets/a13da7e7b2a24cb69bd7cb04dd1bede0/detail => generated 672 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:33.340393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:33.341539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:33.355484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:33.355927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:33.356363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:33.357142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:33.357520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:33.357936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:33.473693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:33.492457 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b4bcaa1-53ef-406f-b6b7-3ac3a69ed222 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.548504 Oct 12 08:45:33.493048 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 107/293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:32 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:33.507084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ca7c7b4-a847-4e3d-b2f4-9aeee1456bcb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:33.563420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ca7c7b4-a847-4e3d-b2f4-9aeee1456bcb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:33.566891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ca7c7b4-a847-4e3d-b2f4-9aeee1456bcb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:33.567477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ca7c7b4-a847-4e3d-b2f4-9aeee1456bcb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:33.628053 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-3ca7c7b4-a847-4e3d-b2f4-9aeee1456bcb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-858383-10. Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ca7c7b4-a847-4e3d-b2f4-9aeee1456bcb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Request method failure captured: Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 40 Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6o4_hQEdrNgTomXNi08LkuVIZgTrp9LCa432NH_4EPDbmBto0pvEIfS-QW9bW_ikWrcd72E0Ku0VPPDEust6mnITtPYbuKNWLS51GvN_kuv0gX_90ERwLasAtDK_zE5zNKnbGCm5cR_Qu2OyZstR6tieXDTOC0E1xUFntRMlzqv7w Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:45:33.638293 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}] Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 47ec0256bc04462c9faf6897b1cf2bbb Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: {"add_host": {"host": "n-h1-858383-10"}} Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:33.639765 n-d-858383-10 devstack@n-api.service[127007]: exception: Aggregate 11 already has host n-h1-858383-10. Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-858383-10'}}} Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result.read() Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 08:45:33.640525 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858383-10-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 08:45:33.641598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 08:45:33.642664 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 08:45:33.643630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result.read() Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858383-10-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 8, 45, 33, 607582), 'updated_at': None, 'host': 'n-h1-858383-10', 'aggregate_id': 11}] Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:33.644577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6644, in add_host_to_aggregate Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-858383-10. Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.645933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-858383-10. Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:33.647582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:33.650896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-858383-10. Oct 12 08:45:33.650896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:33.665294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ca7c7b4-a847-4e3d-b2f4-9aeee1456bcb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-858383-10. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:33.668556 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ca7c7b4-a847-4e3d-b2f4-9aeee1456bcb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.170913 Oct 12 08:45:33.674044 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 108/294] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:33 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 12 08:45:33.681659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:33.682621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:33.690257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:33.691055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:33.691678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:33.692915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:33.693587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:33.694436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:33.913757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:33.926534 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd1c3dbc-f832-4775-b3f1-29ffab256cec tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1387 microversion: 2.1 time: 0.590108 Oct 12 08:45:33.942805 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 187/295] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:33 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1387 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:33.951693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Action: 'update', calling method: .version_select at 0x7f98492e94c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:34.048444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.049891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.050608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.051312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:34.052105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.052820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.053515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.060477 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b0cb4f49-1cb1-42ef-b619-7150b6f529ad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1472 microversion: 2.1 time: 0.384899 Oct 12 08:45:34.061055 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 109/296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:33 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:34.073997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:34.074993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:34.088597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.089168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.090259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.091019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.102110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.102503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.107322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.108122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.108652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.109525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.110095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.110590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.195763 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bbca2fa2-a529-4060-9eab-b038fba85286 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/a13da7e7b2a24cb69bd7cb04dd1bede0?user_id=4867352e0566472b989d14f5ccf32e33" status: 200 len: 240 microversion: 2.36 time: 0.247626 Oct 12 08:45:34.196794 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 188/297] 10.222.0.40 () {62 vars in 1384 bytes} [Wed Oct 12 08:45:33 2022] PUT /compute/v2.1/os-quota-sets/a13da7e7b2a24cb69bd7cb04dd1bede0?user_id=4867352e0566472b989d14f5ccf32e33 => generated 240 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:34.207320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ebd7e0d3-5b88-4041-b430-a564ac7ecdfb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:34.227236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd7e0d3-5b88-4041-b430-a564ac7ecdfb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.227724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd7e0d3-5b88-4041-b430-a564ac7ecdfb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.228159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd7e0d3-5b88-4041-b430-a564ac7ecdfb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.386306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:34.396671 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae7492c8-884e-49ee-b6a4-c74a2deff60b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1314 microversion: 2.1 time: 0.334518 Oct 12 08:45:34.410558 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 110/298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:34 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:34.417397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-01bc3509-48e0-4bbe-ac3d-575c19a5227b req-577cffe2-45b4-4492-bf1e-a300f383c5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8eccbb-4ef3-4137-b92e-1542c10d2d0a", "name": "network-vif-plugged", "status": "completed", "tag": "19ab9c16-8c97-4f5f-9937-a5c9f12435a5"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:34.424213 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ebd7e0d3-5b88-4041-b430-a564ac7ecdfb tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.226262 Oct 12 08:45:34.431574 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 189/299] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:34 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:34.441849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:34.444647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:34.455996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-01bc3509-48e0-4bbe-ac3d-575c19a5227b req-577cffe2-45b4-4492-bf1e-a300f383c5b3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.457916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-01bc3509-48e0-4bbe-ac3d-575c19a5227b req-577cffe2-45b4-4492-bf1e-a300f383c5b3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.458428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-01bc3509-48e0-4bbe-ac3d-575c19a5227b req-577cffe2-45b4-4492-bf1e-a300f383c5b3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.459007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.462013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.462534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.463337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.463869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.464287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.479840 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-01bc3509-48e0-4bbe-ac3d-575c19a5227b req-577cffe2-45b4-4492-bf1e-a300f383c5b3 service nova] Creating event network-vif-plugged:19ab9c16-8c97-4f5f-9937-a5c9f12435a5 for instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a on n-h1-858383-10 Oct 12 08:45:34.497930 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-01bc3509-48e0-4bbe-ac3d-575c19a5227b req-577cffe2-45b4-4492-bf1e-a300f383c5b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096616 Oct 12 08:45:34.498856 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 111/300] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:34.504045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d98c3cd3-33d8-49a3-960a-932368ad5f26 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] Calling method '.version_select at 0x7f98495a3790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:34.654440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:34.660833 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d98c3cd3-33d8-49a3-960a-932368ad5f26 tempest-QuotasAdminTestV236-436706129 tempest-QuotasAdminTestV236-436706129-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/a13da7e7b2a24cb69bd7cb04dd1bede0?user_id=4867352e0566472b989d14f5ccf32e33" status: 200 len: 282 microversion: 2.36 time: 0.160708 Oct 12 08:45:34.667209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:34.669603 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 112/301] 10.222.0.40 () {60 vars in 1364 bytes} [Wed Oct 12 08:45:34 2022] GET /compute/v2.1/os-quota-sets/a13da7e7b2a24cb69bd7cb04dd1bede0?user_id=4867352e0566472b989d14f5ccf32e33 => generated 282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:34.674728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:34.676007 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b663a92e-5b9c-4c50-a7be-b51ae1a54b3b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1319 microversion: 2.25 time: 0.243337 Oct 12 08:45:34.676897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efd7443f-38b8-4f3d-a088-84128a237852 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:34.695812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 190/302] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:34 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:34.717729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:34.718507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:34.725078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.725644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.726122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.726888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:34.727401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:34.727831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:34.732781 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efd7443f-38b8-4f3d-a088-84128a237852 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.061994 Oct 12 08:45:34.741223 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 113/303] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:34 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:34.753426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f75b6cb0-dad3-4558-804a-5f4c75cb8282 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-311192644"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:34.759984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-f75b6cb0-dad3-4558-804a-5f4c75cb8282 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid 6abc66a6-6324-4fb0-bb2b-67e5c3906d62 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:34.803295 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f75b6cb0-dad3-4558-804a-5f4c75cb8282 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060654 Oct 12 08:45:34.813062 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 114/304] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:35.029810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1fa608e-9382-46d3-8816-b11af94afae8 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:35.035779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d1fa608e-9382-46d3-8816-b11af94afae8 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '34f23edc5b774d4c9bf2465e8f8cb5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc2736db84748a79d6f25bdb4a4fbe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1fa608e-9382-46d3-8816-b11af94afae8 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Request method failure captured: Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 40 Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6mug0eWMUwRc-U97kBgicEkFwLTF0uvM-1WUZ8xVgu3DgvaaJsrKfxaK_Mqzaat5SuNaW78G5hAGTTGNc41gibeW9XvecH45hbbnF4UgbK8Y09jlXZ7n32xq8ppyC2VQbQ9cdI8ObWUM0lqjxKhfp6R7xXJmNpSlP4ir6jkU2_WQM Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:35.039537 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}] Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 34f23edc5b774d4c9bf2465e8f8cb5db Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: {"add_host": {"host": "n-h1-858383-10"}} Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:35.040907 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-858383-10'}}} Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:35.041675 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 12 08:45:35.042670 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:35.043721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1fa608e-9382-46d3-8816-b11af94afae8 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:35.043721 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d1fa608e-9382-46d3-8816-b11af94afae8 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.227508 Oct 12 08:45:35.047055 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 115/305] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:34 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 233 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:35.057168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:35.060025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:35.070166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:35.070669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:35.071144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:35.080080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:35.084952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:35.086439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:35.408932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:35.418413 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c7386f4a-458f-4baa-90ee-545653b800c7 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1318 microversion: 2.1 time: 0.721375 Oct 12 08:45:35.419064 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 191/306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:34 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:35.434355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d9d35933-dee6-4ccd-9747-8b37d0f6f4ce tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:35.479760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d9d35933-dee6-4ccd-9747-8b37d0f6f4ce tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.049128 Oct 12 08:45:35.485160 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 192/307] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:35 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:35.503185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:35.503830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:35.526839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:35.527632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:35.528359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:35.529251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:35.530172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:35.530851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:35.654463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:35.664714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d3a66acc-e96e-4cf0-80ec-5be83ba9debe tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1387 microversion: 2.1 time: 0.616510 Oct 12 08:45:35.671488 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 116/308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:35 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1387 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:35.682850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:35.683468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:35.709796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:35.713256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:35.714090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:35.716828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:35.718051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:35.719363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:36.002193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:36.016542 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa4ded6d-c82e-4a32-aebb-0768e24cbb77 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1314 microversion: 2.1 time: 0.343620 Oct 12 08:45:36.017151 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 117/309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:35 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:36.021654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6ab3b3c3-74f8-4446-bb95-b5f4a91e2e52 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1040572314"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.025194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-6ab3b3c3-74f8-4446-bb95-b5f4a91e2e52 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid a0417f35-68f8-4bc6-85ce-da8bc5cd3506 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:36.072817 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6ab3b3c3-74f8-4446-bb95-b5f4a91e2e52 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054499 Oct 12 08:45:36.081109 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 118/310] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:36.087425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:36.088623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:36.096970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:36.098141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:36.100697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:36.101363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:36.103910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:36.105629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:36.108739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:36.109465 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34c16671-0049-4af8-b12e-7c971e30787e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1472 microversion: 2.1 time: 0.619105 Oct 12 08:45:36.113234 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 193/311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:35 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1472 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:36.120349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2046402565"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.137828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:36.138563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:36.140920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:36.155919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:36.156136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:36.156692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:36.167601 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2046402565 could not be found. Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Request method failure captured: Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 58 Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6o4_hQEdrNgTomXNi08LkuVIZgTrp9LCa432NH_4EPDbmBto0pvEIfS-QW9bW_ikWrcd72E0Ku0VPPDEust6mnITtPYbuKNWLS51GvN_kuv0gX_90ERwLasAtDK_zE5zNKnbGCm5cR_Qu2OyZstR6tieXDTOC0E1xUFntRMlzqv7w Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:36.172457 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}] Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 47ec0256bc04462c9faf6897b1cf2bbb Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: {"add_host": {"host": "tempest-nonexist_host-2046402565"}} Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:36.173818 n-d-858383-10 devstack@n-api.service[127006]: exception: Compute host tempest-nonexist_host-2046402565 could not be found. Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-2046402565'}}} Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2046402565' is not mapped to any cell Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.175473 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6624, in add_host_to_aggregate Oct 12 08:45:36.177784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2046402565 could not be found. Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2046402565 could not be found. Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.179058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2046402565 could not be found. Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2046402565 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-846f9192-50ba-474c-837b-a145d7d06978 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.058144 Oct 12 08:45:36.180535 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 194/312] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:36.185140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dda66be5-babd-4433-aa52-7dd0471c519d tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:36.212356 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dda66be5-babd-4433-aa52-7dd0471c519d tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.032668 Oct 12 08:45:36.213642 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 195/313] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:36 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:36.235310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de8b8384-bd28-4cb9-a1c8-f8d3fe6a5d57 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de8b8384-bd28-4cb9-a1c8-f8d3fe6a5d57 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Request method failure captured: Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 283 Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6o4_hQEdrNgTomXNi08LkuVIZgTrp9LCa432NH_4EPDbmBto0pvEIfS-QW9bW_ikWrcd72E0Ku0VPPDEust6mnITtPYbuKNWLS51GvN_kuv0gX_90ERwLasAtDK_zE5zNKnbGCm5cR_Qu2OyZstR6tieXDTOC0E1xUFntRMlzqv7w Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:36.254726 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}] Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 47ec0256bc04462c9faf6897b1cf2bbb Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.255956 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:45:36.256463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:36.257052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.258263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.259074 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:45:36.259074 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:45:36.259074 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:45:36.259074 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.259312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de8b8384-bd28-4cb9-a1c8-f8d3fe6a5d57 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:36.260012 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de8b8384-bd28-4cb9-a1c8-f8d3fe6a5d57 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.033906 Oct 12 08:45:36.260602 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 196/314] 10.222.0.40 () {60 vars in 1165 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:45:36.274424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-defb70ee-60a1-43ff-9b74-0740236a0bc2 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-defb70ee-60a1-43ff-9b74-0740236a0bc2 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Request method failure captured: Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 27 Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6o4_hQEdrNgTomXNi08LkuVIZgTrp9LCa432NH_4EPDbmBto0pvEIfS-QW9bW_ikWrcd72E0Ku0VPPDEust6mnITtPYbuKNWLS51GvN_kuv0gX_90ERwLasAtDK_zE5zNKnbGCm5cR_Qu2OyZstR6tieXDTOC0E1xUFntRMlzqv7w Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:36.278263 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}] Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 47ec0256bc04462c9faf6897b1cf2bbb Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: {"aggregate": {"name": ""}} Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:36.279463 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi '' Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:36.280148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:45:36.281326 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.285056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-defb70ee-60a1-43ff-9b74-0740236a0bc2 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:36.285056 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-defb70ee-60a1-43ff-9b74-0740236a0bc2 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.012733 Oct 12 08:45:36.292827 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 197/315] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:45:36.308126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73a1c4b1-29e7-4771-b04a-d3138ac55758 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-12997140"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.312571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-73a1c4b1-29e7-4771-b04a-d3138ac55758 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '34f23edc5b774d4c9bf2465e8f8cb5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc2736db84748a79d6f25bdb4a4fbe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73a1c4b1-29e7-4771-b04a-d3138ac55758 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Request method failure captured: Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 58 Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6mug0eWMUwRc-U97kBgicEkFwLTF0uvM-1WUZ8xVgu3DgvaaJsrKfxaK_Mqzaat5SuNaW78G5hAGTTGNc41gibeW9XvecH45hbbnF4UgbK8Y09jlXZ7n32xq8ppyC2VQbQ9cdI8ObWUM0lqjxKhfp6R7xXJmNpSlP4ir6jkU2_WQM Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:45:36.315217 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}] Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 34f23edc5b774d4c9bf2465e8f8cb5db Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: {"aggregate": {"name": "tempest-test_aggregate-12997140"}} Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:36.316425 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-12997140'}}} Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:36.317117 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:36.318464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 12 08:45:36.319471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.321738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73a1c4b1-29e7-4771-b04a-d3138ac55758 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:36.322831 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73a1c4b1-29e7-4771-b04a-d3138ac55758 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.024215 Oct 12 08:45:36.330255 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 198/316] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:36.336078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d3e791c-3166-4097-b812-4502c6c8af8e tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1523040222"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.340705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.aggregate [None req-6d3e791c-3166-4097-b812-4502c6c8af8e tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid e1974beb-ffbb-4910-9473-0d4c248c4007 for aggregate {{(pid=127006) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:36.361497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:36.368149 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d3e791c-3166-4097-b812-4502c6c8af8e tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036502 Oct 12 08:45:36.369814 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 199/317] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:36.382874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ccc99d0-39e6-49d0-82fb-9ad1511d8869 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1523040222"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.385356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:36.387567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.aggregate [None req-3ccc99d0-39e6-49d0-82fb-9ad1511d8869 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid 08b531cd-a459-4833-9a59-04f98aec62a9 for aggregate {{(pid=127006) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:36.390358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:36.393327 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e84c2271-dc6b-4b74-a08d-4cef11bd2cd1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1361 microversion: 2.25 time: 0.310615 Oct 12 08:45:36.394181 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 119/318] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:36 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:36.403323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3ccc99d0-39e6-49d0-82fb-9ad1511d8869 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1523040222 already exists. Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ccc99d0-39e6-49d0-82fb-9ad1511d8869 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Request method failure captured: Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 60 Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6o4_hQEdrNgTomXNi08LkuVIZgTrp9LCa432NH_4EPDbmBto0pvEIfS-QW9bW_ikWrcd72E0Ku0VPPDEust6mnITtPYbuKNWLS51GvN_kuv0gX_90ERwLasAtDK_zE5zNKnbGCm5cR_Qu2OyZstR6tieXDTOC0E1xUFntRMlzqv7w Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:36.405402 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}] Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 47ec0256bc04462c9faf6897b1cf2bbb Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: {"aggregate": {"name": "tempest-test_aggregate-1523040222"}} Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:36.406571 n-d-858383-10 devstack@n-api.service[127006]: exception: Aggregate tempest-test_aggregate-1523040222 already exists. Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1523040222'}}} Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in create_aggregate Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 12 08:45:36.407256 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1523040222 already exists. Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:36.408786 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1523040222 already exists. Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1523040222 already exists. Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ccc99d0-39e6-49d0-82fb-9ad1511d8869 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1523040222 already exists. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:36.410310 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ccc99d0-39e6-49d0-82fb-9ad1511d8869 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.028930 Oct 12 08:45:36.411564 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 200/319] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 30 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 08:45:36.418288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c84d1955-676b-4a93-bf67-26c334daa712 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:36.462136 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c84d1955-676b-4a93-bf67-26c334daa712 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.049059 Oct 12 08:45:36.463281 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 120/320] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:36 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:36.472155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5e3e64b9-78d4-4366-a210-62edad33a35a tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2044573403"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.472925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:36.473651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:36.481415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-5e3e64b9-78d4-4366-a210-62edad33a35a tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid 264d3130-36f6-4c2c-9e17-65f73020a777 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:36.484754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:36.485485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:36.486119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:36.486912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:36.488695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:36.489362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:36.531300 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5e3e64b9-78d4-4366-a210-62edad33a35a tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.063068 Oct 12 08:45:36.531915 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 121/321] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:36.544655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dbd51747-e4f7-40bd-874f-73a4ad59806c tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:36.552749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dbd51747-e4f7-40bd-874f-73a4ad59806c tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '34f23edc5b774d4c9bf2465e8f8cb5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc2736db84748a79d6f25bdb4a4fbe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dbd51747-e4f7-40bd-874f-73a4ad59806c tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Request method failure captured: Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6mug0eWMUwRc-U97kBgicEkFwLTF0uvM-1WUZ8xVgu3DgvaaJsrKfxaK_Mqzaat5SuNaW78G5hAGTTGNc41gibeW9XvecH45hbbnF4UgbK8Y09jlXZ7n32xq8ppyC2VQbQ9cdI8ObWUM0lqjxKhfp6R7xXJmNpSlP4ir6jkU2_WQM Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:36.556194 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}] Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 34f23edc5b774d4c9bf2465e8f8cb5db Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 08:45:36.557402 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '15'} Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:36.558075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 12 08:45:36.559247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.562192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dbd51747-e4f7-40bd-874f-73a4ad59806c tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:36.563718 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dbd51747-e4f7-40bd-874f-73a4ad59806c tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.022926 Oct 12 08:45:36.565915 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 122/322] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:36.573796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42c28180-f156-47ef-83a3-46945e26b074 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:36.613186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42c28180-f156-47ef-83a3-46945e26b074 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.043080 Oct 12 08:45:36.617121 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 123/323] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 08:45:36.632607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-36ef7442-69f9-48e9-b392-194064d095d0 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:36.645950 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-36ef7442-69f9-48e9-b392-194064d095d0 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-36ef7442-69f9-48e9-b392-194064d095d0 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Request method failure captured: Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6o4_hQEdrNgTomXNi08LkuVIZgTrp9LCa432NH_4EPDbmBto0pvEIfS-QW9bW_ikWrcd72E0Ku0VPPDEust6mnITtPYbuKNWLS51GvN_kuv0gX_90ERwLasAtDK_zE5zNKnbGCm5cR_Qu2OyZstR6tieXDTOC0E1xUFntRMlzqv7w Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:45:36.648288 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}] Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 47ec0256bc04462c9faf6897b1cf2bbb Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: exception: Aggregate -1 could not be found. Oct 12 08:45:36.649593 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '-1'} Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 08:45:36.650237 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.655964 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-36ef7442-69f9-48e9-b392-194064d095d0 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-36ef7442-69f9-48e9-b392-194064d095d0 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026008 Oct 12 08:45:36.658181 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 124/324] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:36 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:45:36.661853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5d824445-c2e1-46a9-9b74-bc2b60af086f tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-956844587"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:36.666365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-5d824445-c2e1-46a9-9b74-bc2b60af086f tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid 724e0db2-6c9b-47a5-a2d5-10f926369880 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:36.698487 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5d824445-c2e1-46a9-9b74-bc2b60af086f tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040709 Oct 12 08:45:36.701087 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 125/325] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:36.707580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:36.708517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:36.718201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:36.719034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:36.719674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:36.721866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:36.722548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:36.723791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.029194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:37.037542 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66c9cefd-5e45-4b5d-9cd5-6603e5de1bd5 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1468 microversion: 2.1 time: 0.598795 Oct 12 08:45:37.038082 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 201/326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:36 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1468 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:37.042597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a88df5a1-42ff-49a9-ab14-9d23bd4936c4 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:37.044082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a88df5a1-42ff-49a9-ab14-9d23bd4936c4 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '34f23edc5b774d4c9bf2465e8f8cb5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc2736db84748a79d6f25bdb4a4fbe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a88df5a1-42ff-49a9-ab14-9d23bd4936c4 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Request method failure captured: Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6mug0eWMUwRc-U97kBgicEkFwLTF0uvM-1WUZ8xVgu3DgvaaJsrKfxaK_Mqzaat5SuNaW78G5hAGTTGNc41gibeW9XvecH45hbbnF4UgbK8Y09jlXZ7n32xq8ppyC2VQbQ9cdI8ObWUM0lqjxKhfp6R7xXJmNpSlP4ir6jkU2_WQM Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:45:37.057766 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}] Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 34f23edc5b774d4c9bf2465e8f8cb5db Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 08:45:37.059398 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '16'} Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:37.060203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 12 08:45:37.061481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:37.063316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a88df5a1-42ff-49a9-ab14-9d23bd4936c4 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:37.064349 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a88df5a1-42ff-49a9-ab14-9d23bd4936c4 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.025315 Oct 12 08:45:37.067981 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 202/327] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:37 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:37.072737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:37.073368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:37.092769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.093274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.093740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.094654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.105193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.105828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.306659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:37.324641 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e0913df-3673-4684-bdd3-6ef71f2d3283 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1387 microversion: 2.1 time: 0.620516 Oct 12 08:45:37.325792 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 126/328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:36 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1387 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:37.337071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:37.343466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:37.358537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.360553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.362901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.364770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.366223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.366879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.430979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:37.463797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:37.471613 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-118015dc-9705-4998-a8ce-82fecf590326 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1314 microversion: 2.1 time: 0.402581 Oct 12 08:45:37.472196 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 203/329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:37 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:37.485957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36613821-5b7e-47e2-864e-bedd641d83f4 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:37.527528 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-36613821-5b7e-47e2-864e-bedd641d83f4 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.045153 Oct 12 08:45:37.528451 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 204/330] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:37 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:37.533204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:37.536401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:37.553862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.554391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.554851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.555605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.556066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.556494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.647404 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c89e555-8aef-4fd8-944d-f2809c867fda tempest-DeleteServersAdminTestJSON-1394144889 tempest-DeleteServersAdminTestJSON-1394144889-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.320062 Oct 12 08:45:37.651397 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 127/331] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:45:37 2022] POST /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:45:37.655938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e07356c7-5688-4073-8d38-b238d020ff18 req-2c1cdef0-ff2c-4c38-82fb-ba361a4dc16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b61b844-e46c-4f3f-ad00-c631ed41e36e", "name": "network-vif-plugged", "status": "completed", "tag": "da4a8b0f-0c3e-460f-b35b-9824a7b3d8a0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:37.671556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e07356c7-5688-4073-8d38-b238d020ff18 req-2c1cdef0-ff2c-4c38-82fb-ba361a4dc16a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.672191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e07356c7-5688-4073-8d38-b238d020ff18 req-2c1cdef0-ff2c-4c38-82fb-ba361a4dc16a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.673114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e07356c7-5688-4073-8d38-b238d020ff18 req-2c1cdef0-ff2c-4c38-82fb-ba361a4dc16a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.690066 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e07356c7-5688-4073-8d38-b238d020ff18 req-2c1cdef0-ff2c-4c38-82fb-ba361a4dc16a service nova] Creating event network-vif-plugged:da4a8b0f-0c3e-460f-b35b-9824a7b3d8a0 for instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e on n-h2-858383-10 Oct 12 08:45:37.696635 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e07356c7-5688-4073-8d38-b238d020ff18 req-2c1cdef0-ff2c-4c38-82fb-ba361a4dc16a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046431 Oct 12 08:45:37.697722 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 128/332] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:37.715005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:37.715866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:37.743687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.745394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.746887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.749072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.753571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.754246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.813493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:37.826694 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f8420bad-ea42-4188-a133-71de6e6e5885 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.294213 Oct 12 08:45:37.843557 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 205/333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:37 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:37.855922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6aa54b58-c979-4624-b8eb-3636300ab34d tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:37.866778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:37.878415 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6aa54b58-c979-4624-b8eb-3636300ab34d tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6aa54b58-c979-4624-b8eb-3636300ab34d tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Request method failure captured: Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6o4_hQEdrNgTomXNi08LkuVIZgTrp9LCa432NH_4EPDbmBto0pvEIfS-QW9bW_ikWrcd72E0Ku0VPPDEust6mnITtPYbuKNWLS51GvN_kuv0gX_90ERwLasAtDK_zE5zNKnbGCm5cR_Qu2OyZstR6tieXDTOC0E1xUFntRMlzqv7w Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:37.880881 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}] Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 47ec0256bc04462c9faf6897b1cf2bbb Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: exception: Aggregate -1 could not be found. Oct 12 08:45:37.882120 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '-1'} Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:37.882769 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 12 08:45:37.883830 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:37.884787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6aa54b58-c979-4624-b8eb-3636300ab34d tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:37.884787 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6aa54b58-c979-4624-b8eb-3636300ab34d tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035374 Oct 12 08:45:37.886638 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 206/334] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 08:45:37 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:45:37.899417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:37.901185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:37.924945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.925635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.927385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.928237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.929766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.931709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.989602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:37.991846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:37.992651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:37.992959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:37.993408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lazy-loading 'fault' on Instance uuid cf8eccbb-4ef3-4137-b92e-1542c10d2d0a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:38.006583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:38.008482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:38.009805 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ee96371-6238-43b5-ae8f-73dff892a40e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1361 microversion: 2.25 time: 0.309858 Oct 12 08:45:38.010377 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 129/335] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:37 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:38.016623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-76635d83-224f-4fcc-a863-7bf31b88fc36 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:38.018344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-76635d83-224f-4fcc-a863-7bf31b88fc36 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '34f23edc5b774d4c9bf2465e8f8cb5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc2736db84748a79d6f25bdb4a4fbe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-76635d83-224f-4fcc-a863-7bf31b88fc36 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Request method failure captured: Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6mug0eWMUwRc-U97kBgicEkFwLTF0uvM-1WUZ8xVgu3DgvaaJsrKfxaK_Mqzaat5SuNaW78G5hAGTTGNc41gibeW9XvecH45hbbnF4UgbK8Y09jlXZ7n32xq8ppyC2VQbQ9cdI8ObWUM0lqjxKhfp6R7xXJmNpSlP4ir6jkU2_WQM Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:38.020021 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}] Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 34f23edc5b774d4c9bf2465e8f8cb5db Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 08:45:38.021245 n-d-858383-10 devstack@n-api.service[127007]: action_args: {} Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:38.022282 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:38.023331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-76635d83-224f-4fcc-a863-7bf31b88fc36 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:38.025186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-76635d83-224f-4fcc-a863-7bf31b88fc36 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010009 Oct 12 08:45:38.025186 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 130/336] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:45:38 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:38.033471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bfe847df-898a-43dc-83fd-17f8940ffd7a tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-641266740"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:38.036825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-bfe847df-898a-43dc-83fd-17f8940ffd7a tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid 7417c3df-281b-4346-a96e-373ec9932db7 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:38.062427 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bfe847df-898a-43dc-83fd-17f8940ffd7a tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.032598 Oct 12 08:45:38.066828 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 131/337] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:38.076973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1001439-9f00-4632-af98-6ca14f6e59e5 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:38.094779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1001439-9f00-4632-af98-6ca14f6e59e5 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:38.096583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1001439-9f00-4632-af98-6ca14f6e59e5 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:38.097206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1001439-9f00-4632-af98-6ca14f6e59e5 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:38.266879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1001439-9f00-4632-af98-6ca14f6e59e5 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.194941 Oct 12 08:45:38.274906 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 132/338] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:38.280723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-67f980a1-e3f5-4dfc-a940-452e991e0285 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:38.285633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-67f980a1-e3f5-4dfc-a940-452e991e0285 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '34f23edc5b774d4c9bf2465e8f8cb5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc2736db84748a79d6f25bdb4a4fbe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-67f980a1-e3f5-4dfc-a940-452e991e0285 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Request method failure captured: Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 43 Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6mug0eWMUwRc-U97kBgicEkFwLTF0uvM-1WUZ8xVgu3DgvaaJsrKfxaK_Mqzaat5SuNaW78G5hAGTTGNc41gibeW9XvecH45hbbnF4UgbK8Y09jlXZ7n32xq8ppyC2VQbQ9cdI8ObWUM0lqjxKhfp6R7xXJmNpSlP4ir6jkU2_WQM Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:38.288184 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abc2736db84748a79d6f25bdb4a4fbe9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abc2736db84748a79d6f25bdb4a4fbe9"}]}] Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: abc2736db84748a79d6f25bdb4a4fbe9 Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-995108923 Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 34f23edc5b774d4c9bf2465e8f8cb5db Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-995108923-project Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: {"remove_host": {"host": "n-h1-858383-10"}} Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:38.289526 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-858383-10'}}} Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:38.290278 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 12 08:45:38.291257 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:38.296145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-67f980a1-e3f5-4dfc-a940-452e991e0285 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:38.296145 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-67f980a1-e3f5-4dfc-a940-452e991e0285 tempest-AggregatesAdminNegativeTestJSON-995108923 tempest-AggregatesAdminNegativeTestJSON-995108923-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.014174 Oct 12 08:45:38.296145 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 133/339] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:45:38.303282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-311734d2-cd64-40ff-a45a-80148b8c5cf9 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:38.325476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311734d2-cd64-40ff-a45a-80148b8c5cf9 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:38.326076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311734d2-cd64-40ff-a45a-80148b8c5cf9 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:38.326752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311734d2-cd64-40ff-a45a-80148b8c5cf9 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:38.485824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=7 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:38.499123 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-311734d2-cd64-40ff-a45a-80148b8c5cf9 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.201197 Oct 12 08:45:38.500646 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 134/340] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:38.510900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:38.512532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:38.514377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:38.523179 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80cfddee-4c53-4acb-ae6c-d8b294460200 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1451 microversion: 2.1 time: 0.631368 Oct 12 08:45:38.524712 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 207/341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:37 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1451 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:38.530836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:38.531701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:38.538053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:38.538736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:38.539435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:38.539553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:38.540807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:38.541360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:38.541618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:38.542047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:38.542624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:38.542777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:38.543359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:38.543919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:38.791288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:38.803905 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5618a46-7b4b-4305-a998-ed0a79cbda3b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1387 microversion: 2.1 time: 0.301149 Oct 12 08:45:38.818352 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 135/342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:38 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1387 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:38.825821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f54e4ef3-6de8-4c1f-9128-29aa7ddee761 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:38.856211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f54e4ef3-6de8-4c1f-9128-29aa7ddee761 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.035487 Oct 12 08:45:38.858780 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 136/343] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:38 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 08:45:38.872658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:38.874153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:38.884321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:38.885079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:38.887188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:38.888578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:38.890343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:38.891406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:38.945579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:45:38.999825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:39.009071 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c426e6a3-5b40-4735-b9c4-f6308131e7bf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1314 microversion: 2.1 time: 0.483174 Oct 12 08:45:39.010268 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 208/344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:38 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:39.015621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:39.016425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:39.023208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.023960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.024736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.025615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.026883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.027455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.124847 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-50f4af55-2bb7-4b9d-a69b-da3889c83ec6 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 204 len: 0 microversion: 2.1 time: 0.264397 Oct 12 08:45:39.128690 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 137/345] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:45:38 2022] DELETE /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:45:39.131564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bc9c060-c707-4536-bb9a-cff4f6939cde tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-150060150"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:39.138040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.aggregate [None req-8bc9c060-c707-4536-bb9a-cff4f6939cde tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Generated uuid 8e2bd914-6471-41a2-9ada-e051771f3a94 for aggregate {{(pid=127007) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 08:45:39.182826 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8bc9c060-c707-4536-bb9a-cff4f6939cde tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053706 Oct 12 08:45:39.184355 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 138/346] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 08:45:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:39.192018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ad653e69-1bec-4422-9fce-b190a60b5b26 req-0765d22a-22de-479a-a911-357f079d7695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f7d54d7-366a-49f9-bd42-d252f7868e2d", "tag": "ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:39.206693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ad653e69-1bec-4422-9fce-b190a60b5b26 req-0765d22a-22de-479a-a911-357f079d7695 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.207170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ad653e69-1bec-4422-9fce-b190a60b5b26 req-0765d22a-22de-479a-a911-357f079d7695 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.207593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ad653e69-1bec-4422-9fce-b190a60b5b26 req-0765d22a-22de-479a-a911-357f079d7695 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.228884 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ad653e69-1bec-4422-9fce-b190a60b5b26 req-0765d22a-22de-479a-a911-357f079d7695 service nova] Creating event network-changed:ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7 for instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d on n-h1-858383-10 Oct 12 08:45:39.237861 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ad653e69-1bec-4422-9fce-b190a60b5b26 req-0765d22a-22de-479a-a911-357f079d7695 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049819 Oct 12 08:45:39.238902 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 139/347] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:39.244860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:39.245603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:39.253082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.253595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.254029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.255159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.256010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.256503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.386971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:39.399320 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e96fae4-bbeb-4f90-9c22-f7a9d6d20b81 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.387646 Oct 12 08:45:39.400191 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 209/348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:39 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:39.410207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:39.413989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:39.426800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.430194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.430836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.433599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.436429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.437043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.445890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:39.457317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:39.459383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:39.460791 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bf550769-bef8-49b6-9563-4674005d9001 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1361 microversion: 2.25 time: 0.220578 Oct 12 08:45:39.461686 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 140/349] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:39 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:39.468497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:39.482504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.482983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.483415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.486697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.487390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.491469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.491963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lazy-loading 'fault' on Instance uuid cf8eccbb-4ef3-4137-b92e-1542c10d2d0a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:39.492105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.498658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.498658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.504844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.compute.aggregates [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 12 08:45:39.505481 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Request method failure captured: Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 42 Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6o4_hQEdrNgTomXNi08LkuVIZgTrp9LCa432NH_4EPDbmBto0pvEIfS-QW9bW_ikWrcd72E0Ku0VPPDEust6mnITtPYbuKNWLS51GvN_kuv0gX_90ERwLasAtDK_zE5zNKnbGCm5cR_Qu2OyZstR6tieXDTOC0E1xUFntRMlzqv7w Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:45:39.507488 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_277b44a9ac4a4c7097570f8c77720e2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/277b44a9ac4a4c7097570f8c77720e2d"}]}] Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 277b44a9ac4a4c7097570f8c77720e2d Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-593201183 Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 47ec0256bc04462c9faf6897b1cf2bbb Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: {"remove_host": {"host": "nonexist_host"}} Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:39.509040 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 12 08:45:39.509916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6686, in remove_host_from_aggregate Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 12 08:45:39.511086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.512249 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-74a07e8a-ac02-4610-80a1-bf1b9c43be95 tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.046225 Oct 12 08:45:39.514173 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 141/350] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 08:45:39 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:45:39.517035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cfbd76e6-50b8-4327-8366-b49d6643831b tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:39.552337 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cfbd76e6-50b8-4327-8366-b49d6643831b tempest-AggregatesAdminNegativeTestJSON-593201183 tempest-AggregatesAdminNegativeTestJSON-593201183-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.038510 Oct 12 08:45:39.555647 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 142/351] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:45:39 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 12 08:45:39.742199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-305ee180-01f6-4d8c-823f-c1a794899626 req-7fa93eda-eb03-4478-85e1-3d11532121ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2097f23a-de33-42bd-b1d9-4c9fbbf9f553", "name": "network-vif-plugged", "status": "completed", "tag": "f261bcbd-3b91-4089-a880-324a5143feae"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:39.754790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-305ee180-01f6-4d8c-823f-c1a794899626 req-7fa93eda-eb03-4478-85e1-3d11532121ab service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:39.755570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-305ee180-01f6-4d8c-823f-c1a794899626 req-7fa93eda-eb03-4478-85e1-3d11532121ab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:39.756010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-305ee180-01f6-4d8c-823f-c1a794899626 req-7fa93eda-eb03-4478-85e1-3d11532121ab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:39.769672 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-305ee180-01f6-4d8c-823f-c1a794899626 req-7fa93eda-eb03-4478-85e1-3d11532121ab service nova] Creating event network-vif-plugged:f261bcbd-3b91-4089-a880-324a5143feae for instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 on n-h2-858383-10 Oct 12 08:45:39.776270 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-305ee180-01f6-4d8c-823f-c1a794899626 req-7fa93eda-eb03-4478-85e1-3d11532121ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037642 Oct 12 08:45:39.776833 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 143/352] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:45:39.964792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:39.973887 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b4a9f3a6-e767-435a-ade9-ebaf1b9782e3 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1457 microversion: 2.1 time: 0.572559 Oct 12 08:45:39.992321 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 210/353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:39 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1457 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:40.018626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:40.019242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:40.028008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:40.028510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:40.028930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:40.030019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:40.030627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:40.031679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:40.063318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:40.278260 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02eaa6a7-dd76-4fe8-b464-578e1a5a569f tempest-TenantUsagesNegativeTestJSON-1969318909 tempest-TenantUsagesNegativeTestJSON-1969318909-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-11T08%3A45%3A39.778858&end=2022-10-13T08%3A45%3A39.778858" status: 404 len: 112 microversion: - time: 0.494789 Oct 12 08:45:40.279026 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 144/354] 10.222.0.40 () {58 vars in 1316 bytes} [Wed Oct 12 08:45:39 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-11T08%3A45%3A39.778858&end=2022-10-13T08%3A45%3A39.778858 => generated 112 bytes in 497 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 08:45:40.283825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:40.287446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:40.312706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:40.313547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:40.314305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:40.317955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:40.318583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:40.319168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:40.496946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:40.505768 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-997318e8-63c2-4502-b793-d06f219206f1 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1463 microversion: 2.1 time: 0.225588 Oct 12 08:45:40.522793 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 145/355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:40 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1463 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:40.527618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a4c814b7-c6f1-49c7-aa52-327ba1411b8a tempest-TenantUsagesNegativeTestJSON-1969318909 tempest-TenantUsagesNegativeTestJSON-1969318909-project-admin] Calling method '.version_select at 0x7f984935a430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:40.537523 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a4c814b7-c6f1-49c7-aa52-327ba1411b8a tempest-TenantUsagesNegativeTestJSON-1969318909 tempest-TenantUsagesNegativeTestJSON-1969318909-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a4c814b7-c6f1-49c7-aa52-327ba1411b8a tempest-TenantUsagesNegativeTestJSON-1969318909 tempest-TenantUsagesNegativeTestJSON-1969318909-project-admin] Request method failure captured: Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-simple-tenant-usage/25a5b294073d4857bf663285cd04f6e6?start=2022-10-13T08%3A45%3A39.778858&end=2022-10-11T08%3A45%3A39.778858 HTTP/1.1 Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6zra4kyJhRAVtSoQAnCxTBGmBFIuElBDjj_s04jwRJxeNLm-aFDvvz3cekkdKUoWejmFT8K-rHlGXJ18ydRzlcrsSK-mRvgFWi96yy8ks89bWDPSiUxI69Zdys-a7hOS2YK0ubgoJvEoECKYTzbujijcE3XIN3lFu-XPjLZLujrLo Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 87fdebb6a01a48abb324b33e5d5383bb Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1969318909 Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:45:40.539992 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/87fdebb6a01a48abb324b33e5d5383bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/87fdebb6a01a48abb324b33e5d5383bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_87fdebb6a01a48abb324b33e5d5383bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/87fdebb6a01a48abb324b33e5d5383bb"}]}] Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1969318909 Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 87fdebb6a01a48abb324b33e5d5383bb Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1969318909 Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TenantUsagesNegativeTestJSON-1969318909-project-admin Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 48b4fad024ff4c168835d6226961365b Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1969318909-project-admin Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid start time. The start time cannot occur after the end time. Oct 12 08:45:40.541386 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '25a5b294073d4857bf663285cd04f6e6'} Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 08:45:40.542313 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 12 08:45:40.543565 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:40.545033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a4c814b7-c6f1-49c7-aa52-327ba1411b8a tempest-TenantUsagesNegativeTestJSON-1969318909 tempest-TenantUsagesNegativeTestJSON-1969318909-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:40.548899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:40.558621 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a4c814b7-c6f1-49c7-aa52-327ba1411b8a tempest-TenantUsagesNegativeTestJSON-1969318909 tempest-TenantUsagesNegativeTestJSON-1969318909-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/25a5b294073d4857bf663285cd04f6e6?start=2022-10-13T08%3A45%3A39.778858&end=2022-10-11T08%3A45%3A39.778858" status: 400 len: 111 microversion: 2.1 time: 0.034526 Oct 12 08:45:40.561396 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b7cf831-85b2-42a8-9a77-7975dd9efc7c tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1387 microversion: 2.1 time: 0.567186 Oct 12 08:45:40.561888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 146/356] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Oct 12 08:45:40 2022] GET /compute/v2.1/os-simple-tenant-usage/25a5b294073d4857bf663285cd04f6e6?start=2022-10-13T08%3A45%3A39.778858&end=2022-10-11T08%3A45%3A39.778858 => generated 111 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:45:40.564097 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 211/357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:39 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1387 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:40.581977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:40.582643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:40.586787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:40.586787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:40.597053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:40.600850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:40.603891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:40.606647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:40.606982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:40.607238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:40.607670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:40.608372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:40.608817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:40.609305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:40.609686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:40.614814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:40.932925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:40.942612 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-51727690-91aa-458c-be57-3bfb297968aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.379503 Oct 12 08:45:40.957847 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 147/358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:40 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:41.016001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:41.035409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:41.038038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:41.040600 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4095a2cc-e95a-4c0d-b7b0-ea789a0b5301 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1361 microversion: 2.25 time: 0.474227 Oct 12 08:45:41.042173 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 212/359] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:40 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:41.119700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:41.165251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Searching by: {'deleted': False, 'project_id': '10ef3f8d01bc4380ba8c589480a80168'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:45:41.187006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.191309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.192972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.197163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.199552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.200311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.397286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88d63369-0001-490b-882e-40a1a1e8da91 tempest-TenantUsagesNegativeTestJSON-586860617 tempest-TenantUsagesNegativeTestJSON-586860617-project] Calling method '.version_select at 0x7f98494d8820>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:41.403711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88d63369-0001-490b-882e-40a1a1e8da91 tempest-TenantUsagesNegativeTestJSON-586860617 tempest-TenantUsagesNegativeTestJSON-586860617-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '224f1f3c6302455ca4c7d96d8e02d687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a5b294073d4857bf663285cd04f6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88d63369-0001-490b-882e-40a1a1e8da91 tempest-TenantUsagesNegativeTestJSON-586860617 tempest-TenantUsagesNegativeTestJSON-586860617-project] Request method failure captured: Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T08%3A45%3A39.778858&end=2022-10-13T08%3A45%3A39.778858&detailed=1 HTTP/1.1 Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6yJjC9S2nHMSQMVWxo2SRXO9iRau-swXcNbevrV53G2solRfIfvJ1TTqJiHM6eTtc7sbilITD8hLVGygcI-Tg33wXx-2456toYn80Zf_kptRwFl7ZgVvwVOAcw9SHIPOMd6pN_LO3OK7V3ILnAu0m3PmfcASMlfqUeOZpJH1JYWsg Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 25a5b294073d4857bf663285cd04f6e6 Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-586860617 Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:45:41.415585 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a5b294073d4857bf663285cd04f6e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25a5b294073d4857bf663285cd04f6e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25a5b294073d4857bf663285cd04f6e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a5b294073d4857bf663285cd04f6e6"}]}] Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-586860617 Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 25a5b294073d4857bf663285cd04f6e6 Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-586860617 Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TenantUsagesNegativeTestJSON-586860617-project Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 224f1f3c6302455ca4c7d96d8e02d687 Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-586860617-project Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 08:45:41.416930 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:41.418632 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:41.419647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:41.420796 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 12 08:45:41.420796 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:41.425121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88d63369-0001-490b-882e-40a1a1e8da91 tempest-TenantUsagesNegativeTestJSON-586860617 tempest-TenantUsagesNegativeTestJSON-586860617-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:41.426443 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88d63369-0001-490b-882e-40a1a1e8da91 tempest-TenantUsagesNegativeTestJSON-586860617 tempest-TenantUsagesNegativeTestJSON-586860617-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T08%3A45%3A39.778858&end=2022-10-13T08%3A45%3A39.778858&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.382685 Oct 12 08:45:41.432229 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 213/360] 10.222.0.40 () {58 vars in 1335 bytes} [Wed Oct 12 08:45:41 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T08%3A45%3A39.778858&end=2022-10-13T08%3A45%3A39.778858&detailed=1 => generated 123 bytes in 389 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:41.441005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:41.442568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:41.458145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.459084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.459945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.460915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.461737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.462438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.480913 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2529f4a9-c85e-4c60-8cfa-24c3037e755e tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.521837 Oct 12 08:45:41.483581 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 148/361] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:40 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:41.511927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:41.526561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Searching by: {'deleted': False} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:45:41.533733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.538290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.539083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.539987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.540743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.541326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.574614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.575309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.576361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.579786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lazy-loading 'fault' on Instance uuid cf8eccbb-4ef3-4137-b92e-1542c10d2d0a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:41.748950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:45:41.768635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:41.781861 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-21e10e33-073b-40c9-a127-85f3ff42b56d tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1415 microversion: 2.1 time: 0.347498 Oct 12 08:45:41.793534 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 214/362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:41 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1415 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:41.796939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a8ad99f9-3b98-4b87-9459-c060434f356a req-cc7d24ad-57c1-41e2-a142-9ed442c97330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8eccbb-4ef3-4137-b92e-1542c10d2d0a", "name": "network-vif-deleted", "tag": "19ab9c16-8c97-4f5f-9937-a5c9f12435a5"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:41.820851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a8ad99f9-3b98-4b87-9459-c060434f356a req-cc7d24ad-57c1-41e2-a142-9ed442c97330 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.822763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a8ad99f9-3b98-4b87-9459-c060434f356a req-cc7d24ad-57c1-41e2-a142-9ed442c97330 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.824890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a8ad99f9-3b98-4b87-9459-c060434f356a req-cc7d24ad-57c1-41e2-a142-9ed442c97330 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.853683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a8ad99f9-3b98-4b87-9459-c060434f356a req-cc7d24ad-57c1-41e2-a142-9ed442c97330 service nova] Creating event network-vif-deleted:19ab9c16-8c97-4f5f-9937-a5c9f12435a5 for instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a on n-h1-858383-10 Oct 12 08:45:41.870005 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a8ad99f9-3b98-4b87-9459-c060434f356a req-cc7d24ad-57c1-41e2-a142-9ed442c97330 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082302 Oct 12 08:45:41.872781 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 215/363] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:41.882241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:41.885334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:41.898390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.899255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.903713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.904824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.905912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.906540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:41.996897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:41.997658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:41.998938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.168592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:42.177188 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa024898-753d-4efe-b30e-8df35cf3232e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1586 microversion: 2.1 time: 0.303180 Oct 12 08:45:42.193868 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 216/364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:41 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1586 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:42.211632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:42.213665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:42.222959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.224245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.224944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.225852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.226646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.227215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.412536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:42.448388 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ffcac6c-740f-4af6-9818-84e546572a62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.252059 Oct 12 08:45:42.450820 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 217/365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:42 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:42.456150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:42.457010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:42.465734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.466559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.467565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.468993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.470294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.470987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.660506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:42.672442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:42.673940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:42.675366 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51fe133f-98b2-44c3-bd5f-aed1030de340 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1361 microversion: 2.25 time: 0.223342 Oct 12 08:45:42.676138 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 218/366] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:42 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:42.680969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:42.681478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:42.687773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.688439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.689091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.690287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.690890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.691486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.793972 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f4d86642-87f2-4658-8d73-3c26f16daa68 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116709 Oct 12 08:45:42.797619 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 219/367] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 08:45:42 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:42.818490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:42.819116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:42.836674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.838826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.839267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.839985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.840433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.841269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.919442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:42.924813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:42.925298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:42.925982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lazy-loading 'fault' on Instance uuid cf8eccbb-4ef3-4137-b92e-1542c10d2d0a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:43.008283 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5d4397b-ae4c-4abf-b7f1-fcbe39252825 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11206 microversion: 2.1 time: 1.503891 Oct 12 08:45:43.011391 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 149/368] 10.222.0.40 () {58 vars in 1171 bytes} [Wed Oct 12 08:45:41 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11206 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:43.059153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:43.079280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Searching by: {'deleted': False, 'project_id': '10ef3f8d01bc4380ba8c589480a80168'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:45:43.094584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:43.095116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:43.095633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:43.096566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:43.096882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:43.097309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:43.154635 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-84f3a162-9c6a-4540-802d-c94d6ade25ae tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?tenant_id=b4cc976e520e4b7ea741cdc605abccc6" status: 200 len: 15 microversion: 2.1 time: 0.105119 Oct 12 08:45:43.169690 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 150/369] 10.222.0.40 () {58 vars in 1231 bytes} [Wed Oct 12 08:45:43 2022] GET /compute/v2.1/servers/detail?tenant_id=b4cc976e520e4b7ea741cdc605abccc6 => generated 15 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:43.192697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:43.210779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Searching by: {'tenant_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'deleted': False} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:45:43.218410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:43.219228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:43.219975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:43.220413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '088ae1b875ce4e68a12c234e5cf405b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5568d3dd87fc4fc69b3ef8539fa45fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:43.221022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:43.221645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:43.222068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:43.229500 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-77754b3c-5c73-4a5f-8c34-8fa8b62e1a13 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 200 len: 1308 microversion: 2.1 time: 0.422625 Oct 12 08:45:43.244495 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 220/370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:42 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 1308 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:43.317160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:45:43.420622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:43.422444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:43.423200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:43.427099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:43.473781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:43.474501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:43.482879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:43.484160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:43.486999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:43.487752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:43.489336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:43.489803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.084410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:44.098289 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-da239ee4-6cea-46cb-a6cb-cce963d83fe5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.628657 Oct 12 08:45:44.106528 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 221/371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:43 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:44.112734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.116812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:44.124898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.125384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.130317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.133356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.134127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.138706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.183374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=42 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:44.304310 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1632251d-2f68-4821-a557-3d9a027fc31c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b4cc976e520e4b7ea741cdc605abccc6" status: 200 len: 4833 microversion: 2.1 time: 1.129336 Oct 12 08:45:44.305218 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 151/372] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 12 08:45:43 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b4cc976e520e4b7ea741cdc605abccc6 => generated 4833 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:44.313478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.314516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:44.326943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.327788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.328417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.329320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.332740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.333494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.366197 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] HTTP exception thrown: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Request method failure captured: Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a HTTP/1.1 Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5vMWpvxCxSvLidP5ngALHrhXV_yZx9DwHVHwptP3vVEMgnB_w8iEd6U-Rt8Ca9RMbz2l9LtU8_hEwsRXoQ-7UkmMa_0CwH9aI2XbLQ59UyxHdmixV5aGAFMCCbSZ9NfLc-K6FvC4AoMr7mfEeZP-v1RKrPdfeauO1CTWKJwB_uIHg Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:44.368051 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}] Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 088ae1b875ce4e68a12c234e5cf405b2 Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.369302 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'cf8eccbb-4ef3-4137-b92e-1542c10d2d0a'} Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:44.369990 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.371041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.374175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Returning 404 to user: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:44.376315 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2e50e0b3-f7ef-4f3a-9f8f-d5df80f7dd58 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 404 len: 111 microversion: 2.1 time: 0.069852 Oct 12 08:45:44.378082 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 152/373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:44 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:44.390617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.400173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Searching by: {'tenant_id': '10ef3f8d01bc4380ba8c589480a80168', 'deleted': False} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:45:44.405218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.405980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.406738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.407712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.408389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.409251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.447043 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-afea8689-dd23-4198-a787-10a2b276ae45 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=10ef3f8d01bc4380ba8c589480a80168" status: 200 len: 15 microversion: 2.1 time: 0.066567 Oct 12 08:45:44.448533 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 153/374] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 12 08:45:44 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=10ef3f8d01bc4380ba8c589480a80168 => generated 15 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:44.457327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.458077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:44.461553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:44.466513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.467256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.468073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.469107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.469728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.470367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.474354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:44.475945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:44.477536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-131b50e5-20df-4ad6-980b-185f905b3968 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1361 microversion: 2.25 time: 0.369507 Oct 12 08:45:44.478117 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 222/375] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:44 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1361 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:44.495751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05630ae5-f9ad-448b-8ac2-37655953c326 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.503312 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05630ae5-f9ad-448b-8ac2-37655953c326 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.018524 Oct 12 08:45:44.507046 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 223/376] 10.222.0.40 () {58 vars in 1189 bytes} [Wed Oct 12 08:45:44 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:44.516540 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] HTTP exception thrown: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Request method failure captured: Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a HTTP/1.1 Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5vMWpvxCxSvLidP5ngALHrhXV_yZx9DwHVHwptP3vVEMgnB_w8iEd6U-Rt8Ca9RMbz2l9LtU8_hEwsRXoQ-7UkmMa_0CwH9aI2XbLQ59UyxHdmixV5aGAFMCCbSZ9NfLc-K6FvC4AoMr7mfEeZP-v1RKrPdfeauO1CTWKJwB_uIHg Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:44.520406 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}] Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 088ae1b875ce4e68a12c234e5cf405b2 Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.521704 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'cf8eccbb-4ef3-4137-b92e-1542c10d2d0a'} Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:44.522330 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.523366 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.525690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Returning 404 to user: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:44.527341 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7fb446c8-9311-4bd3-885e-b7fdf6f57191 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 404 len: 111 microversion: 2.1 time: 0.075989 Oct 12 08:45:44.530874 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 154/377] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:45:44 2022] DELETE /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:44.533490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:44.535755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:44.539044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.539651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: cf8eccbb-4ef3-4137-b92e-1542c10d2d0a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:44.548441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.548939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.549379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.550121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.550575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.550998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.567849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.568343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.576526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.577365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.577871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.580182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.636151 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] HTTP exception thrown: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Request method failure captured: Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a HTTP/1.1 Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5vMWpvxCxSvLidP5ngALHrhXV_yZx9DwHVHwptP3vVEMgnB_w8iEd6U-Rt8Ca9RMbz2l9LtU8_hEwsRXoQ-7UkmMa_0CwH9aI2XbLQ59UyxHdmixV5aGAFMCCbSZ9NfLc-K6FvC4AoMr7mfEeZP-v1RKrPdfeauO1CTWKJwB_uIHg Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:44.637733 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}] Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 088ae1b875ce4e68a12c234e5cf405b2 Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.638877 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'cf8eccbb-4ef3-4137-b92e-1542c10d2d0a'} Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:44.639540 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. Oct 12 08:45:44.640646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.641750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Returning 404 to user: Instance cf8eccbb-4ef3-4137-b92e-1542c10d2d0a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:44.641750 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-80086101-59d8-4733-8f49-c61596de4050 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a" status: 404 len: 111 microversion: 2.1 time: 0.103781 Oct 12 08:45:44.641750 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 155/378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:44 2022] GET /compute/v2.1/servers/cf8eccbb-4ef3-4137-b92e-1542c10d2d0a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:45:44.660206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.660704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:44.677362 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bd434a9f-cc0f-47e4-ba3f-c03acfc9ab0f tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action" status: 202 len: 0 microversion: 2.1 time: 0.150635 Oct 12 08:45:44.678554 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 224/379] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:45:44 2022] POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:45:44.685932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.689257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.690092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.690539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.691270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.691721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.692139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.699777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:44.703841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:45:44.718911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.719938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.721771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.724051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.724836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.727432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.742947 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] HTTP exception thrown: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Request method failure captured: Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 HTTP/1.1 Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5vMWpvxCxSvLidP5ngALHrhXV_yZx9DwHVHwptP3vVEMgnB_w8iEd6U-Rt8Ca9RMbz2l9LtU8_hEwsRXoQ-7UkmMa_0CwH9aI2XbLQ59UyxHdmixV5aGAFMCCbSZ9NfLc-K6FvC4AoMr7mfEeZP-v1RKrPdfeauO1CTWKJwB_uIHg Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:44.744533 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}] Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 088ae1b875ce4e68a12c234e5cf405b2 Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.745996 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e92a4de5-5552-4f10-afa8-0d986c065129'} Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:44.749706 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.750846 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.751975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Returning 404 to user: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:44.751975 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-725f13e4-4e78-4ae6-8b1d-7600592e6451 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 404 len: 111 microversion: 2.1 time: 0.099326 Oct 12 08:45:44.751975 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 156/380] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:45:44 2022] DELETE /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:44.771831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:44.772667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] [instance: e92a4de5-5552-4f10-afa8-0d986c065129] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:44.787620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.788173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.788503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.789190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:44.789668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:44.805697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:44.833912 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] HTTP exception thrown: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Request method failure captured: Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 HTTP/1.1 Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn5vMWpvxCxSvLidP5ngALHrhXV_yZx9DwHVHwptP3vVEMgnB_w8iEd6U-Rt8Ca9RMbz2l9LtU8_hEwsRXoQ-7UkmMa_0CwH9aI2XbLQ59UyxHdmixV5aGAFMCCbSZ9NfLc-K6FvC4AoMr7mfEeZP-v1RKrPdfeauO1CTWKJwB_uIHg Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:44.835448 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5568d3dd87fc4fc69b3ef8539fa45fe4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5568d3dd87fc4fc69b3ef8539fa45fe4"}]}] Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 5568d3dd87fc4fc69b3ef8539fa45fe4 Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-692282452 Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 088ae1b875ce4e68a12c234e5cf405b2 Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersAdminTestJSON-692282452-project Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.836652 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e92a4de5-5552-4f10-afa8-0d986c065129'} Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:44.837326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. Oct 12 08:45:44.842024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:44.842980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] Returning 404 to user: Instance e92a4de5-5552-4f10-afa8-0d986c065129 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:44.842980 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cd358e28-3e8c-4dfe-9076-94f2c94637c9 tempest-DeleteServersAdminTestJSON-692282452 tempest-DeleteServersAdminTestJSON-692282452-project] 10.222.0.40 "GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129" status: 404 len: 111 microversion: 2.1 time: 0.068872 Oct 12 08:45:44.842980 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 157/381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:44 2022] GET /compute/v2.1/servers/e92a4de5-5552-4f10-afa8-0d986c065129 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:44.969028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:45:45.100480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:45.103529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:45.125104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.125927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.126705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:45.129950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.133733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.134470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:45.193403 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f3a61fc-7dab-4cf3-a89e-a74d807b3a45 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.509998 Oct 12 08:45:45.200350 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 225/382] 10.222.0.40 () {58 vars in 1150 bytes} [Wed Oct 12 08:45:44 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:45.209611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d86109f6-60d0-4b76-adde-57fbf1c39b09 req-80baa9d0-8942-4e42-8f10-25dde483d059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2097f23a-de33-42bd-b1d9-4c9fbbf9f553", "tag": "f261bcbd-3b91-4089-a880-324a5143feae"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:45.233885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d86109f6-60d0-4b76-adde-57fbf1c39b09 req-80baa9d0-8942-4e42-8f10-25dde483d059 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.234551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d86109f6-60d0-4b76-adde-57fbf1c39b09 req-80baa9d0-8942-4e42-8f10-25dde483d059 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.235172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d86109f6-60d0-4b76-adde-57fbf1c39b09 req-80baa9d0-8942-4e42-8f10-25dde483d059 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:45.253760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d86109f6-60d0-4b76-adde-57fbf1c39b09 req-80baa9d0-8942-4e42-8f10-25dde483d059 service nova] Creating event network-changed:f261bcbd-3b91-4089-a880-324a5143feae for instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 on n-h2-858383-10 Oct 12 08:45:45.270272 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d86109f6-60d0-4b76-adde-57fbf1c39b09 req-80baa9d0-8942-4e42-8f10-25dde483d059 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062975 Oct 12 08:45:45.271645 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 226/383] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:45.279284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:45.286685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:45.295468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.298995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.299826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:45.301903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.303385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.304940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:45.758472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:45.771468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6980b65-7336-4a80-a581-cb040f09af8a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.498248 Oct 12 08:45:45.772441 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 227/384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:45 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:45.789322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:45.792819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:45.800578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.801209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.802034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:45.802995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.803512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.804033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:45.869766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:45.925293 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-084e30ad-4e01-48eb-88e9-ecd504e8709b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action" status: 202 len: 0 microversion: 2.1 time: 0.150700 Oct 12 08:45:45.934169 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 228/385] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:45:45 2022] POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:45:45.940797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:45.941694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:45.948603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.949405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.950222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:45.951956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:45.952629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:45.953265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:46.101035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:46.109312 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e6584ef-78e9-4f40-9f61-c3c34dc2285e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 200 len: 1586 microversion: 2.1 time: 1.020709 Oct 12 08:45:46.109919 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 158/386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:45 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 1586 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:46.310649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-471134bd-c5e3-42e1-bccc-fdc3ad501891 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1564959269", "id": 1766010346, "os-flavor-access:is_public": "False"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:46.322507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:46.332924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:46.336216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:46.339767 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a5181fa7-0149-4af1-96a6-b07c38473c46 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1361 microversion: 2.25 time: 0.403933 Oct 12 08:45:46.355826 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-471134bd-c5e3-42e1-bccc-fdc3ad501891 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.236147 Oct 12 08:45:46.359578 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 229/387] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:45 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1361 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:46.368432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ccb7aff7-7b30-43bf-92a1-47b623620f51 req-d8750c74-de8c-458e-91b2-7a8f91712b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7d54d7-366a-49f9-bd42-d252f7868e2d", "name": "network-vif-plugged", "status": "completed", "tag": "ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:46.374274 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 159/388] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:45:46 2022] POST /compute/v2.1/flavors => generated 431 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:46.383444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ccb7aff7-7b30-43bf-92a1-47b623620f51 req-d8750c74-de8c-458e-91b2-7a8f91712b66 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:46.384283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ccb7aff7-7b30-43bf-92a1-47b623620f51 req-d8750c74-de8c-458e-91b2-7a8f91712b66 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:46.385145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:46.386615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:46.396038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:46.396385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ccb7aff7-7b30-43bf-92a1-47b623620f51 req-d8750c74-de8c-458e-91b2-7a8f91712b66 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:46.397550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:46.398464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:46.399415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:46.400060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:46.400858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:46.416642 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ccb7aff7-7b30-43bf-92a1-47b623620f51 req-d8750c74-de8c-458e-91b2-7a8f91712b66 service nova] Creating event network-vif-plugged:ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7 for instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d on n-h1-858383-10 Oct 12 08:45:46.423807 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ccb7aff7-7b30-43bf-92a1-47b623620f51 req-d8750c74-de8c-458e-91b2-7a8f91712b66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062124 Oct 12 08:45:46.425223 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 230/389] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:46.432092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4c6dbd8-52ec-4a1f-a13d-771706eb4c58 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f579e1759a7d4d87b22efd0a12a6d843"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:46.750054 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4c6dbd8-52ec-4a1f-a13d-771706eb4c58 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1766010346/action" status: 200 len: 97 microversion: 2.1 time: 0.322715 Oct 12 08:45:46.752656 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 231/390] 10.222.0.40 () {60 vars in 1200 bytes} [Wed Oct 12 08:45:46 2022] POST /compute/v2.1/flavors/1766010346/action => generated 97 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:47.098682 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-614e1de6-9a29-4024-b684-2d28884fcdb7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1617 microversion: 2.1 time: 0.723199 Oct 12 08:45:47.121977 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 160/391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:46 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1617 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:47.138646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:47.139250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:47.152873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:47.153375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:47.164818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:47.166224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:47.169047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:47.171056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:47.491940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-746d8616-51e8-4f40-9b4f-2d8b079c8b70 tempest-FlavorsAccessTestJSON-456057180 tempest-FlavorsAccessTestJSON-456057180-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:47.564240 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-746d8616-51e8-4f40-9b4f-2d8b079c8b70 tempest-FlavorsAccessTestJSON-456057180 tempest-FlavorsAccessTestJSON-456057180-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.805052 Oct 12 08:45:47.571450 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 232/392] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:46 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:47.588954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:47.592105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:47.613773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:47.614836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:47.618187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:47.623266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:47.624929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:47.630780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:47.950418 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5951bed6-845d-45fe-b9f2-fe7f0dc28766 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1617 microversion: 2.1 time: 0.375468 Oct 12 08:45:47.950993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 233/393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:47 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1617 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:47.988699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:47.989312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:48.018048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:48.018570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:48.019018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:48.019754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:48.020210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:48.020635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:48.125569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:48.138624 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bbf67856-ae41-4537-9488-7b9a699d44b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 1.014673 Oct 12 08:45:48.139223 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 161/394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:47 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:48.161631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3fc2841-1c71-44e1-b13a-9a6d3fb88f2a tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f579e1759a7d4d87b22efd0a12a6d843"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:48.312811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:48.330031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:48.331465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:48.332584 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-49c4533d-6718-458d-ac43-26e21bf31d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1361 microversion: 2.25 time: 0.364209 Oct 12 08:45:48.339288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 234/395] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:47 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:48.349196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:48.359497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Searching by: {'host': 'n-h2-858383-10', 'deleted': False} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:45:48.378169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:48.379172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:48.379621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:48.381628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:48.382883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:48.386791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:48.675431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:45:48.819538 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13330ce7-8e18-4510-b072-9134ab8fd43c tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=n-h2-858383-10&all_tenants=1" status: 200 len: 1330 microversion: 2.1 time: 0.478632 Oct 12 08:45:48.826224 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 235/396] 10.222.0.40 () {58 vars in 1192 bytes} [Wed Oct 12 08:45:48 2022] GET /compute/v2.1/servers?host=n-h2-858383-10&all_tenants=1 => generated 1330 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:48.895326 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3fc2841-1c71-44e1-b13a-9a6d3fb88f2a tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1766010346/action" status: 200 len: 21 microversion: 2.1 time: 0.754982 Oct 12 08:45:48.899678 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 162/397] 10.222.0.40 () {60 vars in 1200 bytes} [Wed Oct 12 08:45:48 2022] POST /compute/v2.1/flavors/1766010346/action => generated 21 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:48.908900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:48.929213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:45:48.945903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:48.946724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:48.949234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:48.953386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:48.956130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:48.956767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.129098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1286722010", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:49.171766 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2cd32052-ac2d-4924-a86c-b1c201a405cc tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.270554 Oct 12 08:45:49.181790 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 163/398] 10.222.0.40 () {58 vars in 1196 bytes} [Wed Oct 12 08:45:48 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:49.198891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-57781d86-5763-4930-a268-62f68680c074 tempest-FlavorsAccessTestJSON-456057180 tempest-FlavorsAccessTestJSON-456057180-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:49.241127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:45:49.300208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-57781d86-5763-4930-a268-62f68680c074 tempest-FlavorsAccessTestJSON-456057180 tempest-FlavorsAccessTestJSON-456057180-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.114321 Oct 12 08:45:49.301704 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 164/399] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:49 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:49.307028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:49.307889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:49.316141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:49.316866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:49.317528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.318448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:49.319222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:49.319993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.586901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:49.596881 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bf582f99-6854-40d1-84ff-6bf48fb858fd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.293778 Oct 12 08:45:49.597708 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 165/400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:49 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:49.602725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:49.605882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:49.612917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:49.613977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:49.614555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.615780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:49.616545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:49.617102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.716313 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-018d60d1-411e-40dc-a8f0-afcd3ecf753b tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action" status: 202 len: 0 microversion: 2.1 time: 0.117175 Oct 12 08:45:49.717519 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 166/401] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:45:49 2022] POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:45:49.722379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-98010c04-a848-41c3-a940-e3d48f606e83 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:49.761386 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-98010c04-a848-41c3-a940-e3d48f606e83 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1766010346" status: 202 len: 0 microversion: 2.1 time: 0.041852 Oct 12 08:45:49.763349 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 167/402] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:45:49 2022] DELETE /compute/v2.1/flavors/1766010346 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:45:49.772176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:49.773634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:49.779145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=8,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:49.785474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:49.786373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:49.787257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.788525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:49.789241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:49.789933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.909677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:45:49.910122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:45:49.910550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:45:49.910952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:45:49.911361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:45:49.922661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:49.924729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:49.925389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.927295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:49.928137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:49.930120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:49.967052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Getting quotas for project 75c444d5d31d4ca5bb47e040b1541594. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:45:49.974783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Getting quotas for user 3d7a6a36aadd4818b0422f824718f3f0 and project 75c444d5d31d4ca5bb47e040b1541594. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:45:50.020268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:45:50.023255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:45:50.057817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:50.068617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:50.070093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:50.071253 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58d59b2e-5450-4415-9ecc-d4d823c075e2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1556 microversion: 2.25 time: 0.306234 Oct 12 08:45:50.074516 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 168/403] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:49 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1556 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:50.082729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:50.085665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:50.094749 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7b8344d8-ee30-46dc-84e5-52496ebd16df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264774 Oct 12 08:45:50.102574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.102574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.102574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.102574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.102927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.102927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.103836 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 236/404] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:45:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:45:50.109058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-92d2adcc-8192-48af-9483-021cb9494221 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:50.139958 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-92d2adcc-8192-48af-9483-021cb9494221 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.034496 Oct 12 08:45:50.158871 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 237/405] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:50 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:50.209399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:45:50.210410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:45:50.211029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:45:50.211579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:45:50.212305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:45:50.287652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:50.295375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.296150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.297415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.298975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.299748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.300423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.338082 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-67a0f064-90c1-45bd-8e54-69132e3f2b09 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action" status: 202 len: 1068 microversion: 2.1 time: 0.262139 Oct 12 08:45:50.352001 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 169/406] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:45:50 2022] POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action => generated 1068 bytes in 264 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 08:45:50.352001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3780a1e3-ea23-44c1-9b5f-0b2fb7154a66 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:50.352001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3780a1e3-ea23-44c1-9b5f-0b2fb7154a66 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:50.413771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3780a1e3-ea23-44c1-9b5f-0b2fb7154a66 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:50.430114 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3780a1e3-ea23-44c1-9b5f-0b2fb7154a66 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1217 microversion: 2.1 time: 0.088656 Oct 12 08:45:50.440580 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 170/407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:50 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:50.446115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6199242d-8f81-4857-bc84-c1cad80330a7 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-75697354", "id": 783914395, "os-flavor-access:is_public": "False"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:50.476029 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6199242d-8f81-4857-bc84-c1cad80330a7 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.033875 Oct 12 08:45:50.483331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 171/408] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:45:50 2022] POST /compute/v2.1/flavors => generated 426 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:50.491561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:50.494245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:50.503084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.504649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.505265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.506204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.510160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.514458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:50.515262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:50.518463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.525300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.526014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.526658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.527537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.528160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.528752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.741413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:50.746443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 5f7d54d7-366a-49f9-bd42-d252f7868e2d {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:50.752119 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05a5c74d-1058-4cfd-bcf6-b836d625ba48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.267270 Oct 12 08:45:50.752715 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 172/409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:50 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:50.824466 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f755b8b5-a88a-47b8-b7a5-5239ea20f5fa tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 2050 microversion: 2.25 time: 0.664203 Oct 12 08:45:50.825348 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 238/410] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:50 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 2050 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:50.835576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5246e422-6711-4058-9dea-e5104c5859f7 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:50.846278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cac52957-327b-4ba0-8997-b439bd5c7395 tempest-FlavorsV261TestJSON-2082922110 tempest-FlavorsV261TestJSON-2082922110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1243124673", "id": 1683541881, "os-flavor-access:is_public": "True"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:50.863430 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5246e422-6711-4058-9dea-e5104c5859f7 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/783914395/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.036747 Oct 12 08:45:50.864301 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 239/411] 10.222.0.40 () {58 vars in 1206 bytes} [Wed Oct 12 08:45:50 2022] GET /compute/v2.1/flavors/783914395/os-flavor-access => generated 21 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:45:50.872924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:50.873662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:50.888913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.889712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.890298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.893355 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cac52957-327b-4ba0-8997-b439bd5c7395 tempest-FlavorsV261TestJSON-2082922110 tempest-FlavorsV261TestJSON-2082922110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.139540 Oct 12 08:45:50.894126 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 173/412] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:45:50 2022] POST /compute/v2.1/flavors => generated 468 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:50.894864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.895541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.896172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.909876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:50.910485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:50.919901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.920489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.920926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:50.921833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:50.922645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:50.922822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:51.083089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:51.094453 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-332b4bb4-308d-41ce-9011-d91fb4dbd645 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.225732 Oct 12 08:45:51.098868 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 240/413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:50 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:51.106475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2fc04dac-0655-44b2-9174-a4a48c3f1384 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.134455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:51.138619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2fc04dac-0655-44b2-9174-a4a48c3f1384 tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/783914395" status: 202 len: 0 microversion: 2.1 time: 0.038337 Oct 12 08:45:51.146250 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 241/414] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:45:51 2022] DELETE /compute/v2.1/flavors/783914395 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:45:51.214425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 5f7d54d7-366a-49f9-bd42-d252f7868e2d {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:51.272565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45f4c7db-3042-4677-92c5-4b4a9f894427 tempest-FlavorsV261TestJSON-1289545099 tempest-FlavorsV261TestJSON-1289545099-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.280047 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-91214471-cadf-4c9a-8b19-d49144424d51 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 2050 microversion: 2.25 time: 0.384835 Oct 12 08:45:51.282520 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 174/415] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:50 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 2050 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:51.286497 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45f4c7db-3042-4677-92c5-4b4a9f894427 tempest-FlavorsV261TestJSON-1289545099 tempest-FlavorsV261TestJSON-1289545099-project] 10.222.0.40 "GET /compute/v2.1/flavors/1683541881" status: 200 len: 468 microversion: 2.61 time: 0.137995 Oct 12 08:45:51.287935 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 242/416] 10.222.0.40 () {60 vars in 1199 bytes} [Wed Oct 12 08:45:51 2022] GET /compute/v2.1/flavors/1683541881 => generated 468 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:51.305221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5da5ada-7349-4b36-99c2-afe7d9e015a3 tempest-FlavorsV261TestJSON-2082922110 tempest-FlavorsV261TestJSON-2082922110-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:51.305774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d57d2d3d-7b73-4a3c-a293-4e1f23034a3b tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.353065 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d57d2d3d-7b73-4a3c-a293-4e1f23034a3b tempest-FlavorsAccessTestJSON-1784290236 tempest-FlavorsAccessTestJSON-1784290236-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.1 time: 0.069401 Oct 12 08:45:51.354347 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 175/417] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:51 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:51.359703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-23c130a4-9a06-4479-b163-c4b4679d36f3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.364013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c130a4-9a06-4479-b163-c4b4679d36f3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:51.364684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c130a4-9a06-4479-b163-c4b4679d36f3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:51.365277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c130a4-9a06-4479-b163-c4b4679d36f3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:51.366177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c130a4-9a06-4479-b163-c4b4679d36f3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:51.366805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c130a4-9a06-4479-b163-c4b4679d36f3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:51.367385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c130a4-9a06-4479-b163-c4b4679d36f3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:51.385331 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5da5ada-7349-4b36-99c2-afe7d9e015a3 tempest-FlavorsV261TestJSON-2082922110 tempest-FlavorsV261TestJSON-2082922110-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1683541881" status: 200 len: 469 microversion: 2.61 time: 0.087421 Oct 12 08:45:51.386987 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 243/418] 10.222.0.40 () {62 vars in 1219 bytes} [Wed Oct 12 08:45:51 2022] PUT /compute/v2.1/flavors/1683541881 => generated 469 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:51.405901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ac30898-5e99-4532-8bab-cf2af7482b4a tempest-FlavorsV261TestJSON-1289545099 tempest-FlavorsV261TestJSON-1289545099-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.406633 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-23c130a4-9a06-4479-b163-c4b4679d36f3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.050707 Oct 12 08:45:51.407221 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 176/419] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 12 08:45:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:51.420791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": "auto"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:51.430623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:51.440125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:51.440620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:51.441055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:51.441786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:51.442237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:51.442659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:51.443820 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ac30898-5e99-4532-8bab-cf2af7482b4a tempest-FlavorsV261TestJSON-1289545099 tempest-FlavorsV261TestJSON-1289545099-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.043686 Oct 12 08:45:51.444629 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 244/420] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 12 08:45:51 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:51.471282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.472236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:51.486412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:51.486911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:51.487352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:51.488063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:51.488518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:51.488942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:51.548264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'flavor' on Instance uuid 5f7d54d7-366a-49f9-bd42-d252f7868e2d {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:45:51.604282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:51.615659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8eda985c-58a1-4474-ab0c-99161144f90f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1269 microversion: 2.1 time: 0.153221 Oct 12 08:45:51.630793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Going to try to live migrate instance to n-h2-858383-10 {{(pid=127007) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:45:51.631477 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 245/421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:51 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:51.635625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:51.639779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b90f65b4-80de-49f2-9577-01f75cc22420 tempest-FlavorsV261TestJSON-1289545099 tempest-FlavorsV261TestJSON-1289545099-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.672055 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b90f65b4-80de-49f2-9577-01f75cc22420 tempest-FlavorsV261TestJSON-1289545099 tempest-FlavorsV261TestJSON-1289545099-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.039105 Oct 12 08:45:51.673291 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 246/422] 10.222.0.40 () {60 vars in 1166 bytes} [Wed Oct 12 08:45:51 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:51.692007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ccb5f13b-9f48-4482-956d-c7441878cff0 tempest-FlavorsV261TestJSON-2082922110 tempest-FlavorsV261TestJSON-2082922110-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.716568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ccb5f13b-9f48-4482-956d-c7441878cff0 tempest-FlavorsV261TestJSON-2082922110 tempest-FlavorsV261TestJSON-2082922110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1683541881" status: 202 len: 0 microversion: 2.61 time: 0.029715 Oct 12 08:45:51.717566 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 247/423] 10.222.0.40 () {60 vars in 1202 bytes} [Wed Oct 12 08:45:51 2022] DELETE /compute/v2.1/flavors/1683541881 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:45:51.726467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05595b05-8e82-44a7-96b4-8532c49dff7c tempest-FlavorsV261TestJSON-2082922110 tempest-FlavorsV261TestJSON-2082922110-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.757030 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05595b05-8e82-44a7-96b4-8532c49dff7c tempest-FlavorsV261TestJSON-2082922110 tempest-FlavorsV261TestJSON-2082922110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.034606 Oct 12 08:45:51.771813 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 248/424] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 12 08:45:51 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:51.813415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:51.814247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:51.826552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:51.827005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:51.827508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:51.828163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:51.829807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:51.835805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:52.088606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:52.099697 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0908c627-e4fe-4cee-94bb-dfa1d7944577 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.324880 Oct 12 08:45:52.101891 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 249/425] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:51 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:52.123977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:52.125719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:52.142665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:52.146265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:52.148865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:52.149782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:52.150601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:52.153208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:52.428764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:52.443593 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aad2bf00-d97f-4e7f-b36c-ee99b52ba827 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1477 microversion: 2.1 time: 0.323658 Oct 12 08:45:52.460700 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 250/426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:52 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1477 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:52.642279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:52.642889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:52.652288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:52.652934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:52.653909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:52.655140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:52.655541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:52.655968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:52.808802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:52.830218 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc7cac31-df3b-48b9-aff7-a949ef7fb467 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1269 microversion: 2.1 time: 0.190300 Oct 12 08:45:52.847667 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 251/427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:52 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1269 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:53.133650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:53.134687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:53.147665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:53.152264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:53.154485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:53.155940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:53.156672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:53.157667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:53.557234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:53.567169 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-903f0d2d-bbf7-4ce0-b144-f116a5aaf933 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.439671 Oct 12 08:45:53.569147 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 252/428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:53 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:53.574842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:53.575449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:53.581798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:53.582470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:53.583070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:53.583917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:53.584527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:53.584949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:53.930755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:53.942402 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-781d5cc3-590f-44ac-a0f5-743e4b51f9f0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1476 microversion: 2.1 time: 0.372029 Oct 12 08:45:53.943372 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 253/429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:53 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:53.948500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:53.949361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:53.956089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:53.956739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:53.957316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:53.958232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:53.958847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:53.959365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:54.066924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:54.082821 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b0bfb4aa-f080-455e-9a86-51aeabc77254 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1275 microversion: 2.1 time: 0.138139 Oct 12 08:45:54.096212 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 254/430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:53 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:54.594036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:54.595667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:54.622933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:54.625582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:54.628528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:54.629675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:54.630576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:54.632317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:54.724225 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae80af71-cba9-4e87-a9bd-3c47d3e419e4 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d/action" status: 202 len: 0 microversion: 2.25 time: 3.308015 Oct 12 08:45:54.725260 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 177/431] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:45:51 2022] POST /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d/action => generated 0 bytes in 3310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:45:54.734776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:54.737423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:54.754486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:54.755357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:54.757170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:54.758801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:54.760313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:54.761156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:54.924315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:54.936987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:54.938392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:54.940141 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-01aebf7b-13c1-485a-8b04-98fed4832d24 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.210241 Oct 12 08:45:54.940852 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 178/432] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:54 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:54.965951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:54.966646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:54.974496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:54.976553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:54.977338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:54.978646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:54.979275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:54.979869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:55.167086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:55.176071 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5fbacf1-9a0b-43a6-b461-bcdad9fe4aa0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1476 microversion: 2.1 time: 0.213801 Oct 12 08:45:55.176855 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 179/433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:54 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:55.194013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:55.195208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:55.212254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:55.212752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:55.213190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:55.214023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:55.214506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:55.215003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:55.330535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:55.343699 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ffc443cd-ef19-4277-9cb2-aa368411d983 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1275 microversion: 2.1 time: 0.163571 Oct 12 08:45:55.344276 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 180/434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:55 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:55.670928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:55.674522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:45:55.679648 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0c09b2f8-4ebd-454b-bff7-3d01022c870a tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 1.091529 Oct 12 08:45:55.686394 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 255/435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:54 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:55.967957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:55.969080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:55.978478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:55.988128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:55.988822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:55.990248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:55.992207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:55.996510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:56.201693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:56.202217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:56.224628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:56.225121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:56.225582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:56.226291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:56.226830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:56.227145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:56.652315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:56.666385 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b4d2e80-4513-4d41-b8ce-19f0e5054068 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1476 microversion: 2.1 time: 0.465121 Oct 12 08:45:56.667744 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 256/436] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:56 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1476 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:56.681495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:56.682812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:56.700865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:56.701485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:56.702196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:56.703067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:56.703660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:56.704207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:56.835734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:56.871303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:56.872951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:56.874521 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a69ed3f8-582f-4ab1-bd27-ff349f690150 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.910677 Oct 12 08:45:56.875530 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 181/437] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:55 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:56.880709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-179bcb23-c14b-4cf2-bbad-d39f6cb78bd5 req-75832c30-b959-45ed-8b27-a916ead1af67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744cfd99-597c-4504-af66-6ba5723fcbee", "name": "network-vif-unplugged", "status": "completed", "tag": "865792b9-525d-4c68-888b-8212face2199"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:56.907837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-179bcb23-c14b-4cf2-bbad-d39f6cb78bd5 req-75832c30-b959-45ed-8b27-a916ead1af67 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:56.908842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-179bcb23-c14b-4cf2-bbad-d39f6cb78bd5 req-75832c30-b959-45ed-8b27-a916ead1af67 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:56.909416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-179bcb23-c14b-4cf2-bbad-d39f6cb78bd5 req-75832c30-b959-45ed-8b27-a916ead1af67 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:56.926533 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-179bcb23-c14b-4cf2-bbad-d39f6cb78bd5 req-75832c30-b959-45ed-8b27-a916ead1af67 service nova] Creating event network-vif-unplugged:865792b9-525d-4c68-888b-8212face2199 for instance 744cfd99-597c-4504-af66-6ba5723fcbee on n-h2-858383-10 Oct 12 08:45:56.942892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-179bcb23-c14b-4cf2-bbad-d39f6cb78bd5 req-75832c30-b959-45ed-8b27-a916ead1af67 service nova] Instance 744cfd99-597c-4504-af66-6ba5723fcbee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:45:56.958117 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-179bcb23-c14b-4cf2-bbad-d39f6cb78bd5 req-75832c30-b959-45ed-8b27-a916ead1af67 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080991 Oct 12 08:45:56.958914 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 182/438] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:57.221391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:57.239789 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ccb6b931-4f2b-4726-8d37-a208f04e09f2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1317 microversion: 2.1 time: 0.570414 Oct 12 08:45:57.240300 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 257/439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:56 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:57.250653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.254248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:57.270207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.271627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.272834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.274130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.274765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.275353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.376443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Calling method '.version_select at 0x7f9848e57f70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.379058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.379741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.380536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.397171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.397693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.398477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.410903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.411793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.412425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.419915 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-51dc9bc9-5d0e-4c7c-aa36-62198a07cb0e tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.459507 Oct 12 08:45:57.420504 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 183/440] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:57.491979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Calling method '.version_select at 0x7f9848e57dc0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.493835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.494319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.494781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.519520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.520234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.520833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.537316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.538148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.538722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.546649 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-84fd8db6-58a6-4b4b-a811-35f90c6da219 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.118834 Oct 12 08:45:57.547633 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 184/441] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:57.663135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bedcb8e3-7261-4592-a9bb-be6161eaac32 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] Calling method '.version_select at 0x7f9848e57430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.665729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bedcb8e3-7261-4592-a9bb-be6161eaac32 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '9aa1560ffe414080b3fa8aeba09e6684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec79f2d22afd4f72ac781432df1c04f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bedcb8e3-7261-4592-a9bb-be6161eaac32 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] Request method failure captured: Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-hypervisors/n-h1-858383-10/search HTTP/1.1 Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7DZ0aB0mmkfzgYbQ4yoplCUl8bBL0Pd-pUHW6DWRFcLMOyA0K-I4L-mGSqNW4ym4W5J1bACuHMdAtIGn9HN_0fG8VlGcjTS74iRIyhv-sK2TMSlDy4jjbQ6mgJ17pNc3Jb9z3fRGWzyvBVDHkG6UOcYKEmdlJcof-jiYfmG5wbKLs Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: ec79f2d22afd4f72ac781432df1c04f4 Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1511519413 Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:57.667753 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec79f2d22afd4f72ac781432df1c04f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec79f2d22afd4f72ac781432df1c04f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec79f2d22afd4f72ac781432df1c04f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec79f2d22afd4f72ac781432df1c04f4"}]}] Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1511519413 Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: ec79f2d22afd4f72ac781432df1c04f4 Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1511519413 Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 9aa1560ffe414080b3fa8aeba09e6684 Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 08:45:57.668936 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'n-h1-858383-10'} Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:57.669652 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 12 08:45:57.670701 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.671632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bedcb8e3-7261-4592-a9bb-be6161eaac32 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:57.671700 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bedcb8e3-7261-4592-a9bb-be6161eaac32 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h1-858383-10/search" status: 403 len: 117 microversion: 2.1 time: 0.123173 Oct 12 08:45:57.672883 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 185/442] 10.222.0.40 () {58 vars in 1212 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-10/search => generated 117 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:57.678851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5de15738-246c-4f47-919e-a7ca60fbd9c8 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Calling method '.version_select at 0x7f9848f8baf0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.681119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de15738-246c-4f47-919e-a7ca60fbd9c8 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.681827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de15738-246c-4f47-919e-a7ca60fbd9c8 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.682279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de15738-246c-4f47-919e-a7ca60fbd9c8 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.709592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de15738-246c-4f47-919e-a7ca60fbd9c8 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.710086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de15738-246c-4f47-919e-a7ca60fbd9c8 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.710982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de15738-246c-4f47-919e-a7ca60fbd9c8 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.720115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:57.725204 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5de15738-246c-4f47-919e-a7ca60fbd9c8 tempest-HypervisorAdminV228Test-1391786154 tempest-HypervisorAdminV228Test-1391786154-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.051218 Oct 12 08:45:57.737234 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 186/443] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:45:57.737234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d26c541-d84b-47a5-a2d1-9c7aa018d225 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Calling method '.version_select at 0x7f9848f8b430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.737234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d26c541-d84b-47a5-a2d1-9c7aa018d225 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.737234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d26c541-d84b-47a5-a2d1-9c7aa018d225 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.737774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d26c541-d84b-47a5-a2d1-9c7aa018d225 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.746180 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-26344e63-288a-47b4-9ad4-07f523489234 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.503557 Oct 12 08:45:57.747477 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 258/444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:57.766087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.767101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:57.780455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.781471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.782202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.783126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.783783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.784732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.796958 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-4d26c541-d84b-47a5-a2d1-9c7aa018d225 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d26c541-d84b-47a5-a2d1-9c7aa018d225 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Request method failure captured: Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7EmNfUDYbMRCNTROcOohXVWOVuf8QKAaW4DvsLcPPJhToab0gWeN5MPXT1xZNxGOljxrblQItFweLVISE69L-qqBnEg4Z69oLd5oaeVnDkiAptlGipqVlqCNSLyDLwut0novnEQwLA_WRETnCVTbaHke4ZbLvvZQePpmzl_vgIM4c Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a38c4a84672e493cac699e6d3a6d19b9 Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1015322002 Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:45:57.798870 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a38c4a84672e493cac699e6d3a6d19b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a38c4a84672e493cac699e6d3a6d19b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a38c4a84672e493cac699e6d3a6d19b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a38c4a84672e493cac699e6d3a6d19b9"}]}] Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1015322002 Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a38c4a84672e493cac699e6d3a6d19b9 Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1015322002 Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2957fc7154ab4c9ba9218c70dcde762d Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 08:45:57.800259 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:57.800926 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:57.802073 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:57.802073 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:57.802073 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:57.802073 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 12 08:45:57.802073 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.802073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d26c541-d84b-47a5-a2d1-9c7aa018d225 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:57.802073 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d26c541-d84b-47a5-a2d1-9c7aa018d225 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.072532 Oct 12 08:45:57.802073 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 187/445] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:57.815128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Calling method '.version_select at 0x7f984924a8b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.817109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.817625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.818066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.850673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.851167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.851613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.868576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.869076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.869541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.876087 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-452ad488-af6b-4386-b699-c536251e0a82 tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.065311 Oct 12 08:45:57.877222 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 188/446] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:57.888929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83e28d7e-def0-49f5-9823-2e31206eae81 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] Calling method '.version_select at 0x7f984924a310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.891287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-83e28d7e-def0-49f5-9823-2e31206eae81 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '9aa1560ffe414080b3fa8aeba09e6684', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec79f2d22afd4f72ac781432df1c04f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83e28d7e-def0-49f5-9823-2e31206eae81 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] Request method failure captured: Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7DZ0aB0mmkfzgYbQ4yoplCUl8bBL0Pd-pUHW6DWRFcLMOyA0K-I4L-mGSqNW4ym4W5J1bACuHMdAtIGn9HN_0fG8VlGcjTS74iRIyhv-sK2TMSlDy4jjbQ6mgJ17pNc3Jb9z3fRGWzyvBVDHkG6UOcYKEmdlJcof-jiYfmG5wbKLs Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: ec79f2d22afd4f72ac781432df1c04f4 Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1511519413 Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:45:57.893115 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec79f2d22afd4f72ac781432df1c04f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec79f2d22afd4f72ac781432df1c04f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec79f2d22afd4f72ac781432df1c04f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec79f2d22afd4f72ac781432df1c04f4"}]}] Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1511519413 Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: ec79f2d22afd4f72ac781432df1c04f4 Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1511519413 Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 9aa1560ffe414080b3fa8aeba09e6684 Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 08:45:57.894608 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1'} Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:45:57.895602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 12 08:45:57.896851 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:45:57.899007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83e28d7e-def0-49f5-9823-2e31206eae81 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:57.900011 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83e28d7e-def0-49f5-9823-2e31206eae81 tempest-HypervisorAdminNegativeUnderV252Test-1511519413 tempest-HypervisorAdminNegativeUnderV252Test-1511519413-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015780 Oct 12 08:45:57.901300 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 189/447] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:57.906598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:57.907539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:57.916515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.922746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.923495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:57.924794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:57.925568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:57.926172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:58.143598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:58.151645 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6df508d5-7cf7-4ed8-9c9d-c273873624fe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1476 microversion: 2.1 time: 0.402777 Oct 12 08:45:58.152259 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 259/448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:58.159227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55e85430-061e-454e-b7ba-b96a2202204c tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Calling method '.version_select at 0x7f9849203dc0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:58.161032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:58.161279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55e85430-061e-454e-b7ba-b96a2202204c tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:58.161946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55e85430-061e-454e-b7ba-b96a2202204c tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:58.162605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55e85430-061e-454e-b7ba-b96a2202204c tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:58.175914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:58.182631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:58.183809 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-55e85430-061e-454e-b7ba-b96a2202204c tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] HTTP exception thrown: No hypervisor matching '1f8e5719-bac8-4699-acaf-4f216faa6b6b' could be found. Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55e85430-061e-454e-b7ba-b96a2202204c tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Request method failure captured: Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hypervisors/1f8e5719-bac8-4699-acaf-4f216faa6b6b/servers HTTP/1.1 Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7EmNfUDYbMRCNTROcOohXVWOVuf8QKAaW4DvsLcPPJhToab0gWeN5MPXT1xZNxGOljxrblQItFweLVISE69L-qqBnEg4Z69oLd5oaeVnDkiAptlGipqVlqCNSLyDLwut0novnEQwLA_WRETnCVTbaHke4ZbLvvZQePpmzl_vgIM4c Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a38c4a84672e493cac699e6d3a6d19b9 Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1015322002 Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:45:58.185681 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a38c4a84672e493cac699e6d3a6d19b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a38c4a84672e493cac699e6d3a6d19b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a38c4a84672e493cac699e6d3a6d19b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a38c4a84672e493cac699e6d3a6d19b9"}]}] Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1015322002 Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a38c4a84672e493cac699e6d3a6d19b9 Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1015322002 Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 2957fc7154ab4c9ba9218c70dcde762d Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: exception: No hypervisor matching '1f8e5719-bac8-4699-acaf-4f216faa6b6b' could be found. Oct 12 08:45:58.187195 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '1f8e5719-bac8-4699-acaf-4f216faa6b6b'} Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '1f8e5719-bac8-4699-acaf-4f216faa6b6b' could be found. Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:58.187999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:45:58.189280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:45:58.189280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:45:58.189280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:45:58.189280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:45:58.189280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '1f8e5719-bac8-4699-acaf-4f216faa6b6b' could be found. Oct 12 08:45:58.189280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:45:58.191409 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-199da42c-0aca-4a67-902f-2937f294d6aa tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.288667 Oct 12 08:45:58.191943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55e85430-061e-454e-b7ba-b96a2202204c tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] Returning 404 to user: No hypervisor matching '1f8e5719-bac8-4699-acaf-4f216faa6b6b' could be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:45:58.193174 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 190/449] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:57 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:45:58.193824 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55e85430-061e-454e-b7ba-b96a2202204c tempest-HypervisorAdminNegativeUnderV252Test-1015322002 tempest-HypervisorAdminNegativeUnderV252Test-1015322002-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1f8e5719-bac8-4699-acaf-4f216faa6b6b/servers" status: 404 len: 123 microversion: 2.1 time: 0.038935 Oct 12 08:45:58.194909 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 260/450] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 12 08:45:58 2022] GET /compute/v2.1/os-hypervisors/1f8e5719-bac8-4699-acaf-4f216faa6b6b/servers => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:45:58.200878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-31b57cbf-3d90-44ce-9a1e-304e1355d026 req-b3a9c861-c944-4eaf-8ee5-af4063fc4bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7d54d7-366a-49f9-bd42-d252f7868e2d", "name": "network-vif-unplugged", "status": "completed", "tag": "ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:58.225719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-31b57cbf-3d90-44ce-9a1e-304e1355d026 req-b3a9c861-c944-4eaf-8ee5-af4063fc4bf9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:58.226469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-31b57cbf-3d90-44ce-9a1e-304e1355d026 req-b3a9c861-c944-4eaf-8ee5-af4063fc4bf9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:58.228015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-31b57cbf-3d90-44ce-9a1e-304e1355d026 req-b3a9c861-c944-4eaf-8ee5-af4063fc4bf9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:58.245765 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-31b57cbf-3d90-44ce-9a1e-304e1355d026 req-b3a9c861-c944-4eaf-8ee5-af4063fc4bf9 service nova] Creating event network-vif-unplugged:ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7 for instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d on n-h1-858383-10 Oct 12 08:45:58.252900 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-31b57cbf-3d90-44ce-9a1e-304e1355d026 req-b3a9c861-c944-4eaf-8ee5-af4063fc4bf9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056453 Oct 12 08:45:58.259428 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 191/451] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:58.268719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:58.270889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:58.277854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:58.278819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:58.279402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:58.282342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:58.282808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:58.283236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:58.771461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:58.773068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:58.780529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:58.781015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:58.781458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:58.782350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:58.783166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:58.783783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:59.008421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:59.018006 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10c5c8fa-2c1b-43f4-9df2-fe95c76cc90e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.251286 Oct 12 08:45:59.021699 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 192/452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:58 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:45:59.026883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1f601f69-9db2-4f96-a499-6d5ac0f6efc9 req-90bf6bf2-61dd-4907-be28-31a0d5eb264f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "744cfd99-597c-4504-af66-6ba5723fcbee", "tag": "865792b9-525d-4c68-888b-8212face2199"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:45:59.039186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1f601f69-9db2-4f96-a499-6d5ac0f6efc9 req-90bf6bf2-61dd-4907-be28-31a0d5eb264f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:59.039845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1f601f69-9db2-4f96-a499-6d5ac0f6efc9 req-90bf6bf2-61dd-4907-be28-31a0d5eb264f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:59.040692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1f601f69-9db2-4f96-a499-6d5ac0f6efc9 req-90bf6bf2-61dd-4907-be28-31a0d5eb264f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:59.055329 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1f601f69-9db2-4f96-a499-6d5ac0f6efc9 req-90bf6bf2-61dd-4907-be28-31a0d5eb264f service nova] Creating event network-changed:865792b9-525d-4c68-888b-8212face2199 for instance 744cfd99-597c-4504-af66-6ba5723fcbee on n-h2-858383-10 Oct 12 08:45:59.061920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-1f601f69-9db2-4f96-a499-6d5ac0f6efc9 req-90bf6bf2-61dd-4907-be28-31a0d5eb264f service nova] Instance 744cfd99-597c-4504-af66-6ba5723fcbee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:45:59.074321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1f601f69-9db2-4f96-a499-6d5ac0f6efc9 req-90bf6bf2-61dd-4907-be28-31a0d5eb264f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053742 Oct 12 08:45:59.075819 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 193/453] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:45:59.081912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:59.090875 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0325e1f-a4ca-4b9e-b129-0abd3aa135f5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1317 microversion: 2.1 time: 0.829898 Oct 12 08:45:59.091596 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 261/454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:58 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:45:59.175674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:59.176756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:59.183975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:59.184700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:59.186200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:59.187126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:59.187878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:59.188606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:59.223509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:45:59.224336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:45:59.235405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:59.237899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:59.238747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:59.240393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:45:59.241111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:45:59.241947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:45:59.680250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:59.688699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:59.690838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:59.692607 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-87e72f69-02b7-47ca-95ba-5d183c103b44 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.473968 Oct 12 08:45:59.701969 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 262/455] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:45:59 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:45:59.864874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:45:59.882341 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b453dc7c-be00-4025-835b-333c0f819c57 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1474 microversion: 2.1 time: 0.710881 Oct 12 08:45:59.897917 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 194/456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:45:59 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1474 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:00.042457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:00.043113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:00.049825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=16 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:00.050784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:00.055661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.056591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.057526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:00.058446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.059152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.060382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:00.116608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:00.117938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:00.130240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.131043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.132448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:00.133515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.134253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.134862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:00.344227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:00.370028 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-49dbba4a-e996-4359-9ebf-dc791bfba8a4 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.331084 Oct 12 08:46:00.371265 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 263/457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:00 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:00.379235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e8f17014-2490-4310-9a86-45a4febc7a3a req-b3611a38-74e6-48f5-9f3f-339b7babb1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9767489-b818-4f08-8371-1199b70f77cb", "tag": "cb327098-0bbf-4741-a0c2-add8d16ae5ed"}, {"name": "network-changed", "server_uuid": "5f7d54d7-366a-49f9-bd42-d252f7868e2d", "tag": "ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:00.392539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e8f17014-2490-4310-9a86-45a4febc7a3a req-b3611a38-74e6-48f5-9f3f-339b7babb1e2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.393088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e8f17014-2490-4310-9a86-45a4febc7a3a req-b3611a38-74e6-48f5-9f3f-339b7babb1e2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.393616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e8f17014-2490-4310-9a86-45a4febc7a3a req-b3611a38-74e6-48f5-9f3f-339b7babb1e2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:00.410869 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e8f17014-2490-4310-9a86-45a4febc7a3a req-b3611a38-74e6-48f5-9f3f-339b7babb1e2 service nova] Creating event network-changed:cb327098-0bbf-4741-a0c2-add8d16ae5ed for instance a9767489-b818-4f08-8371-1199b70f77cb on n-h1-858383-10 Oct 12 08:46:00.411618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e8f17014-2490-4310-9a86-45a4febc7a3a req-b3611a38-74e6-48f5-9f3f-339b7babb1e2 service nova] Creating event network-changed:ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7 for instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d on n-h1-858383-10 Oct 12 08:46:00.418756 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e8f17014-2490-4310-9a86-45a4febc7a3a req-b3611a38-74e6-48f5-9f3f-339b7babb1e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045841 Oct 12 08:46:00.419360 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 264/458] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:00.428282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=16 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:00.432927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:00.442739 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fc3787a9-c07b-4e34-850d-6c7517e811f8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1317 microversion: 2.1 time: 0.330755 Oct 12 08:46:00.443315 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 195/459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:00 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:00.730369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:00.731336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:00.743650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.747340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.748255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:00.751067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.751549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.751992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:00.907393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:00.908044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:00.916621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.917335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.917935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:00.918787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:00.920208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:00.921128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.129252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:01.142139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:01.147621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:01.151591 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ed24236-b6f6-438f-941a-82ed880e378f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.428447 Oct 12 08:46:01.167778 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 265/460] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:00 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:01.322735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:01.335981 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-55defe98-4767-42cc-a0a0-ea03ceee9dd1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1471 microversion: 2.1 time: 0.433651 Oct 12 08:46:01.361105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:01.362363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:01.362616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 196/461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:00 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1471 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:01.369577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:01.370354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:01.370997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.371915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:01.372556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:01.373489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.392726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:01.393834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:01.404180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=18 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:01.408845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:01.409694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:01.410767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.419067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:01.419919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:01.420872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.488457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:01.578636 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0667c071-69b6-41c6-8f82-8075d38ce018 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee/action" status: 204 len: 0 microversion: 2.1 time: 0.222100 Oct 12 08:46:01.587497 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 266/462] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:01 2022] POST /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee/action => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:46:01.598817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:01.599544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:01.632544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:01.633054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:01.634778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.638657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:01.639157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:01.639745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.779185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:01.793283 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-03a43396-18cc-4063-b90f-913aa3e59dc9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.404592 Oct 12 08:46:01.807407 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 197/463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:01 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:01.822944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:01.824983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:01.841989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:01.847661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:01.848692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.851160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:01.853769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:01.854467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:01.937881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:01.946441 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6920f595-0128-4c74-94c1-4316d1c248aa tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1317 microversion: 2.1 time: 0.357496 Oct 12 08:46:01.950932 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 267/464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:01 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:02.113884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:02.123392 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba250041-2a0d-48d5-9441-7e3d81a075de tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1471 microversion: 2.1 time: 0.312761 Oct 12 08:46:02.125106 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 198/465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:01 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:02.181748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:02.182673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:02.193630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:02.196704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:02.197642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:02.200054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:02.200963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:02.201690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:02.504881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:02.515526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:02.517583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:02.523683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a2cdd64-0f9d-45b7-ac1b-4a76c775f422 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.347152 Oct 12 08:46:02.526633 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 268/466] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:02 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:02.816602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:02.818689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:02.827200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:02.828697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:02.840185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:02.841515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:02.842244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:02.846564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:02.971767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:02.972554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:02.980812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:02.984709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:02.985318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:02.986779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:02.987743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:02.988470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:03.107849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:03.119395 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3383d0f6-9b8f-4df0-afde-c6d857c6e4f6 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.306836 Oct 12 08:46:03.136220 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 199/467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:02 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:03.144741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c001619d-0d11-4484-86f1-f26c95f01883 req-4e241623-fb01-4df2-83a7-202f2e596823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744cfd99-597c-4504-af66-6ba5723fcbee", "name": "network-vif-plugged", "status": "completed", "tag": "865792b9-525d-4c68-888b-8212face2199"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:03.186926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c001619d-0d11-4484-86f1-f26c95f01883 req-4e241623-fb01-4df2-83a7-202f2e596823 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:03.188921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c001619d-0d11-4484-86f1-f26c95f01883 req-4e241623-fb01-4df2-83a7-202f2e596823 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:03.189898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c001619d-0d11-4484-86f1-f26c95f01883 req-4e241623-fb01-4df2-83a7-202f2e596823 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:03.217431 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c001619d-0d11-4484-86f1-f26c95f01883 req-4e241623-fb01-4df2-83a7-202f2e596823 service nova] Creating event network-vif-plugged:865792b9-525d-4c68-888b-8212face2199 for instance 744cfd99-597c-4504-af66-6ba5723fcbee on n-h2-858383-10 Oct 12 08:46:03.225261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-c001619d-0d11-4484-86f1-f26c95f01883 req-4e241623-fb01-4df2-83a7-202f2e596823 service nova] Instance 744cfd99-597c-4504-af66-6ba5723fcbee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:46:03.242538 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c001619d-0d11-4484-86f1-f26c95f01883 req-4e241623-fb01-4df2-83a7-202f2e596823 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107790 Oct 12 08:46:03.243888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 200/468] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:03.253644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:03.256495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:03.259332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:03.264280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:03.264830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:03.265338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:03.266275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:03.266792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:03.267274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:03.276553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b240968a-90e5-4f21-9acd-986854b82e5b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1317 microversion: 2.1 time: 0.309016 Oct 12 08:46:03.279786 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 269/469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:02 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:03.417954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:03.429366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-769a15bb-8a3c-4e2a-831d-b893d297dad5 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1471 microversion: 2.1 time: 0.183351 Oct 12 08:46:03.437594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 201/470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:03 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:03.551387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:03.552893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:03.559345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:03.560100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:03.560728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:03.561706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:03.562683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:03.563671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:03.761622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:03.772350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:03.774846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:03.776016 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45f43ef6-77d7-4ce3-8985-99418f54e11f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.228709 Oct 12 08:46:03.777288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 270/471] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:03 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:03.960596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b462f8bc-59df-447f-a7d2-a530b661bc6b tempest-InstanceUsageAuditLogTestJSON-292005981 tempest-InstanceUsageAuditLogTestJSON-292005981-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:03.982352 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b462f8bc-59df-447f-a7d2-a530b661bc6b tempest-InstanceUsageAuditLogTestJSON-292005981 tempest-InstanceUsageAuditLogTestJSON-292005981-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12 08:46:03" status: 200 len: 318 microversion: 2.1 time: 0.391298 Oct 12 08:46:03.983656 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 202/472] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 08:46:03 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-12%2008%3A46%3A03 => generated 318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:03.997746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8b5d0ae8-b474-4358-98b3-f9911860fa95 tempest-InstanceUsageAuditLogTestJSON-292005981 tempest-InstanceUsageAuditLogTestJSON-292005981-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:04.024348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8b5d0ae8-b474-4358-98b3-f9911860fa95 tempest-InstanceUsageAuditLogTestJSON-292005981 tempest-InstanceUsageAuditLogTestJSON-292005981-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.030868 Oct 12 08:46:04.025589 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 271/473] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 12 08:46:03 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:04.143738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:04.144351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:04.150561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.151242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.151695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.152401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.152859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.153479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.297088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:04.304607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:04.305595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:04.305944 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5d1b068-c359-4909-b1ef-40a013c73d48 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.166057 Oct 12 08:46:04.312769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.313694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.315117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.316251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.316856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.317616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.317969 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 203/474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:04 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:04.452576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:04.453454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:04.459673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.460165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.460596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.461491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.462102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.462530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.485852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:04.495686 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a977e072-91c9-4572-9fb2-65d83e01cf72 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1317 microversion: 2.1 time: 0.195591 Oct 12 08:46:04.496499 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 272/475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:04 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:04.610199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:04.618207 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bd2694f7-bf72-4672-8f64-728ea0d40177 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1463 microversion: 2.1 time: 0.169533 Oct 12 08:46:04.618773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 204/476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:04 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:04.642059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:04.642675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:04.649162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.649702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.650197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.651203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.651920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.652882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.855148 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e81ae037-a2b1-49d5-9ec9-36bd1ff125f6 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1616 microversion: 2.1 time: 0.216953 Oct 12 08:46:04.866920 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 205/477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:04 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1616 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:04.884874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:04.886054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:04.892808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.893607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.894194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:04.895062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:04.895687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:04.896266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.051456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d02b39a-c952-4b2a-8472-e96597a64232 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Calling method '.version_select at 0x7f9848f7df70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:05.077336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:05.094200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:05.096246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:05.097643 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef04153f-266d-471e-90b5-2e1af1331532 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.222925 Oct 12 08:46:05.098280 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 206/478] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:04 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:05.103132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55fd1020-6d6d-43bd-a3bb-96b8d0c9e034 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '.version_select at 0x7f9848dbc430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:05.107373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55fd1020-6d6d-43bd-a3bb-96b8d0c9e034 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.108045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55fd1020-6d6d-43bd-a3bb-96b8d0c9e034 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.108489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55fd1020-6d6d-43bd-a3bb-96b8d0c9e034 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.120436 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-55fd1020-6d6d-43bd-a3bb-96b8d0c9e034 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 799 microversion: 2.1 time: 0.020982 Oct 12 08:46:05.121035 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 207/479] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:46:05 2022] GET /compute/v2.1/os-migrations => generated 799 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:05.165886 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d02b39a-c952-4b2a-8472-e96597a64232 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 371 microversion: 2.1 time: 0.553689 Oct 12 08:46:05.166780 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 273/480] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 08:46:04 2022] GET /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:05.179983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3035e54b-8349-460a-8c8e-507da82a76d9 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Action: 'update', calling method: .version_select at 0x7f9848fa1550>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:05.210405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2028677281", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:05.267469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:05.481683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:05.482405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:05.482941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:05.484754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:05.485407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:05.494801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.495363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.495861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.496702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.497233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.497746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.519272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Getting quotas for project c5f79b4420cc4778bcc4c7679f9f7f69. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:05.524125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Getting quotas for user d0a108410e9643139337a933cc07e946 and project c5f79b4420cc4778bcc4c7679f9f7f69. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:05.535410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:05.536919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:05.540641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:05.593744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3035e54b-8349-460a-8c8e-507da82a76d9 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.594437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3035e54b-8349-460a-8c8e-507da82a76d9 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.595307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3035e54b-8349-460a-8c8e-507da82a76d9 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.596272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3035e54b-8349-460a-8c8e-507da82a76d9 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.596923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3035e54b-8349-460a-8c8e-507da82a76d9 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.597538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3035e54b-8349-460a-8c8e-507da82a76d9 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.605259 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-08bb00e9-431a-411e-a369-b08c54b92fdf tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482438 Oct 12 08:46:05.612680 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 208/481] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:46:05.618227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-370119690", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:05.660247 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3035e54b-8349-460a-8c8e-507da82a76d9 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 328 microversion: 2.1 time: 0.483843 Oct 12 08:46:05.661273 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 274/482] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:46:05 2022] PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 328 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:05.671399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:05.671968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:05.679807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.681101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.681774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.682736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.683342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.683926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.691593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:05.734414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:05.906394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:05.915735 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a2abf06-5b3f-4f09-84b6-c479d6f186e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.253406 Oct 12 08:46:05.921681 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 275/483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:05 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:05.926497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:05.927284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:05.933684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.934173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.934608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:05.935844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:05.936306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:05.936884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:06.050982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:06.051411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:06.052178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:06.052888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:06.053614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:06.066341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:06.067032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:06.067624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:06.068679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:06.069285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:06.069896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:06.085495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:06.093459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:06.094865 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a3dc7f5-c351-4591-8d9f-b437f1b300f4 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1317 microversion: 2.1 time: 0.176575 Oct 12 08:46:06.095767 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 276/484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:05 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:06.099196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for user 5631063704964af4a1d7780077789e48 and project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:06.101329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-33379e6a-5bbb-48aa-8dc3-cb97fcc55196 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:06.101994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-33379e6a-5bbb-48aa-8dc3-cb97fcc55196 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:06.112686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:06.115070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:06.166345 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fb732779-7df3-4ff1-a725-4ee2f6aac2f2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558302 Oct 12 08:46:06.166994 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 209/485] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:46:06.172100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-79e9f65b-e530-49ce-b81c-d4be23134272 req-56f0cae9-a11e-4433-b9d6-3f06f758da24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9767489-b818-4f08-8371-1199b70f77cb", "name": "network-vif-plugged", "status": "completed", "tag": "cb327098-0bbf-4741-a0c2-add8d16ae5ed"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:06.179418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33379e6a-5bbb-48aa-8dc3-cb97fcc55196 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:06.186620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-79e9f65b-e530-49ce-b81c-d4be23134272 req-56f0cae9-a11e-4433-b9d6-3f06f758da24 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:06.187299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-79e9f65b-e530-49ce-b81c-d4be23134272 req-56f0cae9-a11e-4433-b9d6-3f06f758da24 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:06.187419 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-33379e6a-5bbb-48aa-8dc3-cb97fcc55196 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1222 microversion: 2.1 time: 0.090496 Oct 12 08:46:06.188052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-79e9f65b-e530-49ce-b81c-d4be23134272 req-56f0cae9-a11e-4433-b9d6-3f06f758da24 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:06.201799 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-79e9f65b-e530-49ce-b81c-d4be23134272 req-56f0cae9-a11e-4433-b9d6-3f06f758da24 service nova] Creating event network-vif-plugged:cb327098-0bbf-4741-a0c2-add8d16ae5ed for instance a9767489-b818-4f08-8371-1199b70f77cb on n-h1-858383-10 Oct 12 08:46:06.202811 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 277/486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:06 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:06.207684 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-79e9f65b-e530-49ce-b81c-d4be23134272 req-56f0cae9-a11e-4433-b9d6-3f06f758da24 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039372 Oct 12 08:46:06.208487 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 210/487] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:06.217312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:06.219106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:06.227434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:06.228423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:06.229399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:06.230209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:06.230933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:06.231432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:06.449698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:06.461961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:06.463431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:06.464603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8dc7f2df-1cef-40cf-b228-1f2de28e681f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.254353 Oct 12 08:46:06.465178 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 211/488] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:06 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:06.483618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ec30c5f1-cdc2-4dab-b4e0-defe0d8d4e1c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:06.484242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ec30c5f1-cdc2-4dab-b4e0-defe0d8d4e1c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:06.573015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ec30c5f1-cdc2-4dab-b4e0-defe0d8d4e1c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:06.588017 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ec30c5f1-cdc2-4dab-b4e0-defe0d8d4e1c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1212 microversion: 2.1 time: 0.120024 Oct 12 08:46:06.588633 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 212/489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:06 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:06.693988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-800758212", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:06.755407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:06.941896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:06.942666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:06.953325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:06.954406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:06.954997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:06.956368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:06.957083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:06.957689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.059794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:07.060642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:07.061387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:07.062044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:07.062769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:07.074069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.074756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.075333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.076715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.077189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.077634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.095722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:07.102086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:07.106188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Getting quotas for project 12149d2d47fd4d21843dfc4f5117a256. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:07.110261 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-803dd584-7fee-40db-8876-1c18656e19cf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.174760 Oct 12 08:46:07.111754 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 213/490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:06 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:07.115116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Getting quotas for user e163c43dcc1344408223966cab83840b and project 12149d2d47fd4d21843dfc4f5117a256. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:07.118255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:07.118638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:07.124997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.125755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.126390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.127319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.127966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.128597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.133183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.utils [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] cores quota exceeded for 12149d2d47fd4d21843dfc4f5117a256, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127006) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 08:46:07.134404 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Request method failure captured: Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 144 Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7L_OyJOaNkPo7SzK6AdeJhY1akNw1F_NyqT8iwzAr_Yu6YtwVG7KpCqtRZAMPOJmG5AHhLn78xN5J6k3y1N5PEQ85A-NB55Nhq11UkJ9HVBTjefPGgdZMNA_Ca7SpIs7BItg16ZD2a6zzuuWqHvISgzt1Vi1EoU27prtPzkTLzV-s Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 12149d2d47fd4d21843dfc4f5117a256 Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:46:07.138120 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12149d2d47fd4d21843dfc4f5117a256"}]}] Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 12149d2d47fd4d21843dfc4f5117a256 Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-QuotasAdminNegativeTest-639947897-project Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e163c43dcc1344408223966cab83840b Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-QuotasAdminNegativeTest-639947897-project Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-800758212", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} Oct 12 08:46:07.139511 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-800758212', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452'}}} Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 08:46:07.140443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:07.142459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:07.144025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9bf97a4d-ab75-4265-8da9-919641f92ef8 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.935672 Oct 12 08:46:07.146267 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 278/491] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:06 2022] POST /compute/v2.1/servers => generated 111 bytes in 937 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:46:07.149988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb8ed59e-5b13-4496-ad10-643e18678436 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Action: 'update', calling method: .version_select at 0x7f9848ef5c10>, body: {"quota_set": {"cores": 20}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:07.274827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:07.283416 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c384114f-4af5-4031-ad5b-44c529a73802 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1317 microversion: 2.1 time: 0.169910 Oct 12 08:46:07.284179 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 214/492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:07 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:07.289031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:07.289745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:07.295522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.296070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.296576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.297343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.297882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.298375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.374199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:07.382790 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33e3ef55-d489-48b4-aaa2-8ce2e61b24d3 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1274 microversion: 2.1 time: 0.097143 Oct 12 08:46:07.383873 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 215/493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:07 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:07.471528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8ed59e-5b13-4496-ad10-643e18678436 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.472023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8ed59e-5b13-4496-ad10-643e18678436 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.472836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8ed59e-5b13-4496-ad10-643e18678436 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.473203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8ed59e-5b13-4496-ad10-643e18678436 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.473692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8ed59e-5b13-4496-ad10-643e18678436 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.474125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8ed59e-5b13-4496-ad10-643e18678436 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.491070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:07.491673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:07.499631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.500504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.501154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.502127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.502784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.503388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.541056 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb8ed59e-5b13-4496-ad10-643e18678436 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 329 microversion: 2.1 time: 0.394093 Oct 12 08:46:07.550393 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 279/494] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:46:07 2022] PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 329 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:07.555421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e58cea28-dce9-4e4d-a91e-6135f355e13b tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Calling method '.version_select at 0x7f9848edee50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:07.679007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:07.688966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:07.691292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:07.693246 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5dfd2222-cbdf-4653-803b-562aa3dd5f55 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.206187 Oct 12 08:46:07.694286 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 216/495] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:07 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:46:07.710521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:07.712150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:07.733129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.736509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.738085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.739783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:07.741396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:07.742979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:07.890028 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e58cea28-dce9-4e4d-a91e-6135f355e13b tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 371 microversion: 2.1 time: 0.338374 Oct 12 08:46:07.891422 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 280/496] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 08:46:07 2022] GET /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:07.903369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:07.907030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ae59d7b-7d9b-46da-835e-484bc1f8f862 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Action: 'update', calling method: .version_select at 0x7f9848ee0670>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:07.911812 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a50f237-43fb-4e3a-9eab-01b8949fd01f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1208 microversion: 2.1 time: 0.216093 Oct 12 08:46:07.915865 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 217/497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:07 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1208 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:08.128514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae59d7b-7d9b-46da-835e-484bc1f8f862 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.128988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae59d7b-7d9b-46da-835e-484bc1f8f862 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.129426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae59d7b-7d9b-46da-835e-484bc1f8f862 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.130188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae59d7b-7d9b-46da-835e-484bc1f8f862 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.131028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae59d7b-7d9b-46da-835e-484bc1f8f862 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.131464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae59d7b-7d9b-46da-835e-484bc1f8f862 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.188375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-814849575", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:08.193831 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ae59d7b-7d9b-46da-835e-484bc1f8f862 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 328 microversion: 2.1 time: 0.294472 Oct 12 08:46:08.194812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 281/498] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:46:07 2022] PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:46:08.212436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:08.213067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:08.226792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.228389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.230092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.231480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.232476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.233106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.268985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:08.383595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:08.392251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3cc5e702-c8fc-487b-acbf-04a6b20a3c3e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.196227 Oct 12 08:46:08.392854 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 282/499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:08 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:08.397825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:08.398519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:08.405482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.406041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.406508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.407271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.407756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.408222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.551613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:08.552876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:08.554185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:08.554955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:08.555639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:08.566593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.567331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.567942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.569775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.570488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.571258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.601541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Getting quotas for project 9fc6ae74b9204e0084b4b80740a47d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:08.607798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Getting quotas for user 236d9004c6b249cda20d50effcf03227 and project 9fc6ae74b9204e0084b4b80740a47d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:08.626995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:08.630004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:08.651850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:08.663677 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e5d2a68e-5163-485d-82fc-e9f8f91f1a4d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1467 microversion: 2.1 time: 0.269740 Oct 12 08:46:08.667693 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 283/500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:08 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1467 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:08.679527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1785249084", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:08.705656 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7ed3e9ef-5893-41ef-8da4-91bcecdc6326 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586482 Oct 12 08:46:08.706778 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 218/501] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:46:08.718483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:08.719880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:08.737967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.754830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.756747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.760067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:08.760657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:08.762407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:08.780327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:08.785977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:09.149863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:09.163686 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee6e3515-207a-4157-a7dd-84700c67cd64 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1280 microversion: 2.1 time: 0.455505 Oct 12 08:46:09.164901 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 219/502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:08 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1280 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:09.171494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1497184623", "metadata": {"image_type": "test"}}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:09.175482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:09.183599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.184088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.184531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.185235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.185758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.186179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.240013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Getting quotas for project 75c444d5d31d4ca5bb47e040b1541594. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:09.245609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Getting quotas for user 3d7a6a36aadd4818b0422f824718f3f0 and project 75c444d5d31d4ca5bb47e040b1541594. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:09.557509 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b94b6c66-fc4e-48cf-aae5-47e14f947d89 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "POST /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb/action" status: 202 len: 0 microversion: 2.1 time: 0.390884 Oct 12 08:46:09.565281 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 220/503] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:09 2022] POST /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:46:09.571057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:09.573200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:09.587589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.588179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.592756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.593548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.594187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.594770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.614981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:09.614981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:09.614981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:09.615861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:09.615861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:09.628614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.633461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.634098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.635031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.636260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.641225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.679486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Getting quotas for project 12149d2d47fd4d21843dfc4f5117a256. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:09.685543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Getting quotas for user e163c43dcc1344408223966cab83840b and project 12149d2d47fd4d21843dfc4f5117a256. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:09.703266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.utils [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] instances quota exceeded for 12149d2d47fd4d21843dfc4f5117a256, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127006) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 08:46:09.704061 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Request method failure captured: Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 145 Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7L_OyJOaNkPo7SzK6AdeJhY1akNw1F_NyqT8iwzAr_Yu6YtwVG7KpCqtRZAMPOJmG5AHhLn78xN5J6k3y1N5PEQ85A-NB55Nhq11UkJ9HVBTjefPGgdZMNA_Ca7SpIs7BItg16ZD2a6zzuuWqHvISgzt1Vi1EoU27prtPzkTLzV-s Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 12149d2d47fd4d21843dfc4f5117a256 Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:46:09.706506 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12149d2d47fd4d21843dfc4f5117a256"}]}] Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 12149d2d47fd4d21843dfc4f5117a256 Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-QuotasAdminNegativeTest-639947897-project Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e163c43dcc1344408223966cab83840b Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-QuotasAdminNegativeTest-639947897-project Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1785249084", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} Oct 12 08:46:09.708064 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1785249084', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452'}}} Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 08:46:09.708877 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:09.710682 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:09.712060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9f80cdf-399e-4d18-b854-8605ad0d776c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.040315 Oct 12 08:46:09.713408 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 284/504] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:08 2022] POST /compute/v2.1/servers => generated 119 bytes in 1045 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:46:09.719994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:09.724478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:09.725386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:09.733034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.733874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.734529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.735566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.736327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.737102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.745065 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3cb2a8c2-9c51-42f7-b0dc-bff3c794937f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1214 microversion: 2.1 time: 0.173893 Oct 12 08:46:09.745743 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 221/505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:09 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:09.755577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:09.756195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:09.768858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.770929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.771252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.771969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.772424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.772847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.875603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:09.886974 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6231a59c-7f40-4f64-8174-c72f0170a63c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1270 microversion: 2.1 time: 0.140112 Oct 12 08:46:09.887580 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 222/506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:09 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:09.906345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:09.907576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:09.913679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.914172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.914613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:09.915360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:09.915771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:09.916186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.043332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:10.052450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:10.054316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:10.056820 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0ae5e448-35a9-4b08-bd0e-fc35d03b9df1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1566 microversion: 2.25 time: 0.338189 Oct 12 08:46:10.057957 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 285/507] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:09 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1566 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:10.075052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5638a8e-a049-4bee-b9d8-a0b4a2dba50b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848ede4c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:10.135489 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5638a8e-a049-4bee-b9d8-a0b4a2dba50b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.076104 Oct 12 08:46:10.136590 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 286/508] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:10 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:10.141462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4219df39-2832-47f8-bfef-d1605c4254ca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Action: 'update', calling method: .version_select at 0x7f9848edee50>, body: {"quota_set": {"instances": 10}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:10.185206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:10.195619 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf188ea4-15b3-4cf8-955c-2a80cd1f7cf2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.306922 Oct 12 08:46:10.212752 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 223/509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:09 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:10.218711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:10.219628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:10.228871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.229641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.230329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.231234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.231866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.232475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.263939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4219df39-2832-47f8-bfef-d1605c4254ca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.265629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4219df39-2832-47f8-bfef-d1605c4254ca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.266286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4219df39-2832-47f8-bfef-d1605c4254ca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.267484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4219df39-2832-47f8-bfef-d1605c4254ca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.267991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4219df39-2832-47f8-bfef-d1605c4254ca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.268410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4219df39-2832-47f8-bfef-d1605c4254ca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.345372 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4219df39-2832-47f8-bfef-d1605c4254ca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 329 microversion: 2.1 time: 0.207042 Oct 12 08:46:10.346206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 287/510] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:46:10 2022] PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 329 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:10.365858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-196ac30d-951e-4c1a-8a3c-1df675b55b9c tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Calling method '.version_select at 0x7f9848ef15e0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:10.476419 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-196ac30d-951e-4c1a-8a3c-1df675b55b9c tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 371 microversion: 2.1 time: 0.119501 Oct 12 08:46:10.477481 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 288/511] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 08:46:10 2022] GET /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:46:10.491098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f69f7d2-d96c-480b-8df0-5e6133becfca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Action: 'update', calling method: .version_select at 0x7f98490dbdc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:10.535868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:10.551180 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-204578ba-e62b-437f-98d1-856c8b910101 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.336239 Oct 12 08:46:10.563669 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 224/512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:10 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:10.584817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f69f7d2-d96c-480b-8df0-5e6133becfca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.585303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f69f7d2-d96c-480b-8df0-5e6133becfca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.585976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f69f7d2-d96c-480b-8df0-5e6133becfca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.586881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f69f7d2-d96c-480b-8df0-5e6133becfca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.587598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f69f7d2-d96c-480b-8df0-5e6133becfca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.588071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f69f7d2-d96c-480b-8df0-5e6133becfca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.700483 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f69f7d2-d96c-480b-8df0-5e6133becfca tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 325 microversion: 2.1 time: 0.215850 Oct 12 08:46:10.703074 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 289/513] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:46:10 2022] PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:46:10.763321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2132667353", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:10.767397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:10.768049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:10.780329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.781711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.782158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.784320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.784785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.785211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:10.853530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:10.962003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:10.975113 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dc00ee9b-b509-440b-ae5a-7f5a452cc923 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1288 microversion: 2.1 time: 0.210535 Oct 12 08:46:10.976688 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 290/514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:10 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1288 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:10.984496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ee42cbd1-c813-4e5f-a65d-c2fba33a45e4 req-6a7d6680-e5ce-49c3-ab7e-e49253e81f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561dbcab-7deb-49e4-9cca-c94b1899016e", "tag": "3fd40a37-8ce9-41eb-852a-3a30a088ec17"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:10.997481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ee42cbd1-c813-4e5f-a65d-c2fba33a45e4 req-6a7d6680-e5ce-49c3-ab7e-e49253e81f3e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:10.998574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ee42cbd1-c813-4e5f-a65d-c2fba33a45e4 req-6a7d6680-e5ce-49c3-ab7e-e49253e81f3e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:10.999247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ee42cbd1-c813-4e5f-a65d-c2fba33a45e4 req-6a7d6680-e5ce-49c3-ab7e-e49253e81f3e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.014808 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ee42cbd1-c813-4e5f-a65d-c2fba33a45e4 req-6a7d6680-e5ce-49c3-ab7e-e49253e81f3e service nova] Creating event network-changed:3fd40a37-8ce9-41eb-852a-3a30a088ec17 for instance 561dbcab-7deb-49e4-9cca-c94b1899016e on n-h1-858383-10 Oct 12 08:46:11.020775 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ee42cbd1-c813-4e5f-a65d-c2fba33a45e4 req-6a7d6680-e5ce-49c3-ab7e-e49253e81f3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041332 Oct 12 08:46:11.022184 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 291/515] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:11.028540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:11.029736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:11.037667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.038826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.039616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.040939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.042035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.042976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.363076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:11.363824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:11.364377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:11.364845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:11.365319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:11.369232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:11.376515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.377289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.377805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.379022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.379392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.380228 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-99ef137a-e2d7-4bc3-98d5-39a2cc814f44 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1312 microversion: 2.1 time: 0.356278 Oct 12 08:46:11.380489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.381543 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 292/516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:11 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1312 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:11.387779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:11.388392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:11.391971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:11.397426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.398123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.399894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.400799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.401309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.401804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.403166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Getting quotas for project 12149d2d47fd4d21843dfc4f5117a256. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:11.409846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Getting quotas for user e163c43dcc1344408223966cab83840b and project 12149d2d47fd4d21843dfc4f5117a256. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:11.424667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.utils [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] ram quota exceeded for 12149d2d47fd4d21843dfc4f5117a256, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127007) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 12 08:46:11.425996 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Request method failure captured: Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 145 Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7L_OyJOaNkPo7SzK6AdeJhY1akNw1F_NyqT8iwzAr_Yu6YtwVG7KpCqtRZAMPOJmG5AHhLn78xN5J6k3y1N5PEQ85A-NB55Nhq11UkJ9HVBTjefPGgdZMNA_Ca7SpIs7BItg16ZD2a6zzuuWqHvISgzt1Vi1EoU27prtPzkTLzV-s Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 12149d2d47fd4d21843dfc4f5117a256 Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:46:11.430421 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12149d2d47fd4d21843dfc4f5117a256"}]}] Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 12149d2d47fd4d21843dfc4f5117a256 Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-QuotasAdminNegativeTest-639947897-project Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: e163c43dcc1344408223966cab83840b Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-QuotasAdminNegativeTest-639947897-project Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2132667353", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} Oct 12 08:46:11.431685 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2132667353', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452'}}} Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 08:46:11.432364 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:11.433363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.435154 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:11.437375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:11.437375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:11.437375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:11.437375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:11.437375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 12 08:46:11.437375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.440424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:11.441557 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4f3e5d7c-6bc3-463e-a286-265c72a16964 tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.683604 Oct 12 08:46:11.442382 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 225/517] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 685 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:46:11.451436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-df60ce76-6cd4-40a3-8004-2ae85c3bc503 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848cfd040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:11.514685 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-df60ce76-6cd4-40a3-8004-2ae85c3bc503 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.067370 Oct 12 08:46:11.515286 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 226/518] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:11 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:11.530382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:11.531942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:11.543215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.544167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.545145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.546093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.546755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.547392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.669571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:11.677858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:11.679277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:11.680422 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d5630fc0-fe0e-42f1-90e4-96b7b8ff5777 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1556 microversion: 2.25 time: 0.297834 Oct 12 08:46:11.694959 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 293/519] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:11 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1556 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:11.694959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fabc3c32-65d8-46a2-bdae-915730a30d21 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Action: 'update', calling method: .version_select at 0x7f9848edea60>, body: {"quota_set": {"ram": 51200}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:11.762164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fabc3c32-65d8-46a2-bdae-915730a30d21 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.762718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fabc3c32-65d8-46a2-bdae-915730a30d21 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.763112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fabc3c32-65d8-46a2-bdae-915730a30d21 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.764064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fabc3c32-65d8-46a2-bdae-915730a30d21 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.764465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fabc3c32-65d8-46a2-bdae-915730a30d21 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.765465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fabc3c32-65d8-46a2-bdae-915730a30d21 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.823156 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fabc3c32-65d8-46a2-bdae-915730a30d21 tempest-QuotasAdminNegativeTest-1368220512 tempest-QuotasAdminNegativeTest-1368220512-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 200 len: 329 microversion: 2.1 time: 0.140981 Oct 12 08:46:11.823917 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 294/520] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:46:11 2022] PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:11.832103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:11.833237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:11.849478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.850070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.850574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.853591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.854148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.854700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.888522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:11.901518 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d8fcb56-45c4-427e-9ca7-078b65eef0ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1472 microversion: 2.1 time: 0.383987 Oct 12 08:46:11.902888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 227/521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:11 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1472 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:11.920907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-11b71f9e-8343-4141-8ce4-aac37e7057da tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '.version_select at 0x7f9848cfdca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:11.926709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11b71f9e-8343-4141-8ce4-aac37e7057da tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.927208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11b71f9e-8343-4141-8ce4-aac37e7057da tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.927648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11b71f9e-8343-4141-8ce4-aac37e7057da tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.937217 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-11b71f9e-8343-4141-8ce4-aac37e7057da tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1112 microversion: 2.25 time: 0.032549 Oct 12 08:46:11.938250 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 228/522] 10.222.0.40 () {60 vars in 1184 bytes} [Wed Oct 12 08:46:11 2022] GET /compute/v2.1/os-migrations => generated 1112 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:11.943624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d1f95e9-5df0-4bc0-9c7a-9d70234a976c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Action: 'update', calling method: .version_select at 0x7f9848d16160>, body: {"quota_set": {"ram": 0}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:11.949030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3d1f95e9-5df0-4bc0-9c7a-9d70234a976c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e163c43dcc1344408223966cab83840b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12149d2d47fd4d21843dfc4f5117a256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d1f95e9-5df0-4bc0-9c7a-9d70234a976c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Request method failure captured: Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 HTTP/1.1 Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 25 Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7L_OyJOaNkPo7SzK6AdeJhY1akNw1F_NyqT8iwzAr_Yu6YtwVG7KpCqtRZAMPOJmG5AHhLn78xN5J6k3y1N5PEQ85A-NB55Nhq11UkJ9HVBTjefPGgdZMNA_Ca7SpIs7BItg16ZD2a6zzuuWqHvISgzt1Vi1EoU27prtPzkTLzV-s Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 12149d2d47fd4d21843dfc4f5117a256 Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:46:11.951128 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12149d2d47fd4d21843dfc4f5117a256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12149d2d47fd4d21843dfc4f5117a256"}]}] Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 12149d2d47fd4d21843dfc4f5117a256 Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-639947897 Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-QuotasAdminNegativeTest-639947897-project Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: e163c43dcc1344408223966cab83840b Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-QuotasAdminNegativeTest-639947897-project Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: {"quota_set": {"ram": 0}} Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 08:46:11.952454 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '12149d2d47fd4d21843dfc4f5117a256', 'body': {'quota_set': {'ram': 0}}} Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:11.959746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.960844 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d1f95e9-5df0-4bc0-9c7a-9d70234a976c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d1f95e9-5df0-4bc0-9c7a-9d70234a976c tempest-QuotasAdminNegativeTest-639947897 tempest-QuotasAdminNegativeTest-639947897-project] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256" status: 403 len: 116 microversion: 2.1 time: 0.013089 Oct 12 08:46:11.962144 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 229/523] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:46:11 2022] PUT /compute/v2.1/os-quota-sets/12149d2d47fd4d21843dfc4f5117a256 => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:46:11.962681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-803b1c47-adc0-4455-92ec-ec61147fbf49 req-0b693bcd-6250-4d95-aff2-3696dd4db555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf50845-c51f-4d7f-8210-a04d9e628357", "tag": "62d17ea7-d92a-4239-aa4f-2df03bf6a199"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:11.970167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-803b1c47-adc0-4455-92ec-ec61147fbf49 req-0b693bcd-6250-4d95-aff2-3696dd4db555 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:11.970807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-803b1c47-adc0-4455-92ec-ec61147fbf49 req-0b693bcd-6250-4d95-aff2-3696dd4db555 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:11.972348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-803b1c47-adc0-4455-92ec-ec61147fbf49 req-0b693bcd-6250-4d95-aff2-3696dd4db555 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:11.986940 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-803b1c47-adc0-4455-92ec-ec61147fbf49 req-0b693bcd-6250-4d95-aff2-3696dd4db555 service nova] Creating event network-changed:62d17ea7-d92a-4239-aa4f-2df03bf6a199 for instance ecf50845-c51f-4d7f-8210-a04d9e628357 on n-h1-858383-10 Oct 12 08:46:11.991891 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-803b1c47-adc0-4455-92ec-ec61147fbf49 req-0b693bcd-6250-4d95-aff2-3696dd4db555 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037375 Oct 12 08:46:11.992754 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 230/524] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:11.999879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:12.001150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:12.008218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:12.008720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:12.009161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:12.009905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:12.010361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:12.010795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:12.084090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:12.092145 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4e37d4b0-3f6a-4fca-ab81-20813638cc4d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.265227 Oct 12 08:46:12.092807 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 295/525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:11 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:12.097384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:12.098271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:12.104861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:12.105670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:12.106259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:12.107110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:12.107719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:12.108147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:12.179620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:12.196132 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2baffca7-b166-484f-8813-de2afe48bfc3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1276 microversion: 2.1 time: 0.102208 Oct 12 08:46:12.197192 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 296/526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:12 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:12.237677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 5f7d54d7-366a-49f9-bd42-d252f7868e2d {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:12.255520 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-167f4c2c-c84f-4322-847f-19d653ec9972 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 2050 microversion: 2.25 time: 0.261220 Oct 12 08:46:12.255999 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 231/527] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:11 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 2050 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:12.393929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1239366411", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3ff61c2d-1adb-4df2-9b11-32c76cd9be4b"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:12.405122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:12.406209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:12.425297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:12.425828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:12.429312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:12.430646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:12.431695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:12.432396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:12.455362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] validate_networks() for [('3ff61c2d-1adb-4df2-9b11-32c76cd9be4b', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:12.695548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:12.704456 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4227391-70c0-469a-8880-354f58dcb5c6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1312 microversion: 2.1 time: 0.303336 Oct 12 08:46:12.705309 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 232/528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:12 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1312 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:12.717050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f24a9078-bec5-4714-a2d1-58ae5bd0a1ba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848d16820>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:12.790901 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f24a9078-bec5-4714-a2d1-58ae5bd0a1ba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.084372 Oct 12 08:46:12.792338 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 233/529] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:12 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:12.936792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:12.937469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:12.946078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:12.946600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:12.947137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:12.947860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:12.948321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:12.948751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:13.021467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:13.021467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:13.022072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:13.022820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:13.023690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:13.036538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:13.037198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:13.037840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:13.038526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:13.039051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:13.039476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:13.081519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:13.086132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for user 008f3287ba094f53971db283b5f303c5 and project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:13.102694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:13.105096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:13.169002 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-242203cd-07d3-47b7-a747-5c027f946596 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.778863 Oct 12 08:46:13.170583 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 297/530] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:46:13.213495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:13.223010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:13.226534 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-681b956d-f9b8-4ab5-a815-1968e11f00c5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1478 microversion: 2.1 time: 0.305234 Oct 12 08:46:13.227040 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 234/531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:12 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1478 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:13.229780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:13.247494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7aa9ab89-b54e-4a00-8f68-3fbf18be6a14 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:13.248117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7aa9ab89-b54e-4a00-8f68-3fbf18be6a14 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:13.252030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:13.252534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:13.258030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:13.261759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:13.262332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:13.262711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:13.275942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:13.427335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7aa9ab89-b54e-4a00-8f68-3fbf18be6a14 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:13.438316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7aa9ab89-b54e-4a00-8f68-3fbf18be6a14 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:13.442288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7aa9ab89-b54e-4a00-8f68-3fbf18be6a14 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:13.443964 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7aa9ab89-b54e-4a00-8f68-3fbf18be6a14 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1262 microversion: 2.25 time: 0.215478 Oct 12 08:46:13.465522 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 235/532] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:13 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1262 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:13.473950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:13.494663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:13.512891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:13.519719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:13.520395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:13.522050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:13.526184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:13.527208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:13.944195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:13.959296 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5786867e-aadf-4762-bfd6-6ecc74bc5612 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.786982 Oct 12 08:46:13.974658 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 298/533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:13 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:13.982693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:13.983517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:13.990822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:13.991540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:13.991976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:13.992704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:13.993299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:13.993945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:14.091156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:14.106440 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a08842cb-97f9-4257-9978-2588de7fb5f3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.639856 Oct 12 08:46:14.107269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 236/534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:13 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:14.128275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8f59a72a-2fe8-469f-9783-6aaa0109b2e1 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848d9bca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:14.196004 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8f59a72a-2fe8-469f-9783-6aaa0109b2e1 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.086111 Oct 12 08:46:14.212581 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 237/535] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:14 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:14.256969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:14.257661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:14.275514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:14.276036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:14.277985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:14.278734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:14.279204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:14.279640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:14.396140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:14.411994 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-559ae43f-cf38-453e-94ff-d33773a78a63 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1312 microversion: 2.1 time: 0.435680 Oct 12 08:46:14.433615 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 299/536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:13 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1312 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:14.471826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:14.472666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:14.483282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:14.484141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:14.484757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:14.485625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:14.498240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:14.498886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:14.908835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:14.925329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:14.925329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:14.925857 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4cbc014c-116e-45a0-b57e-5c92c3209e6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1258 microversion: 2.25 time: 0.458159 Oct 12 08:46:14.937069 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 300/537] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:14 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1258 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:14.986193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:14.987097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:15.006845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.007341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.007957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:15.008830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.009486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.010091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:15.100676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:15.110962 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b1fee83-f079-47ea-b89f-6fb0db44e5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1478 microversion: 2.1 time: 0.860928 Oct 12 08:46:15.112560 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 238/538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:14 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1478 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:15.135408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:15.137405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:15.145600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.146605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.147595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:15.151398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.152040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.152971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:15.257122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:15.272606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4e3679d1-d74d-4f47-ad4d-2c61ab1f3a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.290352 Oct 12 08:46:15.293404 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 301/539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:14 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:15.313498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-085af688-98e8-415b-9d66-abbca2c82518 req-7103dbb7-f67d-4392-8f22-a349c4d2a006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ea5574-8d03-4573-8842-011eee036ae4", "tag": "510b2867-6c33-4cf6-beba-1493665faaa6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:15.333235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-085af688-98e8-415b-9d66-abbca2c82518 req-7103dbb7-f67d-4392-8f22-a349c4d2a006 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.334095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-085af688-98e8-415b-9d66-abbca2c82518 req-7103dbb7-f67d-4392-8f22-a349c4d2a006 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.337232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-085af688-98e8-415b-9d66-abbca2c82518 req-7103dbb7-f67d-4392-8f22-a349c4d2a006 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:15.343154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:15.357726 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-085af688-98e8-415b-9d66-abbca2c82518 req-7103dbb7-f67d-4392-8f22-a349c4d2a006 service nova] Creating event network-changed:510b2867-6c33-4cf6-beba-1493665faaa6 for instance d9ea5574-8d03-4573-8842-011eee036ae4 on n-h2-858383-10 Oct 12 08:46:15.368283 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-085af688-98e8-415b-9d66-abbca2c82518 req-7103dbb7-f67d-4392-8f22-a349c4d2a006 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073181 Oct 12 08:46:15.369684 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 302/540] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:15.376132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73211248-e3fa-4947-8507-b7dac93d3c2c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848f4f550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:15.392385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:15.404197 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-966c6b22-ce82-4b51-a9bb-77015e07a19c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.276954 Oct 12 08:46:15.423792 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 239/541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:15 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:15.439754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:15.440402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:15.458515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.468986 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73211248-e3fa-4947-8507-b7dac93d3c2c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.097853 Oct 12 08:46:15.470401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.470935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:15.471738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.472206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.472636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:15.480334 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 303/542] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:15 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:15.953040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:15.954120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:15.976994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.977530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.977979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:15.978711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:15.979172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:15.979601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:16.051359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:16.053767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:16.068973 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3fe3ed7d-fc0f-4d5c-87fa-9079d183c256 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1312 microversion: 2.1 time: 0.634404 Oct 12 08:46:16.071711 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 240/543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:15 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1312 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:16.138683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:16.139350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:16.153076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:16.153628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:16.154080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:16.154811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:16.155267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:16.155716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:16.367448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:16.377524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:16.399759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:16.405104 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80104d1a-4129-441d-909b-813923ada6a8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1314 microversion: 2.25 time: 0.457853 Oct 12 08:46:16.410260 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 304/544] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:15 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:16.428146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e9e9eafa-f164-4c63-b6ba-d30f41b83996 req-ec0a3782-0726-4d3f-bf02-623a6cfeedc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9767489-b818-4f08-8371-1199b70f77cb", "name": "network-vif-plugged", "status": "completed", "tag": "cb327098-0bbf-4741-a0c2-add8d16ae5ed"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:16.485918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e9e9eafa-f164-4c63-b6ba-d30f41b83996 req-ec0a3782-0726-4d3f-bf02-623a6cfeedc8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:16.491873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e9e9eafa-f164-4c63-b6ba-d30f41b83996 req-ec0a3782-0726-4d3f-bf02-623a6cfeedc8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:16.494735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e9e9eafa-f164-4c63-b6ba-d30f41b83996 req-ec0a3782-0726-4d3f-bf02-623a6cfeedc8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:16.544805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e9e9eafa-f164-4c63-b6ba-d30f41b83996 req-ec0a3782-0726-4d3f-bf02-623a6cfeedc8 service nova] Creating event network-vif-plugged:cb327098-0bbf-4741-a0c2-add8d16ae5ed for instance a9767489-b818-4f08-8371-1199b70f77cb on n-h1-858383-10 Oct 12 08:46:16.566009 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e9e9eafa-f164-4c63-b6ba-d30f41b83996 req-ec0a3782-0726-4d3f-bf02-623a6cfeedc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154425 Oct 12 08:46:16.566706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:16.572983 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 305/545] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:16.579873 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37f16c01-3d62-420d-b88c-bee728b87074 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1478 microversion: 2.1 time: 0.445583 Oct 12 08:46:16.582787 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 241/546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:16 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1478 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:16.594395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:16.596326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:16.605149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:16.605463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:16.619856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:16.624771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:16.626342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:16.628273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:16.630180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:16.631881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:16.635880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:16.636389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:16.636830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:16.637584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:16.638042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:16.638474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:17.049776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:17.058155 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-43de4726-c96c-4d61-ad9f-9a47daceebd4 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.472959 Oct 12 08:46:17.058748 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 242/547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:16 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:17.079993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d28b0626-aacd-48a0-8c30-31b0dfe4bdb9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848ca75e0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:17.177322 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d28b0626-aacd-48a0-8c30-31b0dfe4bdb9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.114088 Oct 12 08:46:17.178004 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 243/548] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:17 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:17.196021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:17.198043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:17.205995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:17.207705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:17.208509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:17.209507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:17.210179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:17.210822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:17.224483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:17.237457 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cede624c-8816-45f0-932e-7c132bc7149e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.659671 Oct 12 08:46:17.238641 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 306/549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:16 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:17.440508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:17.441360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:17.454742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:17.459549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:17.460015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:17.460763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:17.463962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:17.464500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:17.586826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:17.599657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:17.602956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:17.606695 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-833b98e5-9d90-4231-8fd4-3b32aa413d83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1320 microversion: 2.25 time: 0.171591 Oct 12 08:46:17.610041 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 307/550] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:17 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1320 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:46:17.621194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:17.621818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:17.633773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:17.634395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:17.634971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:17.635797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:17.636361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:17.636906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:17.871232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:17.882416 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ddea0e6f-5df4-4cce-ac0a-9c5b995e6206 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1464 microversion: 2.1 time: 0.270850 Oct 12 08:46:17.892436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:17.901611 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f1ebb8ab-cbd9-4a6c-9b5b-14f6c4a3c113 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1312 microversion: 2.1 time: 0.709725 Oct 12 08:46:17.904947 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 308/551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:17 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1464 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:17.920233 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 244/552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:17 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1312 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:17.926211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:17.926864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:17.951202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:17.951867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:17.952441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:17.961107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:17.961670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:17.962308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.093013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:18.094196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:18.126600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.132979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.134469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.143506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.144611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.145283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.217599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:18.223854 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-18898934-d21b-40b7-8fa4-1c447f0443ef tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1464 microversion: 2.1 time: 0.317158 Oct 12 08:46:18.226303 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 309/553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:17 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:18.248786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9beb10b7-9ed3-4247-82b1-f2c56761faaf tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848ee09d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:18.320837 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9beb10b7-9ed3-4247-82b1-f2c56761faaf tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.078164 Oct 12 08:46:18.321916 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 310/554] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:18 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:18.327315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:18.330388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:18.339348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.340077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.340624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.342021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.342596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.343146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.432575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:18.433002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:18.433515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:18.434433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:18.435084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:18.511803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:18.518031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.518814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.519410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.520294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.520938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.521550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.552428 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-10316db4-72fb-4697-8f88-7a21c5be5e62 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action" status: 202 len: 1068 microversion: 2.1 time: 0.228923 Oct 12 08:46:18.565963 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 311/555] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:18 2022] POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action => generated 1068 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 08:46:18.572483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:18.573393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:18.579748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.580490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.581316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.582219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.583475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.584100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.815430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:18.828177 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3171b650-a3e3-45b9-b578-6a14bc85f184 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.260878 Oct 12 08:46:18.830029 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 312/556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:18 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:18.834722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:18.835329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:18.865345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.866633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.868227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.870928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:18.873230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:18.874474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:18.959804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:18.974929 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8234e409-b7c1-41af-80e7-a30b530a8984 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.891735 Oct 12 08:46:18.993103 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 245/557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:18 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:18.999602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:19.000301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:19.007583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:19.008074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:19.009038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:19.010200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:19.010950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:19.011837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:19.071145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:19.079481 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86451935-5131-41d8-b5ba-8c20de0a5157 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.248394 Oct 12 08:46:19.080057 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 313/558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:18 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:19.086047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:19.086840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:19.093892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:19.094592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:19.095185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:19.096027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:19.096622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:19.097185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:19.162600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:19.179861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:19.181882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:19.183341 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e6d237fd-c268-4142-aa84-a6bdc30edfdf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1320 microversion: 2.25 time: 0.188449 Oct 12 08:46:19.215987 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 246/559] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:18 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:19.266033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:19.277131 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6da9bf21-f16b-49c8-8ec1-69f29c6b451c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1312 microversion: 2.1 time: 0.195858 Oct 12 08:46:19.278040 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 314/560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:19 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:19.337731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe40ed5d-d5a1-496c-98f7-e705d61c4996 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848d05670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:19.401204 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe40ed5d-d5a1-496c-98f7-e705d61c4996 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.067767 Oct 12 08:46:19.410947 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 247/561] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:19 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:19.448417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-08d4e51e-dfb8-4dca-b01c-f90a592c72e2 req-e84b2073-2632-4a14-8faa-70efe6f790ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b362992b-616f-4d7e-98f1-7465d511f00b", "name": "network-vif-plugged", "status": "completed", "tag": "1867b80e-5e98-4292-963e-36458a1a69d0"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:19.469649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-08d4e51e-dfb8-4dca-b01c-f90a592c72e2 req-e84b2073-2632-4a14-8faa-70efe6f790ef service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:19.470348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-08d4e51e-dfb8-4dca-b01c-f90a592c72e2 req-e84b2073-2632-4a14-8faa-70efe6f790ef service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:19.471323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-08d4e51e-dfb8-4dca-b01c-f90a592c72e2 req-e84b2073-2632-4a14-8faa-70efe6f790ef service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:19.494368 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-08d4e51e-dfb8-4dca-b01c-f90a592c72e2 req-e84b2073-2632-4a14-8faa-70efe6f790ef service nova] Creating event network-vif-plugged:1867b80e-5e98-4292-963e-36458a1a69d0 for instance b362992b-616f-4d7e-98f1-7465d511f00b on n-h2-858383-10 Oct 12 08:46:19.503478 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-08d4e51e-dfb8-4dca-b01c-f90a592c72e2 req-e84b2073-2632-4a14-8faa-70efe6f790ef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059156 Oct 12 08:46:19.505023 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 315/562] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:19.858493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:19.859878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:19.877459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:19.878236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:19.878687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:19.879401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:19.879856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:19.880470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.002676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:20.003381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:20.021328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:20.021857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:20.022294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.023004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:20.023633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:20.024314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.324077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:20.338715 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-224359ee-ec8d-48c6-a80a-0a260b5cafac tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.340460 Oct 12 08:46:20.339413 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 316/563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:19 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:20.371319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:20.371928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:20.379377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:20.379886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:20.380815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.381561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:20.382444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:20.382884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.503987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:20.516125 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-70711b78-699d-46e2-b6b6-71b184218e3a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.661920 Oct 12 08:46:20.536362 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 248/564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:19 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:20.542846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:20.552610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:20.560946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:20.561850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:20.562494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.566871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:20.572545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:20.573184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.667849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:20.685797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-444c9f18-9195-4c88-8f4f-4644aff46988 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.318900 Oct 12 08:46:20.702852 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 317/565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:20 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:20.709146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:20.710035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:20.718985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:20.719647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:20.720219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.721082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:20.721703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:20.722386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:20.934857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:20.943446 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac162673-83d2-4328-8749-f7c45b317176 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1312 microversion: 2.1 time: 0.239081 Oct 12 08:46:20.944389 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 318/566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:20 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:20.949292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6768510-b571-4569-86cd-8e0cb4502fce tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848ee0040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:21.037914 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6768510-b571-4569-86cd-8e0cb4502fce tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.092045 Oct 12 08:46:21.045945 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 319/567] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:20 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:21.110754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:21.121145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:21.122879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:21.124182 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9dfcf6ca-74a5-41d1-9727-c8beff36c5c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1362 microversion: 2.25 time: 0.586109 Oct 12 08:46:21.154655 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 249/568] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:20 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1362 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:21.370963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:21.371620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:21.379122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:21.381845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:21.382699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:21.382923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:21.383355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:21.383775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:21.542719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:21.561554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:21.565658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:21.576958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:21.577642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:21.578243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:21.579056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:21.579607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:21.580178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:21.633601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:21.659146 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8b9744f6-bf6a-4181-b213-ac3f9cba16e9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.298534 Oct 12 08:46:21.673472 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 320/569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:21 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:21.673472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-786ff189-f48a-47e8-9fd5-07a11216a90c req-4aa9eba3-88a0-4f39-bb7f-b626ecfb64e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561dbcab-7deb-49e4-9cca-c94b1899016e", "name": "network-vif-plugged", "status": "completed", "tag": "3fd40a37-8ce9-41eb-852a-3a30a088ec17"}, {"server_uuid": "ecf50845-c51f-4d7f-8210-a04d9e628357", "name": "network-vif-plugged", "status": "completed", "tag": "62d17ea7-d92a-4239-aa4f-2df03bf6a199"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:21.688483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-786ff189-f48a-47e8-9fd5-07a11216a90c req-4aa9eba3-88a0-4f39-bb7f-b626ecfb64e8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:21.690083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-786ff189-f48a-47e8-9fd5-07a11216a90c req-4aa9eba3-88a0-4f39-bb7f-b626ecfb64e8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:21.690988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-786ff189-f48a-47e8-9fd5-07a11216a90c req-4aa9eba3-88a0-4f39-bb7f-b626ecfb64e8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:21.710839 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-786ff189-f48a-47e8-9fd5-07a11216a90c req-4aa9eba3-88a0-4f39-bb7f-b626ecfb64e8 service nova] Creating event network-vif-plugged:3fd40a37-8ce9-41eb-852a-3a30a088ec17 for instance 561dbcab-7deb-49e4-9cca-c94b1899016e on n-h1-858383-10 Oct 12 08:46:21.711619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-786ff189-f48a-47e8-9fd5-07a11216a90c req-4aa9eba3-88a0-4f39-bb7f-b626ecfb64e8 service nova] Creating event network-vif-plugged:62d17ea7-d92a-4239-aa4f-2df03bf6a199 for instance ecf50845-c51f-4d7f-8210-a04d9e628357 on n-h1-858383-10 Oct 12 08:46:21.724895 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-786ff189-f48a-47e8-9fd5-07a11216a90c req-4aa9eba3-88a0-4f39-bb7f-b626ecfb64e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061874 Oct 12 08:46:21.752392 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 321/570] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:21.769947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:21.770816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:21.783415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:21.783918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:21.784361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:21.785083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:21.790063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:21.790749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:21.823097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:22.068425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:22.078113 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-94d36fa1-e64a-4451-a688-5de1ce561f68 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.315504 Oct 12 08:46:22.078691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 322/571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:21 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:22.084292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7e42a02f-7351-4703-a60c-35484af21a4e req-fc936d55-a99e-4b1f-af01-6d7bb92d7039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6737ba52-cb8a-4710-85dd-f0a1aa841a5e", "tag": "37c8ed16-2d1b-4bef-8a90-962fed6302ce"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:22.096901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7e42a02f-7351-4703-a60c-35484af21a4e req-fc936d55-a99e-4b1f-af01-6d7bb92d7039 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:22.097648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7e42a02f-7351-4703-a60c-35484af21a4e req-fc936d55-a99e-4b1f-af01-6d7bb92d7039 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:22.098245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7e42a02f-7351-4703-a60c-35484af21a4e req-fc936d55-a99e-4b1f-af01-6d7bb92d7039 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:22.112116 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7e42a02f-7351-4703-a60c-35484af21a4e req-fc936d55-a99e-4b1f-af01-6d7bb92d7039 service nova] Creating event network-changed:37c8ed16-2d1b-4bef-8a90-962fed6302ce for instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e on n-h1-858383-10 Oct 12 08:46:22.119001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7e42a02f-7351-4703-a60c-35484af21a4e req-fc936d55-a99e-4b1f-af01-6d7bb92d7039 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Oct 12 08:46:22.119786 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 323/572] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:22.126001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:22.126742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:22.133335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:22.133860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:22.134670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:22.135681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:22.136298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:22.137056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:22.141345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:22.151733 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0708dfd8-eff5-4c1b-9f7e-b6ee4524b2d1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.615263 Oct 12 08:46:22.153881 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 250/573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:21 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:22.159828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30c60c97-9c1d-451c-9fb3-e1f157365b6c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848e5b820>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:22.236642 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30c60c97-9c1d-451c-9fb3-e1f157365b6c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.081239 Oct 12 08:46:22.244812 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 251/574] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:22 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:22.250907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:22.251563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:22.258249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:22.259102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:22.259542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:22.260389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:22.260840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:22.261422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:22.387279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:22.397150 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be5da28f-8822-4135-9c99-8bb3b969c3a8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1312 microversion: 2.1 time: 0.275948 Oct 12 08:46:22.398318 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 324/575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:22 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:22.687106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:22.687756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:22.698110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:22.698875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:22.699738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:22.700447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:22.704932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:22.705430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:22.886768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:22.908368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:22.910175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:22.911533 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c5e3f3f-80fb-47be-87d6-9b774a75ee83 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1362 microversion: 2.25 time: 0.665433 Oct 12 08:46:22.912305 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 252/576] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:22 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1362 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:22.964430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:22.974099 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b21f9e0d-6b37-4305-a0fe-76fdf7062ec6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.290755 Oct 12 08:46:22.981895 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 325/577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:22 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:23.108280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:23.109212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:23.121345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.125049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:23.125829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:23.127439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.136507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:23.137496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:23.179797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:23.184518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:23.195566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=18 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:23.196984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=78 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:23.202910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.203746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:23.205942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:23.206895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.208690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:23.209355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:23.435799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=32 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:23.491491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:23.504644 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c940a43a-13aa-4af5-938c-e3e12ed7f180 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1322 microversion: 2.1 time: 0.328391 Oct 12 08:46:23.506969 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 326/578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:23 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:23.512900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1f0d799-bde5-4d40-b79e-03eee91cd207 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f98490db9d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:23.578595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:23.580888 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d1f0d799-bde5-4d40-b79e-03eee91cd207 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.072620 Oct 12 08:46:23.581775 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 327/579] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:23 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:23.589139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:23.590413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:23.601533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.602381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:23.602844 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-93d9e2ad-35d7-4398-bc64-428e1aeef64e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.505294 Oct 12 08:46:23.604672 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 253/580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:23 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:23.605833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:23.607386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.608071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:23.608714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:23.924755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:23.938484 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7130d72-bc76-4bb3-954b-03085a7e9f0d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1461 microversion: 2.1 time: 0.355032 Oct 12 08:46:23.939394 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 328/581] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:23 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1461 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:23.944066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:23.944993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:23.955091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.955844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:23.956461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:23.957471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.958256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:23.958841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:23.967266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:23.969813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:23.990950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:23.991443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:24.002664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:24.006346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:24.009315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:24.011751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:24.194941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:24.202016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Old instance type m1.heat2, new instance type m1.heat {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 08:46:24.215259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:24.216010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:24.217061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:24.222128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:24.222840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:24.233210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:24.578482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:24.595951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:24.597417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:24.605161 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c073da52-ecd6-41a9-bb4c-e59fc2d19b9f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1362 microversion: 2.25 time: 0.667999 Oct 12 08:46:24.609798 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 254/582] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:23 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1362 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:24.628902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:24.630444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:24.635430 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-166b3d30-472c-49c7-a8a7-5ca90bb323a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357/action" status: 202 len: 0 microversion: 2.1 time: 0.672209 Oct 12 08:46:24.641579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 329/583] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:23 2022] POST /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:46:24.643933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:24.644399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:24.645662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:24.646537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:24.647149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:24.647748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:24.656715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:24.664119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:24.683076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:24.683546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:24.688231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:24.689899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:24.690373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:24.690804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:24.930248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:24.963657 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6f853264-6f85-4e98-bded-65ab4f547ca0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.352063 Oct 12 08:46:24.964877 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 255/584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:24 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:24.972473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e510451-726d-42bc-a9c6-6c8101961b4f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848ca7a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:25.015258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:25.026910 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61743cec-59fb-4444-bacb-f4a94165865f tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1472 microversion: 2.1 time: 0.384083 Oct 12 08:46:25.041975 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 330/585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:24 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:25.052314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:25.052962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:25.059557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:25.060081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:25.060561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:25.061343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:25.062078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:25.062577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:25.078335 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3e510451-726d-42bc-a9c6-6c8101961b4f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.112100 Oct 12 08:46:25.087373 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 256/586] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:24 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:25.092203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:25.092823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:25.118010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:25.119031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:25.121690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:25.122595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:25.123208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:25.123938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:25.384035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:25.396045 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ac52d81-3d46-4dbd-abc7-3774f79ce4d7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1470 microversion: 2.1 time: 0.307534 Oct 12 08:46:25.399526 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 257/587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:25 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1470 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:25.640759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:25.649064 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d20f3b7-7c7f-4a15-8745-647e09aa71cb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.605742 Oct 12 08:46:25.654409 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 331/588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:25 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:25.666593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:25.667209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:25.697371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:25.697772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:25.706638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:25.712178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:25.714385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:25.718273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:25.919271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0fc2bf6-6ae4-45a4-b98c-56797daa1854 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:25.920281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e0fc2bf6-6ae4-45a4-b98c-56797daa1854 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] [instance: eae1614d-eade-460e-9507-fc981ffdb69d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:25.930188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e0fc2bf6-6ae4-45a4-b98c-56797daa1854 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] HTTP exception thrown: Instance eae1614d-eade-460e-9507-fc981ffdb69d could not be found. Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0fc2bf6-6ae4-45a4-b98c-56797daa1854 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Request method failure captured: Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/eae1614d-eade-460e-9507-fc981ffdb69d/action HTTP/1.1 Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 15 Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7MevQ0WyESfPm0cIN_U3QhbRHCfoabc5Bk3KUvkgbmYXo9WttcVPZiFuzikayGmvcltZx7MP-ayq7wroz1ptRusRFa8eiJECe0NsiY5C8h8uzjjQjE025KT_RetYjhJ0JuoeBJ8RM91ruqIN6cxSLZ63ZdFFJZtOy1pvyrsOTXGIE Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:46:25.935888 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}] Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 52c9aaf5292e4a73b7cc969f6573818e Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: {"migrate": {}} Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:46:25.937397 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance eae1614d-eade-460e-9507-fc981ffdb69d could not be found. Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'eae1614d-eade-460e-9507-fc981ffdb69d', 'body': {'migrate': {}}} Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae1614d-eade-460e-9507-fc981ffdb69d could not be found. Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:25.938409 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae1614d-eade-460e-9507-fc981ffdb69d could not be found. Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae1614d-eade-460e-9507-fc981ffdb69d could not be found. Oct 12 08:46:25.940004 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:25.940991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0fc2bf6-6ae4-45a4-b98c-56797daa1854 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Returning 404 to user: Instance eae1614d-eade-460e-9507-fc981ffdb69d could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:25.940991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e0fc2bf6-6ae4-45a4-b98c-56797daa1854 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/eae1614d-eade-460e-9507-fc981ffdb69d/action" status: 404 len: 111 microversion: 2.1 time: 0.536654 Oct 12 08:46:25.940991 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 258/589] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:25 2022] POST /compute/v2.1/servers/eae1614d-eade-460e-9507-fc981ffdb69d/action => generated 111 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:46:25.955443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:25.956439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:25.973236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:25.977049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:25.977794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:25.978719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:25.980553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:25.981915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:26.044532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:46:26.122189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:26.130720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:26.136255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:26.148033 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f633e0f9-3281-4cf8-9f47-1822fecddeb4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1362 microversion: 2.25 time: 0.476824 Oct 12 08:46:26.148956 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 332/590] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:25 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:26.169702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:26.179983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:26.206173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:26.206173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:26.206173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:26.206173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:26.206631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:26.206631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:26.247341 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02162168-c46c-48ee-be02-f8f7898d7c6a tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 204 len: 0 microversion: 2.1 time: 0.303651 Oct 12 08:46:26.248656 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 259/591] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:46:25 2022] DELETE /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:46:26.267240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae3fc525-9035-47f9-8069-db6ef247ca98 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848cbc550>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:26.328431 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae3fc525-9035-47f9-8069-db6ef247ca98 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.065917 Oct 12 08:46:26.338322 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 260/592] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:26 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:26.344173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1349171160", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:26.474678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:26.607565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:26.638507 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb213248-22c9-4c3f-8674-a8e4007901d3 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.488728 Oct 12 08:46:26.650058 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 333/593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:26 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:26.664643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a26465f6-4c45-4549-bc38-fb0579df3cba req-d97299a9-d279-4e3a-a5f4-68ed58ee0944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ea5574-8d03-4573-8842-011eee036ae4", "name": "network-vif-plugged", "status": "completed", "tag": "510b2867-6c33-4cf6-beba-1493665faaa6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:26.698227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a26465f6-4c45-4549-bc38-fb0579df3cba req-d97299a9-d279-4e3a-a5f4-68ed58ee0944 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:26.698721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a26465f6-4c45-4549-bc38-fb0579df3cba req-d97299a9-d279-4e3a-a5f4-68ed58ee0944 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:26.699153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a26465f6-4c45-4549-bc38-fb0579df3cba req-d97299a9-d279-4e3a-a5f4-68ed58ee0944 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:26.732233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a26465f6-4c45-4549-bc38-fb0579df3cba req-d97299a9-d279-4e3a-a5f4-68ed58ee0944 service nova] Creating event network-vif-plugged:510b2867-6c33-4cf6-beba-1493665faaa6 for instance d9ea5574-8d03-4573-8842-011eee036ae4 on n-h2-858383-10 Oct 12 08:46:26.743775 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a26465f6-4c45-4549-bc38-fb0579df3cba req-d97299a9-d279-4e3a-a5f4-68ed58ee0944 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090384 Oct 12 08:46:26.744386 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 334/594] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:26.756209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:26.761826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:26.776168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:26.780192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:26.780996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:26.782298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:26.785489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:26.786242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:26.799333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:26.799743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:26.800210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:26.800609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:26.801016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:26.816699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:26.817097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:26.818977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:26.819929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:26.822282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:26.822931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:26.858032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Getting quotas for project c5f79b4420cc4778bcc4c7679f9f7f69. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:26.875908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Getting quotas for user d0a108410e9643139337a933cc07e946 and project c5f79b4420cc4778bcc4c7679f9f7f69. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:26.908306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:26.922053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:27.014214 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30067e91-d481-4cd2-8873-71de4ad529a4 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674090 Oct 12 08:46:27.014830 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 261/595] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:46:27.024925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-528133612", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "2050110167", "adminPass": "***", "networks": [{"uuid": "c94bb784-0634-4fb2-8a38-492c7a8c22d8"}], "security_groups": [{"name": "tempest-securitygroup--2013115360"}], "key_name": "tempest-keypair-1094760699", "user_data": "}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:27.231809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] validate_networks() for [('c94bb784-0634-4fb2-8a38-492c7a8c22d8', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:27.577965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:27.587110 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-716a28fe-ec69-4414-92a6-f4a4a94fd3e7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1470 microversion: 2.1 time: 0.837137 Oct 12 08:46:27.605464 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 335/596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:26 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1470 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:27.672242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:27.674505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:27.760179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:27.761183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:27.762192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:27.766936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:27.770741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:27.771675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:28.459256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:28.460841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:28.461828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:28.462404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:28.463024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:28.480203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:28.484119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:28.485226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:28.486631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:28.487622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:28.489375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:28.491977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:28.498917 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed97fbb8-f18e-4269-95bc-7e11330bdf6b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.900200 Oct 12 08:46:28.502114 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 336/597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:27 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:28.516845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:28.518104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:28.536536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:28.538010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:28.539784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Getting quotas for project 2fc11687869b49f697bd3a37b5f3e23e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:28.540527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:28.544545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:28.545297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:28.545965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:28.547094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Getting quotas for user bdcf977edf9f49cb8c2b3a645fd7db7f and project 2fc11687869b49f697bd3a37b5f3e23e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:28.572667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:28.583604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:28.653661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:28.662785 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5a6a42b4-b539-4518-a854-7daa0369d7e2 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.646740 Oct 12 08:46:28.663701 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 262/598] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:46:28.669801 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02f4edcb-eb10-4ddf-9a68-e9a40fc7b9bd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1218 microversion: 2.1 time: 0.166299 Oct 12 08:46:28.672450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:28.673525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:28.677756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 337/599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:28 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:28.682677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13abc3fc-f093-47d9-8b23-ce047144cce2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848ef5430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:28.691534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:28.692287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:28.692898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:28.693964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:28.694560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:28.702158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:28.715821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:28.804601 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13abc3fc-f093-47d9-8b23-ce047144cce2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.125648 Oct 12 08:46:28.812754 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 338/600] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:28 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:28.824992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:28.825692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:28.850775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:28.873070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:28.873894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:28.873894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:28.874345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:28.874812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:29.241102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:29.254900 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1cc24d6f-91da-416c-8d02-d4e19f7a3ca6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1318 microversion: 2.1 time: 0.447577 Oct 12 08:46:29.256076 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 339/601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:28 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:29.257121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:29.263182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:29.263978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:29.269979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:29.271048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:29.271870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:29.272279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:29.274398 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-894dc813-b9c1-47fa-9725-256035d394b6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1362 microversion: 2.25 time: 0.609506 Oct 12 08:46:29.277003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:29.277923 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 263/602] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:28 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1362 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:29.288861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:29.289328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:29.293373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:29.297683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dd45639d-383f-49c5-a5ec-e407aff1f9ca tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:29.299031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dd45639d-383f-49c5-a5ec-e407aff1f9ca tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:29.429183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dd45639d-383f-49c5-a5ec-e407aff1f9ca tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:29.437122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dd45639d-383f-49c5-a5ec-e407aff1f9ca tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1264 microversion: 2.1 time: 0.157889 Oct 12 08:46:29.441271 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 264/603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:29 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:29.528943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:29.546029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa932cee-2777-4a89-9c51-62de6a10d1d3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1470 microversion: 2.1 time: 0.285490 Oct 12 08:46:29.547000 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 340/604] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:29 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:29.576567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:29.578125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:29.590533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:29.591388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2016215556", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:29.592081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:29.592738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:29.593728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:29.594423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:29.595060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:29.633514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:29.686077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] validate_networks() for [('e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:29.806147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:29.816401 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f5c02a9-2fdb-4d4e-be03-31ed2a3c320f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.268205 Oct 12 08:46:29.818089 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 341/605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:29 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:29.825047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:29.826539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:29.844163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:29.844835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:29.845376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:29.846241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:29.847294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:29.847965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:29.953198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:29.964029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-718cd476-9c13-47d8-913a-0719027245fd tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1218 microversion: 2.1 time: 0.142481 Oct 12 08:46:29.966563 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 342/606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:29 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:29.986405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-052eef82-681d-4d73-810e-c0d3be63b639 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f98490c1280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:30.066737 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-052eef82-681d-4d73-810e-c0d3be63b639 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.095353 Oct 12 08:46:30.067494 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 343/607] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:29 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:30.280206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:30.281125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:30.293865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:30.297131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:30.297907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:30.299936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:30.303285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:30.303990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:30.550555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:30.564136 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0ae03bb2-c389-4e02-a18c-d215d7133e19 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1468 microversion: 2.1 time: 0.288344 Oct 12 08:46:30.569509 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 344/608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:30 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1468 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:30.595313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:30.595940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:30.629192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:30.630995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:30.631468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:30.632217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:30.632678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:30.633105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:30.805003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:30.815787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:30.818054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:30.819427 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4444130b-576b-4db1-a477-97c8ab80ac32 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1362 microversion: 2.25 time: 0.232159 Oct 12 08:46:30.820201 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 345/609] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:30 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:30.847388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:30.848352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:30.860478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:30.861225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:30.861894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:30.862832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:30.863508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:30.864143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:31.025030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:31.036891 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cfe7ba0e-abff-4ce0-b3dc-c905f8f06724 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1260 microversion: 2.1 time: 0.200031 Oct 12 08:46:31.045351 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 346/610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:30 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:31.050756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7885f7bc-8206-40a3-b911-bd22e2c6ebe1 req-548c517d-f700-405d-9cd7-041641a9e6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6737ba52-cb8a-4710-85dd-f0a1aa841a5e", "name": "network-vif-plugged", "status": "completed", "tag": "37c8ed16-2d1b-4bef-8a90-962fed6302ce"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:31.076385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7885f7bc-8206-40a3-b911-bd22e2c6ebe1 req-548c517d-f700-405d-9cd7-041641a9e6ad service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:31.085212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7885f7bc-8206-40a3-b911-bd22e2c6ebe1 req-548c517d-f700-405d-9cd7-041641a9e6ad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:31.086342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7885f7bc-8206-40a3-b911-bd22e2c6ebe1 req-548c517d-f700-405d-9cd7-041641a9e6ad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:31.114117 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7885f7bc-8206-40a3-b911-bd22e2c6ebe1 req-548c517d-f700-405d-9cd7-041641a9e6ad service nova] Creating event network-vif-plugged:37c8ed16-2d1b-4bef-8a90-962fed6302ce for instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e on n-h1-858383-10 Oct 12 08:46:31.123103 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7885f7bc-8206-40a3-b911-bd22e2c6ebe1 req-548c517d-f700-405d-9cd7-041641a9e6ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076265 Oct 12 08:46:31.124060 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 347/611] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:31.132872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:31.136339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:31.153767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:31.157166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:31.159482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:31.160523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:31.161333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:31.164217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:31.969027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:31.984618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc1ba2a6-9c17-4c40-b813-93aeba624e96 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1470 microversion: 2.1 time: 0.856894 Oct 12 08:46:31.986811 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 348/612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:31 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1470 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:32.284569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:32.285735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:32.286397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:32.286962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:32.287521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:32.320689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-670898457", "block_migration": true, "disk_over_commit": false}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:32.325031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:32.327962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:32.328450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:32.328883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:32.329642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:32.330097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:32.330517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:32.351375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:32.352780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:32.356108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:32.358584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:32.367122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:32.368633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:32.434894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Getting quotas for project 82d063b8b7164196a37fdc496e5d6146. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:32.449809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Getting quotas for user cbc2b1086dbf432bbd45864e16811e24 and project 82d063b8b7164196a37fdc496e5d6146. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:32.480030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:32.486581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:32.606618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:32.690717 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94220b86-f16d-4049-8046-cb9c3c71930d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.247596 Oct 12 08:46:32.691888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 265/613] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:46:32.705242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:32.706076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lazy-loading 'flavor' on Instance uuid d9ea5574-8d03-4573-8842-011eee036ae4 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:32.709938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:32.721826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:32.726254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:32.732897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:32.734121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:32.734965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:32.735599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:32.982472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Going to try to live migrate instance to tempest-host-670898457 {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:46:33.002905 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] HTTP exception thrown: Compute host tempest-host-670898457 could not be found. Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Request method failure captured: Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4/action HTTP/1.1 Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 106 Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7PmWSptnGq8Zywik_Er3Lmr3Sm-nRkDF5sqnonWYinj5UOerIlITVHDRzV9FYEvb8F3FLEfc08NMAgDjnWe5bqKO5QEsUwMJjnEyz8UYfvAgNp6mabC9qTWbcKROQ_sGlF_yo5Y4kopd6RBGOcAOInIJ6G5AB4N2pFNWlgAJ7MkLQ Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a274446c78314ea08bb37416cca0e88e Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-LiveMigrationNegativeTest-109379378 Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:46:33.021562 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a274446c78314ea08bb37416cca0e88e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a274446c78314ea08bb37416cca0e88e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a274446c78314ea08bb37416cca0e88e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a274446c78314ea08bb37416cca0e88e"}]}] Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-LiveMigrationNegativeTest-109379378 Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a274446c78314ea08bb37416cca0e88e Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-109379378 Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-LiveMigrationNegativeTest-109379378-project-admin Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c8b6877c17854c7c8c94b3f3a617fb95 Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-LiveMigrationNegativeTest-109379378-project-admin Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: {"os-migrateLive": {"host": "tempest-host-670898457", "block_migration": true, "disk_over_commit": false}} Oct 12 08:46:33.023050 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: exception: Compute host tempest-host-670898457 could not be found. Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'd9ea5574-8d03-4573-8842-011eee036ae4', 'body': {'os-migrateLive': {'host': 'tempest-host-670898457', 'block_migration': True, 'disk_over_commit': False}}} Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 08:46:33.023850 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5490, in live_migrate Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-670898457 could not be found. Oct 12 08:46:33.024964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-670898457 could not be found. Oct 12 08:46:33.026131 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-670898457 could not be found. Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Returning 400 to user: Compute host tempest-host-670898457 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:33.027289 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f4543be-dd7a-4da3-9a45-221782f38370 tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4/action" status: 400 len: 99 microversion: 2.1 time: 1.034985 Oct 12 08:46:33.035840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 349/614] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 12 08:46:31 2022] POST /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4/action => generated 99 bytes in 1048 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:46:33.053996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:33.054726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:33.088558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:33.089153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:33.089640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:33.093363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:33.095214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:33.097978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:33.802486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:33.888073 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d289c82-f022-4a1f-9738-a4aba1a3d53b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 1.189231 Oct 12 08:46:33.888073 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 266/615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:32 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:33.913248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e42622dc-e426-4b09-bf5d-ad1e0781cd12 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848d16a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:34.072874 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e42622dc-e426-4b09-bf5d-ad1e0781cd12 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.187766 Oct 12 08:46:34.073531 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 267/616] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:33 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:34.098199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:34.103202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:34.116974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:34.123720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:34.132065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:34.132831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:34.141518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:34.141995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:34.430106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:34.460313 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa7d631b-a815-42b4-b512-3c60b44d6ad5 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1322 microversion: 2.1 time: 1.417479 Oct 12 08:46:34.462413 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 350/617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:33 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1322 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:34.467713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:34.473044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:34.505724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:34.511951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:34.515750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:34.533219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:34.538236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:34.543028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:34.660858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:34.675325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:34.680363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:34.687704 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a5ae1757-c529-4f86-b961-0a8d673aa1f8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1558 microversion: 2.25 time: 0.606323 Oct 12 08:46:34.688999 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 268/618] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:34 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1558 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:34.702123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-410b85f2-4510-49a5-9aa8-d17899a2f9dc req-9ea54004-775c-419b-8126-6f81a6a089b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2097f23a-de33-42bd-b1d9-4c9fbbf9f553", "name": "network-vif-deleted", "tag": "f261bcbd-3b91-4089-a880-324a5143feae"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:34.743069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-410b85f2-4510-49a5-9aa8-d17899a2f9dc req-9ea54004-775c-419b-8126-6f81a6a089b2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:34.743547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-410b85f2-4510-49a5-9aa8-d17899a2f9dc req-9ea54004-775c-419b-8126-6f81a6a089b2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:34.743972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-410b85f2-4510-49a5-9aa8-d17899a2f9dc req-9ea54004-775c-419b-8126-6f81a6a089b2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:34.781681 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-410b85f2-4510-49a5-9aa8-d17899a2f9dc req-9ea54004-775c-419b-8126-6f81a6a089b2 service nova] Creating event network-vif-deleted:f261bcbd-3b91-4089-a880-324a5143feae for instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 on n-h2-858383-10 Oct 12 08:46:34.794934 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-410b85f2-4510-49a5-9aa8-d17899a2f9dc req-9ea54004-775c-419b-8126-6f81a6a089b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104442 Oct 12 08:46:34.800890 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 269/619] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:34.805969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:34.818955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:34.850601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:34.851373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:34.851831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:34.867579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:34.868091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:34.868613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:34.994032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:35.008210 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5e16dbc8-78ad-40f7-8ed7-f2e8360b8e5b tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1322 microversion: 2.1 time: 0.544283 Oct 12 08:46:35.021848 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 351/620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:34 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:35.037396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:35.039153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:35.050852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:35.057065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:35.058880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:35.059022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:35.062355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:35.068866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:35.069585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:35.074702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c5343a0-5cfb-4c70-aa3f-1346df561026 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1276 microversion: 2.1 time: 0.270249 Oct 12 08:46:35.075900 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 270/621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:34 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:35.081684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:35.082543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:35.094525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:35.095502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:35.096154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:35.102881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:35.106691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:35.107684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:35.456925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:35.477616 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-427083b5-1265-4bc7-bd41-60015991f242 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.454351 Oct 12 08:46:35.490858 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 352/622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:35 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:35.507135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:35.517120 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7fbcc98c-f66c-43da-b351-093e2f50a9df tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1468 microversion: 2.1 time: 0.439918 Oct 12 08:46:35.535850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:35.547480 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 271/623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:35 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1468 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:35.554302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:35.567800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:35.568426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:35.576510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:35.590935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:35.591574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:35.592352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:35.592834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:35.593308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:35.614712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:35.615213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:35.615659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:35.619042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:35.621134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:35.621650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:36.061707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 6737ba52-cb8a-4710-85dd-f0a1aa841a5e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:36.102732 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0df66c46-b359-438c-a888-9d1a2964a11d tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 2053 microversion: 2.25 time: 0.603412 Oct 12 08:46:36.104020 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 353/624] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:35 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 2053 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:36.113052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dcaf211c-a931-457e-adab-a097a123cb84 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848f7d8b0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:36.173676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:36.180025 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dcaf211c-a931-457e-adab-a097a123cb84 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.074630 Oct 12 08:46:36.181047 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 354/625] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:36 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:36.183479 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d55e35a3-51c2-4b01-a8d3-9dcf9aecfe96 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.632850 Oct 12 08:46:36.187641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:36.188929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:36.196390 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 272/626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:35 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:36.202394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1509257404", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:36.207886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:36.208682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:36.209319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:36.210328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:36.212862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:36.215513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:36.320946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:36.511885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:36.522976 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f2698dc-7bbf-47a1-84b2-2da4ea2377c7 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1322 microversion: 2.1 time: 0.340392 Oct 12 08:46:36.523776 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 355/627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:36 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:36.537138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c488da72-5e30-40f6-a8d1-f8ce18bc63e3 req-4a45053b-eaad-4874-a5dc-8d3ddfec70f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308efddf-4cd5-4a08-9d55-3756c716f3e7", "tag": "1e161a8c-0685-4115-b9e3-e3bb3016e38a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:36.561881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c488da72-5e30-40f6-a8d1-f8ce18bc63e3 req-4a45053b-eaad-4874-a5dc-8d3ddfec70f1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:36.562362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c488da72-5e30-40f6-a8d1-f8ce18bc63e3 req-4a45053b-eaad-4874-a5dc-8d3ddfec70f1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:36.562785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c488da72-5e30-40f6-a8d1-f8ce18bc63e3 req-4a45053b-eaad-4874-a5dc-8d3ddfec70f1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:36.575474 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c488da72-5e30-40f6-a8d1-f8ce18bc63e3 req-4a45053b-eaad-4874-a5dc-8d3ddfec70f1 service nova] Creating event network-changed:1e161a8c-0685-4115-b9e3-e3bb3016e38a for instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 on n-h2-858383-10 Oct 12 08:46:36.581061 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c488da72-5e30-40f6-a8d1-f8ce18bc63e3 req-4a45053b-eaad-4874-a5dc-8d3ddfec70f1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049894 Oct 12 08:46:36.581989 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 356/628] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:36.587301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:36.587994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:36.594648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:36.595131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:36.595565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:36.596265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:36.596713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:36.597136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:36.881067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:36.924316 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4619c964-2dcd-4a2f-a32b-20ccd8aac637 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.317277 Oct 12 08:46:36.924316 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 357/629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:36 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:36.927266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:36.928058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:36.935991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:36.936485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:36.936962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:36.937707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:36.938168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:36.938895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.025163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:37.034739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c54c5c4c-f4ee-48b8-a3db-5c2fc68d075b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1282 microversion: 2.1 time: 0.111768 Oct 12 08:46:37.035635 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 358/630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:36 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:37.040612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:37.041920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:37.055294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.055858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.056361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.057192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.057905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.058399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.238584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 6737ba52-cb8a-4710-85dd-f0a1aa841a5e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:37.258210 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-17d5ee1c-8a0b-4028-894f-66c8999ee2ba tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 2053 microversion: 2.25 time: 0.221249 Oct 12 08:46:37.260112 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 359/631] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:37 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 2053 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:37.272331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:37.273325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:37.280814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.281558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.282165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.283110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.283564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.284044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.286975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:37.351952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:37.352926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:37.354501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:37.355321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:37.356400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:37.379764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.380600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.381294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.382327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.382942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.383510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.409156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Getting quotas for project 9fc6ae74b9204e0084b4b80740a47d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:37.414857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Getting quotas for user 236d9004c6b249cda20d50effcf03227 and project 9fc6ae74b9204e0084b4b80740a47d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:37.431492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:37.436894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:37.504679 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d6c8a0b1-a58c-4e19-a5c4-b68425dcbfb0 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306617 Oct 12 08:46:37.512254 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 273/632] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:46:37.519185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35c57aad-7ffb-4228-bbbb-4ee6c374821e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848d051f0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:37.544333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:37.552292 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29152b60-f90e-477e-8459-c6853aba2153 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.290920 Oct 12 08:46:37.557925 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 360/633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:37 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:37.562328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:37.562934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:37.581680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.582177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.582607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.583309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.589041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.590129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.592920 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35c57aad-7ffb-4228-bbbb-4ee6c374821e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1422 microversion: 2.1 time: 0.078711 Oct 12 08:46:37.594500 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 274/634] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:37 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1422 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:37.599597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d60a3c91-159a-4706-81c1-a1e6068755e5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:37.605022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a3c91-159a-4706-81c1-a1e6068755e5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.605739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a3c91-159a-4706-81c1-a1e6068755e5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.606380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a3c91-159a-4706-81c1-a1e6068755e5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.607798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a3c91-159a-4706-81c1-a1e6068755e5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.608500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a3c91-159a-4706-81c1-a1e6068755e5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.609180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a3c91-159a-4706-81c1-a1e6068755e5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.639286 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d60a3c91-159a-4706-81c1-a1e6068755e5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.043594 Oct 12 08:46:37.640648 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 275/635] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 12 08:46:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:46:37.645677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73847765-a857-4e25-905e-ca1a85d79088 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:37.646444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-73847765-a857-4e25-905e-ca1a85d79088 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:37.782907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:37.794717 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-98464253-22ca-41d1-94c6-8342aca5e532 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.236180 Oct 12 08:46:37.809466 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 361/636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:37 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:37.809466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:37.809466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:37.810344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.811077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.811801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.812737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.815565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-73847765-a857-4e25-905e-ca1a85d79088 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:37.823754 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-73847765-a857-4e25-905e-ca1a85d79088 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1219 microversion: 2.1 time: 0.181815 Oct 12 08:46:37.824348 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 276/637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:37 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1219 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:37.832892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.833465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.849484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:37.862594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:37.876783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.880237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.881116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.882714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:37.885581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:37.886829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:37.988307 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e057a4f-7bac-4abd-a775-fb6deb196932 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e/action" status: 202 len: 0 microversion: 2.25 time: 0.145406 Oct 12 08:46:37.991349 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 277/638] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:46:37 2022] POST /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:46:38.009898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:38.013587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:38.023973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.024467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.024899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.025640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.026095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.026518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.087550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:38.097837 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a7fc58b7-e262-4dbc-8cc4-82d1696f8df9 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1322 microversion: 2.1 time: 0.300707 Oct 12 08:46:38.099067 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 362/639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:37 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:38.113883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:38.117058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:38.145298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.145815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.146245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.146963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.147402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.147822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.435565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:38.445346 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4643b275-06c5-4080-acea-3dd843431411 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.452749 Oct 12 08:46:38.446549 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 278/640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:37 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:38.454715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:38.455459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:38.461802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.462587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.463245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.464941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.465674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.466324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.472622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 6737ba52-cb8a-4710-85dd-f0a1aa841a5e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:38.491854 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-77ab2da7-3dcd-45e6-9b7d-36212278e93c tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 2058 microversion: 2.25 time: 0.391516 Oct 12 08:46:38.492918 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 363/641] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:38 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 2058 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:38.580268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:38.581236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:38.588751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.589505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.590026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.591380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.591914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.592549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.834167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:38.844081 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-16ba8c7c-1294-4448-b57f-ce028cc0890b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1324 microversion: 2.1 time: 0.396246 Oct 12 08:46:38.845197 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 279/642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:38 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:38.850463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d8968a3-d9cd-41d4-8c81-be45d3018d3d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848cbc310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:38.859430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:38.870048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d05fa6c6-4384-45c2-beea-73b4b638a97e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.294974 Oct 12 08:46:38.870630 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 364/643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:38 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:38.892106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:38.893096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:38.899975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.900549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.901057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.901885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.902414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.902912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.945904 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d8968a3-d9cd-41d4-8c81-be45d3018d3d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1431 microversion: 2.1 time: 0.099324 Oct 12 08:46:38.951535 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 280/644] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:38 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1431 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:38.962866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:38.963487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:38.970410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.971061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.971506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:38.972224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:38.972683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:38.973117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.070445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:39.081336 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aad0ee8a-5bce-4487-b9db-a838538fea87 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1271 microversion: 2.1 time: 0.128413 Oct 12 08:46:39.097071 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 281/645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:38 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:39.102356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5a9f9241-4a82-4acd-b766-1de7e4f2997b req-dc8ea72d-aa07-4e52-959a-d76a27914699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4", "tag": "9188de81-465f-446b-98f5-a11b075643d2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:39.116686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5a9f9241-4a82-4acd-b766-1de7e4f2997b req-dc8ea72d-aa07-4e52-959a-d76a27914699 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.117412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5a9f9241-4a82-4acd-b766-1de7e4f2997b req-dc8ea72d-aa07-4e52-959a-d76a27914699 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.118041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5a9f9241-4a82-4acd-b766-1de7e4f2997b req-dc8ea72d-aa07-4e52-959a-d76a27914699 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.129366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5a9f9241-4a82-4acd-b766-1de7e4f2997b req-dc8ea72d-aa07-4e52-959a-d76a27914699 service nova] Creating event network-changed:9188de81-465f-446b-98f5-a11b075643d2 for instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 on n-h2-858383-10 Oct 12 08:46:39.135667 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5a9f9241-4a82-4acd-b766-1de7e4f2997b req-dc8ea72d-aa07-4e52-959a-d76a27914699 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037208 Oct 12 08:46:39.136755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 282/646] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:39.143887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-de90f532-07c1-455d-9ef6-db2bf5532211 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848cc9dc0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:39.194401 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-de90f532-07c1-455d-9ef6-db2bf5532211 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 200 len: 1431 microversion: 2.1 time: 0.056223 Oct 12 08:46:39.204734 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 283/647] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:39 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 1431 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:39.210144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:39.211158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:39.218198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.218983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.219590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.220318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.220784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.221211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.433373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:39.442860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fbcd3c26-1092-4576-91d9-bd07b96a2e1e tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.559154 Oct 12 08:46:39.443976 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 365/648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:38 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:39.448917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:39.449754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:39.456632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.457295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.457868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.459108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.459779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.460465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.462064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:39.471240 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c8e2e9e2-7719-41a7-8398-bf349262584c tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1322 microversion: 2.1 time: 0.264971 Oct 12 08:46:39.474763 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 284/649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:39 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:39.479765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:39.480913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:39.487739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.489125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.489830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.490760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.504290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.505812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.824217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:39.835106 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9fcd434-4f58-4a3d-adc5-a4e07432718c tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1467 microversion: 2.1 time: 0.389688 Oct 12 08:46:39.852414 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 366/650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:39 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:39.852414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:39.852414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:39.852414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.852873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.852873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.852873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:39.853127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:39.853127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:39.901153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:39.910058 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-73b8811f-ac75-4ba0-a37b-3fde3854f4da tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.433832 Oct 12 08:46:39.910643 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 285/651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:39 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:39.916347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58afd95e-67a8-4aaf-bad3-e5c4b8df964f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848cafca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:39.991824 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58afd95e-67a8-4aaf-bad3-e5c4b8df964f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/3816cc90-eecd-445f-9498-be8ec212c308" status: 200 len: 784 microversion: 2.1 time: 0.079891 Oct 12 08:46:39.993247 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 286/652] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:39 2022] GET /compute/v2.1/images/3816cc90-eecd-445f-9498-be8ec212c308 => generated 784 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:39.998009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:39.998828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:40.005499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:40.006244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:40.006907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:40.007808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:40.008441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:40.009057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:40.023175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 6737ba52-cb8a-4710-85dd-f0a1aa841a5e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:40.040688 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c9755e3-affc-4598-8c18-2325d1cf765a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 2038 microversion: 2.25 time: 0.203741 Oct 12 08:46:40.041614 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 367/653] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:39 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 2038 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:40.046471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:40.047109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:40.054301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:40.054786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:40.055221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:40.056644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:40.057096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:40.057829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:40.199719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:40.208877 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4fdf6052-07c3-4b07-b7fb-271f76857191 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.166219 Oct 12 08:46:40.209873 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 368/654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:40 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:40.215337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55c24722-9ac1-463d-8251-42d60d7e190e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:40.223605 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55c24722-9ac1-463d-8251-42d60d7e190e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012448 Oct 12 08:46:40.225561 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 369/655] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:46:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:40.230322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": "auto"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:40.233113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:40.240887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:40.241529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:40.241984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:40.242713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:40.243190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:40.243608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:40.267452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'flavor' on Instance uuid 6737ba52-cb8a-4710-85dd-f0a1aa841a5e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:40.279748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Going to try to live migrate instance to n-h2-858383-10 {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:46:40.321734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:40.330179 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2f553fa7-1aa0-46e0-b434-69adfc7a3531 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1324 microversion: 2.1 time: 0.335660 Oct 12 08:46:40.330882 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 287/656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:39 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:40.335865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:40.336761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:40.342961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:40.343708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:40.344368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:40.345294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:40.346000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:40.346635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:40.471092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:40.478650 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e626daf9-89ca-4210-8a09-b3a94b4afcbf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1277 microversion: 2.1 time: 0.146572 Oct 12 08:46:40.479867 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 288/657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:40 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:40.484577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4694e45e-261b-4d2b-8895-0d0655f5835e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848d164c0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:41.153552 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4694e45e-261b-4d2b-8895-0d0655f5835e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "DELETE /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 204 len: 0 microversion: 2.1 time: 0.672456 Oct 12 08:46:41.161025 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 289/658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:40 2022] DELETE /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:46:41.174193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:41.174927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:41.186329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.187014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.187462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:41.188166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.188954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.189353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:41.192351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:41.325662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:41.333887 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0a518f38-a12d-434a-b662-81e9f6a6f5a9 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.168544 Oct 12 08:46:41.338745 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 290/659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:41 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:41.343605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:41.344204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:41.350789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.351271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.351737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:41.352432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.352908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.353362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:41.483397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:41.491668 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-542de777-77a4-4b9b-b4ff-887aafac8b94 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1322 microversion: 2.1 time: 0.151855 Oct 12 08:46:41.492232 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 291/660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:41 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:41.496956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:41.498962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:41.503924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.504402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.504835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:41.505861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.506334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.506773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:41.658804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:41.668054 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2eee72aa-7c6f-48eb-8e30-069cc1ff7dc0 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.174771 Oct 12 08:46:41.668636 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 292/661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:41 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:41.673557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-75371bbb-94c0-4bc5-9ea1-f347eb1a9b0a req-dde8f4dc-21eb-4b4d-a941-777daaed42bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce22591d-61fd-44bf-8816-b86eb6e5ba6e", "tag": "78484926-556e-4306-8e69-9de56e4195c2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:41.683231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75371bbb-94c0-4bc5-9ea1-f347eb1a9b0a req-dde8f4dc-21eb-4b4d-a941-777daaed42bf service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.683725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75371bbb-94c0-4bc5-9ea1-f347eb1a9b0a req-dde8f4dc-21eb-4b4d-a941-777daaed42bf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.684151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75371bbb-94c0-4bc5-9ea1-f347eb1a9b0a req-dde8f4dc-21eb-4b4d-a941-777daaed42bf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:41.696036 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-75371bbb-94c0-4bc5-9ea1-f347eb1a9b0a req-dde8f4dc-21eb-4b4d-a941-777daaed42bf service nova] Creating event network-changed:78484926-556e-4306-8e69-9de56e4195c2 for instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e on n-h1-858383-10 Oct 12 08:46:41.701837 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-75371bbb-94c0-4bc5-9ea1-f347eb1a9b0a req-dde8f4dc-21eb-4b4d-a941-777daaed42bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031066 Oct 12 08:46:41.702826 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 293/662] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:41.710098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7718792d-83c1-43b9-9937-7d56c70cc4c7 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848e5b040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:41.735311 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7718792d-83c1-43b9-9937-7d56c70cc4c7 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] HTTP exception thrown: Image not found. Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7718792d-83c1-43b9-9937-7d56c70cc4c7 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Request method failure captured: Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 HTTP/1.1 Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn68projI7PtQJ1I7XBQGvfuBJL-jYQ4E1Gk4OvRkgHzQRwaijBjAEAjJ24CFgKibiZW2-Br8PGaDjmeP04oSz6G5Ik2UGEK00AkYw8RzWbyxV8HTp0SAH-9fkcx1ZHGN6qtGnNLw2vJ2r7Xyh1UdaGOAuMAOZjOu6YfzaJQafU_vBE Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 75c444d5d31d4ca5bb47e040b1541594 Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:46:41.748312 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75c444d5d31d4ca5bb47e040b1541594"}]}] Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 75c444d5d31d4ca5bb47e040b1541594 Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerTestJSON-879504439-project Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3d7a6a36aadd4818b0422f824718f3f0 Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerTestJSON-879504439-project Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '8e27dfc2-8e6a-4251-986c-fc7725a3ff99'} Oct 12 08:46:41.749940 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:46:41.750822 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8e27dfc2-8e6a-4251-986c-fc7725a3ff99 Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:46:41.751891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8e27dfc2-8e6a-4251-986c-fc7725a3ff99 could not be found. Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:46:41.753110 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:46:41.754235 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:41.757378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7718792d-83c1-43b9-9937-7d56c70cc4c7 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:41.758768 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7718792d-83c1-43b9-9937-7d56c70cc4c7 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 404 len: 62 microversion: 2.1 time: 0.054630 Oct 12 08:46:41.764971 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 294/663] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:41 2022] GET /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:46:41.774744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:41.775720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:41.785976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.786475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.787383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:41.788242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:41.788704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:41.789819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.164968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:42.173334 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e4360fc-b102-4077-8429-ffdca1db90d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.410369 Oct 12 08:46:42.173928 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 295/664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:41 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:42.178918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:42.179752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:42.214684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.215519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.215922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.216831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.217286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.217845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.496860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-35bd1bc3-436e-489c-ae08-abae8a8cc584 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e/action" status: 202 len: 0 microversion: 2.25 time: 2.269941 Oct 12 08:46:42.501662 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 370/665] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:46:40 2022] POST /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e/action => generated 0 bytes in 2275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:46:42.506663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:42.507451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:42.514470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.514965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.515400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.516100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.516711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.517326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.530475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:42.543765 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42edb1c2-a01e-46f6-93a8-29588feb1d0b tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1324 microversion: 2.1 time: 0.368409 Oct 12 08:46:42.558127 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 296/666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:42 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:42.576783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-953ea1db-8138-4732-8652-f3376ec43ce2 req-2027f72b-eba7-4d5c-9d7f-63ecb7a3a44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308efddf-4cd5-4a08-9d55-3756c716f3e7", "name": "network-vif-plugged", "status": "completed", "tag": "1e161a8c-0685-4115-b9e3-e3bb3016e38a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:42.589541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-953ea1db-8138-4732-8652-f3376ec43ce2 req-2027f72b-eba7-4d5c-9d7f-63ecb7a3a44e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.590352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-953ea1db-8138-4732-8652-f3376ec43ce2 req-2027f72b-eba7-4d5c-9d7f-63ecb7a3a44e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.590997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-953ea1db-8138-4732-8652-f3376ec43ce2 req-2027f72b-eba7-4d5c-9d7f-63ecb7a3a44e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.606102 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-953ea1db-8138-4732-8652-f3376ec43ce2 req-2027f72b-eba7-4d5c-9d7f-63ecb7a3a44e service nova] Creating event network-vif-plugged:1e161a8c-0685-4115-b9e3-e3bb3016e38a for instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 on n-h2-858383-10 Oct 12 08:46:42.611324 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-953ea1db-8138-4732-8652-f3376ec43ce2 req-2027f72b-eba7-4d5c-9d7f-63ecb7a3a44e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051645 Oct 12 08:46:42.612131 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 297/667] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:42.617208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2067483323"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:42.619829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:42.626522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.627101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.627545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.628253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.628710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.629138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.724267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:42.734048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-927cd975-c650-4f2a-a954-56f4e40fd9ec tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1319 microversion: 2.1 time: 0.231115 Oct 12 08:46:42.737051 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 371/668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:42 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:42.761736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:42.762537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:42.770728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.772176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.773497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.774437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.775684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.776272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.886904 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ce332a33-1a1e-4a46-87d1-e361acb7b7e9 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "POST /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb/action" status: 202 len: 0 microversion: 2.1 time: 0.273533 Oct 12 08:46:42.888452 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 298/669] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:42 2022] POST /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:46:42.896032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:42.897388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:42.911714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.912209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.912646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.913355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:42.914157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:42.914298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:42.984811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:42.992994 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0fb4228e-6d8f-4ff0-b084-d2bb18cb68a8 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.241091 Oct 12 08:46:42.993603 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 372/670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:42 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:43.001827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:43.002654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:43.008885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.009375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.009879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.010583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.011036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.011462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.147378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:43.148503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:43.157997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:43.159477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:43.160289 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-964ceea0-f5f7-4a70-8341-276fac152e91 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1322 microversion: 2.1 time: 0.165284 Oct 12 08:46:43.160666 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ceb3587-0e44-4ebe-a696-8163e8ca389f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.270425 Oct 12 08:46:43.160964 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 373/671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:42 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:43.174321 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 299/672] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:42 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:43.182406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:43.182406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:43.184919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54db121a-f09a-40c8-8710-1d409c0d3c52 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848c87dc0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:43.195525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.196036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.196487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.197201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.197692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.198120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.237876 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54db121a-f09a-40c8-8710-1d409c0d3c52 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.062209 Oct 12 08:46:43.246809 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 300/673] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:43 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:43.252063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:43.253004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:43.259369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.259951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.260395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.261084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.261563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.261989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.342973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:43.351200 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2241fbe3-4466-42f2-8f43-33680473a979 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.188158 Oct 12 08:46:43.351770 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 374/674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:43 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:43.512957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:43.521572 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8ee8d10d-70a0-4801-bfe5-5e37a9314dcd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.273233 Oct 12 08:46:43.522161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 301/675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:43 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:43.576216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:43.577262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:43.584752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.585231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.585809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.586588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.587273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.587674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.591106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:43.732839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:43.737303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5516d59d-8484-4484-a4d7-55a7ebe9c85c req-ce0e0119-1a1b-4aaa-9c20-1b3ece386524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ac63b8-9b0a-446f-a9b2-00a239f12e48", "tag": "0ece6206-e06e-42b4-aa3a-11459e36d424"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:43.741834 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a193a44-187b-4506-9c05-0790102d17cb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1324 microversion: 2.1 time: 0.169353 Oct 12 08:46:43.743344 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 375/676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:43 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:43.749688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5516d59d-8484-4484-a4d7-55a7ebe9c85c req-ce0e0119-1a1b-4aaa-9c20-1b3ece386524 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.750555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5516d59d-8484-4484-a4d7-55a7ebe9c85c req-ce0e0119-1a1b-4aaa-9c20-1b3ece386524 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.750948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5516d59d-8484-4484-a4d7-55a7ebe9c85c req-ce0e0119-1a1b-4aaa-9c20-1b3ece386524 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.762083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:43.762977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:43.764637 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5516d59d-8484-4484-a4d7-55a7ebe9c85c req-ce0e0119-1a1b-4aaa-9c20-1b3ece386524 service nova] Creating event network-changed:0ece6206-e06e-42b4-aa3a-11459e36d424 for instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 on n-h1-858383-10 Oct 12 08:46:43.769632 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5516d59d-8484-4484-a4d7-55a7ebe9c85c req-ce0e0119-1a1b-4aaa-9c20-1b3ece386524 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039984 Oct 12 08:46:43.769988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.770586 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 302/677] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:46:43.770706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.771090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.772019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:43.772497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:43.772918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:43.952236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:43.960064 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66a7d056-38da-44ce-9d7c-e995d281cb2f tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1319 microversion: 2.1 time: 0.202043 Oct 12 08:46:43.961040 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 376/678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:43 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:44.020590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:44.021938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:44.028451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.028752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.029283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.030466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.030990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.031796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.176448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:44.184870 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-826cccb6-fa4d-4f2d-9bfb-2bfd8b2474fd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.171916 Oct 12 08:46:44.185482 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 303/679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:44 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:44.187306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:44.188866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:44.192026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:44.193266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:44.197472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.198562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.199246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.200021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.200309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.200953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.201239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.201583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.201919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.202347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.202812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.203240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.335465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:44.342032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:44.344803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:44.346972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:44.348587 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7c2559e-f00f-4dc6-bfa3-978c2d5b1b58 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.161940 Oct 12 08:46:44.349971 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 304/680] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:44 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:44.354648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f123453-aa92-4aa0-a16b-12e74fa11e9b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848caf8b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:44.361654 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dfa4e687-d5b2-49f6-b113-a7ea3d3d12fb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1322 microversion: 2.1 time: 0.170097 Oct 12 08:46:44.380807 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 377/681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:44 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:44.383347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:44.383937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:44.390441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.390920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.393944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.394744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.395218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.395650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.439544 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f123453-aa92-4aa0-a16b-12e74fa11e9b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.088069 Oct 12 08:46:44.451255 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 305/682] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:44 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:44.542119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:44.544671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:44.545574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:44.550404 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-874f6cbf-45ce-40ac-bb90-a36a270ca57f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.178499 Oct 12 08:46:44.551180 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 378/683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:44 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:44.552225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.552864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.553355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.554299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.554965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.555490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.628092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-66359ba7-9668-4fe5-a5e5-3f0dd397a6a7 req-7fe2840e-3fc6-467d-a7d6-870b805b3d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9767489-b818-4f08-8371-1199b70f77cb", "name": "network-vif-unplugged", "status": "completed", "tag": "cb327098-0bbf-4741-a0c2-add8d16ae5ed"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:44.638391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-66359ba7-9668-4fe5-a5e5-3f0dd397a6a7 req-7fe2840e-3fc6-467d-a7d6-870b805b3d3b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.638852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-66359ba7-9668-4fe5-a5e5-3f0dd397a6a7 req-7fe2840e-3fc6-467d-a7d6-870b805b3d3b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.639297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-66359ba7-9668-4fe5-a5e5-3f0dd397a6a7 req-7fe2840e-3fc6-467d-a7d6-870b805b3d3b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.650913 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-66359ba7-9668-4fe5-a5e5-3f0dd397a6a7 req-7fe2840e-3fc6-467d-a7d6-870b805b3d3b service nova] Creating event network-vif-unplugged:cb327098-0bbf-4741-a0c2-add8d16ae5ed for instance a9767489-b818-4f08-8371-1199b70f77cb on n-h1-858383-10 Oct 12 08:46:44.656404 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-66359ba7-9668-4fe5-a5e5-3f0dd397a6a7 req-7fe2840e-3fc6-467d-a7d6-870b805b3d3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031904 Oct 12 08:46:44.657170 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 379/684] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:46:44.768408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:44.768827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:44.769353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:44.775946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.776414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.776825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.777601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.778038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.778468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.778579 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6118866c-f938-46d6-8392-a973ecc8956b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.238234 Oct 12 08:46:44.779302 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 306/685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:44 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:44.909561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:44.917425 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3a6b59d-fc59-4ad5-85bc-76070cf707ef tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1324 microversion: 2.1 time: 0.153464 Oct 12 08:46:44.918031 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 380/686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:44 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:44.983527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:44.984403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:44.990740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.991270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.991736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:44.992430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:44.992877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:44.993294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.209265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:45.210344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:45.214273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:45.218554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.219042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.219727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.220683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.221156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.221635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.366727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:45.375461 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a53be16b-0a56-4171-a954-6228cd43c789 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.169986 Oct 12 08:46:45.376188 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 381/687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:45 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:45.380776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:45.383071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:45.387417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.387906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.388337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.389027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.389629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.390037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.491598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:45.501037 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ebe3256b-f7c6-4e84-8ac6-d53a998f6603 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1319 microversion: 2.1 time: 0.521351 Oct 12 08:46:45.517542 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 307/688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:44 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:45.524560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:45.525705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:45.532754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.533316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.533553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:45.533947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.534719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.535244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.535883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.544537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:45.546336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:45.548018 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c8a66545-9f2a-4f16-ac44-c18d929d210d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.170601 Oct 12 08:46:45.549059 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 382/689] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:45 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:45.554085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e549c081-491f-446b-8b2a-19a8e210b144 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f98491b6dc0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:45.626740 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e549c081-491f-446b-8b2a-19a8e210b144 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.076209 Oct 12 08:46:45.627317 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 383/690] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:45 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:45.631985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:45.633204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:45.644967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.645563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.646390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.647276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.647729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.648157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.808599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:45.822850 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ba3c588b-d6eb-4498-a391-f4dfd4228132 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.193861 Oct 12 08:46:45.824189 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 384/691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:45 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:45.832592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:45.840744 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2def4cd8-ea1c-4124-8de6-6b54c7195a54 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1472 microversion: 2.1 time: 0.321260 Oct 12 08:46:45.842075 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 308/692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:45 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:45.842586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e7b52ff1-1ff9-4ff7-9826-28ea635d218b req-f3feec51-44ed-482d-bd27-43d3d345df5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6737ba52-cb8a-4710-85dd-f0a1aa841a5e", "name": "network-vif-unplugged", "status": "completed", "tag": "37c8ed16-2d1b-4bef-8a90-962fed6302ce"}, {"name": "network-changed", "server_uuid": "6737ba52-cb8a-4710-85dd-f0a1aa841a5e", "tag": "37c8ed16-2d1b-4bef-8a90-962fed6302ce"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:45.847454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:45.848307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:45.854910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.855065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7b52ff1-1ff9-4ff7-9826-28ea635d218b req-f3feec51-44ed-482d-bd27-43d3d345df5f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.855438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7b52ff1-1ff9-4ff7-9826-28ea635d218b req-f3feec51-44ed-482d-bd27-43d3d345df5f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.855933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7b52ff1-1ff9-4ff7-9826-28ea635d218b req-f3feec51-44ed-482d-bd27-43d3d345df5f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.856201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.856985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.857917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.858624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.859257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.872780 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e7b52ff1-1ff9-4ff7-9826-28ea635d218b req-f3feec51-44ed-482d-bd27-43d3d345df5f service nova] Creating event network-vif-unplugged:37c8ed16-2d1b-4bef-8a90-962fed6302ce for instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e on n-h1-858383-10 Oct 12 08:46:45.873528 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e7b52ff1-1ff9-4ff7-9826-28ea635d218b req-f3feec51-44ed-482d-bd27-43d3d345df5f service nova] Creating event network-changed:37c8ed16-2d1b-4bef-8a90-962fed6302ce for instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e on n-h1-858383-10 Oct 12 08:46:45.878847 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e7b52ff1-1ff9-4ff7-9826-28ea635d218b req-f3feec51-44ed-482d-bd27-43d3d345df5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053090 Oct 12 08:46:45.880156 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 385/693] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:45.885422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:45.886260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:45.892890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.893864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.893864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.894567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:45.895024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:45.895454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:45.922108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lazy-loading 'flavor' on Instance uuid 308efddf-4cd5-4a08-9d55-3756c716f3e7 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:45.993337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3de3702b-9e03-4a13-8844-cba4c2461141 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7/action" status: 202 len: 0 microversion: 2.1 time: 0.111658 Oct 12 08:46:45.994333 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 386/694] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:45 2022] POST /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:46:45.999553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:46.000293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:46.006725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.007206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.007656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.008344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.008794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.009225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.024175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:46.033369 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5ab107a-183d-496e-a80a-db509b814703 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.189727 Oct 12 08:46:46.034342 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 309/695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:45 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:46.039848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:46.040682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:46.050373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.050857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.051287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.051984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.052433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.052852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.069796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:46.154799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:46.163544 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9342c50-fd1f-416d-96b4-37cfd54a5e32 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1324 microversion: 2.1 time: 0.167937 Oct 12 08:46:46.164336 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 387/696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:45 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:46.401454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:46.403020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:46.410698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.411486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.412026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.412942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.413622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.414302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.528507 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-95aa3b6f-ff39-45d0-bc86-9bb0db6960de tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1633 microversion: 2.1 time: 0.492872 Oct 12 08:46:46.530223 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 310/697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:46 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1633 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:46.538679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:46.539270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:46.547742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.548546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.549125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.550179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.550968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.552483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.563024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:46.574207 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2cc530d5-a8b3-4ea2-a2b7-0f5b5ae59485 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.178066 Oct 12 08:46:46.575302 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 388/698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:46 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:46.594134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:46.594900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:46.601649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.602135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.602564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.603336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.603790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.604598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.755543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:46.763789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:46.765492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:46.766653 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c779e27c-edff-408d-9675-89521c06abba tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.190282 Oct 12 08:46:46.767206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 389/699] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:46 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:46.771515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-238bec6c-0100-4287-9aee-ccd493fc5d3d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f98494a6940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:46.811794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:46.820560 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8aced37d-3c57-425a-aa1c-dc1357d2831c tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1319 microversion: 2.1 time: 0.289105 Oct 12 08:46:46.821136 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 311/700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:46 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:46.822486 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-238bec6c-0100-4287-9aee-ccd493fc5d3d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.054263 Oct 12 08:46:46.825487 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 390/701] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:46 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:46.825607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-57ee3f4e-781a-489d-8a0d-8a33c94bbb5f req-1ddcf20e-ff15-4079-bf3f-235439e6233b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4", "name": "network-vif-plugged", "status": "completed", "tag": "9188de81-465f-446b-98f5-a11b075643d2"}, {"server_uuid": "ce22591d-61fd-44bf-8816-b86eb6e5ba6e", "name": "network-vif-plugged", "status": "completed", "tag": "78484926-556e-4306-8e69-9de56e4195c2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:46.835847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-57ee3f4e-781a-489d-8a0d-8a33c94bbb5f req-1ddcf20e-ff15-4079-bf3f-235439e6233b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.836444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-57ee3f4e-781a-489d-8a0d-8a33c94bbb5f req-1ddcf20e-ff15-4079-bf3f-235439e6233b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.836723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-57ee3f4e-781a-489d-8a0d-8a33c94bbb5f req-1ddcf20e-ff15-4079-bf3f-235439e6233b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.846800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:46.847416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:46.851407 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-57ee3f4e-781a-489d-8a0d-8a33c94bbb5f req-1ddcf20e-ff15-4079-bf3f-235439e6233b service nova] Creating event network-vif-plugged:9188de81-465f-446b-98f5-a11b075643d2 for instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 on n-h2-858383-10 Oct 12 08:46:46.851899 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-57ee3f4e-781a-489d-8a0d-8a33c94bbb5f req-1ddcf20e-ff15-4079-bf3f-235439e6233b service nova] Creating event network-vif-plugged:78484926-556e-4306-8e69-9de56e4195c2 for instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e on n-h1-858383-10 Oct 12 08:46:46.857267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.857267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.857267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.857267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:46.857728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:46.860556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:46.864794 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-57ee3f4e-781a-489d-8a0d-8a33c94bbb5f req-1ddcf20e-ff15-4079-bf3f-235439e6233b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042400 Oct 12 08:46:46.868711 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 312/702] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:46.997430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:47.005758 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8416f587-e221-446d-84d1-9e45a22b688f tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.163203 Oct 12 08:46:47.006529 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 391/703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:46 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:47.057283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:47.057963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:47.065054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.065578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.066161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.066919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.067399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.067967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.187072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:47.187781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:47.206135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.208806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.209329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.210611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.211130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.211700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.266495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:47.274301 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ebfa091-b5b0-4de4-9a9f-b90f0627af8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.221514 Oct 12 08:46:47.274859 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 313/704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:47 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:47.344913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:47.352913 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dcaa1b85-a317-4e1a-8243-f5117383707d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1324 microversion: 2.1 time: 0.169952 Oct 12 08:46:47.353471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 392/705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:47 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:47.556018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:47.557072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:47.567893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.568689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.569408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.570586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.571345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.572041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.597786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:47.598499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:47.605333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.605927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.606435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.607207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.607735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.608333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.619365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:47.624663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:47.708995 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3ae23e6-38ca-4721-92fb-d29997b4deab tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1616 microversion: 2.1 time: 0.159174 Oct 12 08:46:47.710085 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 314/706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:47 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1616 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:47.732123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:47.732696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:47.740577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:47.746417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.747506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.747943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.748727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.749176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.749658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.761367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:47.769294 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-167d0e44-b066-43ed-bafd-997e839beb60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.175402 Oct 12 08:46:47.770037 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 393/707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:47 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:47.794750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:47.804316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:47.811441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.813907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.822530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=28 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:47.823270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.824168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.824825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.825338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.825884 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] HTTP exception thrown: Cannot 'migrate' instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 while it is in vm_state suspended Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Request method failure captured: Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7/action HTTP/1.1 Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 15 Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7MevQ0WyESfPm0cIN_U3QhbRHCfoabc5Bk3KUvkgbmYXo9WttcVPZiFuzikayGmvcltZx7MP-ayq7wroz1ptRusRFa8eiJECe0NsiY5C8h8uzjjQjE025KT_RetYjhJ0JuoeBJ8RM91ruqIN6cxSLZ63ZdFFJZtOy1pvyrsOTXGIE Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:46:47.827663 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}] Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 52c9aaf5292e4a73b7cc969f6573818e Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: {"migrate": {}} Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:46:47.829210 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'migrate' instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 while it is in vm_state suspended Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '308efddf-4cd5-4a08-9d55-3756c716f3e7', 'body': {'migrate': {}}} Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 in vm_state suspended. Cannot resize while the instance is in this state. Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.830537 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 while it is in vm_state suspended Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:47.836419 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:47.837702 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:47.837702 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:47.837702 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 while it is in vm_state suspended Oct 12 08:46:47.837702 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.837702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Returning 409 to user: Cannot 'migrate' instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 while it is in vm_state suspended {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:47.837702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1e736af5-86ca-470c-b29b-c78648ccbec7 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7/action" status: 409 len: 148 microversion: 2.1 time: 0.100841 Oct 12 08:46:47.837702 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 315/708] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:47 2022] POST /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7/action => generated 148 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 08:46:47.839362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b99c9f37-9d4a-4675-bbbb-59a6153dc276 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b99c9f37-9d4a-4675-bbbb-59a6153dc276 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Request method failure captured: Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e/action HTTP/1.1 Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 39 Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7MevQ0WyESfPm0cIN_U3QhbRHCfoabc5Bk3KUvkgbmYXo9WttcVPZiFuzikayGmvcltZx7MP-ayq7wroz1ptRusRFa8eiJECe0NsiY5C8h8uzjjQjE025KT_RetYjhJ0JuoeBJ8RM91ruqIN6cxSLZ63ZdFFJZtOy1pvyrsOTXGIE Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:46:47.852414 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}] Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 52c9aaf5292e4a73b7cc969f6573818e Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: {"os-resetState": {"state": "invalid"}} Oct 12 08:46:47.854092 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '561dbcab-7deb-49e4-9cca-c94b1899016e', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:47.855055 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:46:47.856957 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 12 08:46:47.859477 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:47.859477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b99c9f37-9d4a-4675-bbbb-59a6153dc276 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:47.859477 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b99c9f37-9d4a-4675-bbbb-59a6153dc276 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e/action" status: 400 len: 144 microversion: 2.1 time: 0.021174 Oct 12 08:46:47.861953 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 316/709] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:47 2022] POST /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e/action => generated 144 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:46:47.874867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-446656b8-7183-41d1-8255-265830982cd8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848bfb5e0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:47.925124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-446656b8-7183-41d1-8255-265830982cd8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.062260 Oct 12 08:46:47.925999 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 317/710] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:47 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:47.930536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:47.931107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:47.937745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.938549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.939011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:47.939667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:47.940109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:47.940702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.032627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:48.042006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:48.043610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:48.044924 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f4399c7-1430-4c58-95ea-4bf897022893 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.254215 Oct 12 08:46:48.046022 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 394/711] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:47 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:48.050756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9aa12c9a-da50-4990-a6af-9af6d549b491 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9aa12c9a-da50-4990-a6af-9af6d549b491 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Request method failure captured: Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e/action HTTP/1.1 Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 31 Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7MevQ0WyESfPm0cIN_U3QhbRHCfoabc5Bk3KUvkgbmYXo9WttcVPZiFuzikayGmvcltZx7MP-ayq7wroz1ptRusRFa8eiJECe0NsiY5C8h8uzjjQjE025KT_RetYjhJ0JuoeBJ8RM91ruqIN6cxSLZ63ZdFFJZtOy1pvyrsOTXGIE Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:46:48.054701 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}] Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 52c9aaf5292e4a73b7cc969f6573818e Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: {"os-resetState": {"state": 1}} Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:46:48.056151 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '561dbcab-7deb-49e4-9cca-c94b1899016e', 'body': {'os-resetState': {'state': 1}}} Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 1 Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:48.057077 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 12 08:46:48.058604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.060576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9aa12c9a-da50-4990-a6af-9af6d549b491 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:48.061704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9aa12c9a-da50-4990-a6af-9af6d549b491 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e/action" status: 400 len: 120 microversion: 2.1 time: 0.014467 Oct 12 08:46:48.066856 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 395/712] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:48 2022] POST /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:46:48.072328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:48.073150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:48.080809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.081301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.082397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.082718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.083659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.085219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.096841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:48.106665 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8406ab3e-7f57-4905-8030-7b2b20972bf9 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1319 microversion: 2.1 time: 0.179526 Oct 12 08:46:48.107465 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 318/713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:47 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:48.112291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0bc2aa72-2875-4b06-86b2-9e0412ec7930 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:48.114747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0bc2aa72-2875-4b06-86b2-9e0412ec7930 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Failed to fetch instance by id 999 {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 08:46:48.115424 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-0bc2aa72-2875-4b06-86b2-9e0412ec7930 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0bc2aa72-2875-4b06-86b2-9e0412ec7930 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Request method failure captured: Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 37 Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7MevQ0WyESfPm0cIN_U3QhbRHCfoabc5Bk3KUvkgbmYXo9WttcVPZiFuzikayGmvcltZx7MP-ayq7wroz1ptRusRFa8eiJECe0NsiY5C8h8uzjjQjE025KT_RetYjhJ0JuoeBJ8RM91ruqIN6cxSLZ63ZdFFJZtOy1pvyrsOTXGIE Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:46:48.122659 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7236f3d6b91a46f2a537448c27a2e4ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7236f3d6b91a46f2a537448c27a2e4ec"}]}] Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7236f3d6b91a46f2a537448c27a2e4ec Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-523823473 Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 52c9aaf5292e4a73b7cc969f6573818e Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-523823473-project-admin Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: {"os-resetState": {"state": "error"}} Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:46:48.124218 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 999 could not be found. Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:46:48.125094 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0bc2aa72-2875-4b06-86b2-9e0412ec7930 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:48.126577 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0bc2aa72-2875-4b06-86b2-9e0412ec7930 tempest-ServersAdminNegativeTestJSON-523823473 tempest-ServersAdminNegativeTestJSON-523823473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.015455 Oct 12 08:46:48.129271 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 319/714] 10.222.0.40 () {60 vars in 1179 bytes} [Wed Oct 12 08:46:48 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:46:48.139546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:48.140051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:48.169210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.169761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.170211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.171020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.171476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.171900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.268422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:48.277996 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6e28dca0-cf05-4733-a400-83921943d0d1 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1390 microversion: 2.1 time: 0.209740 Oct 12 08:46:48.279178 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 396/715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:48 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1390 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:48.324272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:48.325971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:48.334440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.335581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.336244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.337243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.337985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.338831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.395750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:46:48.497499 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-52f364b0-2343-4a08-982d-4c16f4a7faff tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "DELETE /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 204 len: 0 microversion: 2.1 time: 0.367628 Oct 12 08:46:48.498097 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 320/716] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:46:48 2022] DELETE /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:46:48.504472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:48.505862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:48.512614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.513103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.513573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.514322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.514769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.515192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.536788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:48.546876 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-164f003a-004c-4b02-9a81-c01855a90677 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.233975 Oct 12 08:46:48.547968 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 397/717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:48 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:48.552645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:48.553407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:48.559577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.560239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.560870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.561829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.562286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.562745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.716536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:48.725503 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1694d01f-2279-4b7a-bc24-71393fa08be0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1324 microversion: 2.1 time: 0.225511 Oct 12 08:46:48.726390 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 321/718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:48 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:48.765431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:48.775543 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e9c4bed-c745-46f4-8ae0-415cf8e86c04 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1469 microversion: 2.1 time: 0.226333 Oct 12 08:46:48.792348 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 398/719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:48 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:48.802779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:48.803844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:48.816355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.817491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.820790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.821758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.822296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.822971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.886582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-29b766cf-313e-4a9f-b88f-a20b1e0f592e req-fe08da34-7281-4227-abf1-aff0dfc4dfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9767489-b818-4f08-8371-1199b70f77cb", "name": "network-vif-plugged", "status": "completed", "tag": "cb327098-0bbf-4741-a0c2-add8d16ae5ed"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:48.903315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-29b766cf-313e-4a9f-b88f-a20b1e0f592e req-fe08da34-7281-4227-abf1-aff0dfc4dfec service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:48.903929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-29b766cf-313e-4a9f-b88f-a20b1e0f592e req-fe08da34-7281-4227-abf1-aff0dfc4dfec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:48.904215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-29b766cf-313e-4a9f-b88f-a20b1e0f592e req-fe08da34-7281-4227-abf1-aff0dfc4dfec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:48.924918 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-29b766cf-313e-4a9f-b88f-a20b1e0f592e req-fe08da34-7281-4227-abf1-aff0dfc4dfec service nova] Creating event network-vif-plugged:cb327098-0bbf-4741-a0c2-add8d16ae5ed for instance a9767489-b818-4f08-8371-1199b70f77cb on n-h1-858383-10 Oct 12 08:46:48.930288 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-29b766cf-313e-4a9f-b88f-a20b1e0f592e req-fe08da34-7281-4227-abf1-aff0dfc4dfec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047652 Oct 12 08:46:48.931077 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 399/720] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:48.941294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89b50d46-b75f-4458-a333-057e2fcfb0fe tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f984932b280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:48.996748 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89b50d46-b75f-4458-a333-057e2fcfb0fe tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.060022 Oct 12 08:46:48.997563 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 400/721] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:48 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:49.004405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:49.014207 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-618a3a3d-8f27-4a5e-b027-5325114789ce tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.217322 Oct 12 08:46:49.015180 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 322/722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:48 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:49.070571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:49.072432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:49.079741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.080356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.081021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.082121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.082889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.083506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.134111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:49.135526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:49.146112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.147119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.148739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.149694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.151383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.151383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.258112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:49.272901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:49.277259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:49.278573 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa06a72e-eacb-452e-813f-4555d8cf7143 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.212046 Oct 12 08:46:49.279507 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 401/723] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:49 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:49.305237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:49.305867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:49.311922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.312410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.312842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.313953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.314576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.315189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.331443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:49.340212 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7c3c8f1d-5a46-4c89-8752-e753ebf2abef tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1319 microversion: 2.1 time: 0.213810 Oct 12 08:46:49.342107 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 323/724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:49 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:49.459456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:49.473743 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc3f3d9a-4a92-4f29-86d8-4ea9bb495646 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1589 microversion: 2.1 time: 0.172899 Oct 12 08:46:49.474625 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 402/725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:49 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1589 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:49.500211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:49.500996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:49.507341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.508107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.508619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.509606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.510226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.510651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.575423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:49.576748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:49.586923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.587767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.588406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.589660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.590181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.590670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.599764 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa83c8a8-107b-422a-a7f7-b504afd66294 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103604 Oct 12 08:46:49.600714 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 324/726] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 08:46:49 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:49.749802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:49.750417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:49.760740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.761234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.761692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.762400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.762847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.763268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.850474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:49.863896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5b3fd5c-4b2d-4445-b128-884ed417dcc4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.293666 Oct 12 08:46:49.878810 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 403/727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:49 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:49.885461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:49.886077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:49.903676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.904175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.904787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.905707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:49.906164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:49.906617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:49.983366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:49.991698 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3da0c25f-5c76-478c-80dc-41c114e1e9f9 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1519 microversion: 2.1 time: 0.247317 Oct 12 08:46:50.005535 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 325/728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:49 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:50.017913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ee2a37f-d6aa-48c4-b309-be1ff48e6def tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848bfb9d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:50.101716 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ee2a37f-d6aa-48c4-b309-be1ff48e6def tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.092035 Oct 12 08:46:50.103307 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 326/729] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:50 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:50.115806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97f08a28-a6e0-424e-a953-d8c75eaadcca tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'create', calling method: .version_select at 0x7f9848c87700>, body: {"pool": null} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:50.228560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:50.239720 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c6091df5-fe24-42f2-a9a3-f9fe06da96d0 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1469 microversion: 2.1 time: 0.359571 Oct 12 08:46:50.254384 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 404/730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:49 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:50.261137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:50.261825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:50.268253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:50.268741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:50.269172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:50.269950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:50.270408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:50.270830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:50.516074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:50.530869 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ba491d2-e807-4e72-a865-de56d09bd890 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1473 microversion: 2.1 time: 0.273067 Oct 12 08:46:50.533190 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 405/731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:50 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:50.541734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:50.543075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:50.553147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:50.553893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:50.554539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:50.555492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:50.556632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:50.557376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:50.852328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:50.871439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:50.873145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:50.874684 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1de52478-ec84-4f64-9975-c0dc3e2123fb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.340101 Oct 12 08:46:50.875728 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 406/732] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:50 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:50.880472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:50.881218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:50.888258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:50.888879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:50.889477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:50.890290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:50.890856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:50.891450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:51.090659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:51.099655 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8007085a-968a-4d6d-a9d4-ae210c7397fc tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1319 microversion: 2.1 time: 0.222657 Oct 12 08:46:51.100240 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 407/733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:50 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:51.127563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:51.128171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:51.142177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:51.143026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:51.143687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:51.145308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:51.146020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:51.146597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:51.643600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:51.652939 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-433c8d5f-bba1-4ba8-a55e-6c8178a74f13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.533295 Oct 12 08:46:51.663018 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 408/734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:51 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:51.663018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-793d8e7d-d2f3-4080-8327-b4d89dd6c784 req-08ebb79c-c1ea-4fda-804d-e8315f4527cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ac63b8-9b0a-446f-a9b2-00a239f12e48", "name": "network-vif-plugged", "status": "completed", "tag": "0ece6206-e06e-42b4-aa3a-11459e36d424"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:51.673109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-793d8e7d-d2f3-4080-8327-b4d89dd6c784 req-08ebb79c-c1ea-4fda-804d-e8315f4527cb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:51.673612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-793d8e7d-d2f3-4080-8327-b4d89dd6c784 req-08ebb79c-c1ea-4fda-804d-e8315f4527cb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:51.674044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-793d8e7d-d2f3-4080-8327-b4d89dd6c784 req-08ebb79c-c1ea-4fda-804d-e8315f4527cb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:51.694765 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-793d8e7d-d2f3-4080-8327-b4d89dd6c784 req-08ebb79c-c1ea-4fda-804d-e8315f4527cb service nova] Creating event network-vif-plugged:0ece6206-e06e-42b4-aa3a-11459e36d424 for instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 on n-h1-858383-10 Oct 12 08:46:51.699958 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-793d8e7d-d2f3-4080-8327-b4d89dd6c784 req-08ebb79c-c1ea-4fda-804d-e8315f4527cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044064 Oct 12 08:46:51.700570 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 409/735] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:51.705816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6dd1f975-dafb-4b3c-a26d-e8e5b0d8e295 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f98494a6f70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:51.753503 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6dd1f975-dafb-4b3c-a26d-e8e5b0d8e295 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.051666 Oct 12 08:46:51.754656 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 410/736] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:51 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:51.759546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:51.760520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:51.767524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:51.768301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:51.768998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:51.769937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:51.770573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:51.771158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:52.066810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:52.079699 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c438c8ec-4c68-439f-8111-4e86fd300924 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1469 microversion: 2.1 time: 0.323778 Oct 12 08:46:52.084489 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 411/737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:51 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1469 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:52.092508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:52.094158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:52.116768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:52.118567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:52.120965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:52.132511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:52.134675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:52.135319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:52.416656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:52.424290 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f0d5f71e-4dd4-4efa-b589-6c2182e6793d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1479 microversion: 2.1 time: 0.338409 Oct 12 08:46:52.433992 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 412/738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:52 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1479 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:52.444709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:52.445338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:52.451618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:52.452462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:52.452746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:52.453271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:52.453755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:52.454178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:52.669307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:52.684234 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e886f932-9022-4008-9221-0d59ca604e90 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1589 microversion: 2.1 time: 0.246717 Oct 12 08:46:52.686795 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 413/739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:52 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1589 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:52.694900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-fbb880a3-5165-49d8-aa83-86d5c02ffc4c req-37b0bc82-2028-4784-aeb5-0a17982943c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4", "tag": "9188de81-465f-446b-98f5-a11b075643d2"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:52.717020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fbb880a3-5165-49d8-aa83-86d5c02ffc4c req-37b0bc82-2028-4784-aeb5-0a17982943c3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:52.718220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fbb880a3-5165-49d8-aa83-86d5c02ffc4c req-37b0bc82-2028-4784-aeb5-0a17982943c3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:52.718792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fbb880a3-5165-49d8-aa83-86d5c02ffc4c req-37b0bc82-2028-4784-aeb5-0a17982943c3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:52.746526 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-fbb880a3-5165-49d8-aa83-86d5c02ffc4c req-37b0bc82-2028-4784-aeb5-0a17982943c3 service nova] Creating event network-changed:9188de81-465f-446b-98f5-a11b075643d2 for instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 on n-h2-858383-10 Oct 12 08:46:52.762952 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-fbb880a3-5165-49d8-aa83-86d5c02ffc4c req-37b0bc82-2028-4784-aeb5-0a17982943c3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074749 Oct 12 08:46:52.763950 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 414/740] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:52.769996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:52.770684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:52.788254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:52.788763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:52.789210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:52.790309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:52.790421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:52.790901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:52.797805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:53.015728 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97f08a28-a6e0-424e-a953-d8c75eaadcca tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.910927 Oct 12 08:46:53.017965 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 327/741] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:46:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:53.035131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:53.039265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:53.077533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.078190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.078726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:53.079550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.081036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.093040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:53.120749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:53.129790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:53.131226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:53.132394 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c312a17d-b74f-4287-9123-52085cfcf5dc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.367220 Oct 12 08:46:53.133267 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 415/742] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:52 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:53.137877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:53.138475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:53.144696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.145181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.145672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:53.146351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.146801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.147320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:53.333172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:53.347574 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cbf7a250-20d4-4622-b03a-f05c0ab14157 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.210171 Oct 12 08:46:53.366535 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 416/743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:53 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:53.379895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-82e38c66-84c3-48e5-bd42-830cb7d3a45d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9849162670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:53.472368 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-82e38c66-84c3-48e5-bd42-830cb7d3a45d tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.104393 Oct 12 08:46:53.473352 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 417/744] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:53 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:53.482019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:53.484184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-305073511", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:53.493574 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1dbdf940-220d-4168-8dbb-1a5464e6f0b6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1319 microversion: 2.1 time: 0.474051 Oct 12 08:46:53.505964 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 328/745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:53 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:53.519144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:53.519773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:53.541295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.541876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.542325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:53.552349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.552850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.558137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:53.602231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] validate_networks() for [('e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:46:53.768955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:53.791459 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-292891a0-bc27-40eb-8477-43c9bef471f1 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1298 microversion: 2.1 time: 0.283880 Oct 12 08:46:53.792625 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 329/746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:53 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1298 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:53.809304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bf562077-4f63-4081-bdc4-40f7c0553c63 req-1b7023ec-45db-4c66-9829-3181074d7165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308efddf-4cd5-4a08-9d55-3756c716f3e7", "name": "network-vif-deleted", "tag": "1e161a8c-0685-4115-b9e3-e3bb3016e38a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:53.859503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf562077-4f63-4081-bdc4-40f7c0553c63 req-1b7023ec-45db-4c66-9829-3181074d7165 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.867687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf562077-4f63-4081-bdc4-40f7c0553c63 req-1b7023ec-45db-4c66-9829-3181074d7165 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.869003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf562077-4f63-4081-bdc4-40f7c0553c63 req-1b7023ec-45db-4c66-9829-3181074d7165 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:53.897183 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bf562077-4f63-4081-bdc4-40f7c0553c63 req-1b7023ec-45db-4c66-9829-3181074d7165 service nova] Creating event network-vif-deleted:1e161a8c-0685-4115-b9e3-e3bb3016e38a for instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 on n-h2-858383-10 Oct 12 08:46:53.902362 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bf562077-4f63-4081-bdc4-40f7c0553c63 req-1b7023ec-45db-4c66-9829-3181074d7165 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108491 Oct 12 08:46:53.907283 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 330/747] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:46:53.912716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:53.913891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:53.920945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.921425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.922149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:53.923011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:53.923822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:53.924219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.139041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:54.149338 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-190adf39-e244-49fd-9a61-cddd79e146e3 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1479 microversion: 2.1 time: 0.239982 Oct 12 08:46:54.150160 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 331/748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:53 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1479 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:54.166046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:54.171077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:54.188996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.189537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.189983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.190694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.193132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.193761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.213805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:54.371461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:54.384791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:46:54.385313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:46:54.385826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:46:54.386304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:46:54.386825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:46:54.396897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:54.398900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:54.399216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.399717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.400156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.400890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.401089 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c1aa371c-9dab-4092-aadf-0903500dedfe tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.240550 Oct 12 08:46:54.401534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.402104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.402492 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 332/749] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:54 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:54.407547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:54.408503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:54.426635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.427403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.428261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.428813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Getting quotas for project 82d063b8b7164196a37fdc496e5d6146. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:54.429733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.430434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.431085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.438715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Getting quotas for user cbc2b1086dbf432bbd45864e16811e24 and project 82d063b8b7164196a37fdc496e5d6146. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:54.452512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:46:54.456023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:46:54.511048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf892fec-d414-407e-ab92-a522a91b7ce8 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036545 Oct 12 08:46:54.512697 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 418/750] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:46:54.523494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cbd6e23d-5552-4c29-8c1c-34a80c9a4bc5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848c97b80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:54.611270 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cbd6e23d-5552-4c29-8c1c-34a80c9a4bc5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.096603 Oct 12 08:46:54.617641 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 419/751] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:54 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:54.622507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:54.623120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:54.642499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.643899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.644809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.650842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:54.662115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.662636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.663084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.668874 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-47e817dd-7809-48f9-8aaa-afb19a606902 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.257331 Oct 12 08:46:54.671393 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 333/752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:54 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:54.676511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c91e7b6-d7a9-4de1-89de-8ca3a186b8fb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:54.677125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8c91e7b6-d7a9-4de1-89de-8ca3a186b8fb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:54.812567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8c91e7b6-d7a9-4de1-89de-8ca3a186b8fb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:54.833994 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8c91e7b6-d7a9-4de1-89de-8ca3a186b8fb tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1223 microversion: 2.1 time: 0.161128 Oct 12 08:46:54.845725 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 334/753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:54 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1223 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:54.846600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:54.847485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:54.861344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.864270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.864743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.866183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.866803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.867391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.917563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:54.918311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:54.919666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:54.920374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lazy-loading 'fault' on Instance uuid 308efddf-4cd5-4a08-9d55-3756c716f3e7 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:54.936712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:54.950963 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0bea8d31-6453-4add-a0ab-1e74edfa2a16 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1469 microversion: 2.1 time: 0.330901 Oct 12 08:46:54.953580 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 420/754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:54 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1469 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:54.968543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:54.977541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:54.977708 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3fccdb65-792b-48ce-ab95-d871a4144478 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 200 len: 1312 microversion: 2.1 time: 0.140196 Oct 12 08:46:54.978081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:54.978808 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 335/755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:54 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:55.000174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.001108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.001727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.002653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.003104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.003836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.041673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lazy-loading 'flavor' on Instance uuid f5ac63b8-9b0a-446f-a9b2-00a239f12e48 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:55.129217 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5892ac39-cc34-482b-9ac9-31ce08dd1dcd tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48/action" status: 202 len: 0 microversion: 2.1 time: 0.154985 Oct 12 08:46:55.132849 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 421/756] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:54 2022] POST /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:46:55.138620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:55.139332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:55.147247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.147765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.148203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.149216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.150221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.150889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.174934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:55.175860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:55.185564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.186096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.186575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.187295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.197670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.198499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.409633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:55.419089 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-74e08c2e-2545-4fa8-9d82-ed402ab2dcda tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1477 microversion: 2.1 time: 0.284660 Oct 12 08:46:55.420831 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 336/757] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:55 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:55.433057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:55.434988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:55.455089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.455907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.456682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.457645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.458359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.458977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.826649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:55.837219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:55.845157 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0761e5c7-b66f-4f1c-badc-9371ca79f101 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1479 microversion: 2.1 time: 0.673649 Oct 12 08:46:55.858018 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 422/758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:55 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1479 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:55.861246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:55.867569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:55.869303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5bd42382-06d9-4787-bf09-7e0293e54d0f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1568 microversion: 2.25 time: 0.442125 Oct 12 08:46:55.870703 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 337/759] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:55 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1568 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:46:55.872934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7671a39c-9305-4d9a-afdb-32ae290e228e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f98491f4940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:55.883812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:55.887112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:55.898354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.904371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.905170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.906195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.910056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.911336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.941283 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7671a39c-9305-4d9a-afdb-32ae290e228e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.075255 Oct 12 08:46:55.950442 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 423/760] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:55 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:55.957306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:55.958145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:55.966237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.967297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.968364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:55.969560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:55.970356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:55.970937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.065211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:56.092906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-20fc62f9-e959-4871-99af-2a4fbd9cbd51 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1275 microversion: 2.1 time: 0.141005 Oct 12 08:46:56.093523 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 424/761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:55 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:56.098528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:56.099323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 308efddf-4cd5-4a08-9d55-3756c716f3e7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:56.105516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.106232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.106843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.107876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.109181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.113887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.142096 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] HTTP exception thrown: Instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 could not be found. Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Request method failure captured: Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 HTTP/1.1 Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7LOsI4pGarqXCYX3e9i_LhP3tV4MzAqzd3WPrbkHm0PDXNDnTKGIPAvR39s0fqrcAcNk7il1SUQCAFQbkXC_TgY_jTku8AH8LrILfDIawr3dcRLbqm95F3k6AYWa8hqn5LJmDo0QvIUwilOZbjxMuOXaX9Gfy3lcTQdiyhLi3mm5g Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: c5f79b4420cc4778bcc4c7679f9f7f69 Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1985192059 Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:46:56.144773 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f79b4420cc4778bcc4c7679f9f7f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5f79b4420cc4778bcc4c7679f9f7f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5f79b4420cc4778bcc4c7679f9f7f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f79b4420cc4778bcc4c7679f9f7f69"}]}] Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1985192059 Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: c5f79b4420cc4778bcc4c7679f9f7f69 Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1985192059 Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersAdminNegativeTestJSON-1985192059-project Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d0a108410e9643139337a933cc07e946 Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1985192059-project Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 could not be found. Oct 12 08:46:56.146394 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '308efddf-4cd5-4a08-9d55-3756c716f3e7'} Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 could not be found. Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:46:56.147442 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 could not be found. Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 could not be found. Oct 12 08:46:56.149289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:46:56.155108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Returning 404 to user: Instance 308efddf-4cd5-4a08-9d55-3756c716f3e7 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:46:56.156132 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-812b337e-8492-43f3-90ff-cb0a5d3bcf8d tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7" status: 404 len: 111 microversion: 2.1 time: 0.061502 Oct 12 08:46:56.160674 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 425/762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:56 2022] GET /compute/v2.1/servers/308efddf-4cd5-4a08-9d55-3756c716f3e7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:46:56.167018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:56.167893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:56.175218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:56.176767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.177327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.177820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.178528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.179135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.179563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.183351 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad9c4006-ff67-4f03-999f-8b13a5110342 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.309155 Oct 12 08:46:56.184365 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 338/763] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:55 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:56.224007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3b04dc08-3b1a-4cb4-8745-db82a198e9a1 req-1ae6a6d1-bafe-4fdf-a579-e9749844e313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b362992b-616f-4d7e-98f1-7465d511f00b", "name": "network-vif-unplugged", "status": "completed", "tag": "1867b80e-5e98-4292-963e-36458a1a69d0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:56.235770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:46:56.242195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3b04dc08-3b1a-4cb4-8745-db82a198e9a1 req-1ae6a6d1-bafe-4fdf-a579-e9749844e313 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.242985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3b04dc08-3b1a-4cb4-8745-db82a198e9a1 req-1ae6a6d1-bafe-4fdf-a579-e9749844e313 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.243453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3b04dc08-3b1a-4cb4-8745-db82a198e9a1 req-1ae6a6d1-bafe-4fdf-a579-e9749844e313 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.264237 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3b04dc08-3b1a-4cb4-8745-db82a198e9a1 req-1ae6a6d1-bafe-4fdf-a579-e9749844e313 service nova] Creating event network-vif-unplugged:1867b80e-5e98-4292-963e-36458a1a69d0 for instance b362992b-616f-4d7e-98f1-7465d511f00b on n-h2-858383-10 Oct 12 08:46:56.270576 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3b04dc08-3b1a-4cb4-8745-db82a198e9a1 req-1ae6a6d1-bafe-4fdf-a579-e9749844e313 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050296 Oct 12 08:46:56.271740 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 339/764] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:46:56.342069 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-493da501-6fa4-42e1-bc2b-093d00d39bdb tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "DELETE /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 204 len: 0 microversion: 2.1 time: 0.179587 Oct 12 08:46:56.343093 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 426/765] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:46:56 2022] DELETE /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:46:56.352420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:56.353197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:56.359958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.360735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.361385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.362340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.362986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.363605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.449188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:56.450041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:56.458710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.459210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.459648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.460494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.460970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.461662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.519695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:56.528731 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a6fde4e-6143-4b20-aec9-8ec18bb1c6fa tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1478 microversion: 2.1 time: 0.180584 Oct 12 08:46:56.529956 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 340/766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:56 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1478 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:56.628618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:56.639129 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9831292a-e4a6-4e91-98c4-5a43f9937273 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1477 microversion: 2.1 time: 0.194586 Oct 12 08:46:56.639708 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 427/767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:56 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:46:56.874117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:56.875158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:56.882287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.883017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.883648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.884632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.885090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.885604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.899741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:56.901498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:56.913500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.914457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.915055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:56.916468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:56.919458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:56.921519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.149154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:57.159463 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6faddcfa-8a5c-40c7-bfb0-8a1e611d5e93 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1464 microversion: 2.1 time: 0.292500 Oct 12 08:46:57.163917 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 341/768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:56 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1464 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:57.171288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d3ee9f7-91b6-4d19-b924-5a7cc90c6025 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848e579d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:57.234061 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d3ee9f7-91b6-4d19-b924-5a7cc90c6025 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.067497 Oct 12 08:46:57.235719 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 342/769] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:57 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:57.241205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:57.242021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:57.248998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.249746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.250496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.252162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.252777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.253368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.328675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:57.338841 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5616a1d-c0fd-44dd-aca1-8401f2a22b9f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1281 microversion: 2.1 time: 0.101861 Oct 12 08:46:57.340423 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 343/770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:57 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:57.345905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:57.349149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:57.356685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.357548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.358193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.359100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.359740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.360371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.407677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:57.417988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:57.424344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:57.425681 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59b80b7a-555b-46ab-95fa-1687ac190240 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1543 microversion: 2.25 time: 0.529842 Oct 12 08:46:57.438395 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 428/771] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:56 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1543 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:57.463612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:57.464637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:57.469498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:57.474447 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b11dfdb-2965-47b6-a3d0-acc388770685 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action" status: 202 len: 0 microversion: 2.1 time: 0.132208 Oct 12 08:46:57.476078 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 344/772] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:57 2022] POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:46:57.482105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d55f5179-2fd7-43c0-9710-e99e09459635 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '.version_select at 0x7f9848bfb940>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:57.484929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.485785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.488098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55f5179-2fd7-43c0-9710-e99e09459635 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.488393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.488599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55f5179-2fd7-43c0-9710-e99e09459635 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.489489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d55f5179-2fd7-43c0-9710-e99e09459635 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.490724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.491444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.492291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.517009 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d55f5179-2fd7-43c0-9710-e99e09459635 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.25 time: 0.039245 Oct 12 08:46:57.518048 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 345/773] 10.222.0.40 () {60 vars in 1184 bytes} [Wed Oct 12 08:46:57 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:57.522530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:57.523288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:57.530178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.530668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.531107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.531816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.532271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.532700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.581139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.581772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.582191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.582653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lazy-loading 'fault' on Instance uuid b362992b-616f-4d7e-98f1-7465d511f00b {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:57.739093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:57.742940 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9f03f6b-23ea-4c6c-8c59-881816472abf tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1600 microversion: 2.1 time: 0.223199 Oct 12 08:46:57.744064 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 346/774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:57 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1600 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:57.749179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:57.750076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:57.750421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d8c34af-3a54-43d2-b5fe-6b5462a62ea3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1475 microversion: 2.1 time: 0.310591 Oct 12 08:46:57.751015 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 429/775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:57 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1475 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:57.771024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:57.771993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:57.772846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.773416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.773949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.774748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.775301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.775795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.787036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.787544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.788014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.788775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.792407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.794032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.932536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 6737ba52-cb8a-4710-85dd-f0a1aa841a5e {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:46:57.961400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9691d514-e8b0-4058-9379-6d8c281161d6 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 2038 microversion: 2.25 time: 0.215893 Oct 12 08:46:57.962303 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 347/776] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:46:57 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 2038 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:46:57.966807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:57.967438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:57.973759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.974279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.974742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:57.975477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:57.975953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:57.976405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:58.073919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:58.083737 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a8c2ed1-2e1e-42b9-92de-4c54db751c2e tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1478 microversion: 2.1 time: 0.329492 Oct 12 08:46:58.084595 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 430/777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:57 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1478 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:58.103750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:58.111212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:58.124282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:58.127031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:58.129619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:58.130588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:58.133087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:58.133723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:58.168529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:58.211415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:58.212707 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-540feaec-8440-4919-bf6c-7b0a9efc6813 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1460 microversion: 2.1 time: 0.246645 Oct 12 08:46:58.216706 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 348/778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:57 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1460 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:58.235598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ef43f2d-1e8b-474e-a4ce-279c05fbeea5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Action: 'create', calling method: .version_select at 0x7f9848d9b940>, body: {"keypair": {"name": "tempest-keypair-1758790530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoS59XfFlHm7VonCjZKiHpgCUHWAoAlD38PrD1bDOZlLa/tCkmAdNbtiGVR4hENTCU0asIphYLWiqOZG9bKiZVkn0UdJlWrXJowfH54UOHSd0WTMq5JkRcejhiyHR0VjQ=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:46:58.273250 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-07150582-a0d8-4deb-964c-2509f98677a7 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action" status: 202 len: 0 microversion: 2.1 time: 0.183968 Oct 12 08:46:58.277492 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 431/779] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:46:58 2022] POST /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:46:58.277667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-4ef43f2d-1e8b-474e-a4ce-279c05fbeea5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:46:58.281264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-4ef43f2d-1e8b-474e-a4ce-279c05fbeea5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for user 008f3287ba094f53971db283b5f303c5 and project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:46:58.285267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:58.285638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:58.303257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:58.304549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:58.305051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:58.306762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:58.308381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:58.308825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:58.314298 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ef43f2d-1e8b-474e-a4ce-279c05fbeea5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.092376 Oct 12 08:46:58.315853 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 349/780] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 08:46:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 08:46:58.321607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-98410ac9-6125-44c4-8061-25f39aa802da tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848cc9a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:58.386917 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-98410ac9-6125-44c4-8061-25f39aa802da tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.069549 Oct 12 08:46:58.389641 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 350/781] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:46:58 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:58.395056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:58.399723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:58.414059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:58.414595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:58.415036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:58.415781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:58.416289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:58.416724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:58.928640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:46:58.943290 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-979fe961-6895-4836-bac8-2fb991791143 tempest-ServersAdminTestJSON-1985421074 tempest-ServersAdminTestJSON-1985421074-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1617 microversion: 2.1 time: 0.552270 Oct 12 08:46:58.943899 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 351/782] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:58 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1617 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:58.967269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:58.968183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:58.979372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:58.985347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:58.985962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:58.987765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:58.988253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:58.988749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:59.124361 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f10aefc-845d-4ebc-9e8e-7c7af6ea193c tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1613 microversion: 2.1 time: 0.847324 Oct 12 08:46:59.150619 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 432/783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:58 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1613 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:59.157191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:59.158285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:59.164673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:59.165398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:59.166020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:59.166993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:59.167625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:59.168197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:59.350008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:46:59.363781 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe412b10-1452-4a99-b5ba-ae2c69b298dc tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.404803 Oct 12 08:46:59.364723 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 352/784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:58 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:46:59.369672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:59.378190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:59.386197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:59.386978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:59.387602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:59.388615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:59.389243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:59.389868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:59.438211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:46:59.635988 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-156a7233-1247-4ab9-afd7-d5d179ff8acd tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 204 len: 0 microversion: 2.1 time: 0.269778 Oct 12 08:46:59.643350 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 353/785] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:46:59 2022] DELETE /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:46:59.661375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:46:59.668293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:46:59.692734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:59.693250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:59.694296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:46:59.710305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:46:59.711074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:46:59.712403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.163257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a108410e9643139337a933cc07e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f79b4420cc4778bcc4c7679f9f7f69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:00.174991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e055c3e0-6e19-4823-9a5e-ff925facdc13 tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 200 len: 1478 microversion: 2.1 time: 0.530865 Oct 12 08:47:00.175764 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 354/786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:59 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 1478 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:00.194078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e0e9dcf-fa10-4a00-81d3-c0d09c27af8a tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:00.206217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e9dcf-fa10-4a00-81d3-c0d09c27af8a tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.207662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e9dcf-fa10-4a00-81d3-c0d09c27af8a tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.208788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e9dcf-fa10-4a00-81d3-c0d09c27af8a tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.210409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e9dcf-fa10-4a00-81d3-c0d09c27af8a tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.211335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e9dcf-fa10-4a00-81d3-c0d09c27af8a tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.213336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e9dcf-fa10-4a00-81d3-c0d09c27af8a tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.256023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e0e9dcf-fa10-4a00-81d3-c0d09c27af8a tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.078258 Oct 12 08:47:00.258775 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 355/787] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 08:47:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:00.266968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33fcdf15-ed28-49ee-9ac4-556dcb474628 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848bfb790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:00.356309 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33fcdf15-ed28-49ee-9ac4-556dcb474628 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.096220 Oct 12 08:47:00.357967 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 356/788] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:00 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:00.366696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:00.371272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:00.401631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.402283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.405816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.407051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.407650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.408189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.578282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:00.590606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d5f806d3-d8c7-49c1-a225-b3e3bcad2cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1474 microversion: 2.1 time: 1.437670 Oct 12 08:47:00.614757 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 433/789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:46:59 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1474 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:00.622515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-dbfa34b7-9f8d-4f91-b615-d2df093a1dc6 req-eb08a428-e35a-4b00-9450-1355a9505336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b362992b-616f-4d7e-98f1-7465d511f00b", "name": "network-vif-plugged", "status": "completed", "tag": "1867b80e-5e98-4292-963e-36458a1a69d0"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:00.648362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dbfa34b7-9f8d-4f91-b615-d2df093a1dc6 req-eb08a428-e35a-4b00-9450-1355a9505336 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.651724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dbfa34b7-9f8d-4f91-b615-d2df093a1dc6 req-eb08a428-e35a-4b00-9450-1355a9505336 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.653010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dbfa34b7-9f8d-4f91-b615-d2df093a1dc6 req-eb08a428-e35a-4b00-9450-1355a9505336 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.659564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:00.669875 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0264cba7-4aab-4add-9cff-093e1f0b5687 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1469 microversion: 2.1 time: 0.310004 Oct 12 08:47:00.671192 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-dbfa34b7-9f8d-4f91-b615-d2df093a1dc6 req-eb08a428-e35a-4b00-9450-1355a9505336 service nova] Creating event network-vif-plugged:1867b80e-5e98-4292-963e-36458a1a69d0 for instance b362992b-616f-4d7e-98f1-7465d511f00b on n-h2-858383-10 Oct 12 08:47:00.677663 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 357/790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:00 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:00.681093 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-dbfa34b7-9f8d-4f91-b615-d2df093a1dc6 req-eb08a428-e35a-4b00-9450-1355a9505336 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064254 Oct 12 08:47:00.683959 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 434/791] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:00.692268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-335ac547-ad05-42b7-8e5a-fbfda9b779e8 req-dd3b7304-8fbb-4735-8b31-d69131d08f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561dbcab-7deb-49e4-9cca-c94b1899016e", "name": "network-vif-deleted", "tag": "3fd40a37-8ce9-41eb-852a-3a30a088ec17"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:00.698131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a831f76a-3094-4f51-a925-2dce47e35ce9 req-545523c7-a192-43b7-ae35-287c79fa263e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf50845-c51f-4d7f-8210-a04d9e628357", "name": "network-vif-unplugged", "status": "completed", "tag": "62d17ea7-d92a-4239-aa4f-2df03bf6a199"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:00.716099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a831f76a-3094-4f51-a925-2dce47e35ce9 req-545523c7-a192-43b7-ae35-287c79fa263e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.717237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a831f76a-3094-4f51-a925-2dce47e35ce9 req-545523c7-a192-43b7-ae35-287c79fa263e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.717912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a831f76a-3094-4f51-a925-2dce47e35ce9 req-545523c7-a192-43b7-ae35-287c79fa263e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.719093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-335ac547-ad05-42b7-8e5a-fbfda9b779e8 req-dd3b7304-8fbb-4735-8b31-d69131d08f1c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.720381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-335ac547-ad05-42b7-8e5a-fbfda9b779e8 req-dd3b7304-8fbb-4735-8b31-d69131d08f1c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.720817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-335ac547-ad05-42b7-8e5a-fbfda9b779e8 req-dd3b7304-8fbb-4735-8b31-d69131d08f1c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.737734 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a831f76a-3094-4f51-a925-2dce47e35ce9 req-545523c7-a192-43b7-ae35-287c79fa263e service nova] Creating event network-vif-unplugged:62d17ea7-d92a-4239-aa4f-2df03bf6a199 for instance ecf50845-c51f-4d7f-8210-a04d9e628357 on n-h2-858383-10 Oct 12 08:47:00.746343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-a831f76a-3094-4f51-a925-2dce47e35ce9 req-545523c7-a192-43b7-ae35-287c79fa263e service nova] Instance ecf50845-c51f-4d7f-8210-a04d9e628357 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:47:00.751601 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-335ac547-ad05-42b7-8e5a-fbfda9b779e8 req-dd3b7304-8fbb-4735-8b31-d69131d08f1c service nova] Creating event network-vif-deleted:3fd40a37-8ce9-41eb-852a-3a30a088ec17 for instance 561dbcab-7deb-49e4-9cca-c94b1899016e on n-h1-858383-10 Oct 12 08:47:00.766480 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-335ac547-ad05-42b7-8e5a-fbfda9b779e8 req-dd3b7304-8fbb-4735-8b31-d69131d08f1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087249 Oct 12 08:47:00.767343 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 358/792] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:00.774443 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a831f76a-3094-4f51-a925-2dce47e35ce9 req-545523c7-a192-43b7-ae35-287c79fa263e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087569 Oct 12 08:47:00.775488 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 435/793] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:00.780858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:00.781589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:00.788408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.788918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.789538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.790281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.790537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": true, "disk_over_commit": false}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:00.790749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.791222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.793106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:00.798223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:00.807259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.817944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.818678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.819577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.820183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.820770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.913260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Lazy-loading 'flavor' on Instance uuid f5ac63b8-9b0a-446f-a9b2-00a239f12e48 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:00.951841 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 while it is in vm_state suspended Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Request method failure captured: Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48/action HTTP/1.1 Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 98 Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7PmWSptnGq8Zywik_Er3Lmr3Sm-nRkDF5sqnonWYinj5UOerIlITVHDRzV9FYEvb8F3FLEfc08NMAgDjnWe5bqKO5QEsUwMJjnEyz8UYfvAgNp6mabC9qTWbcKROQ_sGlF_yo5Y4kopd6RBGOcAOInIJ6G5AB4N2pFNWlgAJ7MkLQ Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a274446c78314ea08bb37416cca0e88e Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-LiveMigrationNegativeTest-109379378 Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:47:00.955279 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a274446c78314ea08bb37416cca0e88e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a274446c78314ea08bb37416cca0e88e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a274446c78314ea08bb37416cca0e88e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a274446c78314ea08bb37416cca0e88e"}]}] Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-LiveMigrationNegativeTest-109379378 Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a274446c78314ea08bb37416cca0e88e Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-109379378 Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-LiveMigrationNegativeTest-109379378-project-admin Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c8b6877c17854c7c8c94b3f3a617fb95 Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-LiveMigrationNegativeTest-109379378-project-admin Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": true, "disk_over_commit": false}} Oct 12 08:47:00.956716 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'os-migrateLive' instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 while it is in vm_state suspended Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f5ac63b8-9b0a-446f-a9b2-00a239f12e48', 'body': {'os-migrateLive': {'host': 'n-h2-858383-10', 'block_migration': True, 'disk_over_commit': False}}} Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 08:47:00.957574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:00.958830 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 while it is in vm_state suspended Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 while it is in vm_state suspended Oct 12 08:47:00.960399 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:00.964066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 while it is in vm_state suspended {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:00.965135 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7f269b1-2c20-452a-a062-e61de7cabeee tempest-LiveMigrationNegativeTest-109379378 tempest-LiveMigrationNegativeTest-109379378-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48/action" status: 409 len: 155 microversion: 2.1 time: 0.196514 Oct 12 08:47:00.974201 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 359/794] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:00 2022] POST /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48/action => generated 155 bytes in 206 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:47:00.985041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:00.985886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:00.993819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.994753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.995370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:00.996258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:00.997778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:00.998603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:01.055041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:01.250679 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-905ce6b4-ef64-4e30-ace7-41e4152900da tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 204 len: 0 microversion: 2.1 time: 0.268784 Oct 12 08:47:01.251343 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 360/795] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:00 2022] DELETE /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:01.262357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:01.276278 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-84ebe2a6-f377-44da-ae9c-11cf41e7432e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.499366 Oct 12 08:47:01.277484 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 436/796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:00 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:01.283661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:01.284215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] [instance: 561dbcab-7deb-49e4-9cca-c94b1899016e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:01.292634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:01.293226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:01.293431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:01.293911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:01.294537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:01.294688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:01.295169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:01.295615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:01.302439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:01.308869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:01.310174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:01.310467 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] HTTP exception thrown: Instance 561dbcab-7deb-49e4-9cca-c94b1899016e could not be found. Oct 12 08:47:01.311429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:01.312098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Request method failure captured: Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e HTTP/1.1 Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7LOsI4pGarqXCYX3e9i_LhP3tV4MzAqzd3WPrbkHm0PDXNDnTKGIPAvR39s0fqrcAcNk7il1SUQCAFQbkXC_TgY_jTku8AH8LrILfDIawr3dcRLbqm95F3k6AYWa8hqn5LJmDo0QvIUwilOZbjxMuOXaX9Gfy3lcTQdiyhLi3mm5g Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c5f79b4420cc4778bcc4c7679f9f7f69 Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1985192059 Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:01.313960 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f79b4420cc4778bcc4c7679f9f7f69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5f79b4420cc4778bcc4c7679f9f7f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5f79b4420cc4778bcc4c7679f9f7f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f79b4420cc4778bcc4c7679f9f7f69"}]}] Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1985192059 Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c5f79b4420cc4778bcc4c7679f9f7f69 Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1985192059 Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersAdminNegativeTestJSON-1985192059-project Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d0a108410e9643139337a933cc07e946 Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1985192059-project Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 561dbcab-7deb-49e4-9cca-c94b1899016e could not be found. Oct 12 08:47:01.315581 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '561dbcab-7deb-49e4-9cca-c94b1899016e'} Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561dbcab-7deb-49e4-9cca-c94b1899016e could not be found. Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:01.316509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561dbcab-7deb-49e4-9cca-c94b1899016e could not be found. Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561dbcab-7deb-49e4-9cca-c94b1899016e could not be found. Oct 12 08:47:01.318050 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:01.319333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] Returning 404 to user: Instance 561dbcab-7deb-49e4-9cca-c94b1899016e could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:01.319333 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7e2f790-09d1-4301-8f3d-51125dd3c96a tempest-ServersAdminNegativeTestJSON-1985192059 tempest-ServersAdminNegativeTestJSON-1985192059-project] 10.222.0.40 "GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e" status: 404 len: 111 microversion: 2.1 time: 0.057091 Oct 12 08:47:01.320311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:01.320759 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 361/797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:01 2022] GET /compute/v2.1/servers/561dbcab-7deb-49e4-9cca-c94b1899016e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:01.372590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9fe6df90-729e-4cd2-99ad-e3e4e3cf9b3e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848c85040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:01.449767 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9fe6df90-729e-4cd2-99ad-e3e4e3cf9b3e tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.080858 Oct 12 08:47:01.450366 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 362/798] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:01 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:01.616268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:01.617128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:01.633307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:01.634156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:01.634771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:01.635662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:01.636310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:01.636921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:01.954745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:01.965613 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06e25b9e-99d3-418c-ac79-3bf4aa394e5b tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1466 microversion: 2.1 time: 0.686743 Oct 12 08:47:01.971691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 437/799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:01 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1466 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:01.988497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:01.989135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:02.007634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:02.008385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:02.009034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:02.010015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:02.010717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:02.011416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:02.061385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:02.078697 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-23c67728-3e06-459d-b254-6412676f1243 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1474 microversion: 2.1 time: 0.467122 Oct 12 08:47:02.083965 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 363/800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:01 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1474 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:02.213198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:02.224195 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51aefc07-b98a-4a6c-8cb6-96c2ae51a887 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 200 len: 1427 microversion: 2.1 time: 0.251089 Oct 12 08:47:02.230506 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 438/801] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:01 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 1427 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:02.264668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-919470336", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3ff61c2d-1adb-4df2-9b11-32c76cd9be4b"}], "security_groups": [{"name": "tempest-securitygroup--1364510978"}], "key_name": "tempest-keypair-1758790530", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:02.301159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:02.302011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:02.312618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:02.313722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:02.314368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:02.315303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:02.315920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:02.316508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:02.440703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] validate_networks() for [('3ff61c2d-1adb-4df2-9b11-32c76cd9be4b', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:47:02.868917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:02.877611 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d5aaabb-f664-46ae-82e3-b20a4548a853 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.581322 Oct 12 08:47:02.886983 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 439/802] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:02 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:02.892021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0d92b17-9957-4f6e-b7ca-caac16c008db tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848ca4ee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:02.951734 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0d92b17-9957-4f6e-b7ca-caac16c008db tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.063427 Oct 12 08:47:02.960930 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 440/803] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:02 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:02.967042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b280135d-ecf0-4d15-a68d-07f53bc062f6 req-e0b31a05-ecd5-487d-a232-4d2ecd3edc8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b61b844-e46c-4f3f-ad00-c631ed41e36e", "name": "network-vif-deleted", "tag": "da4a8b0f-0c3e-460f-b35b-9824a7b3d8a0"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:02.999678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b280135d-ecf0-4d15-a68d-07f53bc062f6 req-e0b31a05-ecd5-487d-a232-4d2ecd3edc8d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:03.000256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b280135d-ecf0-4d15-a68d-07f53bc062f6 req-e0b31a05-ecd5-487d-a232-4d2ecd3edc8d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:03.013733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b280135d-ecf0-4d15-a68d-07f53bc062f6 req-e0b31a05-ecd5-487d-a232-4d2ecd3edc8d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:03.028729 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b280135d-ecf0-4d15-a68d-07f53bc062f6 req-e0b31a05-ecd5-487d-a232-4d2ecd3edc8d service nova] Creating event network-vif-deleted:da4a8b0f-0c3e-460f-b35b-9824a7b3d8a0 for instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e on n-h2-858383-10 Oct 12 08:47:03.034287 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b280135d-ecf0-4d15-a68d-07f53bc062f6 req-e0b31a05-ecd5-487d-a232-4d2ecd3edc8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079062 Oct 12 08:47:03.035387 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 441/804] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:03.043303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b3137b98-f108-42fe-aaa6-f7c9b2d3164b req-2b4e3142-b8e5-49a0-832b-b5c47a312565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf50845-c51f-4d7f-8210-a04d9e628357", "tag": "62d17ea7-d92a-4239-aa4f-2df03bf6a199"}, {"name": "network-changed", "server_uuid": "7e3d5fd9-a725-4697-88f7-c7883ff767a5", "tag": "4a71dc90-5212-462d-a716-48627cfd6634"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:03.059404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b3137b98-f108-42fe-aaa6-f7c9b2d3164b req-2b4e3142-b8e5-49a0-832b-b5c47a312565 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:03.060315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b3137b98-f108-42fe-aaa6-f7c9b2d3164b req-2b4e3142-b8e5-49a0-832b-b5c47a312565 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:03.061110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b3137b98-f108-42fe-aaa6-f7c9b2d3164b req-2b4e3142-b8e5-49a0-832b-b5c47a312565 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:03.087210 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b3137b98-f108-42fe-aaa6-f7c9b2d3164b req-2b4e3142-b8e5-49a0-832b-b5c47a312565 service nova] Creating event network-changed:62d17ea7-d92a-4239-aa4f-2df03bf6a199 for instance ecf50845-c51f-4d7f-8210-a04d9e628357 on n-h2-858383-10 Oct 12 08:47:03.088506 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b3137b98-f108-42fe-aaa6-f7c9b2d3164b req-2b4e3142-b8e5-49a0-832b-b5c47a312565 service nova] Creating event network-changed:4a71dc90-5212-462d-a716-48627cfd6634 for instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 on n-h2-858383-10 Oct 12 08:47:03.110478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-b3137b98-f108-42fe-aaa6-f7c9b2d3164b req-2b4e3142-b8e5-49a0-832b-b5c47a312565 service nova] Instance ecf50845-c51f-4d7f-8210-a04d9e628357 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:47:03.156513 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b3137b98-f108-42fe-aaa6-f7c9b2d3164b req-2b4e3142-b8e5-49a0-832b-b5c47a312565 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.119365 Oct 12 08:47:03.160779 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 442/805] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:03.176443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:03.177153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:03.184717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:03.185250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:03.185715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:03.186430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:03.186883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:03.187312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:03.403585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:03.412191 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2fd26536-552e-4537-abab-e483fd940156 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1466 microversion: 2.1 time: 0.250094 Oct 12 08:47:03.414028 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 443/806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:03 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1466 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:03.452877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:03.455200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:03.482090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:03.483787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:03.485326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:03.486245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:03.487357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:03.488020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:03.962315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:03.971754 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cffe2ba6-f6b0-4481-b260-0b207a162c1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1474 microversion: 2.1 time: 0.556481 Oct 12 08:47:03.972346 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 444/807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:03 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1474 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:03.992838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:03.993386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:03.993781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:03.994199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:03.994614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:03.997486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:03.998323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: 0b61b844-e46c-4f3f-ad00-c631ed41e36e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:04.005262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.008200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.008975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.009652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.010562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.011219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.011880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.012527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.013916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.016313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.017048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.017721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.052812 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] HTTP exception thrown: Instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e could not be found. Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Request method failure captured: Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e HTTP/1.1 Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6Ao596N6__mkKUpXnluIsgHektjlaISpsAl1aCy3XQiFfEe4sFAjlWgw7o40_YM3CQmKtsrKDsXqqwp0AFRTjD9HejFVSSe4fsDQXfoXKnkSvqu-yi-c7yvJCe6yfLvGAvXIuFmND_PgbUxa2HZ91X9gp3YGO6dH8AF30MqeSUJAM Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: b4cc976e520e4b7ea741cdc605abccc6 Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:47:04.054648 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4cc976e520e4b7ea741cdc605abccc6"}]}] Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: b4cc976e520e4b7ea741cdc605abccc6 Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersAdminTestJSON-1870808753-project Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 12321f04fa1844098fb5c2585caae367 Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersAdminTestJSON-1870808753-project Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e could not be found. Oct 12 08:47:04.055925 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '0b61b844-e46c-4f3f-ad00-c631ed41e36e'} Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e could not be found. Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:04.056645 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e could not be found. Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e could not be found. Oct 12 08:47:04.057788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:04.058912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Returning 404 to user: Instance 0b61b844-e46c-4f3f-ad00-c631ed41e36e could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:04.058912 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5f7d0f33-8b86-40e1-a941-3fbfd190607c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e" status: 404 len: 111 microversion: 2.1 time: 0.068014 Oct 12 08:47:04.058912 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 445/808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:03 2022] GET /compute/v2.1/servers/0b61b844-e46c-4f3f-ad00-c631ed41e36e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:04.063864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:04.065401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:04.067861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:04.075174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for user 008f3287ba094f53971db283b5f303c5 and project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:04.082199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.084555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.087688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.088873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.089603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.091884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.108032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:47:04.110827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:47:04.315455 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5d7150c-471e-4901-ab75-0c7b980d635b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.013416 Oct 12 08:47:04.315455 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 364/809] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:47:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:47:04.315455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f92096d-f941-4a9a-8205-1cc53b1936df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848d05430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:04.418158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:04.435791 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f92096d-f941-4a9a-8205-1cc53b1936df tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.160143 Oct 12 08:47:04.436481 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 365/810] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:04 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:04.447840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:04.463702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:04.473746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:04.506389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.510763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:04.511274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.511773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.512528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.512981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.513750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.523238 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3282908a-8531-46ff-a9e8-7729be0d99c3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.462111 Oct 12 08:47:04.524893 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 446/811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:04 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:04.544598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45e632f0-b157-465b-ba58-826c40f91ab5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:04.545617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45e632f0-b157-465b-ba58-826c40f91ab5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:04.594523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:04.669846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45e632f0-b157-465b-ba58-826c40f91ab5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:04.684392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45e632f0-b157-465b-ba58-826c40f91ab5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:04.686240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45e632f0-b157-465b-ba58-826c40f91ab5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:04.689048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45e632f0-b157-465b-ba58-826c40f91ab5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1285 microversion: 2.25 time: 0.161963 Oct 12 08:47:04.699401 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 447/812] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:04 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:04.735807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:04.736423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:04.756795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.757299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.757787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.761652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.762284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.762868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.866259 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-de029d3a-e201-4902-bff7-78d12729c6f2 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 204 len: 0 microversion: 2.1 time: 0.428470 Oct 12 08:47:04.868083 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 366/813] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:04 2022] DELETE /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:04.894949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:04.899811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:04.914204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.919986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.920438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.921178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:04.921662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:04.922091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:04.961390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:04.973683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b900cea-f897-4f90-987e-d8d6ba6fcba8 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 200 len: 1295 microversion: 2.1 time: 0.272449 Oct 12 08:47:04.975028 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 448/814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:04 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 1295 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:05.011590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:05.013788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:05.027120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:05.027870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:05.031701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:05.032647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:05.033933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:05.037546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:05.178211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:05.202181 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a78ee49b-0f80-460f-a059-cf5573086b60 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1470 microversion: 2.1 time: 0.313861 Oct 12 08:47:05.202980 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 367/815] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:04 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1470 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:05.325547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:05.337255 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-337f44b2-3fe0-4347-9e3e-27dc776e9cbc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1472 microversion: 2.1 time: 0.343137 Oct 12 08:47:05.340763 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 449/816] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:04 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:05.391484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8a5741d2-4877-4bcb-bc34-6117d96f57e9 req-6791573c-8575-4bc0-bf10-72c7fc95b0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ac63b8-9b0a-446f-a9b2-00a239f12e48", "name": "network-vif-deleted", "tag": "0ece6206-e06e-42b4-aa3a-11459e36d424"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:05.408377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8a5741d2-4877-4bcb-bc34-6117d96f57e9 req-6791573c-8575-4bc0-bf10-72c7fc95b0d6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:05.413454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8a5741d2-4877-4bcb-bc34-6117d96f57e9 req-6791573c-8575-4bc0-bf10-72c7fc95b0d6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:05.414969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8a5741d2-4877-4bcb-bc34-6117d96f57e9 req-6791573c-8575-4bc0-bf10-72c7fc95b0d6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:05.448494 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8a5741d2-4877-4bcb-bc34-6117d96f57e9 req-6791573c-8575-4bc0-bf10-72c7fc95b0d6 service nova] Creating event network-vif-deleted:0ece6206-e06e-42b4-aa3a-11459e36d424 for instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 on n-h1-858383-10 Oct 12 08:47:05.454467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bc7fe944-29cb-4f18-ac55-34325940703f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f98493a6940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:05.462724 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8a5741d2-4877-4bcb-bc34-6117d96f57e9 req-6791573c-8575-4bc0-bf10-72c7fc95b0d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073262 Oct 12 08:47:05.463706 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 368/817] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:47:05.554546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:05.555703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:05.559339 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bc7fe944-29cb-4f18-ac55-34325940703f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1427 microversion: 2.1 time: 0.111156 Oct 12 08:47:05.567945 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 450/818] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:05 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:05.570600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:05.571098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:05.574710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:05.575464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:05.576012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:05.580060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:05.718985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:05.719819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:05.727695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:05.728545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:05.729167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:05.730667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:05.731479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:05.731780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:05.817516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:05.821574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:05.828828 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-462cb68d-23ab-473c-9734-2e9bd32f8bd0 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.281740 Oct 12 08:47:05.830320 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 369/819] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:05 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:05.903425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:05.919222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:05.920930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:05.922205 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0d1734f-11be-4d60-b201-eef9e2f2761d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1281 microversion: 2.25 time: 0.207265 Oct 12 08:47:05.923191 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 451/820] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:05 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1281 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:05.998972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:05.999285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: f5ac63b8-9b0a-446f-a9b2-00a239f12e48] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:06.006952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.007438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.008069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.009279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.009718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.010112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.028232 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] HTTP exception thrown: Instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 could not be found. Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Request method failure captured: Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 HTTP/1.1 Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7PWjCV0F2T9jDwrG4k3jb-OWb4_LG2Y4ydGcuegY66xj8mgNrXWnxay1pPBtCEL1WczX1Rs8v01TM7jbsfaQC0yq4dEKxFp4LyLq46PJNwZslfjFmHqNakOHLL7aLMSE1-p7z-2Hpruyv7VjMxkDcAOTMetsW-x_qG13s7NS8sFk8 Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9fc6ae74b9204e0084b4b80740a47d9e Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-LiveMigrationNegativeTest-1347603287 Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:06.030560 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fc6ae74b9204e0084b4b80740a47d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9fc6ae74b9204e0084b4b80740a47d9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9fc6ae74b9204e0084b4b80740a47d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fc6ae74b9204e0084b4b80740a47d9e"}]}] Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-LiveMigrationNegativeTest-1347603287 Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9fc6ae74b9204e0084b4b80740a47d9e Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1347603287 Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-LiveMigrationNegativeTest-1347603287-project Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 236d9004c6b249cda20d50effcf03227 Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-LiveMigrationNegativeTest-1347603287-project Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 could not be found. Oct 12 08:47:06.032548 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f5ac63b8-9b0a-446f-a9b2-00a239f12e48'} Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 could not be found. Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:06.033780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 could not be found. Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 could not be found. Oct 12 08:47:06.035170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:06.036480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Returning 404 to user: Instance f5ac63b8-9b0a-446f-a9b2-00a239f12e48 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:06.036480 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-527d538b-d4af-4921-9afe-dc4d1b681607 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48" status: 404 len: 111 microversion: 2.1 time: 0.039562 Oct 12 08:47:06.036911 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 370/821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:05 2022] GET /compute/v2.1/servers/f5ac63b8-9b0a-446f-a9b2-00a239f12e48 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:06.045368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:06.046053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:06.054296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.054857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.055512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.056471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.056989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.057636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.099831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:06.130458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:06.189702 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bd56c4eb-9a0e-44cb-8fa8-42a719c399cf tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 204 len: 0 microversion: 2.1 time: 0.148628 Oct 12 08:47:06.190320 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 452/822] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:06 2022] DELETE /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:06.198501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:06.199121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:06.205410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.206749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.207190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.207940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.208524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.208983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.229742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:06.230539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:06.238316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.239279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.240555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.241615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.242330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.243317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.358026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:06.368468 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e9f17c9f-ebc6-4d64-8494-826007e872d1 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1474 microversion: 2.1 time: 0.173617 Oct 12 08:47:06.369368 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 371/823] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:06 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1474 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:06.374722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:06.375602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:06.381559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.382204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.382795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.383728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.384121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.384544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.395758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:06.404067 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-036fc18d-4904-4a56-879a-08b369eaefaf tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1470 microversion: 2.1 time: 0.178550 Oct 12 08:47:06.404641 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 453/824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:06 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:06.524962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:06.532932 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-283d033c-3bbc-4540-b874-d41ae1a56f75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1472 microversion: 2.1 time: 0.162328 Oct 12 08:47:06.533610 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 372/825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:06 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:06.575680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d35046bc-4fa7-49cf-a647-25bce0a89bf2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848c5cd30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:06.621902 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d35046bc-4fa7-49cf-a647-25bce0a89bf2 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1436 microversion: 2.1 time: 0.050085 Oct 12 08:47:06.622488 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 454/826] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:06 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1436 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:06.638544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83d0fa62-c920-4a7d-b7a3-659236fe8b83 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f984905cd30>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:06.711783 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83d0fa62-c920-4a7d-b7a3-659236fe8b83 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 200 len: 1436 microversion: 2.1 time: 0.078182 Oct 12 08:47:06.712505 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 373/827] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:06 2022] GET /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 1436 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:06.727827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:06.728451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:06.736557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.737106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.737684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.738405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:06.738863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:06.739516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:06.880037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-547958145", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:06.941420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:47:06.987206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:06.997104 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2046c90-bc79-4967-9e42-1dcc947c1632 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1467 microversion: 2.1 time: 0.274219 Oct 12 08:47:06.998655 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 374/828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:06 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:07.016606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:07.017696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:07.026554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.027286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.028620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.029557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.030633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.031217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.163834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:07.164329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:07.164709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:07.165114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:07.165578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:07.174961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.175917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.175917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.176559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.177181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.177886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.195537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Getting quotas for project 246b8300f9b541199731ed89f23cb9f4. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:07.199630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Getting quotas for user 5b855a0c328e425492a8dc28eb276001 and project 246b8300f9b541199731ed89f23cb9f4. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:07.211456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:47:07.213947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:47:07.245245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:07.254790 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9848b56-c358-4bfc-9d3e-02ace23efa6e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.254922 Oct 12 08:47:07.255910 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 375/829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:06 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:07.260981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:07.261675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:07.264884 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-384b4817-7f84-49fb-a30c-49336f993aa1 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566862 Oct 12 08:47:07.265550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 455/830] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:47:07.276850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.277664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.278685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.278936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad55823e-d5c7-4d78-9300-3b9a1998cda5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848c7e700>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:07.280232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.281071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.281605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.407439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:07.426055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:07.427534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:07.434980 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d5a97d7-d9eb-400a-aaa6-6eb461dccf6e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1343 microversion: 2.25 time: 0.177513 Oct 12 08:47:07.435498 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 376/831] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:07 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1343 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:07.464366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-441a0cbd-96fd-4914-a2b0-93b11639854b tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:07.465227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-441a0cbd-96fd-4914-a2b0-93b11639854b tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:07.544448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-441a0cbd-96fd-4914-a2b0-93b11639854b tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:07.559048 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-441a0cbd-96fd-4914-a2b0-93b11639854b tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1213 microversion: 2.1 time: 0.102158 Oct 12 08:47:07.560818 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 377/832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:07 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:07.570864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:07.571475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:07.579062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.579939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.580756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.581719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.583188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.584610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.850003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:07.869877 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-06b09207-92b7-413d-949c-48496a9de3c6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1474 microversion: 2.1 time: 0.306849 Oct 12 08:47:07.874423 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 378/833] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:07 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1474 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:07.879266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:07.886071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:07.897902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.898453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.898846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:07.922516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:07.924470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:07.925204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.072015 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad55823e-d5c7-4d78-9300-3b9a1998cda5 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "DELETE /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e" status: 204 len: 0 microversion: 2.1 time: 0.797307 Oct 12 08:47:08.073318 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 456/834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:07 2022] DELETE /compute/v2.1/images/c2c7b328-2a6d-4a99-aa0e-c7661741281e => generated 0 bytes in 800 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:08.080269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.083469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.092059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.093332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.093975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.094888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.095517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.096136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.237329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:08.253941 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c6b8d78-efad-4f3a-85f1-f5a1c6344a7c tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1470 microversion: 2.1 time: 0.369931 Oct 12 08:47:08.254711 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 379/835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:07 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:08.260175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83bfec0a-a1d5-4e16-8abe-faadb1f8ee4a tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '.version_select at 0x7f9848d05e50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.273106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:08.284053 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d0c51d5-4618-4f14-a401-9c556d618fcf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1469 microversion: 2.1 time: 0.208802 Oct 12 08:47:08.284816 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 457/836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:08 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:08.306171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.307779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.320021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.320799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.323393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.327754 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-83bfec0a-a1d5-4e16-8abe-faadb1f8ee4a tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] HTTP exception thrown: Image not found. Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83bfec0a-a1d5-4e16-8abe-faadb1f8ee4a tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Request method failure captured: Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 HTTP/1.1 Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn68projI7PtQJ1I7XBQGvfuBJL-jYQ4E1Gk4OvRkgHzQRwaijBjAEAjJ24CFgKibiZW2-Br8PGaDjmeP04oSz6G5Ik2UGEK00AkYw8RzWbyxV8HTp0SAH-9fkcx1ZHGN6qtGnNLw2vJ2r7Xyh1UdaGOAuMAOZjOu6YfzaJQafU_vBE Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 75c444d5d31d4ca5bb47e040b1541594 Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:08.331007 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75c444d5d31d4ca5bb47e040b1541594"}]}] Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 75c444d5d31d4ca5bb47e040b1541594 Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerTestJSON-879504439-project Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3d7a6a36aadd4818b0422f824718f3f0 Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerTestJSON-879504439-project Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '8e27dfc2-8e6a-4251-986c-fc7725a3ff99'} Oct 12 08:47:08.332289 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8e27dfc2-8e6a-4251-986c-fc7725a3ff99 to delete Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:08.333040 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8e27dfc2-8e6a-4251-986c-fc7725a3ff99 could not be found. Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:08.334374 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83bfec0a-a1d5-4e16-8abe-faadb1f8ee4a tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:08.335519 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83bfec0a-a1d5-4e16-8abe-faadb1f8ee4a tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "DELETE /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99" status: 404 len: 62 microversion: 2.1 time: 0.076913 Oct 12 08:47:08.337825 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 380/837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:08 2022] DELETE /compute/v2.1/images/8e27dfc2-8e6a-4251-986c-fc7725a3ff99 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:47:08.340503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.341428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.343625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.347182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:08.348422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.366147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.366651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.367091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.368075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.368590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.369039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.456853 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-062e30e4-f5d0-4ab2-968e-3c35c04c148a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357/action" status: 204 len: 0 microversion: 2.1 time: 0.119424 Oct 12 08:47:08.458379 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 381/838] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:08 2022] POST /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357/action => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:08.467526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.468669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.476993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.477952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.478512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.479330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.479919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.480434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.512265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:08.580749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:08.597937 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f3991af-6545-40ab-8044-9c7937c5e9ce tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.311045 Oct 12 08:47:08.598984 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 458/839] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:08 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:08.604459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.604762 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0288fbcc-7b05-4a49-ae88-1aab65a4c39b tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 204 len: 0 microversion: 2.1 time: 0.141957 Oct 12 08:47:08.605536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.606686 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 382/840] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:08 2022] DELETE /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:08.615764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.616362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.616594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.616919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.617300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.617806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.618319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.618803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.624411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.624900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.625593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.626306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.626763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.627256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.756725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:08.765783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:08.767510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:08.768640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-28b19757-1ae2-49cb-a192-61ba7413870a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1411 microversion: 2.25 time: 0.168386 Oct 12 08:47:08.769206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 459/841] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:08 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:08.773788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.774608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.781715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.783013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.784203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.785083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.785720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.786310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.864363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:08.874021 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-54d56bfa-c7cd-4644-baec-cdfe4e4a7d49 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1265 microversion: 2.1 time: 0.103610 Oct 12 08:47:08.875196 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 460/842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:08 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:08.877492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:08.883648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.884340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.891241 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e409387b-4873-4721-a858-f87b60fafcfb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1469 microversion: 2.1 time: 0.279539 Oct 12 08:47:08.892237 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 383/843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:08 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1469 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:08.892465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.893036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.893556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.894439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.896764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.897678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.903781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:08.904687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:08.911332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.911825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.912260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:08.913184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:08.913490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:08.913948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:09.115072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:09.124046 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c4f8807b-a5a4-453c-a934-a6124f9c9a25 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1474 microversion: 2.1 time: 0.227575 Oct 12 08:47:09.124780 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 384/844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:08 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1474 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:09.139621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e0be8312-c315-46bf-a4ef-f0d3e0fc8138 req-1219713a-61b3-4990-bb2a-8bf37141d743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21", "tag": "f197b63f-1a58-4a19-b284-61862fdfca13"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:09.150744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e0be8312-c315-46bf-a4ef-f0d3e0fc8138 req-1219713a-61b3-4990-bb2a-8bf37141d743 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:09.151788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e0be8312-c315-46bf-a4ef-f0d3e0fc8138 req-1219713a-61b3-4990-bb2a-8bf37141d743 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:09.152376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e0be8312-c315-46bf-a4ef-f0d3e0fc8138 req-1219713a-61b3-4990-bb2a-8bf37141d743 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:09.164996 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e0be8312-c315-46bf-a4ef-f0d3e0fc8138 req-1219713a-61b3-4990-bb2a-8bf37141d743 service nova] Creating event network-changed:f197b63f-1a58-4a19-b284-61862fdfca13 for instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 on n-h1-858383-10 Oct 12 08:47:09.170176 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e0be8312-c315-46bf-a4ef-f0d3e0fc8138 req-1219713a-61b3-4990-bb2a-8bf37141d743 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042142 Oct 12 08:47:09.170959 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 385/845] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:09.278765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:09.279417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:09.285793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:09.286274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:09.286707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:09.287792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:09.287903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:09.288333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:09.289998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:09.298014 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4730456b-8179-493a-9194-a33160093c55 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1473 microversion: 2.1 time: 0.421628 Oct 12 08:47:09.298614 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 461/846] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:08 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1473 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:09.429356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:09.437465 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fc16cbc9-1579-4005-8c4e-bdc2f7c6bb3f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1470 microversion: 2.1 time: 0.163049 Oct 12 08:47:09.438376 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 386/847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:09 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:09.622323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:09.622986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:09.629757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:09.630525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:09.631175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:09.631849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:09.632481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:09.632913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:09.795549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:09.796161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:09.805745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:09.806470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:09.807434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:09.815941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:09.817881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:09.819397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:09.982912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:09.994511 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f420777c-e80d-47ce-8f86-2806a08bc502 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.376181 Oct 12 08:47:09.995813 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 462/848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:09 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:10.001764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-77c83c08-1ed6-4567-a56d-546b63820db9 req-980e906e-dcdb-440e-93e0-22d2a1b703da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf50845-c51f-4d7f-8210-a04d9e628357", "name": "network-vif-plugged", "status": "completed", "tag": "62d17ea7-d92a-4239-aa4f-2df03bf6a199"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:10.013406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-77c83c08-1ed6-4567-a56d-546b63820db9 req-980e906e-dcdb-440e-93e0-22d2a1b703da service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.014402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-77c83c08-1ed6-4567-a56d-546b63820db9 req-980e906e-dcdb-440e-93e0-22d2a1b703da service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.015016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-77c83c08-1ed6-4567-a56d-546b63820db9 req-980e906e-dcdb-440e-93e0-22d2a1b703da service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.023067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:10.035526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:10.037629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:10.039146 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e36b1c15-4fbf-49d8-a5a1-fd982781bf11 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1411 microversion: 2.25 time: 0.248073 Oct 12 08:47:10.039333 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-77c83c08-1ed6-4567-a56d-546b63820db9 req-980e906e-dcdb-440e-93e0-22d2a1b703da service nova] Creating event network-vif-plugged:62d17ea7-d92a-4239-aa4f-2df03bf6a199 for instance ecf50845-c51f-4d7f-8210-a04d9e628357 on n-h2-858383-10 Oct 12 08:47:10.040617 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 387/849] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:09 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1411 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:10.048101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:10.049181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:10.057219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.058055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.059868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.060824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.061551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.062195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.067620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:10.069727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-77c83c08-1ed6-4567-a56d-546b63820db9 req-980e906e-dcdb-440e-93e0-22d2a1b703da service nova] Instance ecf50845-c51f-4d7f-8210-a04d9e628357 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:47:10.086197 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-77c83c08-1ed6-4567-a56d-546b63820db9 req-980e906e-dcdb-440e-93e0-22d2a1b703da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088123 Oct 12 08:47:10.087685 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 463/850] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:10.094532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:10.095628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:10.105716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.106546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.107401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.108357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.109390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.110368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.186811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:10.199219 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-96871b6a-6f3e-425f-98fe-fc9adb73fbcf tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1273 microversion: 2.1 time: 0.157071 Oct 12 08:47:10.199918 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 388/851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:10 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:10.210092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:10.210940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:10.219440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.219945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.220384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.221097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.221588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.222188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.518538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:10.526505 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-32f9d9f4-729c-481e-8ae7-70e55f840340 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1469 microversion: 2.1 time: 0.436804 Oct 12 08:47:10.527101 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 464/852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:10 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1469 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:10.534707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:10.538421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:10.551248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236d9004c6b249cda20d50effcf03227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc6ae74b9204e0084b4b80740a47d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:10.557081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.557640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.558077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.559032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.559676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.560891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.565947 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97354560-51aa-414b-a149-37048f2dcd06 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 200 len: 1474 microversion: 2.1 time: 0.364493 Oct 12 08:47:10.569487 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 389/853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:10 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:10.596654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:10.597673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:10.620815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.623027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.624887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.626039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.626607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.627042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:10.795265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:10.803935 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b6e9d46-7585-4aba-93e7-39897707826b tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1470 microversion: 2.1 time: 0.235568 Oct 12 08:47:10.804523 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 390/854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:10 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:10.941604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:10.951430 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c2a5744a-13d6-40bf-8bc8-06af38993fba tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1473 microversion: 2.1 time: 0.420506 Oct 12 08:47:10.952364 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 465/855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:10 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1473 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:10.965052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a2f90359-75a1-4a0f-a8b2-c0c1cb8fc400 req-99666f40-58e2-4f84-b51b-21c419b3e815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c784c0e6-f80d-4d62-8238-7d0977b08110", "name": "network-vif-deleted", "tag": "0fd5e509-91df-45aa-8954-38a9aed1874e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:10.993625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2f90359-75a1-4a0f-a8b2-c0c1cb8fc400 req-99666f40-58e2-4f84-b51b-21c419b3e815 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:10.994719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2f90359-75a1-4a0f-a8b2-c0c1cb8fc400 req-99666f40-58e2-4f84-b51b-21c419b3e815 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:10.995601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2f90359-75a1-4a0f-a8b2-c0c1cb8fc400 req-99666f40-58e2-4f84-b51b-21c419b3e815 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:11.022733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:11.023539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:11.029475 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a2f90359-75a1-4a0f-a8b2-c0c1cb8fc400 req-99666f40-58e2-4f84-b51b-21c419b3e815 service nova] Creating event network-vif-deleted:0fd5e509-91df-45aa-8954-38a9aed1874e for instance c784c0e6-f80d-4d62-8238-7d0977b08110 on n-h2-858383-10 Oct 12 08:47:11.032563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:11.034229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:11.036455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:11.037194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:11.039301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:11.039928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:11.050377 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a2f90359-75a1-4a0f-a8b2-c0c1cb8fc400 req-99666f40-58e2-4f84-b51b-21c419b3e815 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082276 Oct 12 08:47:11.051962 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 391/856] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:11.070899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:11.072082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:11.094002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:11.096549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:11.098720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:11.099733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:11.102139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:11.104075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:11.507022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:11.517343 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d7cfc903-8f27-42b2-865d-574efcf73ad1 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.499161 Oct 12 08:47:11.522703 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 466/857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:11 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:11.554671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:11.557487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:11.572550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:11.575607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:11.576285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:11.577197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:11.577853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:11.591315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:11.807384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:11.829409 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c44769f6-b1db-4961-bc26-2211f0953801 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1271 microversion: 2.1 time: 0.304805 Oct 12 08:47:11.835482 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 467/858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:11 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:11.854083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:11.872362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:11.899765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:11.902181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:11.902659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:11.903421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:11.903952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:11.904382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.178169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:12.186837 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-addde51f-c82b-4173-9f7a-8653d61e45c7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1469 microversion: 2.1 time: 0.350006 Oct 12 08:47:12.187737 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 468/859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:11 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:12.194997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:12.204439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:12.206013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:12.207500 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6f0c4413-ca84-4998-80ea-7272ae99b41a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1411 microversion: 2.25 time: 1.142136 Oct 12 08:47:12.208493 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 392/860] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:11 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1411 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:47:12.214180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1a58f3c5-c963-4b4e-a773-a22d4e43ee8b req-92fc7955-62e8-4061-9149-250ccd252dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ea5574-8d03-4573-8842-011eee036ae4", "name": "network-vif-deleted", "tag": "510b2867-6c33-4cf6-beba-1493665faaa6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:12.221399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:12.226966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] [instance: d9ea5574-8d03-4573-8842-011eee036ae4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:12.240313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.240833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.242829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.245380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a58f3c5-c963-4b4e-a773-a22d4e43ee8b req-92fc7955-62e8-4061-9149-250ccd252dc5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.245758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.246476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a58f3c5-c963-4b4e-a773-a22d4e43ee8b req-92fc7955-62e8-4061-9149-250ccd252dc5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.247095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.247631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a58f3c5-c963-4b4e-a773-a22d4e43ee8b req-92fc7955-62e8-4061-9149-250ccd252dc5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.247866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.260843 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1a58f3c5-c963-4b4e-a773-a22d4e43ee8b req-92fc7955-62e8-4061-9149-250ccd252dc5 service nova] Creating event network-vif-deleted:510b2867-6c33-4cf6-beba-1493665faaa6 for instance d9ea5574-8d03-4573-8842-011eee036ae4 on n-h2-858383-10 Oct 12 08:47:12.265464 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] HTTP exception thrown: Instance d9ea5574-8d03-4573-8842-011eee036ae4 could not be found. Oct 12 08:47:12.266635 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1a58f3c5-c963-4b4e-a773-a22d4e43ee8b req-92fc7955-62e8-4061-9149-250ccd252dc5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056065 Oct 12 08:47:12.267670 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 393/861] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Request method failure captured: Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 HTTP/1.1 Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7PWjCV0F2T9jDwrG4k3jb-OWb4_LG2Y4ydGcuegY66xj8mgNrXWnxay1pPBtCEL1WczX1Rs8v01TM7jbsfaQC0yq4dEKxFp4LyLq46PJNwZslfjFmHqNakOHLL7aLMSE1-p7z-2Hpruyv7VjMxkDcAOTMetsW-x_qG13s7NS8sFk8 Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9fc6ae74b9204e0084b4b80740a47d9e Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-LiveMigrationNegativeTest-1347603287 Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:47:12.267798 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fc6ae74b9204e0084b4b80740a47d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9fc6ae74b9204e0084b4b80740a47d9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9fc6ae74b9204e0084b4b80740a47d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fc6ae74b9204e0084b4b80740a47d9e"}]}] Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-LiveMigrationNegativeTest-1347603287 Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9fc6ae74b9204e0084b4b80740a47d9e Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1347603287 Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-LiveMigrationNegativeTest-1347603287-project Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 236d9004c6b249cda20d50effcf03227 Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-LiveMigrationNegativeTest-1347603287-project Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance d9ea5574-8d03-4573-8842-011eee036ae4 could not be found. Oct 12 08:47:12.269194 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'd9ea5574-8d03-4573-8842-011eee036ae4'} Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ea5574-8d03-4573-8842-011eee036ae4 could not be found. Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:12.270152 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ea5574-8d03-4573-8842-011eee036ae4 could not be found. Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ea5574-8d03-4573-8842-011eee036ae4 could not be found. Oct 12 08:47:12.271518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:12.272569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] Returning 404 to user: Instance d9ea5574-8d03-4573-8842-011eee036ae4 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:12.272569 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd7ad6ba-827f-4106-92a8-f286df90bfb6 tempest-LiveMigrationNegativeTest-1347603287 tempest-LiveMigrationNegativeTest-1347603287-project] 10.222.0.40 "GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4" status: 404 len: 111 microversion: 2.1 time: 0.080535 Oct 12 08:47:12.273414 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 469/862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:12 2022] GET /compute/v2.1/servers/d9ea5574-8d03-4573-8842-011eee036ae4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:12.279490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:12.280184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:12.280747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:12.281649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:12.287251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.288019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.288536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.289418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.289975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.290507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.290922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.291570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.292160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.293024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.293671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.294645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.333296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.334255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.334830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.335973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lazy-loading 'fault' on Instance uuid c784c0e6-f80d-4d62-8238-7d0977b08110 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:12.405944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:12.423387 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e87076d-eccc-4fe5-9d85-6fe1396cee41 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 200 len: 1304 microversion: 2.1 time: 0.141629 Oct 12 08:47:12.424196 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 470/863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:12 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:12.429150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-149b875d-3905-46e8-b59c-8a074c509323 req-9d08d072-9edd-4b24-b57f-39a909b218d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9767489-b818-4f08-8371-1199b70f77cb", "name": "network-vif-unplugged", "status": "completed", "tag": "cb327098-0bbf-4741-a0c2-add8d16ae5ed"}, {"server_uuid": "7e3d5fd9-a725-4697-88f7-c7883ff767a5", "name": "network-vif-plugged", "status": "completed", "tag": "4a71dc90-5212-462d-a716-48627cfd6634"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:12.439551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:12.442460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-149b875d-3905-46e8-b59c-8a074c509323 req-9d08d072-9edd-4b24-b57f-39a909b218d9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.443206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-149b875d-3905-46e8-b59c-8a074c509323 req-9d08d072-9edd-4b24-b57f-39a909b218d9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.443787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-149b875d-3905-46e8-b59c-8a074c509323 req-9d08d072-9edd-4b24-b57f-39a909b218d9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.460558 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-149b875d-3905-46e8-b59c-8a074c509323 req-9d08d072-9edd-4b24-b57f-39a909b218d9 service nova] Creating event network-vif-unplugged:cb327098-0bbf-4741-a0c2-add8d16ae5ed for instance a9767489-b818-4f08-8371-1199b70f77cb on n-h1-858383-10 Oct 12 08:47:12.461322 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-149b875d-3905-46e8-b59c-8a074c509323 req-9d08d072-9edd-4b24-b57f-39a909b218d9 service nova] Creating event network-vif-plugged:4a71dc90-5212-462d-a716-48627cfd6634 for instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 on n-h2-858383-10 Oct 12 08:47:12.471904 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-149b875d-3905-46e8-b59c-8a074c509323 req-9d08d072-9edd-4b24-b57f-39a909b218d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045971 Oct 12 08:47:12.476655 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 471/864] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:12.547753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:12.548509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:12.561013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.564373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.565013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.566084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.566688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.567768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.613036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:12.764867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:12.773115 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b9182cf-613d-4fc9-9194-fc30f28b996f tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1473 microversion: 2.1 time: 0.497249 Oct 12 08:47:12.773732 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 394/865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:12 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1473 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:12.816789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:12.825222 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a430931c-2de2-423b-b10e-bc48c9f2c830 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.282723 Oct 12 08:47:12.825961 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 472/866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:12 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:12.863988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:12.864818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:12.872040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:12.874377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.875187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.875626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:12.876342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:12.876783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:12.877207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.025920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:13.034883 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e328f19-4274-4ffa-9d50-76218be509f0 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1271 microversion: 2.1 time: 0.178365 Oct 12 08:47:13.036101 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 395/867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:12 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:13.212767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:13.213857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:13.222789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.223810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.226462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.227590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.228321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.229136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.240941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:13.241668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:13.256087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.257071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.257967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.261938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.263199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.264937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.431215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:13.440698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13b18f54-31bf-4551-8cf1-f233d9a1a31a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1461 microversion: 2.1 time: 0.232346 Oct 12 08:47:13.441386 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 473/868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:13 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1461 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:13.453487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:13.454356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: c784c0e6-f80d-4d62-8238-7d0977b08110] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:13.462975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.463502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.463939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.464657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.465639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.466635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.482195 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] HTTP exception thrown: Instance c784c0e6-f80d-4d62-8238-7d0977b08110 could not be found. Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Request method failure captured: Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 HTTP/1.1 Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6Ao596N6__mkKUpXnluIsgHektjlaISpsAl1aCy3XQiFfEe4sFAjlWgw7o40_YM3CQmKtsrKDsXqqwp0AFRTjD9HejFVSSe4fsDQXfoXKnkSvqu-yi-c7yvJCe6yfLvGAvXIuFmND_PgbUxa2HZ91X9gp3YGO6dH8AF30MqeSUJAM Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: b4cc976e520e4b7ea741cdc605abccc6 Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:47:13.483882 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4cc976e520e4b7ea741cdc605abccc6"}]}] Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: b4cc976e520e4b7ea741cdc605abccc6 Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersAdminTestJSON-1870808753-project Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 12321f04fa1844098fb5c2585caae367 Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersAdminTestJSON-1870808753-project Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance c784c0e6-f80d-4d62-8238-7d0977b08110 could not be found. Oct 12 08:47:13.485204 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'c784c0e6-f80d-4d62-8238-7d0977b08110'} Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c784c0e6-f80d-4d62-8238-7d0977b08110 could not be found. Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:13.485978 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c784c0e6-f80d-4d62-8238-7d0977b08110 could not be found. Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c784c0e6-f80d-4d62-8238-7d0977b08110 could not be found. Oct 12 08:47:13.487112 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:13.488171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Returning 404 to user: Instance c784c0e6-f80d-4d62-8238-7d0977b08110 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:13.488171 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ccedd0e7-a07a-42cf-ba37-d03a695a47a5 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110" status: 404 len: 111 microversion: 2.1 time: 0.037937 Oct 12 08:47:13.488171 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 474/869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:13 2022] GET /compute/v2.1/servers/c784c0e6-f80d-4d62-8238-7d0977b08110 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:13.490962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:13.491849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:13.498381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.498881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.499372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.500054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.500508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.500967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.637557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:13.647034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:13.656375 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-557b6892-0162-47ee-8dff-1e4308a60fbb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1461 microversion: 2.1 time: 0.168868 Oct 12 08:47:13.661952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:13.663740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:13.665842 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aa99cb17-0776-4096-bc32-a527cb3700b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1411 microversion: 2.25 time: 0.433438 Oct 12 08:47:13.668008 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 396/871] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:13 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1411 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:47:13.668192 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 475/871] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:13 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1461 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:13.679887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:13.680397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:13.688941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-53783cf5-ffe4-41b1-ae3b-716d3918495d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'create', calling method: .version_select at 0x7f9848cbcf70>, body: {"keypair": {"name": "tempest-keypair-1263836956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPcNGj1IvCnwrIvTjByIZH9ORPWBYv6Ih5ZGr4rVpVDp+CwiR3sto7MAqjUacLXQ2Aigo5/VR7wUoVW5pBp+iawuw+zSvf83oP+sIgtc/h68j5tx2J5QVrnQ3oLj0W7xw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:13.690849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.691352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.691800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.692495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.692979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.693400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.707066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-53783cf5-ffe4-41b1-ae3b-716d3918495d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for project 94a0f8d18f724f789b822a70fc97797a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:13.712037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-53783cf5-ffe4-41b1-ae3b-716d3918495d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for user 5631063704964af4a1d7780077789e48 and project 94a0f8d18f724f789b822a70fc97797a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:13.730090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:13.737683 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-53783cf5-ffe4-41b1-ae3b-716d3918495d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052115 Oct 12 08:47:13.738565 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 397/872] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:47:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:47:13.796736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:13.797549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:13.811610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.812178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.812945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.813721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.818277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.818814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.837757 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b6ba1b03-3422-40a7-ae4c-e009ce20ce6d tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 204 len: 0 microversion: 2.1 time: 0.166676 Oct 12 08:47:13.841959 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 476/873] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:13 2022] DELETE /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:13.850612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:13.854598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:13.877417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.880706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.881340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.884181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.885076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.885726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.937983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:13.939124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:13.939726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:13.940346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lazy-loading 'fault' on Instance uuid a9767489-b818-4f08-8371-1199b70f77cb {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:13.995201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7a6a36aadd4818b0422f824718f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c444d5d31d4ca5bb47e040b1541594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:14.005934 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aaa1aa07-f3ee-4293-8884-b5166c6ac641 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 200 len: 1307 microversion: 2.1 time: 0.213581 Oct 12 08:47:14.006629 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 398/874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:13 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:14.011627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:14.012233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:14.031250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:14.032378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:14.032968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:14.034058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:14.034848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:14.035588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:14.042494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:14.132559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:14.141204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-48e48cd2-dd09-484b-bdd9-85ffc8d327da tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1470 microversion: 2.1 time: 0.297535 Oct 12 08:47:14.141817 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 477/875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:13 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:14.148531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:14.149552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:14.158145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:14.158450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:14.159081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:14.159754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:14.160237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:14.160661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:14.311023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:14.329106 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efcd316a-a5a0-4c57-bc51-216922e0291f tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1323 microversion: 2.1 time: 0.321409 Oct 12 08:47:14.341794 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 399/876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:14 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:14.346972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4f8188de-5934-446d-b3f5-8cdfc07d2f3a req-ab2f537f-51b5-4e3b-bd62-9ea74cbb9da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9767489-b818-4f08-8371-1199b70f77cb", "name": "network-vif-deleted", "tag": "cb327098-0bbf-4741-a0c2-add8d16ae5ed"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:14.358408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4f8188de-5934-446d-b3f5-8cdfc07d2f3a req-ab2f537f-51b5-4e3b-bd62-9ea74cbb9da3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:14.359138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4f8188de-5934-446d-b3f5-8cdfc07d2f3a req-ab2f537f-51b5-4e3b-bd62-9ea74cbb9da3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:14.359863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4f8188de-5934-446d-b3f5-8cdfc07d2f3a req-ab2f537f-51b5-4e3b-bd62-9ea74cbb9da3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:14.373400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4f8188de-5934-446d-b3f5-8cdfc07d2f3a req-ab2f537f-51b5-4e3b-bd62-9ea74cbb9da3 service nova] Creating event network-vif-deleted:cb327098-0bbf-4741-a0c2-add8d16ae5ed for instance a9767489-b818-4f08-8371-1199b70f77cb on n-h1-858383-10 Oct 12 08:47:14.374970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:14.385044 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e8b1d014-fe45-49ab-afd8-a6157ac2d567 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1313 microversion: 2.1 time: 0.242182 Oct 12 08:47:14.387392 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4f8188de-5934-446d-b3f5-8cdfc07d2f3a req-ab2f537f-51b5-4e3b-bd62-9ea74cbb9da3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041033 Oct 12 08:47:14.388014 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 478/877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:14 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:14.390135 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 400/878] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:14.694030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:14.694553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:14.711165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:14.711881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:14.713524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:14.714424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:14.715126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:14.715958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:14.986544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:15.004867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:15.006490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:15.007787 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cb2588f-c0e8-4c15-982d-1f34130ff556 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1411 microversion: 2.25 time: 0.318976 Oct 12 08:47:15.009718 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 479/879] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:14 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1411 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:15.030732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:15.031685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] [instance: a9767489-b818-4f08-8371-1199b70f77cb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:15.038286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.039055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.039733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.040658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.041347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.042096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.059105 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] HTTP exception thrown: Instance a9767489-b818-4f08-8371-1199b70f77cb could not be found. Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Request method failure captured: Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb HTTP/1.1 Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn68projI7PtQJ1I7XBQGvfuBJL-jYQ4E1Gk4OvRkgHzQRwaijBjAEAjJ24CFgKibiZW2-Br8PGaDjmeP04oSz6G5Ik2UGEK00AkYw8RzWbyxV8HTp0SAH-9fkcx1ZHGN6qtGnNLw2vJ2r7Xyh1UdaGOAuMAOZjOu6YfzaJQafU_vBE Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 75c444d5d31d4ca5bb47e040b1541594 Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:15.060867 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_75c444d5d31d4ca5bb47e040b1541594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/75c444d5d31d4ca5bb47e040b1541594"}]}] Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 75c444d5d31d4ca5bb47e040b1541594 Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-879504439 Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerTestJSON-879504439-project Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3d7a6a36aadd4818b0422f824718f3f0 Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerTestJSON-879504439-project Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance a9767489-b818-4f08-8371-1199b70f77cb could not be found. Oct 12 08:47:15.062148 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a9767489-b818-4f08-8371-1199b70f77cb'} Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9767489-b818-4f08-8371-1199b70f77cb could not be found. Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:15.063178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9767489-b818-4f08-8371-1199b70f77cb could not be found. Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9767489-b818-4f08-8371-1199b70f77cb could not be found. Oct 12 08:47:15.064376 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:15.065379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] Returning 404 to user: Instance a9767489-b818-4f08-8371-1199b70f77cb could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:15.065379 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83ab02a8-f61e-40d6-ab62-88df78395ac8 tempest-ImagesOneServerTestJSON-879504439 tempest-ImagesOneServerTestJSON-879504439-project] 10.222.0.40 "GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb" status: 404 len: 111 microversion: 2.1 time: 0.036618 Oct 12 08:47:15.065379 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 401/880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:15 2022] GET /compute/v2.1/servers/a9767489-b818-4f08-8371-1199b70f77cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:15.170865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:15.171902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:15.191477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.193830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.195136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.199545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.200866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.204390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.358193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:15.359366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:15.371624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.372599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.374282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.387792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.388953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.392687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.845332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:15.860832 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6355f33e-30e0-41ac-87b2-932ea56b8f8e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 200 len: 1519 microversion: 2.1 time: 0.509829 Oct 12 08:47:15.877397 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 402/881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:15 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 1519 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:15.887917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:15.891660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:15.899170 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b149dcf1-5ed5-4cc9-91da-4bd227249b8f tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1470 microversion: 2.1 time: 0.734717 Oct 12 08:47:15.902124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:15.907359 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 480/882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:15 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1470 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:15.913186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'action', calling method: .version_select at 0x7f984b0b1940>, body: {"addFloatingIp": {"address": "172.25.2.76"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:15.916878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.918430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:15.920087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.922442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.926147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.927655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.928268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.928772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.929189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.929978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:15.931491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:15.932531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:15.933156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:16.018642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:47:16.019515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquired lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:47:16.264207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:16.278848 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e861a11e-276c-4137-aa1b-b9d1dff15038 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1313 microversion: 2.1 time: 0.396616 Oct 12 08:47:16.280033 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 403/883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:15 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:16.285405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:16.286275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:16.293088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:16.293989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:16.294647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:16.295571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:16.296231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:16.296923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:16.583442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:16.598680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:16.604200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:16.618714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b5755c5-c580-467d-a4ac-7badba16f3cc tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1411 microversion: 2.25 time: 0.335286 Oct 12 08:47:16.622002 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 404/884] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:16 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1411 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:16.635394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-53c906c6-6ac0-459d-b3cf-381995d77b6c req-451cee37-d36f-4495-8ff8-a40b7f11e00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8276f079-1fbf-42d0-aa7f-290347030e58", "tag": "fa90881a-0522-4320-a870-8b0814cb8b75"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:16.676776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53c906c6-6ac0-459d-b3cf-381995d77b6c req-451cee37-d36f-4495-8ff8-a40b7f11e00a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:16.679022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53c906c6-6ac0-459d-b3cf-381995d77b6c req-451cee37-d36f-4495-8ff8-a40b7f11e00a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:16.679661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53c906c6-6ac0-459d-b3cf-381995d77b6c req-451cee37-d36f-4495-8ff8-a40b7f11e00a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:16.716798 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-53c906c6-6ac0-459d-b3cf-381995d77b6c req-451cee37-d36f-4495-8ff8-a40b7f11e00a service nova] Creating event network-changed:fa90881a-0522-4320-a870-8b0814cb8b75 for instance 8276f079-1fbf-42d0-aa7f-290347030e58 on n-h1-858383-10 Oct 12 08:47:16.736128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-53c906c6-6ac0-459d-b3cf-381995d77b6c req-451cee37-d36f-4495-8ff8-a40b7f11e00a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107670 Oct 12 08:47:16.738721 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 405/885] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:16.924181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-124d3e6f-729c-40d9-8b57-af9a9f384d3a tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '.version_select at 0x7f9848de90d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:16.928352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-124d3e6f-729c-40d9-8b57-af9a9f384d3a tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:16.929650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-124d3e6f-729c-40d9-8b57-af9a9f384d3a tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:16.930257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-124d3e6f-729c-40d9-8b57-af9a9f384d3a tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:16.942398 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-124d3e6f-729c-40d9-8b57-af9a9f384d3a tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.024698 Oct 12 08:47:16.943018 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 406/886] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:47:16 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:16.947762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:16.948718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:16.959513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:16.960496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:16.961358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:16.962848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:16.963508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:16.964364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:17.111900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12321f04fa1844098fb5c2585caae367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cc976e520e4b7ea741cdc605abccc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:17.122530 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c7ab5194-0e18-4c38-92da-04e5628aeb20 tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 200 len: 1470 microversion: 2.1 time: 0.178006 Oct 12 08:47:17.123150 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 407/887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:16 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:17.145610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ecdbe3c5-7429-4049-8a2e-d388c8c31431 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:17.152541 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ecdbe3c5-7429-4049-8a2e-d388c8c31431 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011973 Oct 12 08:47:17.152893 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 408/888] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:47:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:17.186053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:17.207821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:17.393194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1248526971", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": "none"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:17.483263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:17.483686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:17.485464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:17.485464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:17.485894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:17.500147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:17.501025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:17.501798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:17.504138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:17.505043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:17.505689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:17.534599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Getting quotas for project 1280b9166e5b4421a661aad1fb4630c5. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:17.542500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Getting quotas for user 3161633cfb9f40b8be36fb3b7cbcc0f9 and project 1280b9166e5b4421a661aad1fb4630c5. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:17.558715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:47:17.562595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:47:17.653735 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9b6eacc-a8e3-469c-b6f4-fc126af36f61 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.498107 Oct 12 08:47:17.654368 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 409/889] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:47:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:47:17.682583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7695290-c171-4c53-986e-8e28ac8ff88b tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1136291690", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:17.718479 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7695290-c171-4c53-986e-8e28ac8ff88b tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.062179 Oct 12 08:47:17.719407 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 410/890] 10.222.0.40 () {60 vars in 1146 bytes} [Wed Oct 12 08:47:17 2022] POST /compute/v2.1/flavors => generated 499 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:17.734537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:17.735632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:17.745014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:17.746382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:17.747459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:17.748348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:17.748955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:17.750005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:18.388005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:18.403174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bd4011fd-2125-4c01-80f2-66e4bea01f78 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1313 microversion: 2.1 time: 0.680488 Oct 12 08:47:18.404848 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 411/891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:17 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:18.411259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c5c92b38-b6ec-4fc3-9730-e85bc529e470 req-aae6480a-8e2d-45b6-9488-f56fe5120600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b362992b-616f-4d7e-98f1-7465d511f00b", "name": "network-vif-deleted", "tag": "1867b80e-5e98-4292-963e-36458a1a69d0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:18.431045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c5c92b38-b6ec-4fc3-9730-e85bc529e470 req-aae6480a-8e2d-45b6-9488-f56fe5120600 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:18.432702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c5c92b38-b6ec-4fc3-9730-e85bc529e470 req-aae6480a-8e2d-45b6-9488-f56fe5120600 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:18.433842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c5c92b38-b6ec-4fc3-9730-e85bc529e470 req-aae6480a-8e2d-45b6-9488-f56fe5120600 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:18.457114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:18.459933 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c5c92b38-b6ec-4fc3-9730-e85bc529e470 req-aae6480a-8e2d-45b6-9488-f56fe5120600 service nova] Creating event network-vif-deleted:1867b80e-5e98-4292-963e-36458a1a69d0 for instance b362992b-616f-4d7e-98f1-7465d511f00b on n-h2-858383-10 Oct 12 08:47:18.467362 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c5c92b38-b6ec-4fc3-9730-e85bc529e470 req-aae6480a-8e2d-45b6-9488-f56fe5120600 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058929 Oct 12 08:47:18.469129 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 412/892] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:18.478640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:18.480311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:18.487365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:18.488041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:18.488488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:18.489228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:18.489745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:18.490343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:18.773618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Building network info cache for instance {{(pid=127006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 08:47:18.884785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:18.894425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:18.900795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:18.902055 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37948166-5774-4afe-a546-e12841953891 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1411 microversion: 2.25 time: 0.431025 Oct 12 08:47:18.902629 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 413/893] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:18 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1411 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:18.908278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:18.912392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:18.929320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:18.929880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:18.930328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:18.931144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:18.931535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:18.931911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.166261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:19.181174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:19.185994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:19.205520 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f537108c-3a3c-4ac0-b374-6bee7380eb44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "PUT /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1411 microversion: 2.75 time: 0.298839 Oct 12 08:47:19.206303 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 414/894] 10.222.0.40 () {62 vars in 1297 bytes} [Wed Oct 12 08:47:18 2022] PUT /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1411 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:19.232628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5a24437d-2885-462d-bf91-ce8fbbf5bc99 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:19.240339 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5a24437d-2885-462d-bf91-ce8fbbf5bc99 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013506 Oct 12 08:47:19.241291 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 415/895] 10.222.0.40 () {58 vars in 1182 bytes} [Wed Oct 12 08:47:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:47:19.264648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1ae1572e-565f-4c3b-9ac7-5d260d529c16 req-9fb06f30-0e5b-4dd3-ad18-da8829948d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21", "name": "network-vif-plugged", "status": "completed", "tag": "f197b63f-1a58-4a19-b284-61862fdfca13"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:19.296028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1ae1572e-565f-4c3b-9ac7-5d260d529c16 req-9fb06f30-0e5b-4dd3-ad18-da8829948d85 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.296527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1ae1572e-565f-4c3b-9ac7-5d260d529c16 req-9fb06f30-0e5b-4dd3-ad18-da8829948d85 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.297376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1ae1572e-565f-4c3b-9ac7-5d260d529c16 req-9fb06f30-0e5b-4dd3-ad18-da8829948d85 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.326705 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1ae1572e-565f-4c3b-9ac7-5d260d529c16 req-9fb06f30-0e5b-4dd3-ad18-da8829948d85 service nova] Creating event network-vif-plugged:f197b63f-1a58-4a19-b284-61862fdfca13 for instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 on n-h1-858383-10 Oct 12 08:47:19.340801 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1ae1572e-565f-4c3b-9ac7-5d260d529c16 req-9fb06f30-0e5b-4dd3-ad18-da8829948d85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086763 Oct 12 08:47:19.341635 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 416/896] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:19.353836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:19.354555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] [instance: b362992b-616f-4d7e-98f1-7465d511f00b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:19.368252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.370589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.370827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.372714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.373463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.375366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.408626 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] HTTP exception thrown: Instance b362992b-616f-4d7e-98f1-7465d511f00b could not be found. Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Request method failure captured: Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b HTTP/1.1 Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6Ao596N6__mkKUpXnluIsgHektjlaISpsAl1aCy3XQiFfEe4sFAjlWgw7o40_YM3CQmKtsrKDsXqqwp0AFRTjD9HejFVSSe4fsDQXfoXKnkSvqu-yi-c7yvJCe6yfLvGAvXIuFmND_PgbUxa2HZ91X9gp3YGO6dH8AF30MqeSUJAM Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: b4cc976e520e4b7ea741cdc605abccc6 Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:19.414116 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4cc976e520e4b7ea741cdc605abccc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4cc976e520e4b7ea741cdc605abccc6"}]}] Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: b4cc976e520e4b7ea741cdc605abccc6 Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersAdminTestJSON-1870808753 Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersAdminTestJSON-1870808753-project Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 12321f04fa1844098fb5c2585caae367 Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersAdminTestJSON-1870808753-project Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance b362992b-616f-4d7e-98f1-7465d511f00b could not be found. Oct 12 08:47:19.415385 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'b362992b-616f-4d7e-98f1-7465d511f00b'} Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b362992b-616f-4d7e-98f1-7465d511f00b could not be found. Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:19.416126 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b362992b-616f-4d7e-98f1-7465d511f00b could not be found. Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b362992b-616f-4d7e-98f1-7465d511f00b could not be found. Oct 12 08:47:19.417363 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:19.422250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] Returning 404 to user: Instance b362992b-616f-4d7e-98f1-7465d511f00b could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:19.422250 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a153c9d5-ca3a-4127-8363-87c9d0ddc6eb tempest-ServersAdminTestJSON-1870808753 tempest-ServersAdminTestJSON-1870808753-project] 10.222.0.40 "GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b" status: 404 len: 111 microversion: 2.1 time: 0.075117 Oct 12 08:47:19.441694 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 417/897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:19 2022] GET /compute/v2.1/servers/b362992b-616f-4d7e-98f1-7465d511f00b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:19.465747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:19.467302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:19.477798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.478521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.479249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.488763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.489282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.489755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.643683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Updating instance_info_cache with network_info: [{"id": "78484926-556e-4306-8e69-9de56e4195c2", "address": "fa:16:3e:7f:a4:54", "network": {"id": "e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-737109247-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82d063b8b7164196a37fdc496e5d6146", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap78484926-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:47:19.663332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Releasing lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:47:19.664249 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a474b6b-5f1d-42b9-b917-c7a441ba1507 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action" status: 202 len: 0 microversion: 2.1 time: 3.757417 Oct 12 08:47:19.665051 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 481/898] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:15 2022] POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action => generated 0 bytes in 3759 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 08:47:19.677257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:19.678532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:19.698311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.698922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.699549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.700427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.701101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.701805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.744663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:19.767781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:19.769651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:19.778279 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1df945b5-ef9d-4334-8ef6-4a759b426811 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1419 microversion: 2.75 time: 0.335361 Oct 12 08:47:19.780694 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 418/899] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:19 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1419 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:19.794291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-491227779", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "3f24b9d7-f6bc-4dc9-813a-08e48e509545"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:19.871895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:47:19.940645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:19.954024 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0fe8cec-1ee2-4806-8ed9-108ac85b68c5 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1313 microversion: 2.1 time: 0.286422 Oct 12 08:47:19.955289 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 482/900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:19 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:19.962763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.76"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:19.967008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:19.974614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.975197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.975745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:19.976786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:19.977721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:19.978776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:20.009198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "refresh_cache-7e3d5fd9-a725-4697-88f7-c7883ff767a5" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:47:20.010012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquired lock "refresh_cache-7e3d5fd9-a725-4697-88f7-c7883ff767a5" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:47:20.534719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:20.535221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:20.535598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:20.536165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:20.536404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:20.559555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=25 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:20.561964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:20.563133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:20.564033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:20.565082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:20.565778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:20.566716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:20.591771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:20.596618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for user 5631063704964af4a1d7780077789e48 and project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:20.610392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:47:20.613805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:47:20.699100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-87f83cdb-8506-4e62-bfba-f24620c108c1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915224 Oct 12 08:47:20.707048 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 419/901] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:47:20.719608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:20.720613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:20.746317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:20.747286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:20.747954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:20.751545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:20.752610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:20.753261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:21.120494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:21.130451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:21.132522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:21.134216 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7f3a5d7c-affa-4693-a57b-1c65d1a87d63 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1411 microversion: 2.25 time: 0.425727 Oct 12 08:47:21.135033 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 420/902] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:20 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1411 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:21.156520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-fd1f47e1-3db7-4b47-9fee-3f02a2fe4876 req-2e0c694a-4700-445c-b7c5-5f6881c16e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce22591d-61fd-44bf-8816-b86eb6e5ba6e", "tag": "78484926-556e-4306-8e69-9de56e4195c2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:21.178122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fd1f47e1-3db7-4b47-9fee-3f02a2fe4876 req-2e0c694a-4700-445c-b7c5-5f6881c16e71 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:21.179369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fd1f47e1-3db7-4b47-9fee-3f02a2fe4876 req-2e0c694a-4700-445c-b7c5-5f6881c16e71 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:21.180355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fd1f47e1-3db7-4b47-9fee-3f02a2fe4876 req-2e0c694a-4700-445c-b7c5-5f6881c16e71 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:21.224614 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-fd1f47e1-3db7-4b47-9fee-3f02a2fe4876 req-2e0c694a-4700-445c-b7c5-5f6881c16e71 service nova] Creating event network-changed:78484926-556e-4306-8e69-9de56e4195c2 for instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e on n-h1-858383-10 Oct 12 08:47:21.231743 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-fd1f47e1-3db7-4b47-9fee-3f02a2fe4876 req-2e0c694a-4700-445c-b7c5-5f6881c16e71 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094248 Oct 12 08:47:21.233541 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 421/903] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:21.239122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb73c650-514f-47d3-878a-29c8fb4e49c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:21.240341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb73c650-514f-47d3-878a-29c8fb4e49c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:21.249570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:21.407444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bb73c650-514f-47d3-878a-29c8fb4e49c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:21.414612 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb73c650-514f-47d3-878a-29c8fb4e49c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1278 microversion: 2.1 time: 0.179662 Oct 12 08:47:21.415202 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 422/904] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:21 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:21.425583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:21.425583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:21.444153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:21.445221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:21.446160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:21.447790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:21.449227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:21.450480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:21.627715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:21.639712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:21.646732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:21.657958 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bf03b5c2-7493-4750-8e43-e259907ea5f3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1417 microversion: 2.75 time: 0.241507 Oct 12 08:47:21.670447 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 423/905] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:21 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1417 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:21.689688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:21.690338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:21.705078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:21.705802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:21.706865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:21.707777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:21.708245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:21.708850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:22.285463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:22.300279 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9bd434bf-a194-46a3-b356-c39127df4fa7 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1313 microversion: 2.1 time: 0.628496 Oct 12 08:47:22.308282 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 424/906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:21 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:22.331797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:22.332708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:22.351119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:22.351678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:22.352378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:22.353171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:22.353664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:22.355364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:23.079804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:23.102696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:23.109339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:23.113760 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9c08825-77fe-44cb-9dda-285c2c21bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1606 microversion: 2.25 time: 0.799337 Oct 12 08:47:23.125461 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 425/907] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:22 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1606 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:23.129896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f9a837ac-c50f-4d31-86c6-3aaa7e1c0d77 req-45d9cf05-ded0-4700-9c6a-509b4700b698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8276f079-1fbf-42d0-aa7f-290347030e58", "name": "network-vif-plugged", "status": "completed", "tag": "fa90881a-0522-4320-a870-8b0814cb8b75"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:23.153942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f9a837ac-c50f-4d31-86c6-3aaa7e1c0d77 req-45d9cf05-ded0-4700-9c6a-509b4700b698 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:23.155246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f9a837ac-c50f-4d31-86c6-3aaa7e1c0d77 req-45d9cf05-ded0-4700-9c6a-509b4700b698 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:23.156930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f9a837ac-c50f-4d31-86c6-3aaa7e1c0d77 req-45d9cf05-ded0-4700-9c6a-509b4700b698 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:23.193779 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f9a837ac-c50f-4d31-86c6-3aaa7e1c0d77 req-45d9cf05-ded0-4700-9c6a-509b4700b698 service nova] Creating event network-vif-plugged:fa90881a-0522-4320-a870-8b0814cb8b75 for instance 8276f079-1fbf-42d0-aa7f-290347030e58 on n-h1-858383-10 Oct 12 08:47:23.205937 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f9a837ac-c50f-4d31-86c6-3aaa7e1c0d77 req-45d9cf05-ded0-4700-9c6a-509b4700b698 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086776 Oct 12 08:47:23.208903 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 426/908] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:23.222552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:23.223840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:23.244431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:23.246359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:23.252400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:23.253684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:23.256355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:23.257972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:23.399698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.network.neutron [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] re-assign floating IP 172.25.2.76 from instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e Oct 12 08:47:23.538515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Building network info cache for instance {{(pid=127006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 08:47:23.587253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:23.612124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a5b3eb40-d739-4598-927e-eb7a9df10a5d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1336 microversion: 2.1 time: 0.397703 Oct 12 08:47:23.612774 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 427/909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:23 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1336 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:23.630438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:23.631217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:23.660297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:23.662130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:23.663954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:23.667289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:23.668794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:23.668794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:23.866345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:23.882302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:23.884432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:23.907242 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4c7d9f80-7a92-40d3-ac8b-00e8fb98531d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1438 microversion: 2.75 time: 0.293281 Oct 12 08:47:23.908261 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 428/910] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:23 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1438 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:23.915955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:23.916738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:23.939379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:23.940520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:23.940991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:23.942199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:23.942829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:23.945713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:24.067603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-093c195f-7d27-4a52-8495-8f7c54c63129 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.156941 Oct 12 08:47:24.068454 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 429/911] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 12 08:47:23 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:47:24.082106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:24.082917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:24.106919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:24.107673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:24.108659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:24.109851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:24.110461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:24.112322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:24.703571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Updating instance_info_cache with network_info: [{"id": "78484926-556e-4306-8e69-9de56e4195c2", "address": "fa:16:3e:7f:a4:54", "network": {"id": "e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-737109247-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82d063b8b7164196a37fdc496e5d6146", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap78484926-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:47:24.720757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Building network info cache for instance {{(pid=127006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 08:47:25.058242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:25.076121 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b56fc79-37b7-46dd-9e52-59224912653f tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1313 microversion: 2.1 time: 1.006586 Oct 12 08:47:25.086165 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 430/912] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:24 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1313 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:25.111744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a7c3d442-e703-4842-9f38-f59e83affd52 req-5ff00df3-acf4-4bf0-96c4-e34760aafb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce22591d-61fd-44bf-8816-b86eb6e5ba6e", "tag": "78484926-556e-4306-8e69-9de56e4195c2"}, {"name": "network-changed", "server_uuid": "7e3d5fd9-a725-4697-88f7-c7883ff767a5", "tag": "4a71dc90-5212-462d-a716-48627cfd6634"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:25.144943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a7c3d442-e703-4842-9f38-f59e83affd52 req-5ff00df3-acf4-4bf0-96c4-e34760aafb44 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:25.145465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a7c3d442-e703-4842-9f38-f59e83affd52 req-5ff00df3-acf4-4bf0-96c4-e34760aafb44 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:25.145978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a7c3d442-e703-4842-9f38-f59e83affd52 req-5ff00df3-acf4-4bf0-96c4-e34760aafb44 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:25.164285 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a7c3d442-e703-4842-9f38-f59e83affd52 req-5ff00df3-acf4-4bf0-96c4-e34760aafb44 service nova] Creating event network-changed:78484926-556e-4306-8e69-9de56e4195c2 for instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e on n-h1-858383-10 Oct 12 08:47:25.164796 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a7c3d442-e703-4842-9f38-f59e83affd52 req-5ff00df3-acf4-4bf0-96c4-e34760aafb44 service nova] Creating event network-changed:4a71dc90-5212-462d-a716-48627cfd6634 for instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 on n-h2-858383-10 Oct 12 08:47:25.174278 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a7c3d442-e703-4842-9f38-f59e83affd52 req-5ff00df3-acf4-4bf0-96c4-e34760aafb44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084221 Oct 12 08:47:25.175214 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 431/913] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:25.202053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:25.204973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:25.214533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:25.215946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:25.216564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:25.217778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:25.218416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:25.219145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:25.351488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:25.352784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:25.353599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:25.354330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:25.355244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:25.481396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:25.496019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:25.497711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:25.502017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:25.502907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:25.503631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:25.504132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:26.001511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:26.016262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:26.021920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:26.029741 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ab5482a1-7e29-488b-964b-ba26bc66b53d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "POST /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3/action" status: 202 len: 1495 microversion: 2.75 time: 0.853017 Oct 12 08:47:26.030874 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 432/914] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:47:25 2022] POST /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3/action => generated 1495 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 08:47:26.037263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:26.038513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:26.050584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:26.053652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:26.054322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:26.055289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:26.056667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:26.057313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:26.103414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:26.570884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Updating instance_info_cache with network_info: [{"id": "4a71dc90-5212-462d-a716-48627cfd6634", "address": "fa:16:3e:69:ad:be", "network": {"id": "e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-737109247-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82d063b8b7164196a37fdc496e5d6146", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4a71dc90-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:47:26.579673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Releasing lock "refresh_cache-7e3d5fd9-a725-4697-88f7-c7883ff767a5" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:47:26.580530 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d512b1a4-57bc-4288-9790-d2d103047810 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5/action" status: 202 len: 0 microversion: 2.1 time: 6.624130 Oct 12 08:47:26.581141 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 483/915] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:19 2022] POST /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5/action => generated 0 bytes in 6625 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 08:47:26.636092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:26.651871 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d711806e-27fc-441b-85e3-8276d3ec4f3f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1378 microversion: 2.1 time: 0.617348 Oct 12 08:47:26.655759 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 433/916] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:26 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1378 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:26.672710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:26.673338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:26.687666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:26.688230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:26.689888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:26.692979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:26.693564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:26.695758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:26.787233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-595322548", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": "none"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:26.878406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:26.878961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:26.879642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:26.880154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:26.880675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:26.891267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:26.892396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:26.893270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:26.894476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:26.895068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:26.895591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:26.920096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Getting quotas for project a12dfe3bd7d443e0840df5138f95e661. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:26.926646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Getting quotas for user a51547fb8a9941d99f7757f2ccdc4eec and project a12dfe3bd7d443e0840df5138f95e661. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:26.944140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:47:26.952205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:47:27.008370 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f0afe9a-59bf-45dd-98e6-a5504e8e23e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.426077 Oct 12 08:47:27.009274 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 484/917] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:47:27.015857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:27.016901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:27.023570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.024061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.024527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:27.025224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.025884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.026302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:27.187483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:27.209211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:27.210682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:27.225160 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d4c49c50-10ef-4b12-9509-4ee295a1467b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.568133 Oct 12 08:47:27.226107 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 434/918] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:26 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:27.233753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'action', calling method: .version_select at 0x7f984b0b1a60>, body: {"removeFloatingIp": {"address": "172.25.2.76"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:27.276681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:27.285049 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed4045f5-833a-4f00-9539-1c0e8708a5f3 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1463 microversion: 2.1 time: 0.274542 Oct 12 08:47:27.288932 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 485/919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:27 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1463 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:27.299536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f381949-1a6c-45e2-a840-e294a919490f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:27.300160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f381949-1a6c-45e2-a840-e294a919490f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:27.392155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f381949-1a6c-45e2-a840-e294a919490f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:27.412657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f381949-1a6c-45e2-a840-e294a919490f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:27.414237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f381949-1a6c-45e2-a840-e294a919490f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:27.422313 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f381949-1a6c-45e2-a840-e294a919490f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1452 microversion: 2.91 time: 0.132171 Oct 12 08:47:27.422835 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 486/920] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:27 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:27.427607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c1218322-ffee-4d14-b96b-349c33a12ed3 req-a960ee3e-1458-4769-ad18-c3e139e4f6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:27.447812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c1218322-ffee-4d14-b96b-349c33a12ed3 req-a960ee3e-1458-4769-ad18-c3e139e4f6d8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.448366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c1218322-ffee-4d14-b96b-349c33a12ed3 req-a960ee3e-1458-4769-ad18-c3e139e4f6d8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.448968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c1218322-ffee-4d14-b96b-349c33a12ed3 req-a960ee3e-1458-4769-ad18-c3e139e4f6d8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:27.463966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:27.472145 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c1218322-ffee-4d14-b96b-349c33a12ed3 req-a960ee3e-1458-4769-ad18-c3e139e4f6d8 service nova] Creating event network-changed:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h2-858383-10 Oct 12 08:47:27.478377 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c1218322-ffee-4d14-b96b-349c33a12ed3 req-a960ee3e-1458-4769-ad18-c3e139e4f6d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054016 Oct 12 08:47:27.487169 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 487/921] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:27.644665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b33e8398-55fd-4db8-96b6-0705591e9f18 tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Calling method '.version_select at 0x7f9848b985e0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:27.670625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b33e8398-55fd-4db8-96b6-0705591e9f18 tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.671461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b33e8398-55fd-4db8-96b6-0705591e9f18 tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.672137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b33e8398-55fd-4db8-96b6-0705591e9f18 tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:27.692258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b33e8398-55fd-4db8-96b6-0705591e9f18 tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.692827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b33e8398-55fd-4db8-96b6-0705591e9f18 tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.693323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b33e8398-55fd-4db8-96b6-0705591e9f18 tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:27.713797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b33e8398-55fd-4db8-96b6-0705591e9f18 tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/246b8300f9b541199731ed89f23cb9f4?start=2022-10-11T08%3A47%3A27.303745&end=2022-10-13T08%3A47%3A27.303745" status: 200 len: 694 microversion: 2.1 time: 0.225280 Oct 12 08:47:27.714508 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 488/922] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Oct 12 08:47:27 2022] GET /compute/v2.1/os-simple-tenant-usage/246b8300f9b541199731ed89f23cb9f4?start=2022-10-11T08%3A47%3A27.303745&end=2022-10-13T08%3A47%3A27.303745 => generated 694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:27.721671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:27.721671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:27.731800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.732380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.732882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:27.733714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.734230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.734814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:27.764374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:27.781497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.786079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.790384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:27.791269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:27.791610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:27.792029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.179904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:28.190473 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ee9116d-2ca9-47a1-9c50-9b600ef763dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1378 microversion: 2.1 time: 0.474462 Oct 12 08:47:28.191069 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 489/923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:27 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1378 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:28.199649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb09cb38-13d0-40fa-b606-6d1a3a968a19 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '.version_select at 0x7f9848bb9940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:28.209272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb09cb38-13d0-40fa-b606-6d1a3a968a19 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.209844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb09cb38-13d0-40fa-b606-6d1a3a968a19 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.210326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb09cb38-13d0-40fa-b606-6d1a3a968a19 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.221160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb09cb38-13d0-40fa-b606-6d1a3a968a19 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.221861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb09cb38-13d0-40fa-b606-6d1a3a968a19 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.222304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb09cb38-13d0-40fa-b606-6d1a3a968a19 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.236709 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb09cb38-13d0-40fa-b606-6d1a3a968a19 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/246b8300f9b541199731ed89f23cb9f4?start=2022-10-11T08%3A47%3A27.303745&end=2022-10-13T08%3A47%3A27.303745" status: 200 len: 694 microversion: 2.1 time: 0.044582 Oct 12 08:47:28.237294 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 490/924] 10.222.0.40 () {58 vars in 1412 bytes} [Wed Oct 12 08:47:28 2022] GET /compute/v2.1/os-simple-tenant-usage/246b8300f9b541199731ed89f23cb9f4?start=2022-10-11T08%3A47%3A27.303745&end=2022-10-13T08%3A47%3A27.303745 => generated 694 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:28.241857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9d7a923c-2913-441c-8ecf-24d301d2d146 req-7de7fe75-2a47-4e13-ba25-b8c8b2000f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21", "tag": "f197b63f-1a58-4a19-b284-61862fdfca13"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:28.255247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9d7a923c-2913-441c-8ecf-24d301d2d146 req-7de7fe75-2a47-4e13-ba25-b8c8b2000f9c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.256040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9d7a923c-2913-441c-8ecf-24d301d2d146 req-7de7fe75-2a47-4e13-ba25-b8c8b2000f9c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.256701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9d7a923c-2913-441c-8ecf-24d301d2d146 req-7de7fe75-2a47-4e13-ba25-b8c8b2000f9c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.269165 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9d7a923c-2913-441c-8ecf-24d301d2d146 req-7de7fe75-2a47-4e13-ba25-b8c8b2000f9c service nova] Creating event network-changed:f197b63f-1a58-4a19-b284-61862fdfca13 for instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 on n-h1-858383-10 Oct 12 08:47:28.274529 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9d7a923c-2913-441c-8ecf-24d301d2d146 req-7de7fe75-2a47-4e13-ba25-b8c8b2000f9c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035755 Oct 12 08:47:28.275409 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 491/925] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:28.281270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cfeb8b61-2f04-4d5b-ba87-8b67507287ed tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Calling method '.version_select at 0x7f9848ca4430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:28.291007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfeb8b61-2f04-4d5b-ba87-8b67507287ed tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.291807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfeb8b61-2f04-4d5b-ba87-8b67507287ed tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.292778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfeb8b61-2f04-4d5b-ba87-8b67507287ed tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.309324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfeb8b61-2f04-4d5b-ba87-8b67507287ed tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.309941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfeb8b61-2f04-4d5b-ba87-8b67507287ed tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.311284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfeb8b61-2f04-4d5b-ba87-8b67507287ed tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.348807 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] HTTP exception thrown: Floating IP 172.25.2.76 is not associated with instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e. Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Request method failure captured: Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action HTTP/1.1 Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 48 Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn7kXfIgaEMep2QweXIgZ4DyYcyIjWV41ovXoPYEhwTJA2wGXdnEkSdkGkeI9vvLmuG9M_AqWsJt7duIPgAHF2M6dcH0iHz6_vKGUnRVzRGSUbGJwodyuym6ZpqNgwKpQrV3AlEtec_dX0Bzt7CPMl0A4oYRnygzkZw4Fx51LjGPOSg Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 82d063b8b7164196a37fdc496e5d6146 Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:28.351613 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82d063b8b7164196a37fdc496e5d6146"}]}] Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 82d063b8b7164196a37fdc496e5d6146 Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FloatingIPsAssociationTestJSON-1600812966-project Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: cbc2b1086dbf432bbd45864e16811e24 Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1600812966-project Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: {"removeFloatingIp": {"address": "172.25.2.76"}} Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:47:28.353202 n-d-858383-10 devstack@n-api.service[127007]: exception: Floating IP 172.25.2.76 is not associated with instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e. Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'ce22591d-61fd-44bf-8816-b86eb6e5ba6e', 'body': {'removeFloatingIp': {'address': '172.25.2.76'}}} Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.76 is not associated with instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e. Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:28.355467 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:28.356996 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:28.356996 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:28.356996 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:28.356996 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:28.356996 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.76 is not associated with instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e. Oct 12 08:47:28.356996 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:28.359003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Returning 409 to user: Floating IP 172.25.2.76 is not associated with instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:28.359879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-adf267e8-78ee-4531-92c0-4d76ef4ff8f5 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action" status: 409 len: 145 microversion: 2.1 time: 1.132599 Oct 12 08:47:28.360470 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 435/926] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:27 2022] POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action => generated 145 bytes in 1134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:47:28.367923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:28.368929 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cfeb8b61-2f04-4d5b-ba87-8b67507287ed tempest-TenantUsagesTestJSON-1631298758 tempest-TenantUsagesTestJSON-1631298758-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T08%3A47%3A27.303745&end=2022-10-13T08%3A47%3A27.303745&detailed=1" status: 200 len: 12046 microversion: 2.1 time: 0.092246 Oct 12 08:47:28.369347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:28.369899 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 492/927] 10.222.0.40 () {58 vars in 1335 bytes} [Wed Oct 12 08:47:28 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-11T08%3A47%3A27.303745&end=2022-10-13T08%3A47%3A27.303745&detailed=1 => generated 12046 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:47:28.376073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'action', calling method: .version_select at 0x7f984b0b1a60>, body: {"removeFloatingIp": {"address": "172.25.2.76"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:28.381535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.382245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.382842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.383694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.384293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.384864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.524792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:28.533837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:28.534974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:28.542008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:28.545174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.545701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.546131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.546845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.547295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.547712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.552085 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3201ab8-6aa7-4a68-8780-a46a331b6f44 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.190571 Oct 12 08:47:28.558953 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 436/928] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:28 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:28.569802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:28.569802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:28.574677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.575176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.579574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.580521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.581346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.581981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.614939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:28.792419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1007ede7-ee5a-47ee-8c60-0e6222f11856 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 204 len: 0 microversion: 2.1 time: 0.228174 Oct 12 08:47:28.795385 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 437/929] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:28 2022] DELETE /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:28.815583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:28.816623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:28.846473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.850526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.851112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.851994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:28.852580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:28.853941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:28.982695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:28.995967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:29.003263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "refresh_cache-7e3d5fd9-a725-4697-88f7-c7883ff767a5" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:47:29.003726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquired lock "refresh_cache-7e3d5fd9-a725-4697-88f7-c7883ff767a5" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:47:29.009883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:29.024128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-190d34ae-5ee5-4c91-b1af-0beb09a4fec9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1448 microversion: 2.91 time: 0.225101 Oct 12 08:47:29.027923 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 438/930] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:28 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1448 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:29.034180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:29.035213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:29.046592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:29.048769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:29.050052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:29.052350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:29.054185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:29.055874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:29.408403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:29.416659 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-89d80e7c-c5fd-4982-90fb-3e0f39785f6a tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1469 microversion: 2.1 time: 0.387059 Oct 12 08:47:29.429996 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 439/931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:29 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:29.439204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:29.439897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:29.447722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:29.448224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:29.448669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:29.449635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:29.450075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:29.450541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:29.762698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:29.772571 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b9982b7d-ca9c-4da2-bc91-df268540409f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1378 microversion: 2.1 time: 0.337783 Oct 12 08:47:29.773342 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 440/932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:29 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1378 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:29.778865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:29.779480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:29.787525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:29.788981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:29.789460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:29.790237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:29.790704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:29.792333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:29.985889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:29.995916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:30.002030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:30.010326 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a2a68db9-8835-4732-b406-a249b27c8cf5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.235252 Oct 12 08:47:30.011786 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 441/933] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:29 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:30.056269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:30.056269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:30.064164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.064681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.065149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.076442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.076979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.077499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.164405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Building network info cache for instance {{(pid=127006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 08:47:30.244038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:30.263404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:30.264414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:30.275560 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7561375d-f448-4803-a24c-ef805206aa9d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1510 microversion: 2.91 time: 0.223166 Oct 12 08:47:30.276380 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 442/934] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:30 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:30.282194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bd6c9861-7c2e-4e61-bf87-be3e5b7dfd4e req-b8f12435-8651-40b0-a35e-33055ad7b835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3d5fd9-a725-4697-88f7-c7883ff767a5", "tag": "4a71dc90-5212-462d-a716-48627cfd6634"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:30.294571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bd6c9861-7c2e-4e61-bf87-be3e5b7dfd4e req-b8f12435-8651-40b0-a35e-33055ad7b835 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.295406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bd6c9861-7c2e-4e61-bf87-be3e5b7dfd4e req-b8f12435-8651-40b0-a35e-33055ad7b835 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.296098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bd6c9861-7c2e-4e61-bf87-be3e5b7dfd4e req-b8f12435-8651-40b0-a35e-33055ad7b835 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.318318 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bd6c9861-7c2e-4e61-bf87-be3e5b7dfd4e req-b8f12435-8651-40b0-a35e-33055ad7b835 service nova] Creating event network-changed:4a71dc90-5212-462d-a716-48627cfd6634 for instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 on n-h2-858383-10 Oct 12 08:47:30.325736 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bd6c9861-7c2e-4e61-bf87-be3e5b7dfd4e req-b8f12435-8651-40b0-a35e-33055ad7b835 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047870 Oct 12 08:47:30.327148 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 443/935] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:30.441199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:30.442795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:30.451267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.460775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.461641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.462663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.466114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.466796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.584657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:30.775051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Updating instance_info_cache with network_info: [{"id": "4a71dc90-5212-462d-a716-48627cfd6634", "address": "fa:16:3e:69:ad:be", "network": {"id": "e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-737109247-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82d063b8b7164196a37fdc496e5d6146", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4a71dc90-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:47:30.790490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Releasing lock "refresh_cache-7e3d5fd9-a725-4697-88f7-c7883ff767a5" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:47:30.791723 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-70b45263-8b5c-4a13-b9f6-5cd96e5ee516 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5/action" status: 202 len: 0 microversion: 2.1 time: 2.420821 Oct 12 08:47:30.795871 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 493/936] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:28 2022] POST /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5/action => generated 0 bytes in 2425 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 08:47:30.800811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:30.801416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:30.807484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.808136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.808658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.809626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.810076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.810544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.834268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:30.844751 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7439f7e2-4ecb-4033-b8fb-4958ba0b1ca4 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1469 microversion: 2.1 time: 0.408067 Oct 12 08:47:30.865626 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 444/937] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:30 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:30.872706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:30.873608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:30.881272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.881818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.882262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.883320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:30.883440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:30.883857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:30.916895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:30.990982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:31.000860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df293618-5a9f-4d64-8d19-8b6c60ced9f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1378 microversion: 2.1 time: 0.202410 Oct 12 08:47:31.017629 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 494/938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:30 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1378 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:31.017898 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5575ce5b-ca3e-440e-adcb-1da0246d2973 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 204 len: 0 microversion: 2.1 time: 0.147043 Oct 12 08:47:31.017898 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 445/939] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:30 2022] DELETE /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:31.030133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.76"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:31.032833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:31.040234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:31.040981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:31.041253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:31.041818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:31.041961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:31.042811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:31.043496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:31.044098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:31.049943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:31.054306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:31.054778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:31.055693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:31.056268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:31.056727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:31.082101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:47:31.082822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquired lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:47:31.227103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:31.237192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:31.238677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:31.245471 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d6e2b62b-32bd-4fe0-a5d5-ab6eb1e257f8 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.208931 Oct 12 08:47:31.246788 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 446/940] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:31 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:31.307062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:31.307583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:31.321509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:31.322020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:31.322462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:31.327680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:31.335501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:31.336384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:31.437830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=7 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:31.530986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:31.534595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:31.547850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:31.551319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:31.570445 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b32aeb8-92c8-40f2-9f51-7838b63b2eb4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1510 microversion: 2.91 time: 0.267238 Oct 12 08:47:31.586163 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 447/941] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:31 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1510 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:47:31.717152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1706167178", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "b0bf0094-60cb-403a-9910-1ada4bf97663"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:31.809254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] validate_networks() for [('b0bf0094-60cb-403a-9910-1ada4bf97663', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:47:32.270856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:32.271435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:32.273039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:32.273478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:32.273905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:32.283227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.283719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.284159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.284887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.285344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.285830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.303207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Getting quotas for project 9c9affaa3c854de0919bb5fd833a92fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:32.307205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Getting quotas for user 288742d71ac1442a9bae776c2296935d and project 9c9affaa3c854de0919bb5fd833a92fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:32.318912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:47:32.321231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:47:32.332949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:32.371040 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-75fd1036-a8bc-42ff-be97-560674d9f1f4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783378 Oct 12 08:47:32.371655 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 448/942] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:47:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:47:32.382801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3329593c-6b07-4550-8f6e-7314f28f11dc req-6580caac-16fa-498a-9cfe-f5eb1120ead5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8276f079-1fbf-42d0-aa7f-290347030e58", "name": "network-vif-deleted", "tag": "fa90881a-0522-4320-a870-8b0814cb8b75"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:32.396463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3329593c-6b07-4550-8f6e-7314f28f11dc req-6580caac-16fa-498a-9cfe-f5eb1120ead5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.396956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3329593c-6b07-4550-8f6e-7314f28f11dc req-6580caac-16fa-498a-9cfe-f5eb1120ead5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.397390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3329593c-6b07-4550-8f6e-7314f28f11dc req-6580caac-16fa-498a-9cfe-f5eb1120ead5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.413696 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3329593c-6b07-4550-8f6e-7314f28f11dc req-6580caac-16fa-498a-9cfe-f5eb1120ead5 service nova] Creating event network-vif-deleted:fa90881a-0522-4320-a870-8b0814cb8b75 for instance 8276f079-1fbf-42d0-aa7f-290347030e58 on n-h1-858383-10 Oct 12 08:47:32.419302 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3329593c-6b07-4550-8f6e-7314f28f11dc req-6580caac-16fa-498a-9cfe-f5eb1120ead5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040312 Oct 12 08:47:32.420193 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 449/943] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:32.426372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:32.427191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:32.433978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.434473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.434913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.435941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.436442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.437164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.474694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.475191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.475944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.476411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lazy-loading 'fault' on Instance uuid 8276f079-1fbf-42d0-aa7f-290347030e58 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:32.539139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b855a0c328e425492a8dc28eb276001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246b8300f9b541199731ed89f23cb9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:32.550166 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-931b79d2-d04b-4472-b5fc-bf54e79b19f6 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 200 len: 1303 microversion: 2.1 time: 0.128700 Oct 12 08:47:32.551187 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 450/944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:32 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:32.556067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:32.557292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:32.568546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.569046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.569505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.571894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.571894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.572976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.797198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:32.807626 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-14dcb3bb-5f7e-40b1-84a2-06d93f61e36f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1378 microversion: 2.1 time: 0.255435 Oct 12 08:47:32.821464 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 451/945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:32 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1378 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:32.824096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:32.825394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:32.841274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.842421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.842875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.843738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:32.847022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:32.847502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:32.943266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:32.956548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:32.960354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:32.967026 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-80646c67-4215-4c4c-8dd1-88c984f99c9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.156693 Oct 12 08:47:32.968939 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 452/946] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:32 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:32.975113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-21db6726-1457-4d59-b725-eb560bb8a911 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:32.976412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21db6726-1457-4d59-b725-eb560bb8a911 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:33.053083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-21db6726-1457-4d59-b725-eb560bb8a911 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:33.067280 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-21db6726-1457-4d59-b725-eb560bb8a911 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1225 microversion: 2.1 time: 0.096491 Oct 12 08:47:33.068890 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 453/947] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:32 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:33.083098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-53edb99e-c8c8-44ae-8b06-f1f8c02e1d03 req-d423cfec-ba49-4207-b025-b180235e19d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "name": "network-vif-plugged", "status": "completed", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:33.100382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53edb99e-c8c8-44ae-8b06-f1f8c02e1d03 req-d423cfec-ba49-4207-b025-b180235e19d7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:33.101271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53edb99e-c8c8-44ae-8b06-f1f8c02e1d03 req-d423cfec-ba49-4207-b025-b180235e19d7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:33.101825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53edb99e-c8c8-44ae-8b06-f1f8c02e1d03 req-d423cfec-ba49-4207-b025-b180235e19d7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:33.114769 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-53edb99e-c8c8-44ae-8b06-f1f8c02e1d03 req-d423cfec-ba49-4207-b025-b180235e19d7 service nova] Creating event network-vif-plugged:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h2-858383-10 Oct 12 08:47:33.132614 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-53edb99e-c8c8-44ae-8b06-f1f8c02e1d03 req-d423cfec-ba49-4207-b025-b180235e19d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061354 Oct 12 08:47:33.133273 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 454/948] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:33.139192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:33.140015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:33.146490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:33.147137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:33.147685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:33.148488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:33.149039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:33.149592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:33.233106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:33.245386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:33.249149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:33.255681 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12300e41-25bc-46cc-bfcf-fb7eece74ada tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1510 microversion: 2.91 time: 0.120774 Oct 12 08:47:33.257090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 455/949] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:33 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1510 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:33.576847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:33.578040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] [instance: 8276f079-1fbf-42d0-aa7f-290347030e58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:33.589056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:33.594364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:33.595988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:33.597015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:33.597649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:33.598240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:33.617221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] HTTP exception thrown: Instance 8276f079-1fbf-42d0-aa7f-290347030e58 could not be found. Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Request method failure captured: Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 HTTP/1.1 Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8JDpofsJyNyjaJmpNBWhSRIQ4SZtweagIqiM_YPAkGp3DF-LK4xKZHqBiZj4CpJxbUj20zWCrCZ-IOn41OjO0AGO4vJpedzvDSGcVXtfOOLTzLYO2OqFxhjhNKofxnYslqVlWiKo6PQniRbJf4YKdAU8Ys5t2l82RmV7K46TjJY-g Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 246b8300f9b541199731ed89f23cb9f4 Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TenantUsagesTestJSON-1258636540 Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:33.619745 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/246b8300f9b541199731ed89f23cb9f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/246b8300f9b541199731ed89f23cb9f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_246b8300f9b541199731ed89f23cb9f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/246b8300f9b541199731ed89f23cb9f4"}]}] Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TenantUsagesTestJSON-1258636540 Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 246b8300f9b541199731ed89f23cb9f4 Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1258636540 Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TenantUsagesTestJSON-1258636540-project Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5b855a0c328e425492a8dc28eb276001 Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TenantUsagesTestJSON-1258636540-project Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 8276f079-1fbf-42d0-aa7f-290347030e58 could not be found. Oct 12 08:47:33.621346 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '8276f079-1fbf-42d0-aa7f-290347030e58'} Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8276f079-1fbf-42d0-aa7f-290347030e58 could not be found. Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:33.622351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8276f079-1fbf-42d0-aa7f-290347030e58 could not be found. Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8276f079-1fbf-42d0-aa7f-290347030e58 could not be found. Oct 12 08:47:33.623776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:33.625047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] Returning 404 to user: Instance 8276f079-1fbf-42d0-aa7f-290347030e58 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:33.625047 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-867380bf-45b8-4859-9bce-fe73da284b76 tempest-TenantUsagesTestJSON-1258636540 tempest-TenantUsagesTestJSON-1258636540-project] 10.222.0.40 "GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58" status: 404 len: 111 microversion: 2.1 time: 0.049197 Oct 12 08:47:33.634898 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 456/950] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:33 2022] GET /compute/v2.1/servers/8276f079-1fbf-42d0-aa7f-290347030e58 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:33.835528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:33.835673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:33.866843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:33.868313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:33.868763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:33.869515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:33.874869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:33.875659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:34.225350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:34.234868 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ddb50722-3a33-4f28-a9d7-c5411c75bc2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1378 microversion: 2.1 time: 0.407229 Oct 12 08:47:34.235870 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 457/951] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:33 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1378 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:34.241178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:34.242001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:34.248267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:34.248960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:34.249572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:34.250860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:34.251473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:34.252049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:34.347100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:34.361517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:34.366722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:34.380303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed4f7449-bb00-4a0d-9513-b479ec62c2b3 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.143142 Oct 12 08:47:34.384085 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 458/952] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:34 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:34.435956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:34.438686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:34.447683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:34.448476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:34.449279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:34.450670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:34.451282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:34.451886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:34.592199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:34.609694 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f69d6d22-fc1d-410b-aadb-8cdd4e18fec5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1283 microversion: 2.1 time: 0.178493 Oct 12 08:47:34.625869 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 459/953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:34 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1283 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:34.631909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:34.632717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:34.639410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:34.640113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:34.640743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:34.641696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:34.642307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:34.642920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:34.723495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Building network info cache for instance {{(pid=127006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 08:47:34.862541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:34.875833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:34.877267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:34.889054 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c30fb26-056b-4c75-9c33-7b2fb116d829 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1531 microversion: 2.91 time: 0.261945 Oct 12 08:47:34.894730 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 460/954] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:34 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1531 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:34.902506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-561127d2-521c-4d5d-a8cb-c6e5c3cc2ad6 req-5d7a7abb-efa4-442f-aae1-f8d7f800ca36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3d5fd9-a725-4697-88f7-c7883ff767a5", "name": "network-vif-deleted", "tag": "4a71dc90-5212-462d-a716-48627cfd6634"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:34.927787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-561127d2-521c-4d5d-a8cb-c6e5c3cc2ad6 req-5d7a7abb-efa4-442f-aae1-f8d7f800ca36 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:34.928714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-561127d2-521c-4d5d-a8cb-c6e5c3cc2ad6 req-5d7a7abb-efa4-442f-aae1-f8d7f800ca36 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:34.930161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-561127d2-521c-4d5d-a8cb-c6e5c3cc2ad6 req-5d7a7abb-efa4-442f-aae1-f8d7f800ca36 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:34.960802 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-561127d2-521c-4d5d-a8cb-c6e5c3cc2ad6 req-5d7a7abb-efa4-442f-aae1-f8d7f800ca36 service nova] Creating event network-vif-deleted:4a71dc90-5212-462d-a716-48627cfd6634 for instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 on n-h2-858383-10 Oct 12 08:47:34.991468 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-561127d2-521c-4d5d-a8cb-c6e5c3cc2ad6 req-5d7a7abb-efa4-442f-aae1-f8d7f800ca36 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093728 Oct 12 08:47:34.994087 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 461/955] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:35.595077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:35.595774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:35.610390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:35.610984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:35.611438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:35.612188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:35.615357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:35.617154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:35.786126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lazy-loading 'services' on Instance uuid bcebfe48-986f-41ff-b116-c90382f42b65 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:35.808868 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-442a137a-e1ec-44d4-a38a-5a39d6961de8 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1938 microversion: 2.91 time: 0.813396 Oct 12 08:47:35.810098 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 462/956] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:34 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1938 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:35.815893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:35.816832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:35.832421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:35.832919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:35.833366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:35.834089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:35.834538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:35.835013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:35.948213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Updating instance_info_cache with network_info: [{"id": "78484926-556e-4306-8e69-9de56e4195c2", "address": "fa:16:3e:7f:a4:54", "network": {"id": "e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-737109247-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82d063b8b7164196a37fdc496e5d6146", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap78484926-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:47:35.965159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Releasing lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:47:35.967975 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4391f317-0421-4a2d-811b-d3e80905e729 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action" status: 202 len: 0 microversion: 2.1 time: 4.942063 Oct 12 08:47:35.971134 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 495/957] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:31 2022] POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action => generated 0 bytes in 4946 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 08:47:35.981742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:35.982628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:35.990497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:35.991446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:35.992158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:35.993205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:35.993846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:35.994836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.160609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:36.166487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:36.172155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:36.174322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:36.176460 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9a4228ad-d6d0-45c2-91ce-4fd7d894dc8e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1528 microversion: 2.1 time: 0.364934 Oct 12 08:47:36.177056 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 463/958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:35 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1528 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:36.182626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e71b5fa-fe2a-47f0-b6ae-bd60b989137b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.209990 Oct 12 08:47:36.183498 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 496/959] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:35 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:36.193352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:36.194559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:36.198135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:36.199119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:36.201935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.202688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.203409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.204179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.204820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.205455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.215744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.216161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.216897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.217648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.218398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.218682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.265516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:36.403322 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-efaf914c-a36f-4308-8f45-9a3054e00c55 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 204 len: 0 microversion: 2.1 time: 0.217710 Oct 12 08:47:36.408289 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 497/960] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:36 2022] DELETE /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:36.415764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:36.415764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:36.432953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.433572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.433941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.434937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.435812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.437369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.589842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:36.599837 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bfa82b28-937a-40b2-8037-268ed91a2672 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1325 microversion: 2.1 time: 0.417131 Oct 12 08:47:36.601573 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 464/961] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:36 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1325 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:36.603522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lazy-loading 'services' on Instance uuid bcebfe48-986f-41ff-b116-c90382f42b65 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:36.618529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15286e99-5c75-46a1-b058-ab132e7bdd1d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '.version_select at 0x7f9848a6f430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:36.626623 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-857d6bba-0514-4311-b3fa-ac872e3c9d92 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1938 microversion: 2.91 time: 0.218540 Oct 12 08:47:36.627844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 498/962] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:36 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1938 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:36.632990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:36.633863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:36.641869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.642616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.643421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.644346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.645481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.646068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.839475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:36.848421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-572d69e1-4d57-4b16-8c44-75043bfea66a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1528 microversion: 2.1 time: 0.219196 Oct 12 08:47:36.849082 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 499/963] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:36 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1528 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:36.854209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:36.854976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:36.879814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.880311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.880745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.881475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.886376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.887115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:36.983023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15286e99-5c75-46a1-b058-ab132e7bdd1d tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/6e132142-b03d-4f51-8c4e-3bb85fa986c3" status: 200 len: 183 microversion: 2.1 time: 0.379857 Oct 12 08:47:36.984214 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 465/964] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:47:36 2022] GET /compute/v2.1/os-floating-ips/6e132142-b03d-4f51-8c4e-3bb85fa986c3 => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:36.989275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-088f8f3b-a57d-423c-8f48-75c035c4bda7 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:36.997546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-088f8f3b-a57d-423c-8f48-75c035c4bda7 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:36.999315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-088f8f3b-a57d-423c-8f48-75c035c4bda7 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:36.999995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-088f8f3b-a57d-423c-8f48-75c035c4bda7 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.001639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-088f8f3b-a57d-423c-8f48-75c035c4bda7 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.003820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-088f8f3b-a57d-423c-8f48-75c035c4bda7 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.005228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-088f8f3b-a57d-423c-8f48-75c035c4bda7 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.044420 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-088f8f3b-a57d-423c-8f48-75c035c4bda7 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.058718 Oct 12 08:47:37.044965 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 466/965] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 12 08:47:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:47:37.056984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20c933b3-2f9d-4ff4-bac2-f581361e8b9e tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:37.079840 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20c933b3-2f9d-4ff4-bac2-f581361e8b9e tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/3f24b9d7-f6bc-4dc9-813a-08e48e509545" status: 202 len: 0 microversion: 2.1 time: 0.033594 Oct 12 08:47:37.080570 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 467/966] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:37 2022] DELETE /compute/v2.1/flavors/3f24b9d7-f6bc-4dc9-813a-08e48e509545 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:47:37.090196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.76"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:37.092011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:37.107176 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6eccefc1-562c-435c-b83b-3cf61730cd6d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1713 microversion: 2.1 time: 0.256716 Oct 12 08:47:37.108344 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 500/967] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:36 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1713 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:37.113102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-bf7322c2-9d6e-4130-87c6-5120a0eb3af5 req-ef405a07-58f3-49f9-be7c-a434abf2e09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e369824a-bd0d-4c88-a06f-219dabefea87", "tag": "2092f001-6c5d-4aa9-87b0-1e8e219b217d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:37.131444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bf7322c2-9d6e-4130-87c6-5120a0eb3af5 req-ef405a07-58f3-49f9-be7c-a434abf2e09a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.132032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bf7322c2-9d6e-4130-87c6-5120a0eb3af5 req-ef405a07-58f3-49f9-be7c-a434abf2e09a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.132559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bf7322c2-9d6e-4130-87c6-5120a0eb3af5 req-ef405a07-58f3-49f9-be7c-a434abf2e09a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.145231 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-bf7322c2-9d6e-4130-87c6-5120a0eb3af5 req-ef405a07-58f3-49f9-be7c-a434abf2e09a service nova] Creating event network-changed:2092f001-6c5d-4aa9-87b0-1e8e219b217d for instance e369824a-bd0d-4c88-a06f-219dabefea87 on n-h1-858383-10 Oct 12 08:47:37.150536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-bf7322c2-9d6e-4130-87c6-5120a0eb3af5 req-ef405a07-58f3-49f9-be7c-a434abf2e09a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040543 Oct 12 08:47:37.151193 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 501/968] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:37.157003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:37.157772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:37.164091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.164640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.165136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.165922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.166375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.166797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.196833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lazy-loading 'flavor' on Instance uuid bcebfe48-986f-41ff-b116-c90382f42b65 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:37.303123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=5,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:37.369586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:37.378254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.379091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.379895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.380693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.381553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.382134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.401052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:37.504763 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2e76bff5-e795-4a04-8e1e-6097f2f5b8f7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "POST /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65/action" status: 202 len: 0 microversion: 2.91 time: 0.351981 Oct 12 08:47:37.505363 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 502/969] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:47:37 2022] POST /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:37.510566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53f67c1d-1d0f-439e-a5ab-d2ce8932e487 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:37.532751 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53f67c1d-1d0f-439e-a5ab-d2ce8932e487 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025897 Oct 12 08:47:37.534161 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 503/970] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:47:37 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:37.538234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-883af414-ac94-4f84-9986-dfd816bb39ee req-56f16f82-c1f4-4472-b521-ba20cd6f706b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce22591d-61fd-44bf-8816-b86eb6e5ba6e", "tag": "78484926-556e-4306-8e69-9de56e4195c2"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:37.544046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:37.548652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-883af414-ac94-4f84-9986-dfd816bb39ee req-56f16f82-c1f4-4472-b521-ba20cd6f706b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.548939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-883af414-ac94-4f84-9986-dfd816bb39ee req-56f16f82-c1f4-4472-b521-ba20cd6f706b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.549368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-883af414-ac94-4f84-9986-dfd816bb39ee req-56f16f82-c1f4-4472-b521-ba20cd6f706b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.562608 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-883af414-ac94-4f84-9986-dfd816bb39ee req-56f16f82-c1f4-4472-b521-ba20cd6f706b service nova] Creating event network-changed:78484926-556e-4306-8e69-9de56e4195c2 for instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e on n-h1-858383-10 Oct 12 08:47:37.567488 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-883af414-ac94-4f84-9986-dfd816bb39ee req-56f16f82-c1f4-4472-b521-ba20cd6f706b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033003 Oct 12 08:47:37.568514 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 504/971] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:37.577104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:37.577926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:37.590863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.591364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.591846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.592692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.592948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.593366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.668298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:37.677421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:37.678870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:37.684167 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-659c5e87-a1cb-41c1-b220-88b669856a4a tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.112012 Oct 12 08:47:37.684885 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 505/972] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:37 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:37.689743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:37.690507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:37.696490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.696969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.697612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.698301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.698886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.699555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.768643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:37.776745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:37.778293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:37.783111 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8bc01f3f-19dc-41f1-bca5-faefa53c206d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.097057 Oct 12 08:47:37.783661 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 506/973] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:37 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:37.788144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:37.790462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:37.802663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.803172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.803583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.804284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.804809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.805513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.837927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:37.844464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Old instance type tempest-test_resize_flavor_-1136291690, new instance type m1.heat {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 08:47:37.853364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:37.856986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:37.857652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:37.858255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:37.858517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:37.861344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:47:37.862476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquired lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:47:37.929656 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3e946bbe-f80f-4633-8ffc-10ed8b60d2a6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686/action" status: 202 len: 0 microversion: 2.1 time: 0.144142 Oct 12 08:47:37.930327 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 507/974] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:37 2022] POST /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:47:37.939033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:37.939703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:37.946374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.947342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.947342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:37.948385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:37.948498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:37.949108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:38.174201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:38.183933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-507ab9ca-ed77-47b5-bea8-7e147469c32d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1325 microversion: 2.1 time: 0.248952 Oct 12 08:47:38.184503 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 508/975] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:37 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:38.190065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:38.192009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:38.201753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:38.202488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:38.203075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:38.203964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:38.204570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:38.209860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:38.303252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:38.743594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Building network info cache for instance {{(pid=127007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 08:47:38.747159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:38.755075 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1134b8a5-c023-4854-a26f-e3347b125ae3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1537 microversion: 2.1 time: 0.569338 Oct 12 08:47:38.777738 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 509/976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:38 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1537 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:38.786583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:38.787274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:38.803587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:38.810403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:38.810846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:38.811920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:38.812389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:38.812971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.114631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:39.126141 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7f9975f-1cb6-4b92-a48b-39ad5f0521d4 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1713 microversion: 2.1 time: 0.347187 Oct 12 08:47:39.128004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 510/977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:38 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1713 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:39.132773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:39.143280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:39.151755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.152296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.152733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.153671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.154222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.154736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.258292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:39.266658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:39.268087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:39.281623 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-16624439-1c4b-4187-86f6-c1a219fa5b77 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.152349 Oct 12 08:47:39.297427 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 511/978] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:39 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:39.307902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:39.308810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:39.315373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.316050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.316675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.317578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.318209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.318781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.396244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:39.409724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:39.411673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:39.420119 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-041bd897-1dd3-4e1b-9ae6-4ca5d6bcb16f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.121469 Oct 12 08:47:39.421377 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 512/979] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:39 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:39.435079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:39.445612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:39.453155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.453933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.454555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.455420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.456020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.458152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.697243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:39.706001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed6a4e80-c079-4227-899d-8aa3412a7325 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1325 microversion: 2.1 time: 0.280267 Oct 12 08:47:39.721844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 513/980] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:39 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1325 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:39.726938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-40098040-73a7-4f24-9a9f-752742f97509 req-5021102d-e455-4af9-9879-bc74c314b3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce22591d-61fd-44bf-8816-b86eb6e5ba6e", "tag": "78484926-556e-4306-8e69-9de56e4195c2"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:39.736933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-40098040-73a7-4f24-9a9f-752742f97509 req-5021102d-e455-4af9-9879-bc74c314b3cd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.737564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-40098040-73a7-4f24-9a9f-752742f97509 req-5021102d-e455-4af9-9879-bc74c314b3cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.738224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-40098040-73a7-4f24-9a9f-752742f97509 req-5021102d-e455-4af9-9879-bc74c314b3cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.755315 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-40098040-73a7-4f24-9a9f-752742f97509 req-5021102d-e455-4af9-9879-bc74c314b3cd service nova] Creating event network-changed:78484926-556e-4306-8e69-9de56e4195c2 for instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e on n-h1-858383-10 Oct 12 08:47:39.760449 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-40098040-73a7-4f24-9a9f-752742f97509 req-5021102d-e455-4af9-9879-bc74c314b3cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037265 Oct 12 08:47:39.761161 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 514/981] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:39.766536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61fa48b8-60f9-40cb-8af8-5dda7c73ddcc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848a61d30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:39.820633 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61fa48b8-60f9-40cb-8af8-5dda7c73ddcc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/38e20e67-fb94-4e00-9276-df5661040ebf" status: 200 len: 662 microversion: 2.1 time: 0.057632 Oct 12 08:47:39.835533 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 515/982] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:39 2022] GET /compute/v2.1/images/38e20e67-fb94-4e00-9276-df5661040ebf => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:39.841146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:39.842079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:39.848842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.849751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.850430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:39.851368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:39.851933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:39.852470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.368184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Updating instance_info_cache with network_info: [{"id": "78484926-556e-4306-8e69-9de56e4195c2", "address": "fa:16:3e:7f:a4:54", "network": {"id": "e6e40f6d-ea5a-43ac-98cb-bb0a83ab5347", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-737109247-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "82d063b8b7164196a37fdc496e5d6146", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap78484926-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:47:40.392939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Releasing lock "refresh_cache-ce22591d-61fd-44bf-8816-b86eb6e5ba6e" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:47:40.396722 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b49590cc-9573-4758-87c1-1e757232550e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action" status: 202 len: 0 microversion: 2.1 time: 3.313202 Oct 12 08:47:40.404604 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 468/983] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:37 2022] POST /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e/action => generated 0 bytes in 3323 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 08:47:40.412057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:40.418034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c6bc764-a259-4cc2-bcb5-58c507058c2c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848afe790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:40.421418 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b67b2931-f8fa-4a24-9940-508c63acebe1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1537 microversion: 2.1 time: 0.584592 Oct 12 08:47:40.427680 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 516/984] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:39 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1537 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:40.438442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-901b1a4b-b0e3-4aff-a8ea-45e822f5eed4 req-fca41a61-ae07-4c50-a547-573dc39b0a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4", "name": "network-vif-deleted", "tag": "9188de81-465f-446b-98f5-a11b075643d2"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:40.465280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-901b1a4b-b0e3-4aff-a8ea-45e822f5eed4 req-fca41a61-ae07-4c50-a547-573dc39b0a81 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.480890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-901b1a4b-b0e3-4aff-a8ea-45e822f5eed4 req-fca41a61-ae07-4c50-a547-573dc39b0a81 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.481269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-901b1a4b-b0e3-4aff-a8ea-45e822f5eed4 req-fca41a61-ae07-4c50-a547-573dc39b0a81 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.500975 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-901b1a4b-b0e3-4aff-a8ea-45e822f5eed4 req-fca41a61-ae07-4c50-a547-573dc39b0a81 service nova] Creating event network-vif-deleted:9188de81-465f-446b-98f5-a11b075643d2 for instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 on n-h2-858383-10 Oct 12 08:47:40.507434 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-901b1a4b-b0e3-4aff-a8ea-45e822f5eed4 req-fca41a61-ae07-4c50-a547-573dc39b0a81 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072962 Oct 12 08:47:40.508211 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 517/985] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:40.513869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:40.514797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:40.521376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.522099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.522808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.523713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.524671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.525274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.532612 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c6bc764-a259-4cc2-bcb5-58c507058c2c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/38e20e67-fb94-4e00-9276-df5661040ebf" status: 200 len: 662 microversion: 2.1 time: 0.124172 Oct 12 08:47:40.533240 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 469/986] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:40 2022] GET /compute/v2.1/images/38e20e67-fb94-4e00-9276-df5661040ebf => generated 662 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:40.560924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:40.561898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:40.579553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.580046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.580485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.580947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lazy-loading 'fault' on Instance uuid 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:40.584938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.585451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.593305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.594583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.595068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.595544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.676250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcf977edf9f49cb8c2b3a645fd7db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc11687869b49f697bd3a37b5f3e23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:40.684910 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3206ac41-86b5-43f2-898f-9f6e7faed47d tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 200 len: 1354 microversion: 2.1 time: 0.175036 Oct 12 08:47:40.697675 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 518/987] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:40 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 1354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:40.697675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:40.697675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:40.706281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.707112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.707783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.709805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.714007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.714729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.729744 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] HTTP exception thrown: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Request method failure captured: Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 HTTP/1.1 Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7kXfIgaEMep2QweXIgZ4DyYcyIjWV41ovXoPYEhwTJA2wGXdnEkSdkGkeI9vvLmuG9M_AqWsJt7duIPgAHF2M6dcH0iHz6_vKGUnRVzRGSUbGJwodyuym6ZpqNgwKpQrV3AlEtec_dX0Bzt7CPMl0A4oYRnygzkZw4Fx51LjGPOSg Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 82d063b8b7164196a37fdc496e5d6146 Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:47:40.731821 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82d063b8b7164196a37fdc496e5d6146"}]}] Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 82d063b8b7164196a37fdc496e5d6146 Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FloatingIPsAssociationTestJSON-1600812966-project Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbc2b1086dbf432bbd45864e16811e24 Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1600812966-project Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:40.733126 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7e3d5fd9-a725-4697-88f7-c7883ff767a5'} Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:40.733874 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:40.735029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:40.737675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Returning 404 to user: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:40.738838 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-31bdd40d-8c23-4df9-8ffe-72e462dbcb78 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 404 len: 111 microversion: 2.1 time: 0.052768 Oct 12 08:47:40.739939 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 519/988] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:40 2022] DELETE /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:40.745814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:40.746702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:40.753049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.753915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.754587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.755513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.756165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.756790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.834111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:40.839408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:40.849280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:40.851153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:40.860585 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7f7d284-b3e4-40f4-9a73-49c3f6217425 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.315184 Oct 12 08:47:40.865061 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 470/989] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:40 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:40.881013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:40.887411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:40.896389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.897239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.897937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.899529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.900256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.901303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.907861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:40.923392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:40.935855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:40.954057 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69769df0-ca9e-424a-9ef1-9f2064ad3572 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.212731 Oct 12 08:47:40.954988 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 520/990] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:40 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:40.966277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:40.971296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: 7e3d5fd9-a725-4697-88f7-c7883ff767a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:40.984125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.988572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.989094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:40.989887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:40.990357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:40.995459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.021988 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] HTTP exception thrown: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Request method failure captured: Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 HTTP/1.1 Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7kXfIgaEMep2QweXIgZ4DyYcyIjWV41ovXoPYEhwTJA2wGXdnEkSdkGkeI9vvLmuG9M_AqWsJt7duIPgAHF2M6dcH0iHz6_vKGUnRVzRGSUbGJwodyuym6ZpqNgwKpQrV3AlEtec_dX0Bzt7CPMl0A4oYRnygzkZw4Fx51LjGPOSg Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 82d063b8b7164196a37fdc496e5d6146 Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:47:41.031444 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82d063b8b7164196a37fdc496e5d6146"}]}] Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 82d063b8b7164196a37fdc496e5d6146 Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FloatingIPsAssociationTestJSON-1600812966-project Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbc2b1086dbf432bbd45864e16811e24 Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1600812966-project Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:41.032712 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7e3d5fd9-a725-4697-88f7-c7883ff767a5'} Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:41.033421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. Oct 12 08:47:41.034619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.037180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Returning 404 to user: Instance 7e3d5fd9-a725-4697-88f7-c7883ff767a5 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:41.038335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ff43cc0-0c3a-4c62-a811-bec3323fdaa3 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5" status: 404 len: 111 microversion: 2.1 time: 0.081851 Oct 12 08:47:41.041914 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 521/991] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:40 2022] GET /compute/v2.1/servers/7e3d5fd9-a725-4697-88f7-c7883ff767a5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:41.051835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0ae2e33-f265-4c97-b40b-ffbeef88a26c tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '.version_select at 0x7f98489683a0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:41.193869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:41.204983 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35c794e7-dff2-470b-9fe5-9517d831714f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1325 microversion: 2.1 time: 0.338417 Oct 12 08:47:41.224610 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 471/992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:40 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:41.454006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:41.454839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:41.462320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.462811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.463247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.463942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.471979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.479875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.738974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:41.750518 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b5ace59-eb02-4a82-acf4-bb64d9e32235 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1537 microversion: 2.1 time: 0.300644 Oct 12 08:47:41.751203 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 472/993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:41 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:41.759097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:41.766904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:41.778782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.779420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.779962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.781027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.782351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.789598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.805357 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] HTTP exception thrown: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Request method failure captured: Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 HTTP/1.1 Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn586I29S4gzobPt-Di-vPFjFIrpFrHs6-hY6XiI_WwksMlSkYzl2LkZHatrlvc0Ojq4AbwhjQnCXzdPwfgr7y4tHBF-hwwC0fyI0lY8-67QMSndEjyi1-ryYzNOOeHoTFSAL1mK0cT1CFFqLfrMcZrVjfnv2vcBV6pBFmuJ5WVoaII Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:41.807622 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}] Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: bdcf977edf9f49cb8c2b3a645fd7db7f Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:41.809159 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4'} Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:41.809911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:41.811075 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.813815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Returning 404 to user: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:41.815683 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6fe48dda-cda0-4005-8e74-ccec401bc5cd tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 404 len: 111 microversion: 2.1 time: 0.060408 Oct 12 08:47:41.816418 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 473/994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:41 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:41.826567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:41.827558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:41.835610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.836951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.837763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.838708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.839803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.840771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.864621 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] HTTP exception thrown: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Request method failure captured: Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 HTTP/1.1 Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn586I29S4gzobPt-Di-vPFjFIrpFrHs6-hY6XiI_WwksMlSkYzl2LkZHatrlvc0Ojq4AbwhjQnCXzdPwfgr7y4tHBF-hwwC0fyI0lY8-67QMSndEjyi1-ryYzNOOeHoTFSAL1mK0cT1CFFqLfrMcZrVjfnv2vcBV6pBFmuJ5WVoaII Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:41.866405 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}] Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: bdcf977edf9f49cb8c2b3a645fd7db7f Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.867834 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '2097f23a-de33-42bd-b1d9-4c9fbbf9f553'} Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:41.868568 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.869778 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.871195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Returning 404 to user: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:41.871195 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef06cf50-4e70-4c0d-bbb0-7d5ef8b43140 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 404 len: 111 microversion: 2.1 time: 0.046605 Oct 12 08:47:41.871195 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 474/995] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:41 2022] DELETE /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:41.877335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:41.877976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:41.883945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.884425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.884853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.885632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.886079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.886537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.901007 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] HTTP exception thrown: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Request method failure captured: Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 HTTP/1.1 Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn586I29S4gzobPt-Di-vPFjFIrpFrHs6-hY6XiI_WwksMlSkYzl2LkZHatrlvc0Ojq4AbwhjQnCXzdPwfgr7y4tHBF-hwwC0fyI0lY8-67QMSndEjyi1-ryYzNOOeHoTFSAL1mK0cT1CFFqLfrMcZrVjfnv2vcBV6pBFmuJ5WVoaII Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:41.902886 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}] Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: bdcf977edf9f49cb8c2b3a645fd7db7f Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.904168 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '2097f23a-de33-42bd-b1d9-4c9fbbf9f553'} Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:41.904871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:41.906104 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:41.907144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Returning 404 to user: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:41.907144 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-147d8a18-3200-4411-8da0-f6edb5819d46 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 404 len: 111 microversion: 2.1 time: 0.031000 Oct 12 08:47:41.907144 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 475/996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:41 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:47:41.910307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:41.915186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:41.921540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.921999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.922434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.923138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:41.923590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:41.924011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:41.996107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.005527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.006988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.012358 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c7b54a3-25f9-4f72-8922-4661fba01e0d tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.105884 Oct 12 08:47:42.012931 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 476/997] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:41 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:42.018362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1bdd737-7aa8-4796-ab8e-e14a36374014 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '.version_select at 0x7f9848d16af0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.039100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a1bdd737-7aa8-4796-ab8e-e14a36374014 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094760699" status: 202 len: 0 microversion: 2.1 time: 0.024937 Oct 12 08:47:42.039749 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 477/998] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 08:47:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094760699 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:47:42.044630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.045294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:42.051494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.052206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.052692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.053400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.053882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.054303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.084573 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f0ae2e33-f265-4c97-b40b-ffbeef88a26c tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/6e132142-b03d-4f51-8c4e-3bb85fa986c3" status: 202 len: 0 microversion: 2.1 time: 1.037870 Oct 12 08:47:42.088143 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 522/999] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:47:41 2022] DELETE /compute/v2.1/os-floating-ips/6e132142-b03d-4f51-8c4e-3bb85fa986c3 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:47:42.093297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3dfd77da-c90f-4959-aacb-b9a05f3038fc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848b0ff70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.138395 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3dfd77da-c90f-4959-aacb-b9a05f3038fc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/9556fc16-0120-46eb-b585-8737776351ae" status: 200 len: 661 microversion: 2.1 time: 0.048896 Oct 12 08:47:42.139033 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 523/1000] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/images/9556fc16-0120-46eb-b585-8737776351ae => generated 661 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:42.139821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.144006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.144495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:42.149604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.151451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.151916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.152099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.152598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.153378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.153918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.154548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.158436 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65ff354a-30cf-493f-9d43-27e81bcad049 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.117659 Oct 12 08:47:42.159379 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 478/1001] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:42.178636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:42.181047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c42803f9-6ca9-4d1b-a715-6887504fd879 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848a6ff70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.184029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:42.234864 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c42803f9-6ca9-4d1b-a715-6887504fd879 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/9556fc16-0120-46eb-b585-8737776351ae" status: 200 len: 661 microversion: 2.1 time: 0.074285 Oct 12 08:47:42.236578 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 479/1002] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/images/9556fc16-0120-46eb-b585-8737776351ae => generated 661 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:42.242708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.243557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:42.251358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.252336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.253004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.254221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.254674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.255095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.314520 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d951835c-c14d-4712-9cc9-44a8a509b899 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 204 len: 0 microversion: 2.1 time: 0.173686 Oct 12 08:47:42.315153 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 524/1003] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:42 2022] DELETE /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:42.324957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.325908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:42.332330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.333023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.333490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.334474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.334943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.335374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.469391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.477223 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a10fbad8-aa93-41bd-a4c2-dc717d1f74ee tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1525 microversion: 2.1 time: 0.157563 Oct 12 08:47:42.478019 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 525/1004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:42.532149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.541698 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a242208d-b7cf-4244-94b2-b9c2be30e455 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1325 microversion: 2.1 time: 0.302744 Oct 12 08:47:42.542564 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 480/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1325 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:42.691388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9ec1aa9a-efda-46ad-9a75-578e8f3ae969 req-deb40793-bc7a-4585-9f77-c1dfba8ed69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e369824a-bd0d-4c88-a06f-219dabefea87", "name": "network-vif-plugged", "status": "completed", "tag": "2092f001-6c5d-4aa9-87b0-1e8e219b217d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:42.702105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9ec1aa9a-efda-46ad-9a75-578e8f3ae969 req-deb40793-bc7a-4585-9f77-c1dfba8ed69a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.702572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9ec1aa9a-efda-46ad-9a75-578e8f3ae969 req-deb40793-bc7a-4585-9f77-c1dfba8ed69a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.702996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9ec1aa9a-efda-46ad-9a75-578e8f3ae969 req-deb40793-bc7a-4585-9f77-c1dfba8ed69a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.714128 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9ec1aa9a-efda-46ad-9a75-578e8f3ae969 req-deb40793-bc7a-4585-9f77-c1dfba8ed69a service nova] Creating event network-vif-plugged:2092f001-6c5d-4aa9-87b0-1e8e219b217d for instance e369824a-bd0d-4c88-a06f-219dabefea87 on n-h1-858383-10 Oct 12 08:47:42.719039 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9ec1aa9a-efda-46ad-9a75-578e8f3ae969 req-deb40793-bc7a-4585-9f77-c1dfba8ed69a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 Oct 12 08:47:42.719736 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 526/1006] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:47:42.773804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.774682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:42.781723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.782211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.782641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.783321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.783773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.784197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.823649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6424b501-2f4e-458b-acb6-8e2405ab40c3 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.848317 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6424b501-2f4e-458b-acb6-8e2405ab40c3 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/81276253" status: 202 len: 0 microversion: 2.1 time: 0.028625 Oct 12 08:47:42.848914 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 527/1007] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:47:42 2022] DELETE /compute/v2.1/flavors/81276253 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:47:42.856712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36fbccf6-b130-4dd6-806b-00f7e8d4ecf6 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.877489 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-36fbccf6-b130-4dd6-806b-00f7e8d4ecf6 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.024284 Oct 12 08:47:42.878070 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 528/1008] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:42.896075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f4c9954-d5a2-43e4-b0eb-e448980c3938 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.913621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f4c9954-d5a2-43e4-b0eb-e448980c3938 tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2050110167" status: 202 len: 0 microversion: 2.1 time: 0.021018 Oct 12 08:47:42.914197 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 529/1009] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:47:42 2022] DELETE /compute/v2.1/flavors/2050110167 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:47:42.914314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:42.922422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ab462107-df57-4b4f-a91c-2f743d26263e tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.923487 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30e299d3-5777-4dd3-aa3e-3b3aff87e387 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.153649 Oct 12 08:47:42.924102 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 481/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:42.942070 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ab462107-df57-4b4f-a91c-2f743d26263e tempest-ServersWithSpecificFlavorTestJSON-1381884411 tempest-ServersWithSpecificFlavorTestJSON-1381884411-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023600 Oct 12 08:47:42.942929 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 530/1011] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:42.966063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:42.966580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:42.972706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.973186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.973647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.974330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:42.974777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:42.975197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:42.988583 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] HTTP exception thrown: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Request method failure captured: Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 HTTP/1.1 Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn586I29S4gzobPt-Di-vPFjFIrpFrHs6-hY6XiI_WwksMlSkYzl2LkZHatrlvc0Ojq4AbwhjQnCXzdPwfgr7y4tHBF-hwwC0fyI0lY8-67QMSndEjyi1-ryYzNOOeHoTFSAL1mK0cT1CFFqLfrMcZrVjfnv2vcBV6pBFmuJ5WVoaII Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:42.990161 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}] Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: bdcf977edf9f49cb8c2b3a645fd7db7f Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:42.991615 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4'} Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:42.992354 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:42.993544 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:42.994700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Returning 404 to user: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:42.994700 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c38cab5-96d1-46a1-a486-ef96a2516a9e tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 404 len: 111 microversion: 2.1 time: 0.029541 Oct 12 08:47:42.994700 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 482/1012] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:42 2022] DELETE /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:43.000336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.001137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:43.007923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.008408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.008865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.009635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.010097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.010527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.024163 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] HTTP exception thrown: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Request method failure captured: Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 HTTP/1.1 Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn586I29S4gzobPt-Di-vPFjFIrpFrHs6-hY6XiI_WwksMlSkYzl2LkZHatrlvc0Ojq4AbwhjQnCXzdPwfgr7y4tHBF-hwwC0fyI0lY8-67QMSndEjyi1-ryYzNOOeHoTFSAL1mK0cT1CFFqLfrMcZrVjfnv2vcBV6pBFmuJ5WVoaII Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:47:43.026138 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}] Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: bdcf977edf9f49cb8c2b3a645fd7db7f Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:43.027418 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4'} Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:43.028628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. Oct 12 08:47:43.029841 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.030906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Returning 404 to user: Instance 5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:43.030906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d5ca36db-f3f3-4cba-9cba-512a09ddbe24 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4" status: 404 len: 111 microversion: 2.1 time: 0.031309 Oct 12 08:47:43.030906 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 531/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:42 2022] GET /compute/v2.1/servers/5b268a0f-49c5-4b6b-bea3-bd4ba586c7a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:43.036595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.037349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:43.042780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.043379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:43.044058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.044552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.044992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.045727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.046194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.046617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.049752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.050268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.050710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.051403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.051885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.052309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.060289 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] HTTP exception thrown: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Request method failure captured: Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 HTTP/1.1 Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn586I29S4gzobPt-Di-vPFjFIrpFrHs6-hY6XiI_WwksMlSkYzl2LkZHatrlvc0Ojq4AbwhjQnCXzdPwfgr7y4tHBF-hwwC0fyI0lY8-67QMSndEjyi1-ryYzNOOeHoTFSAL1mK0cT1CFFqLfrMcZrVjfnv2vcBV6pBFmuJ5WVoaII Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:43.062470 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}] Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: bdcf977edf9f49cb8c2b3a645fd7db7f Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.063820 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '2097f23a-de33-42bd-b1d9-4c9fbbf9f553'} Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:43.064630 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.065819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.066952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Returning 404 to user: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:43.066952 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-04142efe-c7ab-4ca8-a022-9e46d2e092fb tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 404 len: 111 microversion: 2.1 time: 0.031291 Oct 12 08:47:43.066952 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 483/1014] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:43 2022] DELETE /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:43.072363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.073193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] [instance: 2097f23a-de33-42bd-b1d9-4c9fbbf9f553] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:43.075174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:43.081124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.081840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.082277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.083007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.083556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.084282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.101278 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] HTTP exception thrown: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Request method failure captured: Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 HTTP/1.1 Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn586I29S4gzobPt-Di-vPFjFIrpFrHs6-hY6XiI_WwksMlSkYzl2LkZHatrlvc0Ojq4AbwhjQnCXzdPwfgr7y4tHBF-hwwC0fyI0lY8-67QMSndEjyi1-ryYzNOOeHoTFSAL1mK0cT1CFFqLfrMcZrVjfnv2vcBV6pBFmuJ5WVoaII Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:43.102635 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fc11687869b49f697bd3a37b5f3e23e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fc11687869b49f697bd3a37b5f3e23e"}]}] Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2fc11687869b49f697bd3a37b5f3e23e Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480 Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: bdcf977edf9f49cb8c2b3a645fd7db7f Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1315314480-project Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.104124 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '2097f23a-de33-42bd-b1d9-4c9fbbf9f553'} Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:43.105113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. Oct 12 08:47:43.106648 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:43.108029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] Returning 404 to user: Instance 2097f23a-de33-42bd-b1d9-4c9fbbf9f553 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:43.108029 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a33e0f48-a76c-4680-b6bb-b34cae468ca9 tempest-ServersWithSpecificFlavorTestJSON-1315314480 tempest-ServersWithSpecificFlavorTestJSON-1315314480-project] 10.222.0.40 "GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553" status: 404 len: 111 microversion: 2.1 time: 0.035372 Oct 12 08:47:43.108029 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 484/1015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:43 2022] GET /compute/v2.1/servers/2097f23a-de33-42bd-b1d9-4c9fbbf9f553 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:43.127828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:43.136404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:43.137943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:43.142727 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf5ae6b1-6985-4257-9b63-d43090b8af8b tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.104360 Oct 12 08:47:43.143378 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 532/1016] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:43 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:43.186963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.187582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:43.193692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.194366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.194865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.195616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.196133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.196615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.282647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:43.291365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:43.292871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:43.294778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=94,nova_api:DELETE=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:43.299997 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d25c978b-3e50-4842-9382-d000d0479702 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.117262 Oct 12 08:47:43.300616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 485/1017] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:43 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:47:43.501390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.502075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:43.508805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.509679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.510014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.510822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.511146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.511590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.565145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.566385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:43.574680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.575162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.575593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.576328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.576976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.577613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.661905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:43.671341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c97713c1-648f-42da-bb87-3eccdd0ead68 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1525 microversion: 2.1 time: 0.174813 Oct 12 08:47:43.671915 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 533/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:43 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1525 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:43.677854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-355ef69c-1276-424c-b1f6-5a37f9fc9e2e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98489b1c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.724276 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-355ef69c-1276-424c-b1f6-5a37f9fc9e2e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4c4435df-16b5-4cb3-a7df-2141a6035976" status: 200 len: 661 microversion: 2.1 time: 0.050550 Oct 12 08:47:43.729493 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 534/1019] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:43 2022] GET /compute/v2.1/images/4c4435df-16b5-4cb3-a7df-2141a6035976 => generated 661 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:43.739373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6828eb81-5995-4a07-8e3f-9c770ae8c6bc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984898c040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.782093 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6828eb81-5995-4a07-8e3f-9c770ae8c6bc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4c4435df-16b5-4cb3-a7df-2141a6035976" status: 200 len: 661 microversion: 2.1 time: 0.046613 Oct 12 08:47:43.782662 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 535/1020] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:47:43 2022] GET /compute/v2.1/images/4c4435df-16b5-4cb3-a7df-2141a6035976 => generated 661 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:47:43.838412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1043652027", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:43.864117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:43.872614 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e77f587f-e121-45e7-8574-eb7956432811 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1325 microversion: 2.1 time: 0.311941 Oct 12 08:47:43.873775 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 486/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:43 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:43.904404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:47:43.946199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:43.946692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:43.953853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.954519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.955254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:43.956026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:43.956688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:43.957329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.097717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:44.098174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:44.098645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:44.099034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:44.099413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:44.108681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.109162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.109638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.110360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.110814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.111238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.129246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Getting quotas for project 3df3fefb313e4c52839e79e0ffd22f54. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:44.133764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Getting quotas for user 98ab7edcece8460aa4b645ef65561ded and project 3df3fefb313e4c52839e79e0ffd22f54. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:44.146576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:47:44.149144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:47:44.160599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:44.184390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:44.194888 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5fa1f820-1508-42d5-828a-2e69ac30d855 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.252488 Oct 12 08:47:44.195106 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a5390152-0f40-4798-8c93-32fe12b4e41f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.361523 Oct 12 08:47:44.209564 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 536/1022] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:47:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:47:44.210803 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 487/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:43 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:44.217928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:44.219043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:44.227048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.228243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.229127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.230252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.230783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.231353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.328828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:44.329502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:44.339496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.340234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.342262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.343157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.343780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.344212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.392179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:44.402726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:44.406687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:44.413874 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f17d88b-b7d8-4ec2-8355-3c9b5748924e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.216504 Oct 12 08:47:44.425466 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 537/1024] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:44 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:44.425466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1529855337", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:44.501687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:47:44.545119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:44.554474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:44.556050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:44.562493 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-871ffd1b-d050-4f67-ad55-f45a5f778ac4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.238255 Oct 12 08:47:44.563445 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 488/1025] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:44 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:44.696753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:44.698257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:44.708721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.710774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.711301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.713474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.713971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.714472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.728398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:44.728632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:44.728914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:44.729321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:44.729789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:44.739815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.740298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.741066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.742036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.742501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.742932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.768574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Getting quotas for project 3df3fefb313e4c52839e79e0ffd22f54. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:47:44.773229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Getting quotas for user 98ab7edcece8460aa4b645ef65561ded and project 3df3fefb313e4c52839e79e0ffd22f54. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:47:44.785625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:47:44.787814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:47:44.839883 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8236b16f-0c05-4725-a623-54f9f1e5df46 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.423778 Oct 12 08:47:44.841046 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 538/1026] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:47:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:47:44.851863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8c5d653d-9416-4b92-8854-919ba3770e25 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:44.852711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8c5d653d-9416-4b92-8854-919ba3770e25 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:44.920006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8c5d653d-9416-4b92-8854-919ba3770e25 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:44.927791 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8c5d653d-9416-4b92-8854-919ba3770e25 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1218 microversion: 2.1 time: 0.079695 Oct 12 08:47:44.928703 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 539/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:44 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:44.944385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:44.950251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:44.958695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.959285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.959786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:44.970681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:44.971276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:44.973179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:45.187602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.198125 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e62c3d9a-1ede-4821-806c-fcd596b4207f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1325 microversion: 2.1 time: 0.268216 Oct 12 08:47:45.199171 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 540/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:44 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:45.263496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:45.264188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:45.297810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:45.298297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:45.304582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:45.308121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:45.310312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:45.312717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:45.450166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.460298 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8598ac32-e4d0-4855-bc8c-5da0c9e40dd7 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1525 microversion: 2.1 time: 0.768086 Oct 12 08:47:45.463362 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 489/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:44 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1525 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:45.481036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:45.482027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:45.489971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:45.490878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:45.491554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:45.492496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:45.493156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:45.493817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:45.532849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.540939 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4617db36-fc4e-434f-8ea9-ebd7f0e78cd9 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.282037 Oct 12 08:47:45.541629 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 541/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:45 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:45.590924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.592520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:45.593218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:45.607692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:45.608586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:45.609486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:45.610502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:45.611166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:45.611835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:45.612293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.614766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.625715 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-724bfca5-6826-4d25-b272-0b1ccdffc8c0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.161080 Oct 12 08:47:45.626318 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 490/1031] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:45 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:45.689190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.698072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.699655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:45.705224 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ba20c6d6-0666-4433-b3b2-92de606bb0cb tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.117501 Oct 12 08:47:45.706092 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 542/1032] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:45 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:47:45.956504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:45.957139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:45.969201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:45.969722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:45.978849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:45.979636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:45.980197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:45.980660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.203283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cbcf85ea-2de2-466d-9d17-407bdcaaaa6a req-14b52679-3c4e-4025-b4e4-a89c57479f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce22591d-61fd-44bf-8816-b86eb6e5ba6e", "name": "network-vif-deleted", "tag": "78484926-556e-4306-8e69-9de56e4195c2"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:46.218618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:46.229791 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c27ae813-6582-45f9-bf8f-797a05411bc5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1270 microversion: 2.1 time: 0.277278 Oct 12 08:47:46.245875 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 491/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:45 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1270 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:46.257034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:46.257853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:46.259549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbcf85ea-2de2-466d-9d17-407bdcaaaa6a req-14b52679-3c4e-4025-b4e4-a89c57479f2b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.261368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbcf85ea-2de2-466d-9d17-407bdcaaaa6a req-14b52679-3c4e-4025-b4e4-a89c57479f2b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.262032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbcf85ea-2de2-466d-9d17-407bdcaaaa6a req-14b52679-3c4e-4025-b4e4-a89c57479f2b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.271338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.272959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.277193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.278190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.278803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.279406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.300455 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cbcf85ea-2de2-466d-9d17-407bdcaaaa6a req-14b52679-3c4e-4025-b4e4-a89c57479f2b service nova] Creating event network-vif-deleted:78484926-556e-4306-8e69-9de56e4195c2 for instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e on n-h1-858383-10 Oct 12 08:47:46.320422 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cbcf85ea-2de2-466d-9d17-407bdcaaaa6a req-14b52679-3c4e-4025-b4e4-a89c57479f2b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123703 Oct 12 08:47:46.324132 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 543/1034] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:46.487519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:46.488370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:46.509510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.510298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.510940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.512014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.512750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.513200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.596190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.597089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.597840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.598523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lazy-loading 'fault' on Instance uuid ce22591d-61fd-44bf-8816-b86eb6e5ba6e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:46.657788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:46.676011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc2b1086dbf432bbd45864e16811e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d063b8b7164196a37fdc496e5d6146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:46.687926 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0d4fc207-f820-49be-bcf7-888de5ac5716 tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 200 len: 1314 microversion: 2.1 time: 0.205115 Oct 12 08:47:46.689173 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 544/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:46 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:46.690142 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dbe098d0-0cf6-467a-873e-68591d59b9d2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.439258 Oct 12 08:47:46.692445 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 492/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:46 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:46.698674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:46.699619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:46.701607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:46.715818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.716585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.718385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.721091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.724742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:46.735573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.736598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.748334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.748847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.749338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.751927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.754059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.756136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.796940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:46.938313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:46.951149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:46.953060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:46.958979 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b35e69c2-935a-4763-ab6f-9de7a666713e tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.265208 Oct 12 08:47:46.974271 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 493/1037] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:46 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:46.986681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:46.987650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:46.995298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.996146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.996808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:46.997822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:46.998511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:46.999178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.020345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:47.230309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:47.243394 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-17b6156f-b909-4a3c-9403-52d461ede1a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.552970 Oct 12 08:47:47.244911 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 545/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:46 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:47.266753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:47.267556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:47.275751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.277115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.280072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.281096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.281805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.282447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.294525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:47.309605 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bda5df9a-924c-47b9-9b35-2b9fdde84733 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.330826 Oct 12 08:47:47.310959 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 494/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:46 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:47.323799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:47.331802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:47.347013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.350851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.353401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.354420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.355120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.357755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.518108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:47.527852 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-923f6372-7ddd-4b5e-9ccf-bfb9d0ad7b20 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1276 microversion: 2.1 time: 0.215181 Oct 12 08:47:47.528599 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 495/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:47 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:47.543702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e468cea-3133-4b0d-b47f-a2fd306685d8 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2008353913", "metadata": {"": ""}}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e468cea-3133-4b0d-b47f-a2fd306685d8 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action HTTP/1.1 Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 107 Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:47.547825 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2008353913", "metadata": {"": ""}}} Oct 12 08:47:47.549135 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e369824a-bd0d-4c88-a06f-219dabefea87', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2008353913', 'metadata': {'': ''}}}} Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'': ''} Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:47.550268 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.551574 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e468cea-3133-4b0d-b47f-a2fd306685d8 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2e468cea-3133-4b0d-b47f-a2fd306685d8 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action" status: 400 len: 170 microversion: 2.1 time: 0.010479 Oct 12 08:47:47.552770 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 496/1041] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 12 08:47:47 2022] POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action => generated 170 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:47:47.558666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:47.559310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:47.567040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.567537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.567983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.569333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.569846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.570279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.689828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:47.701579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:47.702943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:47.717555 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-17ab267f-3a05-436c-8334-8fd08fe7fb3d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.466756 Oct 12 08:47:47.719129 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 546/1042] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:47 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:47.723985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:47.724844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] [instance: ce22591d-61fd-44bf-8816-b86eb6e5ba6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:47.737921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.738738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.739405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.740332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.740787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.741210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.776655 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] HTTP exception thrown: Instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e could not be found. Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Request method failure captured: Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e HTTP/1.1 Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn7kXfIgaEMep2QweXIgZ4DyYcyIjWV41ovXoPYEhwTJA2wGXdnEkSdkGkeI9vvLmuG9M_AqWsJt7duIPgAHF2M6dcH0iHz6_vKGUnRVzRGSUbGJwodyuym6ZpqNgwKpQrV3AlEtec_dX0Bzt7CPMl0A4oYRnygzkZw4Fx51LjGPOSg Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 82d063b8b7164196a37fdc496e5d6146 Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:47:47.778716 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_82d063b8b7164196a37fdc496e5d6146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/82d063b8b7164196a37fdc496e5d6146"}]}] Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 82d063b8b7164196a37fdc496e5d6146 Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1600812966 Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FloatingIPsAssociationTestJSON-1600812966-project Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbc2b1086dbf432bbd45864e16811e24 Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1600812966-project Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e could not be found. Oct 12 08:47:47.780128 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'ce22591d-61fd-44bf-8816-b86eb6e5ba6e'} Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e could not be found. Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:47.780839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e could not be found. Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e could not be found. Oct 12 08:47:47.782166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:47.784532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] Returning 404 to user: Instance ce22591d-61fd-44bf-8816-b86eb6e5ba6e could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:47.785599 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed8480d6-2c09-4a8b-b274-dde27c0c916e tempest-FloatingIPsAssociationTestJSON-1600812966 tempest-FloatingIPsAssociationTestJSON-1600812966-project] 10.222.0.40 "GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e" status: 404 len: 111 microversion: 2.1 time: 0.065290 Oct 12 08:47:47.786694 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 547/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:47 2022] GET /compute/v2.1/servers/ce22591d-61fd-44bf-8816-b86eb6e5ba6e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:47:47.837948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:47.850451 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f306f105-5e07-4b3e-b7bf-3752c60f037f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.295510 Oct 12 08:47:47.851407 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 497/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:47 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:47.878965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:47.879710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:47.889417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.889958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.890394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.891271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:47.891724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:47.892206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:47.993852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:47.994547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:48.011753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.012546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.015078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.020395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.021666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.022768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.243082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:48.258400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:48.265072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:48.277058 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6799e1f1-4b41-483b-87a7-00e16b942725 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.289124 Oct 12 08:47:48.277694 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 498/1045] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:47 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:48.293793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:48.294411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:48.307280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.308399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.309142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.310444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.312807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.316331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.438679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:48.447395 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-da8b711a-6a06-45ca-821f-84c96a8e5239 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.573130 Oct 12 08:47:48.448758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 548/1046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:47 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:48.470581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf080567-ed4b-4313-83e9-fee134bf8cd9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-416487251", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf080567-ed4b-4313-83e9-fee134bf8cd9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action HTTP/1.1 Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 618 Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:47:48.475967 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:47:48.477589 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:47:48.478296 n-d-858383-10 devstack@n-api.service[127006]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-416487251", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 12 08:47:48.478296 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:47:48.478296 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'e369824a-bd0d-4c88-a06f-219dabefea87', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-416487251', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 12 08:47:48.478556 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:48.479417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:48.481054 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:48.481962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:48.481962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:48.481962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:47:48.481962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:47:48.481962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 08:47:48.481962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:47:48.483212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf080567-ed4b-4313-83e9-fee134bf8cd9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:48.488066 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf080567-ed4b-4313-83e9-fee134bf8cd9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action" status: 400 len: 938 microversion: 2.1 time: 0.021540 Oct 12 08:47:48.488983 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 549/1047] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 12 08:47:48 2022] POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:47:48.497210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:48.498312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:48.509895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.512700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.517250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.520418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.520418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.520418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.628032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:48.639707 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5e525969-90df-4e6c-9fff-d7cbddda0c2e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.360762 Oct 12 08:47:48.640612 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 499/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:48 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:48.667861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:48.675224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:48.687624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.688395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.688981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.689911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.690873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.691834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.849358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:48.863352 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1889e0bc-8531-4fc5-9d7e-21aecbbb18e1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1276 microversion: 2.1 time: 0.208318 Oct 12 08:47:48.864119 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 500/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:48 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:48.883806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:48.884333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:48.891041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.891821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.892462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.893357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:48.894011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:48.894618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:48.990456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.005136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.011754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.021918 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-471e0e78-cc20-4352-9992-a8cd2324dae1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.142933 Oct 12 08:47:49.024488 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 501/1050] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:48 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:49.216888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.240998 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f54c601a-1bf8-4190-b904-ecf60d25feaf tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.747163 Oct 12 08:47:49.243953 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 550/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:48 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:49.266449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:49.267842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:49.275156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:49.276480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:49.277112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:49.278039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:49.278678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:49.279303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:49.308308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:49.309228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:49.317341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:49.317874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:49.324626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:49.325606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:49.328856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:49.329300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:49.356018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:49.509322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.519184 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-52bab56d-775d-4591-ac97-f0846be01377 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.256533 Oct 12 08:47:49.537830 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 502/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:49 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:49.553487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.562412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-26faf549-1f56-4bbc-894c-0596b8847526 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:49.565260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.567052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-26faf549-1f56-4bbc-894c-0596b8847526 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action HTTP/1.1 Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 285 Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:49.570003 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:47:49.571314 n-d-858383-10 devstack@n-api.service[127007]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e369824a-bd0d-4c88-a06f-219dabefea87', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:47:49.571971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:47:49.572586 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:47:49.573896 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:47:49.574640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:47:49.574640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:49.574776 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-327ff0f2-0541-474f-afb6-850a3b885821 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.269060 Oct 12 08:47:49.574776 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 551/1053] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:49 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:47:49.576291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-26faf549-1f56-4bbc-894c-0596b8847526 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:49.577233 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-26faf549-1f56-4bbc-894c-0596b8847526 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action" status: 400 len: 619 microversion: 2.1 time: 0.029194 Oct 12 08:47:49.580850 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 503/1054] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 12 08:47:49 2022] POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:47:49.592452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:49.594086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:49.600290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:49.600771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:49.601199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:49.602440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:49.602897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:49.603319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:49.671726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:49.672751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:49.682049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:49.682587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:49.683234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:49.683970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:49.684876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:49.685322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:49.979503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:49.990881 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3846a5d8-f8d9-4412-9fb7-4fd14867b42d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.408139 Oct 12 08:47:49.991536 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 552/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:49 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:49.998885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:50.000133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:50.010977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.013172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.014109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.015096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.015613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.016053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.219887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:50.228927 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ab0fd32-49aa-4dd4-a4f6-9caad24c753f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.564967 Oct 12 08:47:50.229797 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 504/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:49 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:50.241730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:50.242707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:50.249582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.250182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.250670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.251635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.252252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.252681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.460200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:50.469734 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-877abac9-e381-404e-806f-b66912447898 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.238566 Oct 12 08:47:50.470553 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 505/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:50 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:50.484309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:50.485417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:50.494497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.495694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.495694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.496174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.496694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.497294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.603926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:50.613033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:50.614536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:50.620028 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1b2eb155-ff56-4130-8e8b-e8be9a4bc0e6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.148231 Oct 12 08:47:50.620826 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 506/1058] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:50 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:50.625969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-987948435"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:50.628609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:50.634900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.635476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.636052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.637010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.637225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.637810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.719939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:50.732922 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45964745-73a6-477b-bf1b-7c2e53479050 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.740128 Oct 12 08:47:50.734510 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 553/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:49 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:50.761991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:50.765130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:50.785164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.785998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.786711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.787516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.787962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.797838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.868188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6ad9ec1d-2a9b-4899-a25d-071d0d13bb78 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action" status: 202 len: 0 microversion: 2.1 time: 0.245877 Oct 12 08:47:50.869565 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 507/1060] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:50 2022] POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:47:50.883298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2122294262"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:50.887041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:50.894708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.896869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.897315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.898136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:50.898585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:50.899005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:50.973026 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Cannot 'createImage' instance e369824a-bd0d-4c88-a06f-219dabefea87 while it is in task_state image_snapshot_pending Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action HTTP/1.1 Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 85 Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:47:50.974752 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2122294262"}} Oct 12 08:47:50.976151 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'createImage' instance e369824a-bd0d-4c88-a06f-219dabefea87 while it is in task_state image_snapshot_pending Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e369824a-bd0d-4c88-a06f-219dabefea87', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2122294262'}}} Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e369824a-bd0d-4c88-a06f-219dabefea87 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:47:50.976869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e369824a-bd0d-4c88-a06f-219dabefea87 while it is in task_state image_snapshot_pending Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e369824a-bd0d-4c88-a06f-219dabefea87 while it is in task_state image_snapshot_pending Oct 12 08:47:50.978031 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:47:50.979136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 409 to user: Cannot 'createImage' instance e369824a-bd0d-4c88-a06f-219dabefea87 while it is in task_state image_snapshot_pending {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:47:50.979136 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5909b908-60d9-4b2e-87e4-0fc5b1154010 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action" status: 409 len: 167 microversion: 2.1 time: 0.099454 Oct 12 08:47:50.979136 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 508/1061] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:47:50 2022] POST /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87/action => generated 167 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 08:47:50.985211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b49d35b-d8ab-4d2e-a9c7-f12b8d4ca837 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '.version_select at 0x7f9848ad7790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:51.002927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.012061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.018887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.032286 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f3f0a473-8ca2-4990-bf12-5017c780724c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.295693 Oct 12 08:47:51.032993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 554/1062] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:50 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:51.242455 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b49d35b-d8ab-4d2e-a9c7-f12b8d4ca837 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/images/9a4a3dcc-18c3-4bd8-afa5-38b5aa301fde" status: 204 len: 0 microversion: 2.1 time: 0.260903 Oct 12 08:47:51.246495 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 509/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:50 2022] DELETE /compute/v2.1/images/9a4a3dcc-18c3-4bd8-afa5-38b5aa301fde => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:47:51.254344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:51.255222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:51.257253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:51.258002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:51.268118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.269200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.270065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.270571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.270992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.271168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.271729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.272189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.272615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.274904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.275601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.276346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.497403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.506495 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a08b624b-8d01-43c2-9ea4-59bdcec76c56 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1535 microversion: 2.1 time: 0.256360 Oct 12 08:47:51.507449 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 510/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:51 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1535 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:51.566340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d42b23aa-777b-478c-a2eb-54239d9ba951 req-e8851ff4-1cf9-43c5-a586-0597dd7bf893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd399ffd-4151-4122-9901-a61d55e2e70d", "tag": "8ae947b8-c972-44eb-a547-9e84edfdee53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:51.582416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d42b23aa-777b-478c-a2eb-54239d9ba951 req-e8851ff4-1cf9-43c5-a586-0597dd7bf893 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.583384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d42b23aa-777b-478c-a2eb-54239d9ba951 req-e8851ff4-1cf9-43c5-a586-0597dd7bf893 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.584037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d42b23aa-777b-478c-a2eb-54239d9ba951 req-e8851ff4-1cf9-43c5-a586-0597dd7bf893 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.599185 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d42b23aa-777b-478c-a2eb-54239d9ba951 req-e8851ff4-1cf9-43c5-a586-0597dd7bf893 service nova] Creating event network-changed:8ae947b8-c972-44eb-a547-9e84edfdee53 for instance fd399ffd-4151-4122-9901-a61d55e2e70d on n-h2-858383-10 Oct 12 08:47:51.605338 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d42b23aa-777b-478c-a2eb-54239d9ba951 req-e8851ff4-1cf9-43c5-a586-0597dd7bf893 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045754 Oct 12 08:47:51.606609 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 511/1065] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:51.650458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:51.651867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:51.658344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.658896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.659272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.659976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.660434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.660866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.692377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:51.747227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.756616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.758195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.763714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eceb0b09-01cc-4c3d-b5f7-63e3e472c78e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.117543 Oct 12 08:47:51.764810 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 512/1066] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:51 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:47:51.770143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:51.771021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:51.778020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.778701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.779288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.780151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:51.780301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.781247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:51.781881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:51.788054 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b34a5394-d869-46a7-9d77-adfa4a52a5bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.537983 Oct 12 08:47:51.788634 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 555/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:51 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:51.952133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:51.964458 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a781b5dd-8510-40a7-81c7-2810c94a49b4 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.198345 Oct 12 08:47:51.965305 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 513/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:51 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:52.060296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:52.061623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:52.068012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:52.068834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:52.069745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:52.070660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:52.071314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:52.071960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:52.208187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:52.223165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:52.225213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:52.231432 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df0390f7-8e12-4caf-a778-ff0474c65e9c tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1447 microversion: 2.75 time: 0.175045 Oct 12 08:47:52.232598 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 556/1069] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:52 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:52.532803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:52.533338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:52.540808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:52.541639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:52.542157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:52.542946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:52.543508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:52.544000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:52.709986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:52.719588 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-40eb59b3-ed3b-405a-9706-d53aa447d197 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1535 microversion: 2.1 time: 0.190754 Oct 12 08:47:52.725557 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 514/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:52 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1535 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:52.792747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:52.796205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:52.805283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:52.805813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:52.806262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:52.806997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:52.807474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:52.808083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:52.817634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:52.818438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:52.830343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:52.831731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:52.834038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:52.835398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:52.837572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:52.839005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:53.003978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.012385 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9db1e453-83e6-4309-8ecb-a8bf6c69cb42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.201636 Oct 12 08:47:53.012976 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 515/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:52 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:53.018183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:53.019118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:53.027031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:53.027851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:53.028508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:53.029481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:53.030000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:53.030622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:53.090466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.100144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.107178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.118698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5722ed4a-cbe1-4c9a-9992-7ae9ef83eec1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.327394 Oct 12 08:47:53.119390 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 557/1072] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:52 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:53.229555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.237860 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4b568cf8-7ae1-420e-8373-fcf83f6c9af9 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.223323 Oct 12 08:47:53.253787 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 516/1073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:53 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:53.262448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:53.263382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:53.273039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:53.273932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:53.275390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:53.276430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:53.277093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:53.277786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:53.390260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.407487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.408913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.416852 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dfe17cdd-7f4a-4315-bb4e-b967323f1476 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1453 microversion: 2.75 time: 0.158408 Oct 12 08:47:53.429500 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 558/1074] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:53 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:53.665666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-186a7552-f3fa-44f7-ae64-138cc47ce4ec req-9ba19e0e-964f-4326-80e3-89399405af17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1edd0a71-0c50-4935-8219-d14471f1ea58", "tag": "158b51b0-0d4a-4b31-baf5-01b3851b508f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:53.687371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-186a7552-f3fa-44f7-ae64-138cc47ce4ec req-9ba19e0e-964f-4326-80e3-89399405af17 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:53.690802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-186a7552-f3fa-44f7-ae64-138cc47ce4ec req-9ba19e0e-964f-4326-80e3-89399405af17 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:53.691632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-186a7552-f3fa-44f7-ae64-138cc47ce4ec req-9ba19e0e-964f-4326-80e3-89399405af17 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:53.708676 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-186a7552-f3fa-44f7-ae64-138cc47ce4ec req-9ba19e0e-964f-4326-80e3-89399405af17 service nova] Creating event network-changed:158b51b0-0d4a-4b31-baf5-01b3851b508f for instance 1edd0a71-0c50-4935-8219-d14471f1ea58 on n-h2-858383-10 Oct 12 08:47:53.713980 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-186a7552-f3fa-44f7-ae64-138cc47ce4ec req-9ba19e0e-964f-4326-80e3-89399405af17 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053810 Oct 12 08:47:53.715599 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 517/1075] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:53.745702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:53.746582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:53.753419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:53.754537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:53.755175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:53.756089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:53.756744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:53.757367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:53.986062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:53.995388 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d192fd0-5557-4998-84d6-a8257e258a2c tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1541 microversion: 2.1 time: 0.253650 Oct 12 08:47:53.996095 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 559/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:53 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1541 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:54.037299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:54.038031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:54.044442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:54.044919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:54.045561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:54.046261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:54.046708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:54.047311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:54.149750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:54.150815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:54.161356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:54.162968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:54.164662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:54.166404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:54.170777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:54.173233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:54.285095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:54.293858 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4e387b63-aeaf-4d96-a98f-edcad7249b80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.261163 Oct 12 08:47:54.295057 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 518/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:54 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:54.301850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:54.302219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:54.302987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:54.310692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:54.312406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:54.312544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:54.312903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:54.313337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:54.314092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:54.314710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:54.315133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:54.327876 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-723c4c30-f0b3-43f3-a406-b9bd673eede4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.183368 Oct 12 08:47:54.328470 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 560/1078] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:54 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:54.445618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:54.446979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:54.455701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:54.457012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:54.457670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:54.458697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:54.459334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:54.459755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:54.478696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:54.489023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-34caf1bc-61af-4947-8a98-99e6d5eb3bfd tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.192098 Oct 12 08:47:54.495812 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 519/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:54 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:54.592397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:54.634861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:54.637450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:54.643980 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f3e8b80-de28-45bb-899c-a699db90b3f0 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1453 microversion: 2.75 time: 0.202555 Oct 12 08:47:54.645125 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 561/1080] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:54 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:47:55.032129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:55.033555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:55.092115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.092665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.096644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.103635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.104154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.106959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.320457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:55.321766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:55.327838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:55.330861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=14 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:55.332547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.333210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.333849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.334742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.335353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.335942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.410231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.420310 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7074bc8d-3e51-46ce-bb1e-4d8344519a8b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1541 microversion: 2.1 time: 0.403164 Oct 12 08:47:55.420910 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 520/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:55 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1541 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:55.438098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:55.438098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:55.451800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.452310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.452748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.453508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.453939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.454614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.543335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.557636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.558821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.565334 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8957f75-1191-455d-8b9f-e17070a948b5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.143431 Oct 12 08:47:55.569490 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 521/1082] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:55 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:55.584295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:55.584994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:55.594036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.594654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.595102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.595814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.598566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.599341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.786374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.802257 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-736166a9-f350-46e7-98a2-b718f1580dfd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.486042 Oct 12 08:47:55.818910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.821902 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 562/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:55 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:55.829779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:55.830395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:55.839114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.839114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.839114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.839114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:55.839538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:55.839897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:55.845606 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2586f652-4e89-48f5-89b8-aed03335c8dc tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.277678 Oct 12 08:47:55.847698 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 522/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:55 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:55.946272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.972910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.979192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:55.988005 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0d6cacd3-159f-4cbe-b8c1-43f5fc86c497 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1438 microversion: 2.75 time: 0.163652 Oct 12 08:47:55.989348 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 563/1085] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:55 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1438 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:56.285003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:56.288333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:56.294947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.295504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.295937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:56.296636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.297151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.297611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:56.426012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:47:56.426437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:47:56.426914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:47:56.427316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:47:56.433125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:47:56.446036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:56.446637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:56.466968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.467519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.468131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:56.468949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.469649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.470255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:56.530226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:56.542672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.543207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.543647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:56.544925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.545401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.545992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:56.728694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:56.764132 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-670bed36-bfce-4998-8061-36664867787f tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3/action" status: 202 len: 1944 microversion: 2.75 time: 0.750633 Oct 12 08:47:56.774652 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 523/1086] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:47:56 2022] POST /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3/action => generated 1944 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 08:47:56.793929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:56.795067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:56.803071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.803567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.804107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:56.804877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.805392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.805896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:56.911706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:56.929478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:56.932994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:56.940852 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d525cbdb-2f9c-40b9-82b1-778f346f7a55 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.164840 Oct 12 08:47:56.945601 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 524/1087] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:56 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:56.978259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-134b881d-939a-4c49-8d84-dfa7a8e23778 req-c85145e2-169d-4d30-9b12-8072dfc1dfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e369824a-bd0d-4c88-a06f-219dabefea87", "name": "network-vif-plugged", "status": "completed", "tag": "2092f001-6c5d-4aa9-87b0-1e8e219b217d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:56.991564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-134b881d-939a-4c49-8d84-dfa7a8e23778 req-c85145e2-169d-4d30-9b12-8072dfc1dfac service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:56.992334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-134b881d-939a-4c49-8d84-dfa7a8e23778 req-c85145e2-169d-4d30-9b12-8072dfc1dfac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:56.993143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-134b881d-939a-4c49-8d84-dfa7a8e23778 req-c85145e2-169d-4d30-9b12-8072dfc1dfac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.023015 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-134b881d-939a-4c49-8d84-dfa7a8e23778 req-c85145e2-169d-4d30-9b12-8072dfc1dfac service nova] Creating event network-vif-plugged:2092f001-6c5d-4aa9-87b0-1e8e219b217d for instance e369824a-bd0d-4c88-a06f-219dabefea87 on n-h1-858383-10 Oct 12 08:47:57.030641 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-134b881d-939a-4c49-8d84-dfa7a8e23778 req-c85145e2-169d-4d30-9b12-8072dfc1dfac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082638 Oct 12 08:47:57.036888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 525/1088] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:57.043181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:57.044225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:57.056892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:57.059216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.060073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.061732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.062511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.062960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.063588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.142586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:57.150276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:57.171461 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a17ce1fc-fd68-4cae-9cf8-574f3d7157ac tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.132815 Oct 12 08:47:57.172331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 526/1089] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:57 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:57.174707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-01af5d47-fcb8-4896-86e4-0c22f78ba01a tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1523 microversion: 2.1 time: 0.732389 Oct 12 08:47:57.190305 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 564/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:56 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1523 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:57.193340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:57.197666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:57.204284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:57.205286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:57.208831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.209324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.211706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.213873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.214831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.215458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.218172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.218732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.219160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.222544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.223238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.226799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.273023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:57.455469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:57.469187 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1d28b045-66a1-4ab5-a996-8604e5b9a7aa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.295382 Oct 12 08:47:57.469539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:57.485740 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 527/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:57 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:57.485969 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-17109aeb-36a8-42f0-a283-787412d7a31c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.291313 Oct 12 08:47:57.486657 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 565/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:57 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:57.490799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:57.491532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:57.497492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.498351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.499008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.499959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.501137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.501823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.532049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:47:57.640527 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d8e6a86-a307-4d86-9555-9a5a089d0246 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 204 len: 0 microversion: 2.1 time: 0.152854 Oct 12 08:47:57.641514 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 528/1093] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:47:57 2022] DELETE /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:47:57.651385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:57.651768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:57.654723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:57.668053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.668549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.670832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.671817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.672436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.673029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.837037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:57.846234 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86f9f3ff-bb01-48a3-ae36-b3c517438e36 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1529 microversion: 2.1 time: 0.200399 Oct 12 08:47:57.847612 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 566/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:57 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1529 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:57.978591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:57.980166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:57.988038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.988631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.989150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:57.990395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:57.990953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:57.991455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:58.079793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:58.089036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:58.090510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:58.101908 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-660e3dab-4224-4c10-b9ce-d5cc094c3b14 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.128917 Oct 12 08:47:58.109863 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 529/1095] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:57 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:58.199561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:58.200369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:58.207874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:58.208158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:58.208654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:58.209293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:58.209786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:58.210211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:58.301008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:47:58.308302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:58.327827 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f0203c5-0871-4d38-8821-db3c77a8a175 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.132537 Oct 12 08:47:58.328780 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 567/1096] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:58 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:58.494552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:58.495958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:58.506097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:58.509057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:58.510189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:58.512647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:58.513348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:58.513888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:58.514472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:58.517080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:58.527777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:58.530110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:58.532373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:58.535134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:58.535854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:58.536977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:58.709535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:58.719284 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8f83bed-895e-410d-80c1-700c9254db11 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.230738 Oct 12 08:47:58.719795 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 530/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:58 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:58.809496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:58.818973 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95f10fc7-2d80-463a-a925-f129fb8bcbd0 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.310670 Oct 12 08:47:58.833465 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 568/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:58 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:58.872240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:58.872918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:58.878960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:58.879554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:58.880152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:58.880914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:58.881474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:58.881957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.046931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:59.052585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a180a05c-5f44-446e-a559-902338adabbe req-e2696e43-b118-4728-a017-3588028cbfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd399ffd-4151-4122-9901-a61d55e2e70d", "name": "network-vif-plugged", "status": "completed", "tag": "8ae947b8-c972-44eb-a547-9e84edfdee53"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:59.055994 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae0c6d76-9fef-4ce0-9d3a-13dce3e4d436 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1529 microversion: 2.1 time: 0.187964 Oct 12 08:47:59.056591 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 531/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:58 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1529 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:59.079528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a180a05c-5f44-446e-a559-902338adabbe req-e2696e43-b118-4728-a017-3588028cbfad service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.080478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a180a05c-5f44-446e-a559-902338adabbe req-e2696e43-b118-4728-a017-3588028cbfad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.081363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a180a05c-5f44-446e-a559-902338adabbe req-e2696e43-b118-4728-a017-3588028cbfad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.094763 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a180a05c-5f44-446e-a559-902338adabbe req-e2696e43-b118-4728-a017-3588028cbfad service nova] Creating event network-vif-plugged:8ae947b8-c972-44eb-a547-9e84edfdee53 for instance fd399ffd-4151-4122-9901-a61d55e2e70d on n-h2-858383-10 Oct 12 08:47:59.100408 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a180a05c-5f44-446e-a559-902338adabbe req-e2696e43-b118-4728-a017-3588028cbfad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054055 Oct 12 08:47:59.102734 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 569/1100] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:47:59.131081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.132092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:59.140980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.142012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.142609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.143804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.144412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.145024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.234626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:59.261551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:59.267927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:47:59.277354 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07dc7740-1b98-4e85-92a6-0cf715eb7be4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.150557 Oct 12 08:47:59.293608 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 532/1101] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:59 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:59.358580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.359616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:59.366405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.367144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.367812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.368733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.369388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.370079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.456127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:47:59.479792 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb4ba35f-0efd-420d-83cb-0e012fc91768 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.125101 Oct 12 08:47:59.489973 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 533/1102] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:47:59 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:47:59.547589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-249d23d5-e989-4727-abd4-9bef0806fef8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-205907764", "id": 225261434, "os-flavor-access:is_public": "True"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:59.571284 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-249d23d5-e989-4727-abd4-9bef0806fef8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.217343 Oct 12 08:47:59.572875 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 570/1103] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:47:59 2022] POST /compute/v2.1/flavors => generated 426 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:59.585126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e76ba82d-2a0e-4e35-b8f3-51d659f34de4 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.605201 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e76ba82d-2a0e-4e35-b8f3-51d659f34de4 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/225261434" status: 202 len: 0 microversion: 2.1 time: 0.023110 Oct 12 08:47:59.606304 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 534/1104] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:47:59 2022] DELETE /compute/v2.1/flavors/225261434 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:47:59.614199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f79206c0-902c-4dee-acf5-282051b28d2d tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.643519 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f79206c0-902c-4dee-acf5-282051b28d2d tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032984 Oct 12 08:47:59.644453 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 571/1105] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:47:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:47:59.665624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-acd51d92-6dd3-4970-b6e8-432293f720ab tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1266346251", "id": 31463328, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:47:59.686928 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-acd51d92-6dd3-4970-b6e8-432293f720ab tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.027761 Oct 12 08:47:59.700193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-baaa36d3-c17f-43ac-915f-8b6128785194 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.705740 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 535/1106] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:47:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:47:59.724933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-baaa36d3-c17f-43ac-915f-8b6128785194 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.028429 Oct 12 08:47:59.736658 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 572/1107] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:47:59 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:59.744146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.744447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:59.752417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa37aee6-c7d2-435c-a042-bb6982f51ca0 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.760482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.760979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.761418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.763495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.766993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.767163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.793405 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa37aee6-c7d2-435c-a042-bb6982f51ca0 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/31463328" status: 202 len: 0 microversion: 2.1 time: 0.044599 Oct 12 08:47:59.794345 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 573/1108] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 08:47:59 2022] DELETE /compute/v2.1/flavors/31463328 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:47:59.804686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d51cc1bc-d74e-4c9a-a556-0d900796221f tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.848119 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d51cc1bc-d74e-4c9a-a556-0d900796221f tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049548 Oct 12 08:47:59.849051 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 574/1109] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:47:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:47:59.866085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:47:59.866886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:47:59.875599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.876113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.876555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:47:59.877602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:47:59.878069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:47:59.879064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:00.096220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:00.111180 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dbcc9b61-d85e-4bf4-b1ff-0ef7aafa9085 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.371210 Oct 12 08:48:00.122062 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 536/1110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:59 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:00.132327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:00.137179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-953756cc-5b8d-43b4-9a26-78e4081d2137 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-617304422", "id": 433663096, "os-flavor-access:is_public": "True"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:00.149787 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac10ba7b-c4f7-4850-8d76-c18093249b14 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.299491 Oct 12 08:48:00.157096 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 575/1111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:47:59 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:00.165178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.166707 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-953756cc-5b8d-43b4-9a26-78e4081d2137 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.035122 Oct 12 08:48:00.169140 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 537/1112] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:00 2022] POST /compute/v2.1/flavors => generated 425 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:00.179003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:00.195862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe468f06-d902-40a0-b847-d6e3877e0e43 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.212966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:00.213882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:00.214670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:00.217269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:00.217991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:00.218601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:00.238859 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe468f06-d902-40a0-b847-d6e3877e0e43 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/433663096" status: 202 len: 0 microversion: 2.1 time: 0.056952 Oct 12 08:48:00.242021 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 538/1113] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:48:00 2022] DELETE /compute/v2.1/flavors/433663096 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:00.255633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a847330-73f2-4a42-8c79-0e9288a34aa4 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.305143 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a847330-73f2-4a42-8c79-0e9288a34aa4 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053135 Oct 12 08:48:00.307404 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 539/1114] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:00.312626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-38ffef72-ffd1-46df-9584-987cfe826a9c req-bb0d469c-7c7f-4b36-b0de-b8af5b59b0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e369824a-bd0d-4c88-a06f-219dabefea87", "name": "network-vif-deleted", "tag": "2092f001-6c5d-4aa9-87b0-1e8e219b217d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:00.325668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-38ffef72-ffd1-46df-9584-987cfe826a9c req-bb0d469c-7c7f-4b36-b0de-b8af5b59b0ed service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:00.326206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-38ffef72-ffd1-46df-9584-987cfe826a9c req-bb0d469c-7c7f-4b36-b0de-b8af5b59b0ed service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:00.330123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-38ffef72-ffd1-46df-9584-987cfe826a9c req-bb0d469c-7c7f-4b36-b0de-b8af5b59b0ed service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:00.344012 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-38ffef72-ffd1-46df-9584-987cfe826a9c req-bb0d469c-7c7f-4b36-b0de-b8af5b59b0ed service nova] Creating event network-vif-deleted:2092f001-6c5d-4aa9-87b0-1e8e219b217d for instance e369824a-bd0d-4c88-a06f-219dabefea87 on n-h1-858383-10 Oct 12 08:48:00.351623 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-38ffef72-ffd1-46df-9584-987cfe826a9c req-bb0d469c-7c7f-4b36-b0de-b8af5b59b0ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042773 Oct 12 08:48:00.355902 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 540/1115] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:00.363002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.363999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:00.372130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:00.372900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:00.373544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:00.374462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:00.375072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:00.375659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:00.394481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:00.406205 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df880431-674c-49c0-a52e-c50d8cd06ff6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 200 len: 1487 microversion: 2.1 time: 0.246869 Oct 12 08:48:00.406799 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 576/1116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 1487 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:00.422190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4a387a2-d099-4d48-9537-a7a49adbdea2 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1350469102", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:00.450750 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b4a387a2-d099-4d48-9537-a7a49adbdea2 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.042871 Oct 12 08:48:00.462889 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 577/1117] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:00 2022] POST /compute/v2.1/flavors => generated 507 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:00.469907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84c77803-c20e-42cc-a8d8-0083de7ed0c8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.496849 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-84c77803-c20e-42cc-a8d8-0083de7ed0c8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/4d44b117-6d44-42ab-94dd-3e111dc04f37" status: 202 len: 0 microversion: 2.1 time: 0.032427 Oct 12 08:48:00.497766 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 578/1118] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:48:00 2022] DELETE /compute/v2.1/flavors/4d44b117-6d44-42ab-94dd-3e111dc04f37 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:00.506462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a74423d-bfce-4a8c-af0c-7b40be0367f0 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.524225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:00.532734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:00.534441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:00.540618 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a8c5d22-ca6f-45c4-802b-20d1c0acb02b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.183244 Oct 12 08:48:00.549498 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a74423d-bfce-4a8c-af0c-7b40be0367f0 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038660 Oct 12 08:48:00.550016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 541/1119] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:00.550016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.550016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:00.551453 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 579/1120] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:00.572902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:00.573203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:00.573798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:00.574558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:00.575405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:00.575864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:00.583989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a5a0c26-ed76-4cc6-b03b-8c0a9805c6b7 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1495036101", "id": "7c89c6b2-3219-46b2-8921-7bba92bb5d89", "os-flavor-access:is_public": "True"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:00.634011 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a5a0c26-ed76-4cc6-b03b-8c0a9805c6b7 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.054241 Oct 12 08:48:00.638020 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 580/1121] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:00 2022] POST /compute/v2.1/flavors => generated 507 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:48:00.647301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1875303a-1008-44bf-adac-70000282e22e tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.668624 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1875303a-1008-44bf-adac-70000282e22e tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/7c89c6b2-3219-46b2-8921-7bba92bb5d89" status: 202 len: 0 microversion: 2.1 time: 0.024909 Oct 12 08:48:00.670226 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 581/1122] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:48:00 2022] DELETE /compute/v2.1/flavors/7c89c6b2-3219-46b2-8921-7bba92bb5d89 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:48:00.687241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-375279e9-e768-43e7-afbd-d6db6bd0851a tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.717895 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-375279e9-e768-43e7-afbd-d6db6bd0851a tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042756 Oct 12 08:48:00.719907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:00.720422 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 582/1123] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:00.737700 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad71a4ac-3e8d-4504-be48-3d1e5ab052c6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.194849 Oct 12 08:48:00.738598 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 542/1124] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:00.738748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc25fedf-f3dc-45c0-9bf5-2c272725187d tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1831168981", "id": 1230693152, "os-flavor-access:is_public": "True"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:00.768557 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc25fedf-f3dc-45c0-9bf5-2c272725187d tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.034473 Oct 12 08:48:00.769148 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 583/1125] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:00 2022] POST /compute/v2.1/flavors => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:00.781501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a4491c4-3216-4487-95a9-bf025ec349a9 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.789723 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a4491c4-3216-4487-95a9-bf025ec349a9 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1230693152" status: 200 len: 414 microversion: 2.1 time: 0.011820 Oct 12 08:48:00.790308 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 543/1126] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/flavors/1230693152 => generated 414 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:00.912375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03712ea6-f097-4491-a30d-075492664c51 tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.934123 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-03712ea6-f097-4491-a30d-075492664c51 tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.135180 Oct 12 08:48:00.935172 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 584/1127] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:00.953521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b418fae-b093-4f92-b190-bf191363dd20 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:00.974307 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b418fae-b093-4f92-b190-bf191363dd20 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1230693152" status: 202 len: 0 microversion: 2.1 time: 0.024473 Oct 12 08:48:00.974899 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 544/1128] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:48:00 2022] DELETE /compute/v2.1/flavors/1230693152 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:00.984155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b49eecec-fad4-4811-8c8d-2dc16fc427d8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.007011 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b49eecec-fad4-4811-8c8d-2dc16fc427d8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027587 Oct 12 08:48:01.008041 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 585/1129] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:01.027689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-22b79eb9-7961-41e7-82ee-e244b341e324 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-405126015", "id": 1649745124, "os-flavor-access:is_public": "False"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:01.048542 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-22b79eb9-7961-41e7-82ee-e244b341e324 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.024732 Oct 12 08:48:01.053491 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 545/1130] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:01 2022] POST /compute/v2.1/flavors => generated 429 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:01.063823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28227daf-c1a8-4efb-9ba9-fc77572c52c5 tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "1649745124"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:01.077961 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-28227daf-c1a8-4efb-9ba9-fc77572c52c5 tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] HTTP exception thrown: Flavor 1649745124 could not be found. Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28227daf-c1a8-4efb-9ba9-fc77572c52c5 tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] Request method failure captured: Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 107 Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn8-0ItkXLFGdfSn7WuUv8_UcAhbjNFMtNQLQrU5-L6XVCEhZ_U9dAoL2g_ZDrExAGlKUrp5607A50cI47c1wB4tPaKlhNdYuRnFYRCVcJ7fCHHrJJc8CqdVZAQfbfBOA_ZxG3Y5e7mECUX6wczAlAjhyKtPG6UadEsU59T3Cdsgkys Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8a837b406bcf42b397d7cb88256b3ce1 Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsAdminTestJSON-1456671059 Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:01.080517 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a837b406bcf42b397d7cb88256b3ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a837b406bcf42b397d7cb88256b3ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a837b406bcf42b397d7cb88256b3ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a837b406bcf42b397d7cb88256b3ce1"}]}] Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsAdminTestJSON-1456671059 Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8a837b406bcf42b397d7cb88256b3ce1 Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1456671059 Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsAdminTestJSON-1456671059-project Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 2c9bbfc0d78e4df09bd4d932e89f7dcc Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsAdminTestJSON-1456671059-project Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "test", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "1649745124"}} Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:48:01.081926 n-d-858383-10 devstack@n-api.service[127006]: exception: Flavor 1649745124 could not be found. Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '1649745124'}}} Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1649745124 could not be found. Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.083366 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1649745124 could not be found. Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:01.084836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:01.088258 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:01.088258 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:01.088258 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:01.088258 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1649745124 could not be found. Oct 12 08:48:01.088258 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.088258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28227daf-c1a8-4efb-9ba9-fc77572c52c5 tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] Returning 400 to user: Flavor 1649745124 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:01.088258 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-28227daf-c1a8-4efb-9ba9-fc77572c52c5 tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.024035 Oct 12 08:48:01.088258 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 586/1131] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:01 2022] POST /compute/v2.1/servers => generated 81 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:48:01.091418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d308db1c-45ae-42ca-816a-59d8dcc08d6f tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.120360 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d308db1c-45ae-42ca-816a-59d8dcc08d6f tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1649745124" status: 202 len: 0 microversion: 2.1 time: 0.033099 Oct 12 08:48:01.122189 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 546/1132] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:48:01 2022] DELETE /compute/v2.1/flavors/1649745124 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:01.128020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c126e05e-934c-4a19-a3e0-5381625ca033 req-f5324793-6b17-4a5a-842c-eb0d25f668ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1edd0a71-0c50-4935-8219-d14471f1ea58", "name": "network-vif-plugged", "status": "completed", "tag": "158b51b0-0d4a-4b31-baf5-01b3851b508f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:01.129981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4b2400e-8095-4d0f-ae40-23e1be261522 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.152846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c126e05e-934c-4a19-a3e0-5381625ca033 req-f5324793-6b17-4a5a-842c-eb0d25f668ce service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.158874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c126e05e-934c-4a19-a3e0-5381625ca033 req-f5324793-6b17-4a5a-842c-eb0d25f668ce service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.159499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c126e05e-934c-4a19-a3e0-5381625ca033 req-f5324793-6b17-4a5a-842c-eb0d25f668ce service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.163303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4b2400e-8095-4d0f-ae40-23e1be261522 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037283 Oct 12 08:48:01.165094 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 547/1133] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:01.169711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.170392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:01.202317 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c126e05e-934c-4a19-a3e0-5381625ca033 req-f5324793-6b17-4a5a-842c-eb0d25f668ce service nova] Creating event network-vif-plugged:158b51b0-0d4a-4b31-baf5-01b3851b508f for instance 1edd0a71-0c50-4935-8219-d14471f1ea58 on n-h2-858383-10 Oct 12 08:48:01.202741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.203340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.203793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.204558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.205184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.205807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.209048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c126e05e-934c-4a19-a3e0-5381625ca033 req-f5324793-6b17-4a5a-842c-eb0d25f668ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089459 Oct 12 08:48:01.210317 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 587/1134] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:48:01.229822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.232433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:01.248211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.249723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.250431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.251850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.252855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.253591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.389378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:01.399185 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-487d9e90-4153-4014-b274-7a5d63be88ff tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.233332 Oct 12 08:48:01.428145 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 548/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:01 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:01.446171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-72310a69-c9ff-40dd-b895-1776739b1150 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2109770222", "id": 1153582552, "os-flavor-access:is_public": "False"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:01.477641 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-72310a69-c9ff-40dd-b895-1776739b1150 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.047346 Oct 12 08:48:01.479104 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 549/1136] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:01 2022] POST /compute/v2.1/flavors => generated 415 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:01.495420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.496850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:01.504485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.505349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.506163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.507113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.507790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.509971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.528826 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 HTTP/1.1 Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:48:01.531933 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:48:01.533399 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e369824a-bd0d-4c88-a06f-219dabefea87'} Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:01.534743 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:48:01.536087 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:01.540412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:01.541767 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6fb62671-f23a-47c9-b325-525919e2c765 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 404 len: 111 microversion: 2.1 time: 0.061156 Oct 12 08:48:01.542873 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 550/1137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:01 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:01.548549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1db65433-8789-4e46-9d30-6837863b94fb tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1615568497", "id": 1790612792, "os-flavor-access:is_public": "True"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:01.577210 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1db65433-8789-4e46-9d30-6837863b94fb tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.032848 Oct 12 08:48:01.578364 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 551/1138] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:01 2022] POST /compute/v2.1/flavors => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:01.585509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a77ca1b8-190e-4bb5-b89b-1c3aacfcae54 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'create', calling method: .version_select at 0x7f9848afe550>, body: {"keypair": {"name": "tempest-keypair-934976847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfAIXc4m4vN4qXv4VH7gW7UoyPH1dUiEMQoUotMy/Q2B03g0ysygKgskYJ6fBKO/R2Cud9/GC2qtDqyuz6VuuQ0xf1qHNnuwfX1jhpdQwREgf5Y9AuCh+mob+9OlYV4lw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:01.593011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=12,nova_api:INSERT=5 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:01.614093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a77ca1b8-190e-4bb5-b89b-1c3aacfcae54 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Getting quotas for project 9c9affaa3c854de0919bb5fd833a92fd. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:48:01.620690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a77ca1b8-190e-4bb5-b89b-1c3aacfcae54 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Getting quotas for user 288742d71ac1442a9bae776c2296935d and project 9c9affaa3c854de0919bb5fd833a92fd. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:48:01.651122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a77ca1b8-190e-4bb5-b89b-1c3aacfcae54 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070841 Oct 12 08:48:01.651881 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 552/1139] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:48:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:01.676330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.677212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:01.696949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.699539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.701514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.713867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.715476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.716854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.747916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:01.757145 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3627e3a-5430-4c1d-ae76-cb34c215e3c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.545509 Oct 12 08:48:01.761116 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 588/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:01 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:01.778090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-abaa838c-4509-4470-987f-b45ddcf140f8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.816694 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-abaa838c-4509-4470-987f-b45ddcf140f8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.054182 Oct 12 08:48:01.818334 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 589/1141] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 12 08:48:01 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:01.840303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.840930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:01.847821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.848311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.848748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.849473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.860539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.861071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.884605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:01.899542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:01.905757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:01.919384 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24d39a6d-3647-4a86-bf17-f62ac6f3d667 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.264598 Oct 12 08:48:01.921431 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 553/1142] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:01 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:01.930105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:01.931172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:01.947142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.950070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.950535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:01.951286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:01.951758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:01.952185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:02.161903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:02.177144 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6925cb81-ee8c-4a39-ac11-5ea713dc6602 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 2344 microversion: 2.25 time: 0.254064 Oct 12 08:48:02.189912 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 554/1143] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:01 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 2344 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:02.204154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20570a4b-dc08-424e-87ce-eda5482cbe7b tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.234948 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20570a4b-dc08-424e-87ce-eda5482cbe7b tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.043632 Oct 12 08:48:02.243803 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 555/1144] 10.222.0.40 () {58 vars in 1177 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:02.248538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eaa70b6f-ba9e-4165-9fd9-74df8b4c387a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.253278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaa70b6f-ba9e-4165-9fd9-74df8b4c387a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:02.253278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaa70b6f-ba9e-4165-9fd9-74df8b4c387a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:02.253278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaa70b6f-ba9e-4165-9fd9-74df8b4c387a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:02.253669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaa70b6f-ba9e-4165-9fd9-74df8b4c387a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:02.254138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaa70b6f-ba9e-4165-9fd9-74df8b4c387a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:02.254552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaa70b6f-ba9e-4165-9fd9-74df8b4c387a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:02.281894 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eaa70b6f-ba9e-4165-9fd9-74df8b4c387a tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.037233 Oct 12 08:48:02.286877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:02.290050 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 556/1145] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:48:02.307781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aeb1571a-c5cc-41d4-a0e3-62efe4613fd1 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.326891 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aeb1571a-c5cc-41d4-a0e3-62efe4613fd1 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.035385 Oct 12 08:48:02.327381 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 557/1146] 10.222.0.40 () {58 vars in 1171 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:02.331760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e083e8b6-8fab-4973-bd29-3c955881fcf9 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.508212 Oct 12 08:48:02.336308 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 590/1147] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:01 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:02.363741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f07ba64-3c96-4028-9b40-1d3fcd045e1d tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.385448 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f07ba64-3c96-4028-9b40-1d3fcd045e1d tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.033839 Oct 12 08:48:02.395367 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 558/1148] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:02.401030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d6d0472-e6a7-441e-9336-9e2fa62f9fa8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.429548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.430160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:02.438619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d6d0472-e6a7-441e-9336-9e2fa62f9fa8 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.042706 Oct 12 08:48:02.442013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:02.442486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:02.443237 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 591/1149] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:02.447759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:02.451995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:02.452744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:02.453397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:02.460666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc5f45ef-4a3c-4fdd-bbcd-30434cfd78b6 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.496974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:02.508189 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc5f45ef-4a3c-4fdd-bbcd-30434cfd78b6 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.051040 Oct 12 08:48:02.522204 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 592/1150] 10.222.0.40 () {58 vars in 1175 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:02.539217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d705aa67-c0c7-4cf7-87e4-43c814d4f6f3 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.566819 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d705aa67-c0c7-4cf7-87e4-43c814d4f6f3 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.039594 Oct 12 08:48:02.574259 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 593/1151] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:02.593274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63b371a1-a194-47be-b522-9aaf38e59af1 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.619951 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-63b371a1-a194-47be-b522-9aaf38e59af1 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.037502 Oct 12 08:48:02.622557 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 594/1152] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:02.643487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46c2391f-ec42-41bd-9baa-109b0916d5c4 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.668733 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-46c2391f-ec42-41bd-9baa-109b0916d5c4 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1790612792" status: 202 len: 0 microversion: 2.1 time: 0.030988 Oct 12 08:48:02.669818 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 595/1153] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:48:02 2022] DELETE /compute/v2.1/flavors/1790612792 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:48:02.679209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc2d2dbc-cf3b-4edf-a870-3913df41a6dd tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.710262 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc2d2dbc-cf3b-4edf-a870-3913df41a6dd tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035360 Oct 12 08:48:02.711535 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 596/1154] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:02.731378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-91623945-355e-45ea-9e5f-8ea87b71e68c tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.753183 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-91623945-355e-45ea-9e5f-8ea87b71e68c tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1153582552" status: 202 len: 0 microversion: 2.1 time: 0.026992 Oct 12 08:48:02.757786 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 597/1155] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:48:02 2022] DELETE /compute/v2.1/flavors/1153582552 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:48:02.771625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57818cbe-a7d0-4c54-bc35-619ffa6a620a tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.812319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:DELETE=15 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:02.830926 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57818cbe-a7d0-4c54-bc35-619ffa6a620a tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064579 Oct 12 08:48:02.845794 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 598/1156] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:02.845927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:02.853503 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-feb48f0a-95bd-454f-8d08-a97392995f42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.424193 Oct 12 08:48:02.853503 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 559/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:02.866141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.866655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17a86415-26b4-4d10-9cab-91bb9bbc8fb9 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1347860128", "id": 1380939369, "os-flavor-access:is_public": "False"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:02.869665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:02.881468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:02.882871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:02.882871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:02.883868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:02.884466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:02.885020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:02.894293 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-17a86415-26b4-4d10-9cab-91bb9bbc8fb9 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.041527 Oct 12 08:48:02.903490 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 560/1158] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:02 2022] POST /compute/v2.1/flavors => generated 415 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:48:02.909094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-edfe1b25-47cb-40c6-9cf2-9359cfbd289b tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.958803 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-edfe1b25-47cb-40c6-9cf2-9359cfbd289b tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053782 Oct 12 08:48:02.968041 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 561/1159] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:02.973097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:02.973933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:02.988366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:02.988985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:02.989426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:02.991360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:02.991878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:02.992366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:03.193683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:03.207743 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f4f99773-5418-4e6b-9e40-3bb29b97aca8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.371422 Oct 12 08:48:03.208494 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 599/1160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:03.238416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c73a7bf4-0cbc-461b-976e-161006da16ba tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:03.295441 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c73a7bf4-0cbc-461b-976e-161006da16ba tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082206 Oct 12 08:48:03.297643 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 600/1161] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:03.343863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-58079c12-bcfc-4012-9cd6-bf9ce77cb086 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:03.402036 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-58079c12-bcfc-4012-9cd6-bf9ce77cb086 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1380939369" status: 202 len: 0 microversion: 2.1 time: 0.083185 Oct 12 08:48:03.406525 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 601/1162] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:48:03 2022] DELETE /compute/v2.1/flavors/1380939369 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:03.412200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:03.413063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:03.419697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:03.420200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:03.420648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:03.421366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:03.421984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:03.422418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:03.578630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:03.637789 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-091d63e2-76fb-4fa9-b415-9167e144c8eb tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.229271 Oct 12 08:48:03.653637 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 602/1163] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:03 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:03.664129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e84ef1a9-1ef1-497b-934e-4a548cda9452 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:03.693628 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e84ef1a9-1ef1-497b-934e-4a548cda9452 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038452 Oct 12 08:48:03.694820 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 603/1164] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:03.713800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-15c3ab1a-96b0-4eeb-9de1-f621396651bf tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1682584512", "id": 1446456372, "os-flavor-access:is_public": "True"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:03.744140 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-15c3ab1a-96b0-4eeb-9de1-f621396651bf tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.034143 Oct 12 08:48:03.751809 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 604/1165] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:48:03.758728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5e9ada1-5d86-429e-acbd-bf1a500de8bf tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:03.766605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:03.782553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:03.786748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:03.800967 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-315f4768-d99f-412f-b3fc-659b019ea9ae tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.830922 Oct 12 08:48:03.810149 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 562/1166] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:02 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:03.819872 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a5e9ada1-5d86-429e-acbd-bf1a500de8bf tempest-FlavorsAdminTestJSON-1456671059 tempest-FlavorsAdminTestJSON-1456671059-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.066256 Oct 12 08:48:03.827456 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 605/1167] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:03 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:03.849938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-798918d5-c08c-4d01-95d9-ee1e588efd34 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:03.880464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:03.881669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:03.883596 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-798918d5-c08c-4d01-95d9-ee1e588efd34 tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1446456372" status: 202 len: 0 microversion: 2.1 time: 0.039152 Oct 12 08:48:03.884996 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 563/1168] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 08:48:03 2022] DELETE /compute/v2.1/flavors/1446456372 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:03.888593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:03.897202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:03.897202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:03.903030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:03.903608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:03.903965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:03.910083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7571dc1e-867f-455a-8a84-51ac17f6699c tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:03.957776 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7571dc1e-867f-455a-8a84-51ac17f6699c tempest-FlavorsAdminTestJSON-291256179 tempest-FlavorsAdminTestJSON-291256179-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066206 Oct 12 08:48:03.958393 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 564/1169] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:04.231045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:04.231706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:04.243872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:04.244188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:04.244706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:04.245506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:04.245974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:04.246412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:04.366060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:04.374050 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0fe7d83d-f429-4727-8d52-a078feec3d6a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.498824 Oct 12 08:48:04.374573 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 606/1170] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:03 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:04.582957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:04.590887 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7fef03f8-987c-4612-9972-d48ed9ebb9b1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1467 microversion: 2.1 time: 0.364004 Oct 12 08:48:04.591474 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 565/1171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:04 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1467 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:04.616179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:04.617166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:04.628493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:04.629810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:04.633482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:04.634475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:04.635185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:04.635789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:04.669142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:04.671862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:04.690479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:04.691009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:04.691459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:04.692738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:04.693194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:04.694019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:04.879865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:04.929694 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9627ad94-00df-4a27-8bc0-aa8df5e0250a tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.262274 Oct 12 08:48:04.942412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 566/1172] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:04 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:04.958243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:04.968819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:04.969465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:04.978240 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d11105aa-9549-46b8-bb7d-50206bf3db22 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d" status: 200 len: 1467 microversion: 2.1 time: 0.364594 Oct 12 08:48:04.979255 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 607/1173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:04 2022] GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d => generated 1467 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:04.983129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:04.983633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:04.984077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:04.984794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:04.985255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:04.985712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:05.003326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1783058795"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:05.006184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:05.024149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:05.026442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:05.028786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:05.029774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:05.031857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:05.032548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:05.156518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:05.177017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:05.180880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:05.189219 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9a553560-be13-4a48-80d5-093862b82ec4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.245484 Oct 12 08:48:05.201462 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 567/1174] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:04 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:05.211630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1807401174", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:05.320026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] validate_networks() for [('b0bf0094-60cb-403a-9910-1ada4bf97663', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:48:05.593479 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc317b08-6468-40aa-a0da-58199ffe1a54 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "POST /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d/action" status: 202 len: 0 microversion: 2.1 time: 0.593612 Oct 12 08:48:05.598418 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 608/1175] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:04 2022] POST /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:48:06.047537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:48:06.048073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:48:06.048563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:48:06.048972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:48:06.049657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:48:06.070779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.071489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.072122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.073118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.073745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.074549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.094163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Getting quotas for project 9c9affaa3c854de0919bb5fd833a92fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:48:06.095716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1547530159", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "652a0de1-a1df-488c-aa38-7adfe77106a2"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:06.098351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Getting quotas for user 288742d71ac1442a9bae776c2296935d and project 9c9affaa3c854de0919bb5fd833a92fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:48:06.109904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:48:06.113090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:48:06.192845 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5366f6e9-2b49-4943-86e3-f0d254f57f7e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.000805 Oct 12 08:48:06.194090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 568/1176] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:48:06.199025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:06.199859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:06.201997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] validate_networks() for [('652a0de1-a1df-488c-aa38-7adfe77106a2', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:48:06.206784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.207546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.208324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.209207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.209860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.210465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.382652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:06.395262 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ba76819-0e60-4278-8a39-5d45ba289e75 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.199823 Oct 12 08:48:06.395778 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 569/1177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:06 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:06.426988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-969c43d1-6474-4cb8-86ae-5ecf08c6f8a8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98489b95e0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:06.500620 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-969c43d1-6474-4cb8-86ae-5ecf08c6f8a8 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d" status: 200 len: 1453 microversion: 2.1 time: 0.089105 Oct 12 08:48:06.501322 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 570/1178] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:06 2022] GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:06.512877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:06.517586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:06.538202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.540547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.544188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.546222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.550460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.554070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.681262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:06.733162 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3da69d2-0fee-4a01-a42b-5f55a6a0f652 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.230751 Oct 12 08:48:06.753484 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 571/1179] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:06 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:06.753484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-93808132-11c1-4667-9803-96c1a555668e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:06.753484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-93808132-11c1-4667-9803-96c1a555668e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:06.769174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:48:06.771003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:48:06.771491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:48:06.771901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:48:06.772618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:48:06.792756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.793345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.806638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.807536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.808022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.809997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.847083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-93808132-11c1-4667-9803-96c1a555668e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:06.855285 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-93808132-11c1-4667-9803-96c1a555668e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1225 microversion: 2.1 time: 0.113966 Oct 12 08:48:06.867734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Getting quotas for project 6730ea24a78f4ee0ac1bd784286e0c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:48:06.872508 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 572/1180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:06 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:06.878165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:06.878708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:06.886689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Getting quotas for user 7026dc1487554cdf8ef2b31fe14ef0a3 and project 6730ea24a78f4ee0ac1bd784286e0c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:48:06.890551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.890865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.891237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.891949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:06.892586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:06.893067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:06.922157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:48:06.924231 n-d-858383-10 devstack@n-api.service[127006]: WARNING nova.utils [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1547530159 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-154753015 Oct 12 08:48:06.927148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:48:06.996597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:06.997248 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0c5cc1da-b4f0-4fc8-993c-18ed7685ca95 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.397542 Oct 12 08:48:06.998647 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 609/1181] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:48:07.003831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "232127e6-d624-4d60-baf5-c933e472ae7c", "device": "/dev/xvdb"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:07.009566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:07.019439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:07.020222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:07.021046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:07.021899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:07.022966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:07.023567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:07.024137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:07.026502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:07.034100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4b71fc0d-fbab-4eeb-8e4d-72efa257a3bd tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.160264 Oct 12 08:48:07.037602 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 573/1182] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:06 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:07.067951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ed0b609-9838-49c4-beaf-93925a945bc6 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:07.068608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ed0b609-9838-49c4-beaf-93925a945bc6 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:07.154227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ed0b609-9838-49c4-beaf-93925a945bc6 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:07.163603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ed0b609-9838-49c4-beaf-93925a945bc6 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1232 microversion: 2.1 time: 0.123881 Oct 12 08:48:07.165785 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 574/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:07 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1232 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:07.421904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:07.422834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:07.443085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:07.444520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:07.445023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:07.445962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:07.447429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:07.447989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:07.626525 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f834ad7a-040f-45b8-a0be-1bb502846f3e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "POST /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.626425 Oct 12 08:48:07.628849 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 610/1184] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Oct 12 08:48:06 2022] POST /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments => generated 194 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:48:07.640804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59e24468-4513-45a1-8471-3ac4abbb1111 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98489541f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:07.708013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:07.719236 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0db1533e-b066-4edc-a3da-bb58bd9f88d6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.301092 Oct 12 08:48:07.721966 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 575/1185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:07 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:07.745307 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59e24468-4513-45a1-8471-3ac4abbb1111 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d" status: 200 len: 1453 microversion: 2.1 time: 0.114997 Oct 12 08:48:07.753207 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 611/1186] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:07 2022] GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:07.768343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:07.769046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:07.775400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:07.776016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:07.776877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:07.777711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:07.778286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:07.778775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:07.880439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:07.881168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:07.896019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:07.896515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:07.896953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:07.897688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:07.898320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:07.898754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:07.900427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:07.933633 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac9ca9b9-83d2-49f6-8f90-0af8896bb128 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.168602 Oct 12 08:48:07.934200 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 576/1187] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:07 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:07.973821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:07.976157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:07.984500 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d7801b4c-b5c6-46f9-a89d-753df74e9b43 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1277 microversion: 2.1 time: 0.108153 Oct 12 08:48:07.985621 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 612/1188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:07 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:08.067284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:08.068537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:08.073723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:08.087215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:08.088652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:08.089783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:08.090757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:08.091627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:08.093657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:08.190780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:08.191494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:08.204988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:08.207508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:08.208041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:08.209996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:08.211908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:08.213352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:08.222791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:08.233818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:08.235426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:08.241871 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9b129f3-2fe5-471e-9489-3365758014c6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.179768 Oct 12 08:48:08.259527 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 577/1189] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:08 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:48:08.325210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:08.336041 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73d528f3-c46f-4e1c-ac87-5645a359c250 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1228 microversion: 2.1 time: 0.150956 Oct 12 08:48:08.350077 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 613/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:08 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1228 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:08.753476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:08.758623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:08.767698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f1182b2f-3484-421e-80b1-3497ccb7f988 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984889caf0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:08.776108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:08.780377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:08.792611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:08.795424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:08.799649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:08.802892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:08.845428 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f1182b2f-3484-421e-80b1-3497ccb7f988 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d" status: 200 len: 1453 microversion: 2.1 time: 0.088310 Oct 12 08:48:08.853572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 614/1191] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:08 2022] GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:08.963950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:08.964666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:08.975634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:08.978751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:08.983615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:08.990181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:08.990979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:08.991633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:09.158769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:09.205751 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e71ba721-3a7c-474d-9d96-0858c293f8b5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.246553 Oct 12 08:48:09.206449 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 615/1192] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:08 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:09.222031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:09.226381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:09.243410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:09.243913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:09.244400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:09.245124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:09.245615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:09.246046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:09.441039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:09.455010 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aceb9f25-d03d-49db-93fb-7bd28461bbfe tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1542 microversion: 2.1 time: 0.712714 Oct 12 08:48:09.455950 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 578/1193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:08 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1542 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:09.460800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:09.461367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:09.480534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:09.481312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:09.482002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:09.482924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:09.483566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:09.484172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:09.488683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:09.498667 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6821c1ef-7478-424f-9573-0008da8ab63d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.291048 Oct 12 08:48:09.499804 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 616/1194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:09 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:09.799371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:09.801033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-82341c06-2faf-445f-b169-eab1727812ca tempest-FlavorMetadataValidation-809416485 tempest-FlavorMetadataValidation-809416485-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1280599634", "id": 90778796, "os-flavor-access:is_public": "True"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:09.812444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:09.813926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:09.851523 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5cf30592-75d6-45d0-affe-28d1b78b86e7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.394474 Oct 12 08:48:09.878528 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-82341c06-2faf-445f-b169-eab1727812ca tempest-FlavorMetadataValidation-809416485 tempest-FlavorMetadataValidation-809416485-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.86 time: 0.375872 Oct 12 08:48:09.879388 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 617/1195] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:48:09 2022] POST /compute/v2.1/flavors => generated 465 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:48:09.897541 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 579/1196] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:09 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:09.903554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:09.904612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:09.906547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-416e638f-2bbf-4fa3-af51-469e3cb53a19 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98489e1ee0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:09.940534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:09.942373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:09.942999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:09.945136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:09.947080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:09.947788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:10.002224 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-416e638f-2bbf-4fa3-af51-469e3cb53a19 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d" status: 200 len: 1453 microversion: 2.1 time: 0.103388 Oct 12 08:48:10.003576 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 580/1197] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:09 2022] GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:10.014197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8330a5cd-974d-4a52-8e0f-c8d5b2ca2a6d tempest-FlavorMetadataValidation-809416485 tempest-FlavorMetadataValidation-809416485-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:10.080578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:10.089980 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6f77ca82-7e83-4861-a325-36c1f52f0798 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1290 microversion: 2.1 time: 0.206275 Oct 12 08:48:10.116093 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 618/1198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:09 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1290 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:10.253169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:10.254559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:10.265791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:10.270448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:10.273138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:10.274232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:10.275110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:10.280217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:10.506951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:10.507920 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8330a5cd-974d-4a52-8e0f-c8d5b2ca2a6d tempest-FlavorMetadataValidation-809416485 tempest-FlavorMetadataValidation-809416485-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/90778796/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.502982 Oct 12 08:48:10.508546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 581/1199] 10.222.0.40 () {62 vars in 1259 bytes} [Wed Oct 12 08:48:10 2022] POST /compute/v2.1/flavors/90778796/os-extra_specs => generated 62 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:10.519379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:10.520010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:10.534746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:10.535430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:10.536064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:10.537098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:10.538459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:10.541906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:10.572935 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e7595a3-0103-409f-a2c1-7d089eb4e30e tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.323665 Oct 12 08:48:10.576610 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 619/1200] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:10 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:10.582580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-65f4e1ce-cc94-4a4b-9111-90dee54c568b tempest-FlavorMetadataValidation-809416485 tempest-FlavorMetadataValidation-809416485-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:10.630413 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-65f4e1ce-cc94-4a4b-9111-90dee54c568b tempest-FlavorMetadataValidation-809416485 tempest-FlavorMetadataValidation-809416485-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/90778796" status: 202 len: 0 microversion: 2.86 time: 0.051790 Oct 12 08:48:10.631119 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 620/1201] 10.222.0.40 () {60 vars in 1196 bytes} [Wed Oct 12 08:48:10 2022] DELETE /compute/v2.1/flavors/90778796 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:48:10.646472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:10.647707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:10.669869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:10.670605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:10.672715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:10.675010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:10.675597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:10.676099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:10.813515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:10.823282 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-16ae5645-9106-4cea-984b-93358accfcbd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1541 microversion: 2.1 time: 0.313152 Oct 12 08:48:10.830454 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 582/1202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:10 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1541 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:10.846590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ed2b5fd-bc8a-4b71-b0c2-3ff4fcf352e4 tempest-FlavorMetadataValidation-809416485 tempest-FlavorMetadataValidation-809416485-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:10.924518 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ed2b5fd-bc8a-4b71-b0c2-3ff4fcf352e4 tempest-FlavorMetadataValidation-809416485 tempest-FlavorMetadataValidation-809416485-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.092435 Oct 12 08:48:10.930692 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 583/1203] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 12 08:48:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:10.967914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-adb2da07-3f8f-49a7-a331-a924d166bd94 req-521ca451-7bc6-4532-a5dc-1db8fb1a8813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd399ffd-4151-4122-9901-a61d55e2e70d", "name": "network-vif-plugged", "status": "completed", "tag": "8ae947b8-c972-44eb-a547-9e84edfdee53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:11.023530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-adb2da07-3f8f-49a7-a331-a924d166bd94 req-521ca451-7bc6-4532-a5dc-1db8fb1a8813 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.026666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-adb2da07-3f8f-49a7-a331-a924d166bd94 req-521ca451-7bc6-4532-a5dc-1db8fb1a8813 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.027216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-adb2da07-3f8f-49a7-a331-a924d166bd94 req-521ca451-7bc6-4532-a5dc-1db8fb1a8813 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.058828 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-adb2da07-3f8f-49a7-a331-a924d166bd94 req-521ca451-7bc6-4532-a5dc-1db8fb1a8813 service nova] Creating event network-vif-plugged:8ae947b8-c972-44eb-a547-9e84edfdee53 for instance fd399ffd-4151-4122-9901-a61d55e2e70d on n-h2-858383-10 Oct 12 08:48:11.069415 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-adb2da07-3f8f-49a7-a331-a924d166bd94 req-521ca451-7bc6-4532-a5dc-1db8fb1a8813 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115021 Oct 12 08:48:11.072342 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 584/1204] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:11.089870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:11.091507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:11.110522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.111874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.112926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.115433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.116797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.118223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.147023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:11.165895 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-489e7cfd-4b05-4103-b30c-652e2ad66d48 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.531552 Oct 12 08:48:11.175963 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 621/1205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:10 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:11.194361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0d827674-047b-40fb-a16c-684d1de5ea27 req-8b1e5ff6-3b72-488c-80a7-f1bb1651169f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "name": "network-vif-unplugged", "status": "completed", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:11.216974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0d827674-047b-40fb-a16c-684d1de5ea27 req-8b1e5ff6-3b72-488c-80a7-f1bb1651169f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.217592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0d827674-047b-40fb-a16c-684d1de5ea27 req-8b1e5ff6-3b72-488c-80a7-f1bb1651169f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.218039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0d827674-047b-40fb-a16c-684d1de5ea27 req-8b1e5ff6-3b72-488c-80a7-f1bb1651169f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.249790 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0d827674-047b-40fb-a16c-684d1de5ea27 req-8b1e5ff6-3b72-488c-80a7-f1bb1651169f service nova] Creating event network-vif-unplugged:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h1-858383-10 Oct 12 08:48:11.264403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-0d827674-047b-40fb-a16c-684d1de5ea27 req-8b1e5ff6-3b72-488c-80a7-f1bb1651169f service nova] Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:48:11.299482 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0d827674-047b-40fb-a16c-684d1de5ea27 req-8b1e5ff6-3b72-488c-80a7-f1bb1651169f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118624 Oct 12 08:48:11.301813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:11.307723 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 622/1206] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:11.321188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1ee2282-7bf1-4b29-8445-7d21b1a5826b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848837ee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:11.326587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:11.338026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:11.372219 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-39b07e01-e04c-4679-a9c5-31ffd2ff63df tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1558 microversion: 2.91 time: 0.295196 Oct 12 08:48:11.376062 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 585/1207] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:11 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1558 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:11.378775 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1ee2282-7bf1-4b29-8445-7d21b1a5826b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d" status: 200 len: 1453 microversion: 2.1 time: 0.069032 Oct 12 08:48:11.379544 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 623/1208] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:11 2022] GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:11.391660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:11.408134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:11.425780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.428256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.428892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.429660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.430111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.432662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.495058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:11.609368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:11.610446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:11.625013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.625888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.626594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.627534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.632167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.633075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.738347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:11.748589 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8fc44012-8dd9-486f-869f-8fe9aba360d0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1290 microversion: 2.1 time: 0.368597 Oct 12 08:48:11.761708 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 586/1209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:11 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1290 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:11.866188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:11.867498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:11.877717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.878539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.880665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.881787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:11.884853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:11.885600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:11.902868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:11.948317 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf9a8e6b-bc40-426b-95cf-86959443a52b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.344080 Oct 12 08:48:11.951234 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 624/1210] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:11 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:12.203159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:12.204648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:12.214197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:12.215074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:12.219481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:12.223514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:12.225049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:12.225958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:12.440207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:12.452740 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c0727d5a-4b8e-4a2b-8f13-41714dc8e495 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1541 microversion: 2.1 time: 0.596542 Oct 12 08:48:12.459570 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 587/1211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:11 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1541 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:12.474699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-356bc255-307f-4fa4-8d37-984a7007471b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848a54f70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:12.870887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:12.882354 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5b5386c-37c4-415e-99c2-b188479b0d1f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.692230 Oct 12 08:48:12.884293 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 625/1212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:12 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:12.895696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:12.898541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:12.915725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:12.916210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:12.916653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:12.917391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:12.920482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:12.925397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:13.277991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:13.298679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:13.300693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:13.320923 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c76250f0-6a61-492b-b4ed-558d39ae84ee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.433800 Oct 12 08:48:13.341861 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 626/1213] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:12 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:13.359177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:13.360170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:13.371588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:13.372787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:13.374443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:13.375658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:13.377154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:13.377849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:13.924147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:13.944028 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71a20e65-4c2f-44a7-8612-f7ff85a1f753 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.600496 Oct 12 08:48:13.957584 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 627/1214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:13 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:13.972886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:13.974427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:13.992122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:13.993045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:14.001473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:14.002631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:14.003974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:14.004652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:14.247575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:14.295454 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-040f82a2-5f06-4274-88ec-a7ffc230b4f4 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.334239 Oct 12 08:48:14.297064 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 628/1215] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:13 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:14.313844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-10b8c6af-4fa3-4881-adab-cec49f83dbc1 req-0e538601-c3df-44b5-86c1-57f06ff0a196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:14.356004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-10b8c6af-4fa3-4881-adab-cec49f83dbc1 req-0e538601-c3df-44b5-86c1-57f06ff0a196 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:14.366800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-10b8c6af-4fa3-4881-adab-cec49f83dbc1 req-0e538601-c3df-44b5-86c1-57f06ff0a196 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:14.367671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-10b8c6af-4fa3-4881-adab-cec49f83dbc1 req-0e538601-c3df-44b5-86c1-57f06ff0a196 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:14.403047 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-10b8c6af-4fa3-4881-adab-cec49f83dbc1 req-0e538601-c3df-44b5-86c1-57f06ff0a196 service nova] Creating event network-changed:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h1-858383-10 Oct 12 08:48:14.430458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-10b8c6af-4fa3-4881-adab-cec49f83dbc1 req-0e538601-c3df-44b5-86c1-57f06ff0a196 service nova] Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:48:14.464619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-10b8c6af-4fa3-4881-adab-cec49f83dbc1 req-0e538601-c3df-44b5-86c1-57f06ff0a196 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165506 Oct 12 08:48:14.477522 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 629/1216] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:14.492960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:14.506943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:14.531162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:14.531831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:14.532565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:14.533550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:14.534414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:14.535120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:15.245372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:15.281632 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-87f432c8-d69d-48d6-8570-8e38a89af3f6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1473 microversion: 2.1 time: 0.799022 Oct 12 08:48:15.284538 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 630/1217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:14 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1473 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:15.311845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:15.313391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:15.338515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:15.341253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:15.341907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:15.345747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:15.348405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:15.349599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:15.351207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:16.084858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:16.473226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:16.489074 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd57f3f5-b593-41d7-9762-45db1cf37b11 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 1.195640 Oct 12 08:48:16.491076 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 631/1218] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:15 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:16.505585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6fe53d4b-d9f2-432b-b82e-eac28c134699 req-49e42481-a461-476d-a01f-611b1ffadced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1515a4a6-8145-4651-8d70-b3d88c404ed8", "tag": "0ea86b86-358b-437a-a662-3ad7838ec490"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:16.530081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6fe53d4b-d9f2-432b-b82e-eac28c134699 req-49e42481-a461-476d-a01f-611b1ffadced service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:16.530849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6fe53d4b-d9f2-432b-b82e-eac28c134699 req-49e42481-a461-476d-a01f-611b1ffadced service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:16.532265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6fe53d4b-d9f2-432b-b82e-eac28c134699 req-49e42481-a461-476d-a01f-611b1ffadced service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:16.565973 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6fe53d4b-d9f2-432b-b82e-eac28c134699 req-49e42481-a461-476d-a01f-611b1ffadced service nova] Creating event network-changed:0ea86b86-358b-437a-a662-3ad7838ec490 for instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 on n-h1-858383-10 Oct 12 08:48:16.576508 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6fe53d4b-d9f2-432b-b82e-eac28c134699 req-49e42481-a461-476d-a01f-611b1ffadced service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083398 Oct 12 08:48:16.579487 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 632/1219] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:16.592498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:16.595323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:16.612948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:16.613811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:16.614465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:16.615417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:16.616212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:16.616872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:16.643567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:16.835095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:16.879097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:16.890397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:16.900516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:16.913717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:16.920818 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2501d0ed-2521-49d1-ad89-d8a5550a7f62 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.337570 Oct 12 08:48:16.934030 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 633/1220] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:16 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:16.956435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:16.958451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:16.989085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:16.989940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:16.990557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:16.991480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:16.992810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:16.993816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:17.161935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=14 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:17.441754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:17.450470 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0834605a-31a2-40ac-8b16-c76f3bbe2581 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.514969 Oct 12 08:48:17.459476 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 634/1221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:16 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:17.479476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:17.480950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:17.488047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:17.491740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:17.494116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:17.495186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:17.496838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:17.499478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:17.797590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:17.839517 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-48c30c0a-afb0-49d5-b696-d7b112d443d1 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.378512 Oct 12 08:48:17.844337 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 635/1222] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:17 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:17.856288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:17.857427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:17.871281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:17.874020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:17.875576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:17.876584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:17.880737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:17.881505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:18.760633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:18.769998 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c8d9f639-0abf-4c80-901e-26139e553f7f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1470 microversion: 2.1 time: 0.924315 Oct 12 08:48:18.770580 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 636/1223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:17 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1470 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:18.785934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:18.786793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:18.819465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:18.822193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:18.824010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:18.825096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:18.826572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:18.828631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:19.299973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:19.328863 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90c92977-9a5d-49b6-8041-8802daee9862 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.554236 Oct 12 08:48:19.335870 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 637/1224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:18 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:19.345207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:19.350086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:19.365353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:19.365968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:19.366510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:19.367332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:19.367917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:19.368604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:19.512518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:19.526116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:19.528044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:19.535204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d06df30-51d5-4978-bb14-4cdc9d291fee tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.198035 Oct 12 08:48:19.536000 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 638/1225] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:19 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:19.540862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:19.541797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:19.554692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:19.555523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:19.556250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:19.557127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:19.557768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:19.558353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:19.897877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:19.911173 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d8b1a94-c671-464d-b441-cb8ca9a1e7e4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.370626 Oct 12 08:48:19.925468 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 639/1226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:19 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:19.925712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:19.930895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:19.940985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:19.941490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:19.941926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:19.942626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:19.952530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:19.952530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:20.031026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:20.032321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:20.032321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:20.033921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:20.034495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:20.035033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:20.068362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:48:20.074666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for user 5631063704964af4a1d7780077789e48 and project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:48:20.227702 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6a0b225-b8a6-4ad9-82f3-9760491c1754 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686/action" status: 202 len: 0 microversion: 2.1 time: 0.311249 Oct 12 08:48:20.231718 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 640/1227] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:19 2022] POST /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:20.235018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:20.235925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:20.243967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:20.244884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:20.245396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:20.246714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:20.251108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:20.251108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:20.710174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:20.760878 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca0d5245-6317-4c99-8a0c-d044359c8071 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.530887 Oct 12 08:48:20.776388 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 641/1228] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:20 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:20.776388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8168cce3-cc84-45e4-81d9-5ead3973d8d1 req-7034058c-17b0-426f-8e5e-8e7ff1442c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0652c7-d354-40cf-9549-ad84d90f209a", "tag": "f959cb06-3887-4728-8808-065c73b19749"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:20.793094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8168cce3-cc84-45e4-81d9-5ead3973d8d1 req-7034058c-17b0-426f-8e5e-8e7ff1442c87 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:20.793616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8168cce3-cc84-45e4-81d9-5ead3973d8d1 req-7034058c-17b0-426f-8e5e-8e7ff1442c87 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:20.794055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8168cce3-cc84-45e4-81d9-5ead3973d8d1 req-7034058c-17b0-426f-8e5e-8e7ff1442c87 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:20.832366 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8168cce3-cc84-45e4-81d9-5ead3973d8d1 req-7034058c-17b0-426f-8e5e-8e7ff1442c87 service nova] Creating event network-changed:f959cb06-3887-4728-8808-065c73b19749 for instance 5a0652c7-d354-40cf-9549-ad84d90f209a on n-h1-858383-10 Oct 12 08:48:20.851076 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8168cce3-cc84-45e4-81d9-5ead3973d8d1 req-7034058c-17b0-426f-8e5e-8e7ff1442c87 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084329 Oct 12 08:48:20.851690 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 642/1229] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:20.884120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:20.884833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:20.894916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:20.895417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:20.901809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:20.902569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:20.903066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:20.903506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:21.263794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:21.280560 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6bbc9113-84ef-454c-a88e-306a3496b395 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1469 microversion: 2.1 time: 0.427619 Oct 12 08:48:21.281150 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 643/1230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:20 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1469 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:21.310561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:21.311174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:21.338526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:21.339025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:21.339470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:21.340191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:21.340645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:21.341109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:21.640764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:21.657092 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38cf8ced-b506-434f-bdd4-46e5447c1646 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.345244 Oct 12 08:48:21.668132 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 644/1231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:21 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:21.678946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:21.679569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:21.698689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:21.704117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:21.704798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:21.705748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:21.708090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:21.708704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:21.874337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=28,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:21.892081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:21.908048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:21.911832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:21.930212 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd1efe80-e327-4023-9161-1490e5e42d83 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.260815 Oct 12 08:48:21.931851 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 645/1232] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:21 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:21.952123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:21.953738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:21.966529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:21.967372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:21.967976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:21.968887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:21.970382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:21.974012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:22.290329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:22.307706 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b79edf4-595c-4a0b-a4d9-5cce4f474bab tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.373950 Oct 12 08:48:22.308230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 646/1233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:21 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:22.313186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6eb28488-d963-4e16-82ab-26f0556be45b req-bebf7282-ef0f-410a-bfc2-af1bdd81e893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "name": "network-vif-plugged", "status": "completed", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:22.337402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6eb28488-d963-4e16-82ab-26f0556be45b req-bebf7282-ef0f-410a-bfc2-af1bdd81e893 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:22.347475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6eb28488-d963-4e16-82ab-26f0556be45b req-bebf7282-ef0f-410a-bfc2-af1bdd81e893 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:22.347475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6eb28488-d963-4e16-82ab-26f0556be45b req-bebf7282-ef0f-410a-bfc2-af1bdd81e893 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:22.353147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:22.376641 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6eb28488-d963-4e16-82ab-26f0556be45b req-bebf7282-ef0f-410a-bfc2-af1bdd81e893 service nova] Creating event network-vif-plugged:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h1-858383-10 Oct 12 08:48:22.394063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-6eb28488-d963-4e16-82ab-26f0556be45b req-bebf7282-ef0f-410a-bfc2-af1bdd81e893 service nova] Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:48:22.416794 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6eb28488-d963-4e16-82ab-26f0556be45b req-bebf7282-ef0f-410a-bfc2-af1bdd81e893 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106235 Oct 12 08:48:22.417016 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 647/1234] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:22.432395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:22.433103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:22.445694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:22.451380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:22.451908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:22.452342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:22.453069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:22.453542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:22.454004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:22.560724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:22.604860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0657a441-3dc2-40b6-9b84-3e2b41cd7298 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.183939 Oct 12 08:48:22.605263 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 648/1235] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:22 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:22.623711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:22.624349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:22.637019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:22.649866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:22.650422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:22.651198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:22.651683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:22.652104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:22.938317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:22.948190 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b6c4845-a687-412c-8c98-8d2a710f5669 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1469 microversion: 2.1 time: 0.341700 Oct 12 08:48:22.961471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 649/1236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:22 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1469 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:23.175115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bc379a69-9917-4289-91fc-19232ad6589f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Calling method '.version_select at 0x7f984889c550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:23.179040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc379a69-9917-4289-91fc-19232ad6589f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:23.179533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc379a69-9917-4289-91fc-19232ad6589f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:23.180030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc379a69-9917-4289-91fc-19232ad6589f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:23.180839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc379a69-9917-4289-91fc-19232ad6589f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:23.181277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc379a69-9917-4289-91fc-19232ad6589f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:23.181748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc379a69-9917-4289-91fc-19232ad6589f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:23.255284 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bc379a69-9917-4289-91fc-19232ad6589f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.303099 Oct 12 08:48:23.256356 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 650/1237] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 12 08:48:22 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:23.265864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:23.266441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:23.279497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:23.280440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:23.280865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:23.282446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:23.282989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:23.283435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:23.565477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:23.582151 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3451d29f-7adb-4941-9f9b-5399b3bf0fc6 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.324642 Oct 12 08:48:23.583113 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 651/1238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:23 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:23.588649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:23.589271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:23.599165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:23.599671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:23.600116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:23.600828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:23.601408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:23.601904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:23.718776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:23.733377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:23.734848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:23.748276 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-40e9a65a-88e0-42b7-ba81-c09838dd93a1 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.163565 Oct 12 08:48:23.770010 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 652/1239] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:23 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:23.964234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b0c1d06-2d4d-4201-a5ca-19dda097fc19 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Calling method '.version_select at 0x7f984894b940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:23.968369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0b0c1d06-2d4d-4201-a5ca-19dda097fc19 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '55819a6e843645faa2a611e930b27c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00157962a70e4e158504766d43339066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b0c1d06-2d4d-4201-a5ca-19dda097fc19 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Request method failure captured: Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9VfBua1WMTFvxZrktvtI8xOOrLbK2bTH9NfcSPchGx3tYDUY-4Xd3XJQZXb-E_ks7KJSBs0ISi6YZ8Efy7gWP2fZUVHEahIbg7uRPjZBARg32OJxMGitKumW5XAOKxWDdd6FEKh_R82yv9fzuvjSCJbFD6fvsXt4V-ZppZUSWHztE Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:23.970414 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00157962a70e4e158504766d43339066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00157962a70e4e158504766d43339066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}] Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 55819a6e843645faa2a611e930b27c12 Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 08:48:23.973561 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:23.974380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 12 08:48:23.975583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:23.976763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b0c1d06-2d4d-4201-a5ca-19dda097fc19 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:23.976763 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b0c1d06-2d4d-4201-a5ca-19dda097fc19 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.200673 Oct 12 08:48:23.976763 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 653/1240] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 12 08:48:23 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:23.981171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:23.981812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:23.992152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:23.992660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:23.993103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:23.993972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:23.994433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:23.994848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:24.245929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:24.259124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3910090e-2043-49ee-a0d6-d6e278a4f678 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.285105 Oct 12 08:48:24.275217 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 654/1241] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:23 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:24.282085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:24.282615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:24.297510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:24.298161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:24.298700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:24.301348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:24.301348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:24.301688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:24.404525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:24.451358 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67723684-4985-46a1-aaa4-fe3348f53667 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.189513 Oct 12 08:48:24.452191 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 655/1242] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:24 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:24.456651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:24.457251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:24.466574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:24.467064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:24.467500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:24.468294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:24.471084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:24.471084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:24.747888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:24.762025 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-87b696a1-a986-4440-b7ce-90ccfa8b7135 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1469 microversion: 2.1 time: 0.308902 Oct 12 08:48:24.764917 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 656/1243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:24 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:24.784727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29d9211c-56a8-4b33-995a-1b27e6ea34f6 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Calling method '.version_select at 0x7f98489164c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:24.787848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29d9211c-56a8-4b33-995a-1b27e6ea34f6 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '55819a6e843645faa2a611e930b27c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00157962a70e4e158504766d43339066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29d9211c-56a8-4b33-995a-1b27e6ea34f6 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Request method failure captured: Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts/n-d-858383-10/reboot HTTP/1.1 Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9VfBua1WMTFvxZrktvtI8xOOrLbK2bTH9NfcSPchGx3tYDUY-4Xd3XJQZXb-E_ks7KJSBs0ISi6YZ8Efy7gWP2fZUVHEahIbg7uRPjZBARg32OJxMGitKumW5XAOKxWDdd6FEKh_R82yv9fzuvjSCJbFD6fvsXt4V-ZppZUSWHztE Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:24.789486 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00157962a70e4e158504766d43339066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00157962a70e4e158504766d43339066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}] Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 55819a6e843645faa2a611e930b27c12 Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'n-d-858383-10'} Oct 12 08:48:24.791248 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:24.792169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 12 08:48:24.793555 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:24.800442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29d9211c-56a8-4b33-995a-1b27e6ea34f6 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:24.800442 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29d9211c-56a8-4b33-995a-1b27e6ea34f6 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-858383-10/reboot" status: 403 len: 111 microversion: 2.1 time: 0.010154 Oct 12 08:48:24.800442 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 657/1244] 10.222.0.40 () {58 vars in 1191 bytes} [Wed Oct 12 08:48:24 2022] GET /compute/v2.1/os-hosts/n-d-858383-10/reboot => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:24.800442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:24.800442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:24.806249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:24.806755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:24.807359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:24.807929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:24.808459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:24.811555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:25.104564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:25.117559 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b91ecfcb-19df-4f84-8152-9be1ea280f98 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.325132 Oct 12 08:48:25.140308 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 658/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:24 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:25.153290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:25.154185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:25.162736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:25.163514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:25.164117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:25.165011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:25.165700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:25.166284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:25.308901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:25.328501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:25.330339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:25.337553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bd23104e-aeaa-49a1-8b79-611eab28d3d2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.189469 Oct 12 08:48:25.338756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 659/1246] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:25 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:25.344523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a437ee3-6443-4dac-892c-951cb4b7bfc0 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Calling method '.version_select at 0x7f98487f8940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:25.366650 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3a437ee3-6443-4dac-892c-951cb4b7bfc0 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a437ee3-6443-4dac-892c-951cb4b7bfc0 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Request method failure captured: Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9Wnfnb9pALVQvh3jrITEgZPq2RBM9X_svxXGbtZXdIK5FLw5D404zWPrXlTYtq6hAV9bcz6iDDC2KmqiSnrcQqmRpa5NezM9DlmvgolAzEga3EmZls6W5x4vCRxMyLsbEmndeMhoJ0nTpdATdSsqzvjPTpZko31Y3eSXB4J3RQg6M Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:48:25.368867 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}] Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: afb8c3e1868f4566a71c0275a372da84 Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'nonexistent_hostname'} Oct 12 08:48:25.370487 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:48:25.371391 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 08:48:25.372551 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:25.379058 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:25.385828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a437ee3-6443-4dac-892c-951cb4b7bfc0 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:25.388455 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a437ee3-6443-4dac-892c-951cb4b7bfc0 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.048112 Oct 12 08:48:25.391651 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 660/1247] 10.222.0.40 () {58 vars in 1212 bytes} [Wed Oct 12 08:48:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:48:25.408453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e2edbd6f-a67a-427e-902a-27e80006159c req-00478544-bb73-4059-ac53-d678635f82b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515a4a6-8145-4651-8d70-b3d88c404ed8", "name": "network-vif-plugged", "status": "completed", "tag": "0ea86b86-358b-437a-a662-3ad7838ec490"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:25.438216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2edbd6f-a67a-427e-902a-27e80006159c req-00478544-bb73-4059-ac53-d678635f82b6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:25.438874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2edbd6f-a67a-427e-902a-27e80006159c req-00478544-bb73-4059-ac53-d678635f82b6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:25.439455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2edbd6f-a67a-427e-902a-27e80006159c req-00478544-bb73-4059-ac53-d678635f82b6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:25.464166 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e2edbd6f-a67a-427e-902a-27e80006159c req-00478544-bb73-4059-ac53-d678635f82b6 service nova] Creating event network-vif-plugged:0ea86b86-358b-437a-a662-3ad7838ec490 for instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 on n-h1-858383-10 Oct 12 08:48:25.480578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e2edbd6f-a67a-427e-902a-27e80006159c req-00478544-bb73-4059-ac53-d678635f82b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082278 Oct 12 08:48:25.486277 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 661/1248] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:25.499943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:25.500905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:25.521916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:25.522658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:25.523227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:25.524196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:25.525163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:25.527691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:25.767472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:25.779098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a99d160a-6a53-469b-b7e6-181dc6b1de5b tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.291348 Oct 12 08:48:25.780392 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 662/1249] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:25 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:25.800276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0740ef8e-3a2b-4030-999b-f8ecc0846612 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Calling method '.version_select at 0x7f98487f8c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:25.811676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0740ef8e-3a2b-4030-999b-f8ecc0846612 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '55819a6e843645faa2a611e930b27c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00157962a70e4e158504766d43339066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0740ef8e-3a2b-4030-999b-f8ecc0846612 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Request method failure captured: Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts/n-d-858383-10 HTTP/1.1 Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9VfBua1WMTFvxZrktvtI8xOOrLbK2bTH9NfcSPchGx3tYDUY-4Xd3XJQZXb-E_ks7KJSBs0ISi6YZ8Efy7gWP2fZUVHEahIbg7uRPjZBARg32OJxMGitKumW5XAOKxWDdd6FEKh_R82yv9fzuvjSCJbFD6fvsXt4V-ZppZUSWHztE Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:25.815165 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00157962a70e4e158504766d43339066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00157962a70e4e158504766d43339066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}] Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 55819a6e843645faa2a611e930b27c12 Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'n-d-858383-10'} Oct 12 08:48:25.816469 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:25.817243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 12 08:48:25.818444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:25.820704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0740ef8e-3a2b-4030-999b-f8ecc0846612 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:25.821920 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0740ef8e-3a2b-4030-999b-f8ecc0846612 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-858383-10" status: 403 len: 109 microversion: 2.1 time: 0.040309 Oct 12 08:48:25.822687 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 663/1250] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 12 08:48:25 2022] GET /compute/v2.1/os-hosts/n-d-858383-10 => generated 109 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:25.828655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:25.829582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:25.843502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:25.844644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:25.845859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:25.846816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:25.847540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:25.848195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:25.983206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:26.002905 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1bc919ad-a3a0-4a31-a2fd-17490f74569b tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.178719 Oct 12 08:48:26.018054 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 664/1251] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:25 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:26.028796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:26.029419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:26.035271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:26.036899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:26.037465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:26.038225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:26.038943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:26.039396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:26.039819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:26.196377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:26.203098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cb3a1f26-56a2-4ec8-8190-3ff36b536e32 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1469 microversion: 2.1 time: 0.183867 Oct 12 08:48:26.204953 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 665/1252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:26 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:26.209685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31e1713c-6d04-42bc-896c-b13d5d13835a tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Calling method '.version_select at 0x7f984894b1f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:26.216233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-31e1713c-6d04-42bc-896c-b13d5d13835a tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31e1713c-6d04-42bc-896c-b13d5d13835a tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Request method failure captured: Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9Wnfnb9pALVQvh3jrITEgZPq2RBM9X_svxXGbtZXdIK5FLw5D404zWPrXlTYtq6hAV9bcz6iDDC2KmqiSnrcQqmRpa5NezM9DlmvgolAzEga3EmZls6W5x4vCRxMyLsbEmndeMhoJ0nTpdATdSsqzvjPTpZko31Y3eSXB4J3RQg6M Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:48:26.217801 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}] Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: afb8c3e1868f4566a71c0275a372da84 Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'nonexistent_hostname'} Oct 12 08:48:26.219080 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:26.219884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.221020 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.222092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31e1713c-6d04-42bc-896c-b13d5d13835a tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:26.222092 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-31e1713c-6d04-42bc-896c-b13d5d13835a tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.013189 Oct 12 08:48:26.231709 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 666/1253] 10.222.0.40 () {58 vars in 1191 bytes} [Wed Oct 12 08:48:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:48:26.234753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:26.235372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:26.242575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:26.243092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:26.243593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:26.244296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:26.244889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:26.245377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:26.396974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:26.407999 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f739b32-e147-44a7-8f6a-ae87ff60217e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.182808 Oct 12 08:48:26.409740 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 667/1254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:26 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:26.414507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38ede7f6-f138-4b4d-b8af-8491994c1aef tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Calling method '.version_select at 0x7f984894b1f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:26.416358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-38ede7f6-f138-4b4d-b8af-8491994c1aef tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '55819a6e843645faa2a611e930b27c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00157962a70e4e158504766d43339066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38ede7f6-f138-4b4d-b8af-8491994c1aef tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Request method failure captured: Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts/n-d-858383-10/shutdown HTTP/1.1 Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9VfBua1WMTFvxZrktvtI8xOOrLbK2bTH9NfcSPchGx3tYDUY-4Xd3XJQZXb-E_ks7KJSBs0ISi6YZ8Efy7gWP2fZUVHEahIbg7uRPjZBARg32OJxMGitKumW5XAOKxWDdd6FEKh_R82yv9fzuvjSCJbFD6fvsXt4V-ZppZUSWHztE Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:26.417947 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00157962a70e4e158504766d43339066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00157962a70e4e158504766d43339066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}] Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 55819a6e843645faa2a611e930b27c12 Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'n-d-858383-10'} Oct 12 08:48:26.419211 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:26.420085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 12 08:48:26.421167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.424435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38ede7f6-f138-4b4d-b8af-8491994c1aef tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:26.424435 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38ede7f6-f138-4b4d-b8af-8491994c1aef tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-858383-10/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.008469 Oct 12 08:48:26.426523 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 668/1255] 10.222.0.40 () {58 vars in 1197 bytes} [Wed Oct 12 08:48:26 2022] GET /compute/v2.1/os-hosts/n-d-858383-10/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:26.431492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:26.432095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:26.442267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:26.442800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:26.443241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:26.443971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:26.444427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:26.444971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:26.662333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:26.674366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:26.677516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:26.683983 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad14c98f-e810-427b-9170-eaca6ffabf5f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.256299 Oct 12 08:48:26.711693 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 669/1256] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:26 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:26.720268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f1a6d84-5c94-4de5-b738-928c4476a38b tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Calling method '.version_select at 0x7f984889cb80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:26.757429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-2f1a6d84-5c94-4de5-b738-928c4476a38b tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f1a6d84-5c94-4de5-b738-928c4476a38b tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Request method failure captured: Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9Wnfnb9pALVQvh3jrITEgZPq2RBM9X_svxXGbtZXdIK5FLw5D404zWPrXlTYtq6hAV9bcz6iDDC2KmqiSnrcQqmRpa5NezM9DlmvgolAzEga3EmZls6W5x4vCRxMyLsbEmndeMhoJ0nTpdATdSsqzvjPTpZko31Y3eSXB4J3RQg6M Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:48:26.760084 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}] Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: afb8c3e1868f4566a71c0275a372da84 Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'nonexistent_hostname'} Oct 12 08:48:26.761489 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:48:26.762336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 08:48:26.763568 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:26.764777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:26.770685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f1a6d84-5c94-4de5-b738-928c4476a38b tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:26.771936 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f1a6d84-5c94-4de5-b738-928c4476a38b tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.058650 Oct 12 08:48:26.777338 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 670/1257] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 08:48:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:48:26.803035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:26.811684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:26.866858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:26.868941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:26.871038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:26.872779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:26.873714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:26.875196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:26.950130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:27.226662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:27.235368 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d3c4f70-1099-4140-8b05-6fa1109b1c27 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.436359 Oct 12 08:48:27.249742 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 671/1258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:26 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:27.249742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7c1a3c0c-acfe-4629-8ecc-2d8d5f6b4c78 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Calling method '.version_select at 0x7f98487f8160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:27.263691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7c1a3c0c-acfe-4629-8ecc-2d8d5f6b4c78 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '55819a6e843645faa2a611e930b27c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00157962a70e4e158504766d43339066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7c1a3c0c-acfe-4629-8ecc-2d8d5f6b4c78 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Request method failure captured: Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts/n-d-858383-10/startup HTTP/1.1 Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9VfBua1WMTFvxZrktvtI8xOOrLbK2bTH9NfcSPchGx3tYDUY-4Xd3XJQZXb-E_ks7KJSBs0ISi6YZ8Efy7gWP2fZUVHEahIbg7uRPjZBARg32OJxMGitKumW5XAOKxWDdd6FEKh_R82yv9fzuvjSCJbFD6fvsXt4V-ZppZUSWHztE Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:27.266603 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00157962a70e4e158504766d43339066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00157962a70e4e158504766d43339066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}] Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 55819a6e843645faa2a611e930b27c12 Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'n-d-858383-10'} Oct 12 08:48:27.267958 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:27.268805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 12 08:48:27.269980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:27.271084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7c1a3c0c-acfe-4629-8ecc-2d8d5f6b4c78 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:27.271084 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7c1a3c0c-acfe-4629-8ecc-2d8d5f6b4c78 tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-858383-10/startup" status: 403 len: 110 microversion: 2.1 time: 0.032617 Oct 12 08:48:27.281415 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 672/1259] 10.222.0.40 () {58 vars in 1194 bytes} [Wed Oct 12 08:48:27 2022] GET /compute/v2.1/os-hosts/n-d-858383-10/startup => generated 110 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:27.285630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:27.286298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:27.303425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:27.303907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:27.309185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:27.310336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:27.311070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:27.311506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:27.447505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:27.480035 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c7b1e3fd-4562-409a-a70d-ce942e2444e3 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1931 microversion: 2.75 time: 0.201289 Oct 12 08:48:27.481449 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 673/1260] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:27 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1931 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:27.488099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:27.488735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:27.495316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:27.495815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:27.496250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:27.496957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:27.497410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:27.497862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:27.669149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:27.678165 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-916071a7-270c-4036-8fde-5a2f21cb7a14 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1469 microversion: 2.1 time: 0.196172 Oct 12 08:48:27.686893 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 674/1261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:27 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:27.693348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4ee6b0ef-7f06-493e-a9d4-2c4c305c540c tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Calling method '.version_select at 0x7f98487e8040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:27.717618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4ee6b0ef-7f06-493e-a9d4-2c4c305c540c tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4ee6b0ef-7f06-493e-a9d4-2c4c305c540c tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Request method failure captured: Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9Wnfnb9pALVQvh3jrITEgZPq2RBM9X_svxXGbtZXdIK5FLw5D404zWPrXlTYtq6hAV9bcz6iDDC2KmqiSnrcQqmRpa5NezM9DlmvgolAzEga3EmZls6W5x4vCRxMyLsbEmndeMhoJ0nTpdATdSsqzvjPTpZko31Y3eSXB4J3RQg6M Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:48:27.719340 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}] Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: afb8c3e1868f4566a71c0275a372da84 Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'nonexistent_hostname'} Oct 12 08:48:27.720742 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:48:27.721771 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 12 08:48:27.722875 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4ee6b0ef-7f06-493e-a9d4-2c4c305c540c tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4ee6b0ef-7f06-493e-a9d4-2c4c305c540c tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.031964 Oct 12 08:48:27.723961 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 675/1262] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 12 08:48:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:48:27.729769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:27.730898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:27.742691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:27.743176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:27.743740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:27.744445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:27.744896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:27.745989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:27.944369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:27.957068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f05fd0f5-f6eb-46c8-83c4-a441385332be tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.233826 Oct 12 08:48:27.958474 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 676/1263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:27 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:27.963463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:27.964322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:27.974060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:27.974911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:27.975725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:27.976679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:27.977339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:27.978054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.158221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:28.173867 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24eee66a-6165-45ce-b22b-a6bdd7c8ae27 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 2422 microversion: 2.25 time: 0.213646 Oct 12 08:48:28.175123 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 677/1264] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:27 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 2422 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:28.186505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-980e9bd9-4533-492a-80e8-3be65cf2319f req-d723b7ec-16cf-41da-a4ec-e7e86caa226c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0652c7-d354-40cf-9549-ad84d90f209a", "name": "network-vif-plugged", "status": "completed", "tag": "f959cb06-3887-4728-8808-065c73b19749"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:28.197637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-980e9bd9-4533-492a-80e8-3be65cf2319f req-d723b7ec-16cf-41da-a4ec-e7e86caa226c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.198618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-980e9bd9-4533-492a-80e8-3be65cf2319f req-d723b7ec-16cf-41da-a4ec-e7e86caa226c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.199587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-980e9bd9-4533-492a-80e8-3be65cf2319f req-d723b7ec-16cf-41da-a4ec-e7e86caa226c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.212656 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-980e9bd9-4533-492a-80e8-3be65cf2319f req-d723b7ec-16cf-41da-a4ec-e7e86caa226c service nova] Creating event network-vif-plugged:f959cb06-3887-4728-8808-065c73b19749 for instance 5a0652c7-d354-40cf-9549-ad84d90f209a on n-h1-858383-10 Oct 12 08:48:28.219193 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-980e9bd9-4533-492a-80e8-3be65cf2319f req-d723b7ec-16cf-41da-a4ec-e7e86caa226c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035870 Oct 12 08:48:28.220204 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 678/1265] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:28.227030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:28.227901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:28.234213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.234691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.235126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.236028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.236460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.236880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.314357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:28.323776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:28.325208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:28.331233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b8bc6fed-274f-43b4-9d7f-3433018d9a4b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.109465 Oct 12 08:48:28.353960 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 679/1266] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:28 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:28.359278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88c66e2a-5d21-44ce-abda-5047a431a061 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Action: 'update', calling method: .version_select at 0x7f9848983700>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88c66e2a-5d21-44ce-abda-5047a431a061 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Request method failure captured: Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/os-hosts/n-d-858383-10 HTTP/1.1 Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 51 Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9Wnfnb9pALVQvh3jrITEgZPq2RBM9X_svxXGbtZXdIK5FLw5D404zWPrXlTYtq6hAV9bcz6iDDC2KmqiSnrcQqmRpa5NezM9DlmvgolAzEga3EmZls6W5x4vCRxMyLsbEmndeMhoJ0nTpdATdSsqzvjPTpZko31Y3eSXB4J3RQg6M Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:48:28.363540 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}] Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: afb8c3e1868f4566a71c0275a372da84 Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: {"status": "enable", "maintenance_mode": "invalid"} Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:28.365905 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'n-d-858383-10', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance: Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:28.368547 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:28.375336 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:28.378085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:28.378085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:48:28.378085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:48:28.378085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 08:48:28.378085 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.378085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88c66e2a-5d21-44ce-abda-5047a431a061 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:28.378085 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88c66e2a-5d21-44ce-abda-5047a431a061 tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-858383-10" status: 400 len: 199 microversion: 2.1 time: 0.009856 Oct 12 08:48:28.378085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 680/1267] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 12 08:48:28 2022] PUT /compute/v2.1/os-hosts/n-d-858383-10 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:48:28.389067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": "auto"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:28.392008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:28.412567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.413218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.413691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.414423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.414973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.416055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.466431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'flavor' on Instance uuid 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:28.498707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Going to try to live migrate instance to n-h2-858383-10 {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:48:28.574698 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-356bc255-307f-4fa4-8d37-984a7007471b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d" status: 200 len: 1462 microversion: 2.1 time: 16.113386 Oct 12 08:48:28.586199 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 588/1268] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:12 2022] GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d => generated 1462 bytes in 16126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:28.623640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:28.624260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:28.645665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.656674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.658301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.659157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.661770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.666499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.905319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:28.917363 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-74df0a54-173b-47cd-8512-019c0b4d83ad tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.329986 Oct 12 08:48:28.918231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 589/1269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:28 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:28.923059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d05249ed-98f8-4364-a35b-28be69940c7e tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Action: 'update', calling method: .version_select at 0x7f9848a6fee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d05249ed-98f8-4364-a35b-28be69940c7e tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Request method failure captured: Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/os-hosts/n-d-858383-10 HTTP/1.1 Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 51 Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9Wnfnb9pALVQvh3jrITEgZPq2RBM9X_svxXGbtZXdIK5FLw5D404zWPrXlTYtq6hAV9bcz6iDDC2KmqiSnrcQqmRpa5NezM9DlmvgolAzEga3EmZls6W5x4vCRxMyLsbEmndeMhoJ0nTpdATdSsqzvjPTpZko31Y3eSXB4J3RQg6M Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:48:28.927431 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}] Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: afb8c3e1868f4566a71c0275a372da84 Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: {"status": "invalid", "maintenance_mode": "enable"} Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:48:28.929180 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'n-d-858383-10', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance: Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:28.930170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:28.932024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:28.933397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:28.933397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:48:28.933397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:48:28.933397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 12 08:48:28.933397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:28.935505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d05249ed-98f8-4364-a35b-28be69940c7e tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:28.936522 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d05249ed-98f8-4364-a35b-28be69940c7e tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-858383-10" status: 400 len: 189 microversion: 2.1 time: 0.017359 Oct 12 08:48:28.937559 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 590/1270] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 12 08:48:28 2022] PUT /compute/v2.1/os-hosts/n-d-858383-10 => generated 189 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:48:28.942148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:28.942956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:28.950956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.952133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.953551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:28.955013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:28.955817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:28.956564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.065921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:29.089367 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c1a327e1-e990-4d13-931c-c03b4515cfe5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1937 microversion: 2.75 time: 0.150441 Oct 12 08:48:29.090594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 591/1271] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:28 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1937 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:29.096227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-028d389f-caf0-43e6-beaa-f3cc2a4a9d98 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848965790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:29.149536 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-028d389f-caf0-43e6-beaa-f3cc2a4a9d98 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d" status: 200 len: 1462 microversion: 2.1 time: 0.057614 Oct 12 08:48:29.150833 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 592/1272] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:29 2022] GET /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d => generated 1462 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:29.157386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:29.158685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:29.168397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.168901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.169334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.173346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.179760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.180225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.323307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:29.331675 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-436c950c-bf7c-48d0-9fac-5ea7ddbf36c8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1469 microversion: 2.1 time: 0.179002 Oct 12 08:48:29.332163 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 593/1273] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:29 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:29.336689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aec0e166-c54c-48a0-bb92-a8673f10affd tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Action: 'update', calling method: .version_select at 0x7f98489f6820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:29.340230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aec0e166-c54c-48a0-bb92-a8673f10affd tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '55819a6e843645faa2a611e930b27c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00157962a70e4e158504766d43339066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aec0e166-c54c-48a0-bb92-a8673f10affd tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Request method failure captured: Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/os-hosts/n-d-858383-10 HTTP/1.1 Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 50 Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9VfBua1WMTFvxZrktvtI8xOOrLbK2bTH9NfcSPchGx3tYDUY-4Xd3XJQZXb-E_ks7KJSBs0ISi6YZ8Efy7gWP2fZUVHEahIbg7uRPjZBARg32OJxMGitKumW5XAOKxWDdd6FEKh_R82yv9fzuvjSCJbFD6fvsXt4V-ZppZUSWHztE Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:48:29.342092 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00157962a70e4e158504766d43339066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00157962a70e4e158504766d43339066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00157962a70e4e158504766d43339066"}]}] Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 00157962a70e4e158504766d43339066 Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-804519535 Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 55819a6e843645faa2a611e930b27c12 Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-HostsAdminNegativeTestJSON-804519535-project Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: {"status": "enable", "maintenance_mode": "enable"} Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 08:48:29.343727 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'n-d-858383-10', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:29.344886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 12 08:48:29.346295 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.347564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aec0e166-c54c-48a0-bb92-a8673f10affd tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:29.347564 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aec0e166-c54c-48a0-bb92-a8673f10affd tempest-HostsAdminNegativeTestJSON-804519535 tempest-HostsAdminNegativeTestJSON-804519535-project] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-858383-10" status: 403 len: 111 microversion: 2.1 time: 0.010331 Oct 12 08:48:29.347564 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 594/1274] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 12 08:48:29 2022] PUT /compute/v2.1/os-hosts/n-d-858383-10 => generated 111 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:29.351431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:29.352030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:29.359049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.359519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.359948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.360710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.361161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.361606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.493764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:29.501829 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-01d92465-1c24-4ed4-aeb3-1b38d262de14 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1325 microversion: 2.1 time: 0.156666 Oct 12 08:48:29.502391 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 595/1275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:29 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1325 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:29.506883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:29.507594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:29.513488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.514002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.514430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.515120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.515574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.515993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.646227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:29.655168 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bda2e789-17e3-46cd-a001-a26436aaab9d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d" status: 200 len: 1467 microversion: 2.1 time: 0.151810 Oct 12 08:48:29.655751 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 596/1276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:29 2022] GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d => generated 1467 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:29.660350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-79443852-d1dd-4998-bcf7-eac94b61f46f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Action: 'update', calling method: .version_select at 0x7f98489f6ca0>, body: {"status": null, "maintenance_mode": null} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-79443852-d1dd-4998-bcf7-eac94b61f46f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Request method failure captured: Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/os-hosts/n-d-858383-10 HTTP/1.1 Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 42 Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9Wnfnb9pALVQvh3jrITEgZPq2RBM9X_svxXGbtZXdIK5FLw5D404zWPrXlTYtq6hAV9bcz6iDDC2KmqiSnrcQqmRpa5NezM9DlmvgolAzEga3EmZls6W5x4vCRxMyLsbEmndeMhoJ0nTpdATdSsqzvjPTpZko31Y3eSXB4J3RQg6M Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:48:29.664165 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}] Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: afb8c3e1868f4566a71c0275a372da84 Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: {"status": null, "maintenance_mode": null} Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 08:48:29.665598 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'n-d-858383-10', 'body': {'status': None, 'maintenance_mode': None}} Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'disable', Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'Enable', Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'Disable', Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance: Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi None Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:29.666522 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:29.668064 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:29.672174 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:48:29.672174 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:48:29.672174 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 12 08:48:29.672174 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.672174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-79443852-d1dd-4998-bcf7-eac94b61f46f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:29.672174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-79443852-d1dd-4998-bcf7-eac94b61f46f tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-858383-10" status: 400 len: 127 microversion: 2.1 time: 0.008822 Oct 12 08:48:29.672174 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 597/1277] 10.222.0.40 () {60 vars in 1190 bytes} [Wed Oct 12 08:48:29 2022] PUT /compute/v2.1/os-hosts/n-d-858383-10 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:48:29.673477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:29.673477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:29.680810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.681324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.681780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.682700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.683151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.683570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.755330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:29.763635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:29.765076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:29.770290 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bff8a8bc-31d7-4b37-9602-3eec5a8de559 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1535 microversion: 2.91 time: 0.102220 Oct 12 08:48:29.770863 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 598/1278] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:29 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1535 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:29.775354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b386d22-e32b-4c59-a318-653eb8be9bbd tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Action: 'update', calling method: .version_select at 0x7f9848a54160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:29.778617 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.hosts [None req-7b386d22-e32b-4c59-a318-653eb8be9bbd tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Enabling host nonexistent_hostname. Oct 12 08:48:29.787353 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7b386d22-e32b-4c59-a318-653eb8be9bbd tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b386d22-e32b-4c59-a318-653eb8be9bbd tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Request method failure captured: Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 50 Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9Wnfnb9pALVQvh3jrITEgZPq2RBM9X_svxXGbtZXdIK5FLw5D404zWPrXlTYtq6hAV9bcz6iDDC2KmqiSnrcQqmRpa5NezM9DlmvgolAzEga3EmZls6W5x4vCRxMyLsbEmndeMhoJ0nTpdATdSsqzvjPTpZko31Y3eSXB4J3RQg6M Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:48:29.789119 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0c40e10aec54f79be5f2ee334fb8ca8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0c40e10aec54f79be5f2ee334fb8ca8"}]}] Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: b0c40e10aec54f79be5f2ee334fb8ca8 Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1821101202 Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: afb8c3e1868f4566a71c0275a372da84 Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1821101202-project-admin Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: {"status": "enable", "maintenance_mode": "enable"} Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:29.790734 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 12 08:48:29.791731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:29.793008 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:29.794597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b386d22-e32b-4c59-a318-653eb8be9bbd tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:29.795628 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7b386d22-e32b-4c59-a318-653eb8be9bbd tempest-HostsAdminNegativeTestJSON-1821101202 tempest-HostsAdminNegativeTestJSON-1821101202-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018818 Oct 12 08:48:29.795628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 599/1279] 10.222.0.40 () {60 vars in 1211 bytes} [Wed Oct 12 08:48:29 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:48:29.797673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-276430689"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:29.818382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:29.824578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.825142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.825675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:29.826471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:29.826930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:29.827353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.047603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d8a920b-fb2a-4f3c-8ab6-534fcd3a9a32 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "POST /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58/action" status: 202 len: 0 microversion: 2.1 time: 0.254894 Oct 12 08:48:30.048260 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 600/1280] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:29 2022] POST /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:48:30.053309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:30.054323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:30.061278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.061785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.062228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.062924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.063377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.063802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.229973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:30.238140 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4848b864-e82f-4431-be83-4c7cfc51b6ea tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1332 microversion: 2.1 time: 0.188735 Oct 12 08:48:30.238804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 601/1281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:30 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1332 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:30.243498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a6fdb4f3-809e-4381-b4b2-782d748d7b8a tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984894cdc0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:30.291285 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a6fdb4f3-809e-4381-b4b2-782d748d7b8a tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.051400 Oct 12 08:48:30.291854 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 602/1282] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:30 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:30.296527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:30.297123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:30.303239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.303718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.304144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.304825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.305267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.305813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.377348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:30.397932 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1eb11267-fd5a-4a67-9211-fd67ee3752f5 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1937 microversion: 2.75 time: 0.104601 Oct 12 08:48:30.398937 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 603/1283] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:30 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1937 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:30.404391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:30.405211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:30.411020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.411500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.411928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.412618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.413095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.413548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.565753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:30.579335 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-066389dc-7c04-4c6e-a5dd-e568113b8f46 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1469 microversion: 2.1 time: 0.179052 Oct 12 08:48:30.582827 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 604/1284] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:30 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:30.589910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:30.592522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:30.599832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.600534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.601137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.602157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.602828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.603254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.746929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:30.755058 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b27fd3ce-f25b-470e-86ed-ca248caa2568 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1522 microversion: 2.1 time: 0.171209 Oct 12 08:48:30.755795 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 605/1285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:30 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:30.761309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0e05ff1c-abf2-4205-b9b2-a100241082ae req-9be72e92-0419-4b79-a1d4-4a92c9047c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "name": "network-vif-unplugged", "status": "completed", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:30.770766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e05ff1c-abf2-4205-b9b2-a100241082ae req-9be72e92-0419-4b79-a1d4-4a92c9047c8f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.771246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e05ff1c-abf2-4205-b9b2-a100241082ae req-9be72e92-0419-4b79-a1d4-4a92c9047c8f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.771675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e05ff1c-abf2-4205-b9b2-a100241082ae req-9be72e92-0419-4b79-a1d4-4a92c9047c8f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.790429 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0e05ff1c-abf2-4205-b9b2-a100241082ae req-9be72e92-0419-4b79-a1d4-4a92c9047c8f service nova] Creating event network-vif-unplugged:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h1-858383-10 Oct 12 08:48:30.796524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-0e05ff1c-abf2-4205-b9b2-a100241082ae req-9be72e92-0419-4b79-a1d4-4a92c9047c8f service nova] Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:48:30.807669 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0e05ff1c-abf2-4205-b9b2-a100241082ae req-9be72e92-0419-4b79-a1d4-4a92c9047c8f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049841 Oct 12 08:48:30.808123 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 606/1286] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:30.813907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:30.814866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:30.821820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.822545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.822981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:30.824026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:30.824479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:30.824927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:31.017813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:31.025965 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-69ecfce3-04a9-463d-b5ca-d801cb11229d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1522 microversion: 2.1 time: 0.216718 Oct 12 08:48:31.026546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 607/1287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:30 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:31.042371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:31.043094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:31.050616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:31.051108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:31.051547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:31.052255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:31.052707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:31.053252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:31.142325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:31.152995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:31.154468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:31.160478 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8830b81-c774-43ce-ac43-c45b563f00c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1535 microversion: 2.91 time: 0.121950 Oct 12 08:48:31.161375 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 608/1288] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:31 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1535 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:31.167392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1430254009"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:31.169865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:31.187450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:31.187997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:31.188565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:31.189635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:31.190393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:31.190738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:31.247573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:31.438446 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12ecba4e-2c24-4cf5-ac1e-9abb7b5da061 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.275622 Oct 12 08:48:31.445700 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 609/1289] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:31 2022] POST /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:48:31.452854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:31.453592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:31.468326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:31.468928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:31.469243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:31.469978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:31.470520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:31.470826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:31.789676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:31.799388 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aa221713-00e3-49ce-8c6a-d72d3ef6c8d9 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1535 microversion: 2.1 time: 0.352031 Oct 12 08:48:31.800338 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 610/1290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:31 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1535 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:31.811420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dabfe04a-8472-492d-977d-944abf9b5890 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98489e1790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:31.886353 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dabfe04a-8472-492d-977d-944abf9b5890 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.084491 Oct 12 08:48:31.895160 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 611/1291] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:31 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:31.895160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:31.895160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:31.900528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:31.901924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:31.902723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:31.904888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:31.906450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:31.907802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:32.011840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:32.038019 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4b04d978-c71e-4879-92c3-e4f8319b7379 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1937 microversion: 2.75 time: 0.149382 Oct 12 08:48:32.050352 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 612/1292] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:31 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1937 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:32.065229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74e5ee88-c347-4e9e-9e57-65bb7845d2fa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '.version_select at 0x7f98489e1790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:32.114317 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b989b8e2-77d5-4f9f-8bed-bab20b4e335f tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/action" status: 202 len: 0 microversion: 2.25 time: 3.739526 Oct 12 08:48:32.115083 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 681/1293] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:48:28 2022] POST /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/action => generated 0 bytes in 3741 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:48:32.125200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:32.126495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:32.147783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:32.148544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:32.148994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:32.150507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:32.150987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:32.167036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:32.295128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-74e5ee88-c347-4e9e-9e57-65bb7845d2fa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/images/a3260ae9-370b-43a3-bc11-3d99af2aa2a9" status: 204 len: 0 microversion: 2.1 time: 0.243462 Oct 12 08:48:32.296644 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 613/1294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:32 2022] DELETE /compute/v2.1/images/a3260ae9-370b-43a3-bc11-3d99af2aa2a9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:48:32.301659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b30bffc-34c6-4b0b-b811-9c70fc9c1202 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'create', calling method: .version_select at 0x7f9848a544c0>, body: {"pool": "29c8ef46-7259-4303-bca0-4940f77b8940"} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:32.448778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:32.460233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-75ef04e6-f11f-4041-8c91-44688b91bb22 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1535 microversion: 2.1 time: 0.342293 Oct 12 08:48:32.461547 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 682/1295] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:32 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1535 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:32.467946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:32.468891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:32.486487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:32.492731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:32.493343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:32.496967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:32.497689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:32.501998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:32.854278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:32.866406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:32.868108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:32.869568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-33c06954-8b43-45c5-b55e-1bb9a53c4549 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.406763 Oct 12 08:48:32.870279 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 683/1296] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:32 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:32.914658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:32.916992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:32.929471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:32.929994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:32.930446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:32.934028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:32.934839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:32.936135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.026524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:33.036992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:33.038962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:33.044370 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5b90a8d-a740-478c-9b65-4c7f36bd7826 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1478 microversion: 2.91 time: 0.151972 Oct 12 08:48:33.062421 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 684/1297] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:32 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1478 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:33.074398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71254c98-5ad6-464c-8938-00e483c23692 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '.version_select at 0x7f984889c550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:33.107835 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-71254c98-5ad6-464c-8938-00e483c23692 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Image not found. Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71254c98-5ad6-464c-8938-00e483c23692 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/images/a3260ae9-370b-43a3-bc11-3d99af2aa2a9 HTTP/1.1 Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:33.111880 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: exception: Image not found. Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a3260ae9-370b-43a3-bc11-3d99af2aa2a9'} Oct 12 08:48:33.113545 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:48:33.116690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a3260ae9-370b-43a3-bc11-3d99af2aa2a9 Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:48:33.119052 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3260ae9-370b-43a3-bc11-3d99af2aa2a9 could not be found. Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:33.125636 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:33.130430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71254c98-5ad6-464c-8938-00e483c23692 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Image not found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:33.134299 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71254c98-5ad6-464c-8938-00e483c23692 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/images/a3260ae9-370b-43a3-bc11-3d99af2aa2a9" status: 404 len: 62 microversion: 2.1 time: 0.049667 Oct 12 08:48:33.134299 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 685/1298] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:33 2022] GET /compute/v2.1/images/a3260ae9-370b-43a3-bc11-3d99af2aa2a9 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:48:33.134299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c087c862-9fb8-46e4-9123-31b32b4414a0 req-823e9531-f853-4808-bf19-97ebdb2ed8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd399ffd-4151-4122-9901-a61d55e2e70d", "name": "network-vif-unplugged", "status": "completed", "tag": "8ae947b8-c972-44eb-a547-9e84edfdee53"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:33.141007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c087c862-9fb8-46e4-9123-31b32b4414a0 req-823e9531-f853-4808-bf19-97ebdb2ed8c6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.141267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c087c862-9fb8-46e4-9123-31b32b4414a0 req-823e9531-f853-4808-bf19-97ebdb2ed8c6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.142068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c087c862-9fb8-46e4-9123-31b32b4414a0 req-823e9531-f853-4808-bf19-97ebdb2ed8c6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.159456 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c087c862-9fb8-46e4-9123-31b32b4414a0 req-823e9531-f853-4808-bf19-97ebdb2ed8c6 service nova] Creating event network-vif-unplugged:8ae947b8-c972-44eb-a547-9e84edfdee53 for instance fd399ffd-4151-4122-9901-a61d55e2e70d on n-h2-858383-10 Oct 12 08:48:33.167551 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c087c862-9fb8-46e4-9123-31b32b4414a0 req-823e9531-f853-4808-bf19-97ebdb2ed8c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051043 Oct 12 08:48:33.168977 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 686/1299] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:33.179244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2db1b090-64d8-46af-bc44-b937371cdefe tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848a66790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:33.204609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=5 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:33.236841 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2db1b090-64d8-46af-bc44-b937371cdefe tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.063628 Oct 12 08:48:33.237493 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 687/1300] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:33 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:33.248788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:33.249501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:33.256961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.257461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.257891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.258586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.259091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.259514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.340335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] Lazy-loading 'services' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:33.370129 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7affb693-bb4d-4c9f-92ea-aaa6dbe10fb6 tempest-ServersAdmin275Test-745830170 tempest-ServersAdmin275Test-745830170-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1922 microversion: 2.75 time: 0.131081 Oct 12 08:48:33.371479 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 688/1301] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:33 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1922 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:33.377097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858383-10"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:33.380142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:33.386800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.387512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.388126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.389015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.389646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.390249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.443582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858383-10". {{(pid=127006) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 12 08:48:33.513325 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6651b064-eaa2-4885-836b-c8a85df54072 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65/action" status: 202 len: 0 microversion: 2.91 time: 0.140006 Oct 12 08:48:33.514266 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 689/1302] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:48:33 2022] POST /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:48:33.522296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9944c967-32d8-4d0c-a800-5a4e1c530c13 req-b94c25a1-a5b0-44cc-a28d-78360ed4d3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:33.532464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9944c967-32d8-4d0c-a800-5a4e1c530c13 req-b94c25a1-a5b0-44cc-a28d-78360ed4d3a0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.533372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9944c967-32d8-4d0c-a800-5a4e1c530c13 req-b94c25a1-a5b0-44cc-a28d-78360ed4d3a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.533871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9944c967-32d8-4d0c-a800-5a4e1c530c13 req-b94c25a1-a5b0-44cc-a28d-78360ed4d3a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.538123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:33.547718 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9944c967-32d8-4d0c-a800-5a4e1c530c13 req-b94c25a1-a5b0-44cc-a28d-78360ed4d3a0 service nova] Creating event network-changed:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h2-858383-10 Oct 12 08:48:33.557231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-9944c967-32d8-4d0c-a800-5a4e1c530c13 req-b94c25a1-a5b0-44cc-a28d-78360ed4d3a0 service nova] Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:48:33.569565 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9944c967-32d8-4d0c-a800-5a4e1c530c13 req-b94c25a1-a5b0-44cc-a28d-78360ed4d3a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050748 Oct 12 08:48:33.570160 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 690/1303] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:33.576042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:33.576558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:33.582874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.583360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.583799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.584499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.585526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.587415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.750524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:33.759205 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f78af86-61e3-441c-9bf5-fc6891615419 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1540 microversion: 2.1 time: 0.187734 Oct 12 08:48:33.759860 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 691/1304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:33 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1540 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:33.924176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Calling method '.version_select at 0x7f9848a66430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:33.926433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.926911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.927544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.946434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.947089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.947848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.958782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.959315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.959793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.966431 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a54592ef-09e9-4c13-b301-47f4a08bd5fa tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.205269 Oct 12 08:48:33.968086 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 692/1305] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:33 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:33.972977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:33.973484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:33.991787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.992466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.992897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:33.994405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:33.995314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:33.996067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.024919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:48:34.126666 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79eb591a-cb8f-4e61-8e8b-ed9f731e8eff tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 204 len: 0 microversion: 2.75 time: 0.157144 Oct 12 08:48:34.127757 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 693/1306] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:48:33 2022] DELETE /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:48:34.134461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.135396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:34.142240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.142723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.143158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.143957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.144417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.144826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.287595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.295659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df0d3dc7-99f4-4f51-bcea-107fa8661964 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1535 microversion: 2.1 time: 0.166395 Oct 12 08:48:34.296681 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 694/1307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1535 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:34.301248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.301938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:34.307798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.308359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.308881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.310658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.311272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.311766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.384067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.393575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.395114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.400815 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1cc1fd4b-39c4-4a58-9c61-a23681139c08 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1486 microversion: 2.91 time: 0.103171 Oct 12 08:48:34.407576 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 695/1308] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1486 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:34.407773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.408377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:34.415819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.416411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.417944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.417944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.418258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.418743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.506407 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b30bffc-34c6-4b0b-b811-9c70fc9c1202 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.208825 Oct 12 08:48:34.516848 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 614/1309] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:48:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:34.521877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Calling method '.version_select at 0x7f984894c790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.524064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.524935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.525588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.548994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.550616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.551326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.576664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.588006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.589961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.592239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a286158-9d29-4af1-bf06-f6e6684f3967 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.189805 Oct 12 08:48:34.593543 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 696/1310] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:34.600671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.601721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:34.608908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.609396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.610531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.611285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.611937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.612363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.615672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.616503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.617223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.626243 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6ec2cc8-96f2-49b8-871e-b143235d7e3b tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h1-858383-10/servers" status: 200 len: 434 microversion: 2.1 time: 0.107863 Oct 12 08:48:34.627735 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 615/1311] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-10/servers => generated 434 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:34.638768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-620027f0-6db0-42ad-b309-d39770b5f385 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98489e15e0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.687154 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-620027f0-6db0-42ad-b309-d39770b5f385 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.057965 Oct 12 08:48:34.688109 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 616/1312] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:34.692996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'action', calling method: .version_select at 0x7f984b0b1940>, body: {"addFloatingIp": {"address": "172.25.2.223"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:34.695401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:34.701162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.707739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.708411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.708971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.709324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.710127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.710873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.711335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.711502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.717411 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-751616d1-c3fc-406b-902b-542e84818ccf tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1444 microversion: 2.75 time: 0.121996 Oct 12 08:48:34.718036 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 697/1313] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:34.741289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:48:34.741657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquired lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:48:34.743708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Calling method '.version_select at 0x7f984889c040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.745528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.746018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.746674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.762976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.763525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.764031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.775512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.776004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.776444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.785934 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d79c93c-726a-4521-acbe-eb0cdbcf37d4 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.053951 Oct 12 08:48:34.791976 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 698/1314] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:34.792149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.792756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:34.799370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.799859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.800474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.801399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.801947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.802405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.950250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:34.958378 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf8c54bf-b222-47fd-93d2-6e5b6a633971 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1540 microversion: 2.1 time: 0.170377 Oct 12 08:48:34.969650 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 699/1315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1540 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:34.969650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a4d4689-c9ff-444d-8b60-7e79c4449764 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Calling method '.version_select at 0x7f9848b98160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:34.969650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a4d4689-c9ff-444d-8b60-7e79c4449764 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.969650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a4d4689-c9ff-444d-8b60-7e79c4449764 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.970087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a4d4689-c9ff-444d-8b60-7e79c4449764 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.980804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a4d4689-c9ff-444d-8b60-7e79c4449764 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:34.981289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a4d4689-c9ff-444d-8b60-7e79c4449764 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:34.981757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a4d4689-c9ff-444d-8b60-7e79c4449764 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:34.987785 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a4d4689-c9ff-444d-8b60-7e79c4449764 tempest-HypervisorAdminUnderV252Test-978360723 tempest-HypervisorAdminUnderV252Test-978360723-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h1-858383-10/search" status: 200 len: 105 microversion: 2.1 time: 0.027521 Oct 12 08:48:34.988602 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 700/1316] 10.222.0.40 () {58 vars in 1212 bytes} [Wed Oct 12 08:48:34 2022] GET /compute/v2.1/os-hypervisors/n-h1-858383-10/search => generated 105 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:35.319475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:35.320125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:35.327221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:35.327724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:35.328190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:35.328909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:35.329370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:35.329833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:35.779784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:35.788502 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-af4794c0-8693-47c3-a9db-1c22a4ae40d0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1535 microversion: 2.1 time: 0.473128 Oct 12 08:48:35.789049 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 701/1317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:35 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1535 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:35.794073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:35.794891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:35.801724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:35.802633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:35.803281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:35.804003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:35.804439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:35.804858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:35.881999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:35.890525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:35.892605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:35.896659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Building network info cache for instance {{(pid=127007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 08:48:35.897720 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c884862-7a8a-4f24-b3d8-7e2c6c2aa45e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1486 microversion: 2.91 time: 0.107373 Oct 12 08:48:35.899153 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 702/1318] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:35 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1486 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:35.915431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:35.916242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:35.923231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:35.923911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:35.924559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:35.925611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:35.926209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:35.926800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.194976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:36.210879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:36.215674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:36.217654 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-efd2bf8b-9c8a-4102-970e-e2899c53c2c7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.316798 Oct 12 08:48:36.218259 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 703/1319] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:35 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:36.240938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8784eecf-4f2e-4fbd-b935-d2be39e980af tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984889aa60>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:36.292566 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8784eecf-4f2e-4fbd-b935-d2be39e980af tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.057509 Oct 12 08:48:36.301318 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 704/1320] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:36 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:36.306752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:36.307621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:36.310675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:36.319305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.319817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.320404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.321105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.321720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.322106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.374053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.374541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.374983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.375452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lazy-loading 'fault' on Instance uuid c09394cd-e411-4d5e-94c7-02a4beb616a3 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:36.418856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:36.428422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:36.429901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3161633cfb9f40b8be36fb3b7cbcc0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1280b9166e5b4421a661aad1fb4630c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:36.435589 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-257dd672-f321-42fe-bf10-5ff12cb522b5 tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 200 len: 1449 microversion: 2.75 time: 0.132635 Oct 12 08:48:36.436264 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 705/1321] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:36 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 1449 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:36.452597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cb0403c4-4441-44b3-8ab2-edfde6f1e478 req-960201f5-0675-470d-acf1-2304ba55cf06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0652c7-d354-40cf-9549-ad84d90f209a", "tag": "f959cb06-3887-4728-8808-065c73b19749"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:36.470456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb0403c4-4441-44b3-8ab2-edfde6f1e478 req-960201f5-0675-470d-acf1-2304ba55cf06 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.470938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb0403c4-4441-44b3-8ab2-edfde6f1e478 req-960201f5-0675-470d-acf1-2304ba55cf06 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.471369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb0403c4-4441-44b3-8ab2-edfde6f1e478 req-960201f5-0675-470d-acf1-2304ba55cf06 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.486929 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cb0403c4-4441-44b3-8ab2-edfde6f1e478 req-960201f5-0675-470d-acf1-2304ba55cf06 service nova] Creating event network-changed:f959cb06-3887-4728-8808-065c73b19749 for instance 5a0652c7-d354-40cf-9549-ad84d90f209a on n-h1-858383-10 Oct 12 08:48:36.493626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cb0403c4-4441-44b3-8ab2-edfde6f1e478 req-960201f5-0675-470d-acf1-2304ba55cf06 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046463 Oct 12 08:48:36.494749 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 706/1322] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:36.501276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:36.501998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:36.511454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.512034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.512599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.513422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.513938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.514319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.519756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:36.744556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:36.756849 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7cbe8cf1-22ec-4a81-9d9b-5660c2b3f222 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1522 microversion: 2.1 time: 0.260357 Oct 12 08:48:36.773675 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 707/1323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:36 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:36.778946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6e221722-0f8d-4b30-8ea4-34d51da48063 req-008b0e17-7889-42a0-8ca9-3f0cf19bbae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1edd0a71-0c50-4935-8219-d14471f1ea58", "name": "network-vif-plugged", "status": "completed", "tag": "158b51b0-0d4a-4b31-baf5-01b3851b508f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:36.804714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6e221722-0f8d-4b30-8ea4-34d51da48063 req-008b0e17-7889-42a0-8ca9-3f0cf19bbae2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.808105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6e221722-0f8d-4b30-8ea4-34d51da48063 req-008b0e17-7889-42a0-8ca9-3f0cf19bbae2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.808880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6e221722-0f8d-4b30-8ea4-34d51da48063 req-008b0e17-7889-42a0-8ca9-3f0cf19bbae2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.826139 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6e221722-0f8d-4b30-8ea4-34d51da48063 req-008b0e17-7889-42a0-8ca9-3f0cf19bbae2 service nova] Creating event network-vif-plugged:158b51b0-0d4a-4b31-baf5-01b3851b508f for instance 1edd0a71-0c50-4935-8219-d14471f1ea58 on n-h2-858383-10 Oct 12 08:48:36.832970 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6e221722-0f8d-4b30-8ea4-34d51da48063 req-008b0e17-7889-42a0-8ca9-3f0cf19bbae2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057809 Oct 12 08:48:36.834436 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 708/1324] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:36.841940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:36.842908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:36.875707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.876507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.878085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.879195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:36.881150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:36.881855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:36.923634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:48:37.010304 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05347db8-05ab-4549-b723-a10f8f0b7604 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 204 len: 0 microversion: 2.1 time: 0.173797 Oct 12 08:48:37.012091 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 709/1325] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:48:36 2022] DELETE /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:48:37.019179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:37.020195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:37.028460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.029048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.029596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.030405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.030915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.031414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.183852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:37.192577 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a477e2ce-542d-4a71-9109-aebed7247e04 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1535 microversion: 2.1 time: 0.178889 Oct 12 08:48:37.193174 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 710/1326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:37 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1535 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:37.199020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:37.199631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:37.205496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.206034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.206407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.207099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.207549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.208022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.235309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Updating instance_info_cache with network_info: [{"id": "f959cb06-3887-4728-8808-065c73b19749", "address": "fa:16:3e:b1:51:32", "network": {"id": "652a0de1-a1df-488c-aa38-7adfe77106a2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-694125122-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6730ea24a78f4ee0ac1bd784286e0c7b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf959cb06-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:48:37.257834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Releasing lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:48:37.259228 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e0065751-fdb0-4f07-8f38-b95d180d6606 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action" status: 202 len: 0 microversion: 2.1 time: 2.569590 Oct 12 08:48:37.261179 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 617/1327] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:34 2022] POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action => generated 0 bytes in 2572 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 08:48:37.283535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:37.284311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:37.292036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.293168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.293886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.294805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.295483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.296007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.305485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:37.319417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:37.320871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:37.326921 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d9dc7de1-1ab3-46f6-a8b4-1e39ad498528 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1486 microversion: 2.91 time: 0.132671 Oct 12 08:48:37.341462 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 711/1328] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:37 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1486 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:37.341462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:37.341462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:37.341462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.341935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.341935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.342440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.345556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.345556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.474891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:37.483523 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4431558d-5b86-4014-b4e9-2db91b8017c1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1528 microversion: 2.1 time: 0.220907 Oct 12 08:48:37.484474 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 618/1329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:37 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1528 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:37.489950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32c394c3-e2ff-461d-8be8-688f49616dd3 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'create', calling method: .version_select at 0x7f9848a54af0>, body: {"pool": "29c8ef46-7259-4303-bca0-4940f77b8940"} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:37.612708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:37.623002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:37.624850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:37.626169 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c6d27267-fc3c-41c6-b162-46a9e624674a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.297237 Oct 12 08:48:37.627733 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 712/1330] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:37 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:37.633088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5116e1f7-22d0-4b25-83a7-3640819df326 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848bfe940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:37.688074 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5116e1f7-22d0-4b25-83a7-3640819df326 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.059073 Oct 12 08:48:37.688954 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 713/1331] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:37 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:37.694654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:37.695544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] [instance: c09394cd-e411-4d5e-94c7-02a4beb616a3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:37.702761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.703463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.704085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.704958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:37.705698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:37.706514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:37.725841 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] HTTP exception thrown: Instance c09394cd-e411-4d5e-94c7-02a4beb616a3 could not be found. Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Request method failure captured: Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 HTTP/1.1 Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn8T8O_TuKiGIeUbwF6oOTcmflw_18SXHExgCv8lmh5QdCjl2jY4pMTPOreYqELWe9mBpdY9b1G-mUxmcpjE_pw9ig1ASMeP5s4sESNoFDo3hSwSjMz7Wekk1KfJSJNDGgCiPPpZ2intZyUwVqxdy5AuraDwbNspHb6VbAiJF5R6eyU Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.75 Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1280b9166e5b4421a661aad1fb4630c5 Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersAdmin275Test-1415606057 Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:37.728019 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1280b9166e5b4421a661aad1fb4630c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1280b9166e5b4421a661aad1fb4630c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1280b9166e5b4421a661aad1fb4630c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1280b9166e5b4421a661aad1fb4630c5"}]}] Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersAdmin275Test-1415606057 Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1280b9166e5b4421a661aad1fb4630c5 Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersAdmin275Test-1415606057 Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersAdmin275Test-1415606057-project Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3161633cfb9f40b8be36fb3b7cbcc0f9 Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersAdmin275Test-1415606057-project Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance c09394cd-e411-4d5e-94c7-02a4beb616a3 could not be found. Oct 12 08:48:37.729684 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'c09394cd-e411-4d5e-94c7-02a4beb616a3'} Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09394cd-e411-4d5e-94c7-02a4beb616a3 could not be found. Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:37.730606 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09394cd-e411-4d5e-94c7-02a4beb616a3 could not be found. Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09394cd-e411-4d5e-94c7-02a4beb616a3 could not be found. Oct 12 08:48:37.732335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:37.733602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] Returning 404 to user: Instance c09394cd-e411-4d5e-94c7-02a4beb616a3 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:37.733602 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db37463a-0f2d-42e9-9501-bfe2963c82ad tempest-ServersAdmin275Test-1415606057 tempest-ServersAdmin275Test-1415606057-project] 10.222.0.40 "GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3" status: 404 len: 111 microversion: 2.75 time: 0.041640 Oct 12 08:48:37.734084 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 714/1332] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:37 2022] GET /compute/v2.1/servers/c09394cd-e411-4d5e-94c7-02a4beb616a3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:48:38.216226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:38.216880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:38.230402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:38.232343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:38.232961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:38.233559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:38.239513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:38.240115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:38.607716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:38.619561 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c240a9d4-1edf-41ca-9228-fd1d233e0bed tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1535 microversion: 2.1 time: 0.407232 Oct 12 08:48:38.621157 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 715/1333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:38 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1535 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:38.637722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:38.640031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:38.652166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:38.655076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:38.656423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:38.659093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:38.660821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:38.663239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:38.852329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:38.865201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:38.871889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:38.884238 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-75581122-a995-45d2-ae44-2cf465bb05e5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.256933 Oct 12 08:48:38.884806 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 716/1334] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:38 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:38.890299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:38.891242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:38.897939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:38.898885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:38.899641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:38.900531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:38.901162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:38.901793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.165670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:39.176009 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-20cafdf0-781b-48f6-ae43-d08c2bdb9720 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1528 microversion: 2.1 time: 0.290144 Oct 12 08:48:39.181526 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 717/1335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:38 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1528 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:39.184214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:39.184858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:39.191418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.192351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.192544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.193254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.193732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.194160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.504508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:39.527996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:39.536132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:39.537374 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-16b35a66-aa85-4bfd-b069-8bf34853c397 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.357726 Oct 12 08:48:39.538344 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 718/1336] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:39 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:39.542994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-663398b4-53ec-442e-a2be-502e82d9c6af tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984889c040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:39.609850 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-663398b4-53ec-442e-a2be-502e82d9c6af tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.070272 Oct 12 08:48:39.612036 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 719/1337] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:39 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:39.617522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-83faa106-9b1f-4a3a-9ab2-67c2f5f8bd2f req-813fed4a-c045-40cb-a2a8-39e296d771dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515a4a6-8145-4651-8d70-b3d88c404ed8", "name": "network-vif-plugged", "status": "completed", "tag": "0ea86b86-358b-437a-a662-3ad7838ec490"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:39.629199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83faa106-9b1f-4a3a-9ab2-67c2f5f8bd2f req-813fed4a-c045-40cb-a2a8-39e296d771dd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.629855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83faa106-9b1f-4a3a-9ab2-67c2f5f8bd2f req-813fed4a-c045-40cb-a2a8-39e296d771dd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.630524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83faa106-9b1f-4a3a-9ab2-67c2f5f8bd2f req-813fed4a-c045-40cb-a2a8-39e296d771dd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.643046 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-83faa106-9b1f-4a3a-9ab2-67c2f5f8bd2f req-813fed4a-c045-40cb-a2a8-39e296d771dd service nova] Creating event network-vif-plugged:0ea86b86-358b-437a-a662-3ad7838ec490 for instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 on n-h1-858383-10 Oct 12 08:48:39.648280 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-83faa106-9b1f-4a3a-9ab2-67c2f5f8bd2f req-813fed4a-c045-40cb-a2a8-39e296d771dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034807 Oct 12 08:48:39.649116 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 720/1338] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:39.825409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Calling method '.version_select at 0x7f984882c670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:39.829490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.830205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.830990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.847133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.847688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.848310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.881267 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32c394c3-e2ff-461d-8be8-688f49616dd3 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.395149 Oct 12 08:48:39.882869 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 619/1339] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:48:37 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:39.888498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:39.889588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:39.890225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.890723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.891344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.897487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.898103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.898637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.899623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.900460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.901126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.906948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.907718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.908136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.951536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.952028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.952524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.962109 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71286adc-d42c-402c-b95f-b88674887bf1 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2471 microversion: 2.53 time: 0.310394 Oct 12 08:48:39.963045 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 721/1340] 10.222.0.40 () {60 vars in 1243 bytes} [Wed Oct 12 08:48:39 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:39.970923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.92"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:39.979385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:39.986992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.987598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.988048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:39.988802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:39.989295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:39.989759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.024437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:48:40.025242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquired lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:48:40.124877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:40.135800 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db7d843f-fb69-4785-9b25-a081f2289ca1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1535 microversion: 2.1 time: 0.250718 Oct 12 08:48:40.137044 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 620/1341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:39 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1535 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:40.154216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:40.155095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:40.165194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.166048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.166656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.167774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.168398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.169053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.258727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:40.271078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:40.273096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:40.280762 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-06f3825b-fda3-4ad9-ae94-f3e482be0d77 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.141701 Oct 12 08:48:40.282026 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 621/1342] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:40 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:40.301935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Calling method '.version_select at 0x7f98489b9940>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:40.310686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.311199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.311632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.331299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.331841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.332278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.362206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.362684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.363113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.375324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.375854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.376392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.413362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.413934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.414400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.421057 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0a27e55e-ad30-4725-9cb5-39fd18b08e36 tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1162 microversion: 2.53 time: 0.137852 Oct 12 08:48:40.429331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 622/1343] 10.222.0.40 () {60 vars in 1222 bytes} [Wed Oct 12 08:48:40 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1162 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:40.429331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-97c3af47-23af-4bca-bc3c-8a1318ecc981 req-4f66a2b4-9ac6-412a-9772-bd43f5f04f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515a4a6-8145-4651-8d70-b3d88c404ed8", "name": "network-vif-deleted", "tag": "0ea86b86-358b-437a-a662-3ad7838ec490"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:40.439372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97c3af47-23af-4bca-bc3c-8a1318ecc981 req-4f66a2b4-9ac6-412a-9772-bd43f5f04f3a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.439849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97c3af47-23af-4bca-bc3c-8a1318ecc981 req-4f66a2b4-9ac6-412a-9772-bd43f5f04f3a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.440274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97c3af47-23af-4bca-bc3c-8a1318ecc981 req-4f66a2b4-9ac6-412a-9772-bd43f5f04f3a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.452002 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-97c3af47-23af-4bca-bc3c-8a1318ecc981 req-4f66a2b4-9ac6-412a-9772-bd43f5f04f3a service nova] Creating event network-vif-deleted:0ea86b86-358b-437a-a662-3ad7838ec490 for instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 on n-h1-858383-10 Oct 12 08:48:40.457486 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-97c3af47-23af-4bca-bc3c-8a1318ecc981 req-4f66a2b4-9ac6-412a-9772-bd43f5f04f3a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Oct 12 08:48:40.458375 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 623/1344] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:40.465179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:40.466112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:40.473337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.474080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.474863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.475788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.476421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.477039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.513426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.514163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.514787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.515464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lazy-loading 'fault' on Instance uuid 1515a4a6-8145-4651-8d70-b3d88c404ed8 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:48:40.520798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.92 (708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5) with port f959cb06-3887-4728-8808-065c73b19749 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 29c8ef46-7259-4303-bca0-4940f77b8940.", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:48:40.521395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Releasing lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:48:40.522455 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.92 (708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5) with port f959cb06-3887-4728-8808-065c73b19749 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 29c8ef46-7259-4303-bca0-4940f77b8940. Oct 12 08:48:40.522455 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-014a51a4-41ca-494a-b191-bd8150afee6f'] Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Request method failure captured: Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action HTTP/1.1 Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 45 Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9Ev_JBk7IB6187UgEUw6QSIbldUIbOc2Tly8FTXBjd1c3aX8toUo5PBm0tZSENrGAnk0DYjZTBtV-hSbrcvXleGzzQJNDex1rPD9QR_IRiC169ICT0piqF4hCJWFrzfOaXkX4R7T35sdRcx9X7cjWjvmiICWksL2oIlr6l5_5CKnE Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:40.532978 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}] Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 7026dc1487554cdf8ef2b31fe14ef0a3 Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: {"addFloatingIp": {"address": "172.25.2.92"}} Oct 12 08:48:40.534575 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: exception: Cannot associate floating IP 172.25.2.92 (708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5) with port f959cb06-3887-4728-8808-065c73b19749 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 29c8ef46-7259-4303-bca0-4940f77b8940. Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-014a51a4-41ca-494a-b191-bd8150afee6f'] Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5a0652c7-d354-40cf-9549-ad84d90f209a', 'body': {'addFloatingIp': {'address': '172.25.2.92'}}} Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:48:40.535443 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:48:40.536470 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.92 (708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5) with port f959cb06-3887-4728-8808-065c73b19749 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 29c8ef46-7259-4303-bca0-4940f77b8940. Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-014a51a4-41ca-494a-b191-bd8150afee6f'] Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.92 (708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5) with port f959cb06-3887-4728-8808-065c73b19749 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 29c8ef46-7259-4303-bca0-4940f77b8940. Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-014a51a4-41ca-494a-b191-bd8150afee6f'] Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:40.537413 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.92 (708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5) with port f959cb06-3887-4728-8808-065c73b19749 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 29c8ef46-7259-4303-bca0-4940f77b8940. Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-014a51a4-41ca-494a-b191-bd8150afee6f'] Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:40.538939 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.92 (708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5) with port f959cb06-3887-4728-8808-065c73b19749 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 29c8ef46-7259-4303-bca0-4940f77b8940. Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-014a51a4-41ca-494a-b191-bd8150afee6f'] Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Returning 400 to user: Cannot associate floating IP 172.25.2.92 (708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5) with port f959cb06-3887-4728-8808-065c73b19749 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 29c8ef46-7259-4303-bca0-4940f77b8940. Oct 12 08:48:40.540376 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-014a51a4-41ca-494a-b191-bd8150afee6f'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:40.541177 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-94e4c7e1-9c8e-45f2-84af-582b0c85a738 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action" status: 400 len: 380 microversion: 2.1 time: 0.570523 Oct 12 08:48:40.541177 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 722/1345] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:39 2022] POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action => generated 380 bytes in 572 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:48:40.541177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3118f028-b920-430c-b747-709a3178c32e tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Calling method '.version_select at 0x7f9848ca4550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:40.543255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3118f028-b920-430c-b747-709a3178c32e tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.543733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3118f028-b920-430c-b747-709a3178c32e tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.544167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3118f028-b920-430c-b747-709a3178c32e tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.561086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3118f028-b920-430c-b747-709a3178c32e tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.561594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3118f028-b920-430c-b747-709a3178c32e tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.562022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3118f028-b920-430c-b747-709a3178c32e tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.568405 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3118f028-b920-430c-b747-709a3178c32e tempest-HypervisorAdminV253TestBase-1269001076 tempest-HypervisorAdminV253TestBase-1269001076-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/0e0e1726-3dbf-420a-ac82-3c5791840f2d" status: 200 len: 794 microversion: 2.53 time: 0.032182 Oct 12 08:48:40.577581 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 723/1346] 10.222.0.40 () {60 vars in 1298 bytes} [Wed Oct 12 08:48:40 2022] GET /compute/v2.1/os-hypervisors/0e0e1726-3dbf-420a-ac82-3c5791840f2d => generated 794 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:48:40.577581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f3e117f-3ef6-489f-94ed-9428f8d238e2 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '.version_select at 0x7f9848ca4280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:40.577831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:40.585316 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9964a397-b6ef-45f0-a796-a800d5564daa tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 200 len: 1315 microversion: 2.1 time: 0.125427 Oct 12 08:48:40.586367 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 624/1347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:40 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 1315 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:40.591122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:40.591716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:40.598215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.598743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.599188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.600192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:40.601679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:40.602177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:40.837855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:40.852870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:40.854811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:40.856809 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-120cbb2d-6f35-42d4-a311-3dd60860c100 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.269741 Oct 12 08:48:40.858372 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 625/1348] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:40 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:40.880165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-da740d4c-b764-466c-a10b-91754d2969b5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984894c040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:40.933844 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-da740d4c-b764-466c-a10b-91754d2969b5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.074138 Oct 12 08:48:40.934439 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 626/1349] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:40 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:41.163054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:41.163671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:41.173370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:41.174321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:41.175136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:41.176567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:41.177259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:41.178073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:41.445814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:41.459906 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5aebd3c-b057-4877-b437-79e5d69bbb55 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1535 microversion: 2.1 time: 0.300027 Oct 12 08:48:41.462636 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 627/1350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:41 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1535 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:41.480950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:41.483232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:41.503089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:41.503974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:41.504571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:41.505532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:41.506190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:41.506798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:41.623466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:41.626605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:41.647924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:41.650914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:41.658712 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c4d3dfa-25ce-45c0-bb9e-560ed9c76059 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.193529 Oct 12 08:48:41.660101 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 628/1351] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:41 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:41.675464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:41.677519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:41.688203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:41.689763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:41.694461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:41.695251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:41.695909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:41.696394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:41.720605 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f3e117f-3ef6-489f-94ed-9428f8d238e2 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5" status: 202 len: 0 microversion: 2.1 time: 1.150504 Oct 12 08:48:41.725107 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 724/1352] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:48:40 2022] DELETE /compute/v2.1/os-floating-ips/708f3ac7-4ef0-4803-bdaf-f0ef1b4a5ac5 => generated 0 bytes in 1155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:41.726247 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 HTTP/1.1 Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:48:41.729283 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:48:41.730846 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1515a4a6-8145-4651-8d70-b3d88c404ed8'} Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:41.731581 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:48:41.733633 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:41.736161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.223"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:41.738089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:41.739699 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ffdbb40b-f9f9-4bed-8371-52609fe89850 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 404 len: 111 microversion: 2.1 time: 0.077996 Oct 12 08:48:41.740815 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 629/1353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:41 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:41.892399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:41.893422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:41.902897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:41.903868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:41.904642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:41.905534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:41.906297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:41.907045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:42.084156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:42.092587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:42.094319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:42.095743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:42.096726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:42.098267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:42.100273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:42.237209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:42.253695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:42.256190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:42.257390 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-881dcb9d-bdf9-463b-9ca9-9d4b33386447 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.378521 Oct 12 08:48:42.270639 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 630/1354] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:41 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:42.287329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8147b0fa-e292-4be1-9932-ce1c256ca4fa tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848a544c0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:42.606595 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8147b0fa-e292-4be1-9932-ce1c256ca4fa tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1452 microversion: 2.1 time: 0.334956 Oct 12 08:48:42.607344 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 631/1355] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:42 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1452 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:42.622824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-466117426", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:42.627883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:48:42.628544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquired lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:48:45.551375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Building network info cache for instance {{(pid=127006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 08:48:46.814807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Updating instance_info_cache with network_info: [{"id": "f959cb06-3887-4728-8808-065c73b19749", "address": "fa:16:3e:b1:51:32", "network": {"id": "652a0de1-a1df-488c-aa38-7adfe77106a2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-694125122-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6730ea24a78f4ee0ac1bd784286e0c7b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf959cb06-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:48:46.824854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:46.829129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Releasing lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:48:46.830098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c642f256-d4cc-46bf-ad44-0931fc4320a0 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action" status: 202 len: 0 microversion: 2.1 time: 5.103809 Oct 12 08:48:46.834029 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 725/1356] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:41 2022] POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action => generated 0 bytes in 5105 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 08:48:46.837189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:46.837849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:46.846332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:46.847537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:46.848141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:46.849071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:46.849711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:46.850289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:47.150532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:47.166178 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3793859-1fa0-4a94-9b5b-49ca4cba93b8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1528 microversion: 2.1 time: 0.331904 Oct 12 08:48:47.170275 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 726/1357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:46 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1528 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:47.191460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:47.192743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:47.204838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:47.205610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:47.206283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:47.216494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:47.218236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:47.218881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:47.428006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:47.450117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:47.468119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:47.482936 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-977ce196-8294-4b0f-9dc0-3fa659bca995 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.306865 Oct 12 08:48:47.486416 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 727/1358] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:47 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:47.504507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:47.505155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:47.513515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:47.520620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:47.521528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:47.522471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:47.523088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:47.523690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:47.935216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:47.959233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:47.960928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:47.964778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1adc5109-8752-4e71-bba4-75aca3fc9a2f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.474343 Oct 12 08:48:47.968933 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 728/1359] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:47 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:47.981564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f017f1c-0efd-4fe1-8418-24dacd81e83b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98494d83a0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:52.243456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=9 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:52.696710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=88 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:54.977004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] validate_networks() for [('b0bf0094-60cb-403a-9910-1ada4bf97663', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:48:54.986490 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f017f1c-0efd-4fe1-8418-24dacd81e83b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1461 microversion: 2.1 time: 7.011873 Oct 12 08:48:54.987466 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 729/1360] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:47 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1461 bytes in 7013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:55.196765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1325595799", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:55.260641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:48:55.426216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:48:55.426638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:48:55.427114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:48:55.427524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:48:55.427962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:48:55.443864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:55.444351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:55.444788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:55.445816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:55.445972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:55.446442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:55.469625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Getting quotas for project 9c9affaa3c854de0919bb5fd833a92fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:48:55.475742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Getting quotas for user 288742d71ac1442a9bae776c2296935d and project 9c9affaa3c854de0919bb5fd833a92fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:48:55.491872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:48:55.492222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:48:55.492787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:48:55.493334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:48:55.493764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:48:55.494168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:48:55.496300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:48:55.505252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:55.506094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:55.506755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:55.507798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:55.508505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:55.509205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:55.532507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:48:55.537585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:48:55.545245 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ce733ae3-5577-4edf-8232-a28b9583bba7 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 12.936021 Oct 12 08:48:55.545940 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 632/1361] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 12937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:48:55.559606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bcfc6fb5-7518-4c78-8215-71a2008fcf4f req-622c4343-250f-4045-8036-a30a3b2eccd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "name": "network-vif-plugged", "status": "completed", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:55.568309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:48:55.570719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:48:55.571974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bcfc6fb5-7518-4c78-8215-71a2008fcf4f req-622c4343-250f-4045-8036-a30a3b2eccd8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:55.572735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bcfc6fb5-7518-4c78-8215-71a2008fcf4f req-622c4343-250f-4045-8036-a30a3b2eccd8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:55.573202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bcfc6fb5-7518-4c78-8215-71a2008fcf4f req-622c4343-250f-4045-8036-a30a3b2eccd8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:55.586588 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bcfc6fb5-7518-4c78-8215-71a2008fcf4f req-622c4343-250f-4045-8036-a30a3b2eccd8 service nova] Creating event network-vif-plugged:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h2-858383-10 Oct 12 08:48:55.593360 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bcfc6fb5-7518-4c78-8215-71a2008fcf4f req-622c4343-250f-4045-8036-a30a3b2eccd8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045794 Oct 12 08:48:55.594534 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 633/1362] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:55.599882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-66cd8c63-3c65-425e-bb1f-a3dd7c12ef70 req-bca47733-d123-4303-9c40-9b9cba23eefa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0652c7-d354-40cf-9549-ad84d90f209a", "tag": "f959cb06-3887-4728-8808-065c73b19749"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:55.610535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-66cd8c63-3c65-425e-bb1f-a3dd7c12ef70 req-bca47733-d123-4303-9c40-9b9cba23eefa service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:55.611116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-66cd8c63-3c65-425e-bb1f-a3dd7c12ef70 req-bca47733-d123-4303-9c40-9b9cba23eefa service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:55.611665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-66cd8c63-3c65-425e-bb1f-a3dd7c12ef70 req-bca47733-d123-4303-9c40-9b9cba23eefa service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:55.626764 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-66cd8c63-3c65-425e-bb1f-a3dd7c12ef70 req-bca47733-d123-4303-9c40-9b9cba23eefa service nova] Creating event network-changed:f959cb06-3887-4728-8808-065c73b19749 for instance 5a0652c7-d354-40cf-9549-ad84d90f209a on n-h1-858383-10 Oct 12 08:48:55.631934 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-66cd8c63-3c65-425e-bb1f-a3dd7c12ef70 req-bca47733-d123-4303-9c40-9b9cba23eefa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036015 Oct 12 08:48:55.632861 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 634/1363] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:55.640851 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a026d41-eb28-48f1-bb61-edcbf54fe891 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652082 Oct 12 08:48:55.642107 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 730/1364] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:48:55.656128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9835a370-926a-488b-b5a9-86021c774e0a tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '.version_select at 0x7f9848b95310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:55.721197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-be261117-83ba-4c4d-b601-8e7b5126fce6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Calling method '.version_select at 0x7f98489658b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:55.850106 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-be261117-83ba-4c4d-b601-8e7b5126fce6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/3a23bc056fb84e6ea8304e21e0c6a7a5" status: 200 len: 371 microversion: 2.1 time: 0.215620 Oct 12 08:48:55.865631 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 635/1365] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 08:48:55 2022] GET /compute/v2.1/os-quota-sets/3a23bc056fb84e6ea8304e21e0c6a7a5 => generated 371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:55.871026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:55.871720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:55.880346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:55.883673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:55.884073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:55.884841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:55.885261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:55.885848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.267874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.277164 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3dadfb20-c59d-4513-963e-670d2458be4d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1528 microversion: 2.1 time: 0.410336 Oct 12 08:48:56.281602 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 636/1366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:55 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1528 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:56.297479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:56.298636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:56.307685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.308770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.309425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.310943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.311753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.312551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.397602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.406880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.408332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.413531 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a91b5e54-7b75-4147-ad91-05b185097462 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.130708 Oct 12 08:48:56.414114 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 637/1367] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:56 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:56.418846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:56.419453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:56.425622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.425731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.426146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.426899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.427356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.427778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.651096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.661199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.662683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.664247 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9ea978c-0d73-4f8c-b13f-60b1b81650d6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.249197 Oct 12 08:48:56.669907 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 638/1368] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:56 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:56.669907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f69d5946-4633-4cea-b25f-06cbec4b0870 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848965d30>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:56.729300 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f69d5946-4633-4cea-b25f-06cbec4b0870 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 200 len: 1461 microversion: 2.1 time: 0.063337 Oct 12 08:48:56.730771 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 639/1369] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:56 2022] GET /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 1461 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:56.735891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:56.736836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:56.744506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.745572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.746175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.747332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.748281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.748706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.837231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.846740 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9835a370-926a-488b-b5a9-86021c774e0a tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/f7248946-bd41-42b7-8e5d-0acbb4778610" status: 202 len: 0 microversion: 2.1 time: 1.202595 Oct 12 08:48:56.847970 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 731/1370] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:48:55 2022] DELETE /compute/v2.1/os-floating-ips/f7248946-bd41-42b7-8e5d-0acbb4778610 => generated 0 bytes in 1205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:56.850089 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-966c8d28-df1d-4192-9dad-0d36869731dc tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1228 microversion: 2.1 time: 0.117750 Oct 12 08:48:56.861461 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 640/1371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:56 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1228 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:56.861461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0443ac47-8735-418a-9f63-a5e3fecc23ea tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Action: 'update', calling method: .version_select at 0x7f98489f6790>, body: {"quota_set": {"ram": "5120"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:56.875177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:56.876116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:56.885373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.886134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.886868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.887828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.888488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.889136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.932166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0443ac47-8735-418a-9f63-a5e3fecc23ea tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.932876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0443ac47-8735-418a-9f63-a5e3fecc23ea tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.933323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0443ac47-8735-418a-9f63-a5e3fecc23ea tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.934515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0443ac47-8735-418a-9f63-a5e3fecc23ea tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:56.934614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0443ac47-8735-418a-9f63-a5e3fecc23ea tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:56.935138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0443ac47-8735-418a-9f63-a5e3fecc23ea tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:56.961596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:56.969389 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59f1c69f-d0e6-4ec5-89c9-217ed8d608a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1213 microversion: 2.1 time: 0.119998 Oct 12 08:48:56.970009 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 732/1372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:56 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:56.975549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b1cec6fa-2644-45bf-8daa-8037042e34f1 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:56.981651 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-b1cec6fa-2644-45bf-8daa-8037042e34f1 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] HTTP exception thrown: Flavor 3f24b9d7-f6bc-4dc9-813a-08e48e509545 could not be found. Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b1cec6fa-2644-45bf-8daa-8037042e34f1 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Request method failure captured: Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/flavors/3f24b9d7-f6bc-4dc9-813a-08e48e509545 HTTP/1.1 Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6G58dRoANg_8U8ow_hzTDqIEfn3s2uJOV2Ox13OcQuMJ2guCfKPPM9_uQNyhcuHkEK3JfrRlW0zEbn5-Mx0mO6eV-88-VtnlpV9qPllwj42sDVcB6I5NJj1UAtoza-0oP6oXL0OyXnK51LSxJmHRfyHfV5AEAyBBY8qJ9-msm43Cc Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 569b8de08dc140fa949d9c6b7a33887b Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-MigrationsAdminTest-241151849 Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:48:56.987046 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/569b8de08dc140fa949d9c6b7a33887b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/569b8de08dc140fa949d9c6b7a33887b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_569b8de08dc140fa949d9c6b7a33887b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/569b8de08dc140fa949d9c6b7a33887b"}]}] Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-MigrationsAdminTest-241151849 Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 569b8de08dc140fa949d9c6b7a33887b Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-MigrationsAdminTest-241151849 Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-MigrationsAdminTest-241151849-project-admin Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: aefd7aaea5564dccac221b08755a4bb5 Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-MigrationsAdminTest-241151849-project-admin Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: exception: Flavor 3f24b9d7-f6bc-4dc9-813a-08e48e509545 could not be found. Oct 12 08:48:56.988763 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3f24b9d7-f6bc-4dc9-813a-08e48e509545'} Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3f24b9d7-f6bc-4dc9-813a-08e48e509545 could not be found. Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:56.989748 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3f24b9d7-f6bc-4dc9-813a-08e48e509545 could not be found. Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3f24b9d7-f6bc-4dc9-813a-08e48e509545 could not be found. Oct 12 08:48:56.991654 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:56.993550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b1cec6fa-2644-45bf-8daa-8037042e34f1 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Returning 404 to user: Flavor 3f24b9d7-f6bc-4dc9-813a-08e48e509545 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:56.993550 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b1cec6fa-2644-45bf-8daa-8037042e34f1 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/3f24b9d7-f6bc-4dc9-813a-08e48e509545" status: 404 len: 109 microversion: 2.1 time: 0.017760 Oct 12 08:48:56.993550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 733/1373] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:48:56 2022] DELETE /compute/v2.1/flavors/3f24b9d7-f6bc-4dc9-813a-08e48e509545 => generated 109 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:48:56.994496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:56.996062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:57.003406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.004504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.009537 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0443ac47-8735-418a-9f63-a5e3fecc23ea tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/3a23bc056fb84e6ea8304e21e0c6a7a5" status: 200 len: 328 microversion: 2.1 time: 0.157435 Oct 12 08:48:57.009679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.010184 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 641/1374] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:48:56 2022] PUT /compute/v2.1/os-quota-sets/3a23bc056fb84e6ea8304e21e0c6a7a5 => generated 328 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:57.016557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3136b052-098d-4375-8074-a978984453bf tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:57.018306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.018812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.019315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3136b052-098d-4375-8074-a978984453bf tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Request method failure captured: Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action HTTP/1.1 Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 34 Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9Ev_JBk7IB6187UgEUw6QSIbldUIbOc2Tly8FTXBjd1c3aX8toUo5PBm0tZSENrGAnk0DYjZTBtV-hSbrcvXleGzzQJNDex1rPD9QR_IRiC169ICT0piqF4hCJWFrzfOaXkX4R7T35sdRcx9X7cjWjvmiICWksL2oIlr6l5_5CKnE Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:48:57.020749 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}] Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 7026dc1487554cdf8ef2b31fe14ef0a3 Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: {"addFloatingIp": {"address": ""}} Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:48:57.022131 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5a0652c7-d354-40cf-9549-ad84d90f209a', 'body': {'addFloatingIp': {'address': ''}}} Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi '' Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:57.022941 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:48:57.024362 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:48:57.025614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 12 08:48:57.025614 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.025614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3136b052-098d-4375-8074-a978984453bf tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:57.025614 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3136b052-098d-4375-8074-a978984453bf tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action" status: 400 len: 142 microversion: 2.1 time: 0.011060 Oct 12 08:48:57.027835 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 642/1375] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:57 2022] POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:48:57.032241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2084f019-2cc8-4f9b-a729-c9e4342b7289 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:57.049495 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2084f019-2cc8-4f9b-a729-c9e4342b7289 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-quota-sets/3a23bc056fb84e6ea8304e21e0c6a7a5" status: 202 len: 0 microversion: 2.1 time: 0.020662 Oct 12 08:48:57.053016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 643/1376] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 08:48:57 2022] DELETE /compute/v2.1/os-quota-sets/3a23bc056fb84e6ea8304e21e0c6a7a5 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:48:57.055747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:57.058741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:57.066590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.067072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.067509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.068536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.068967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.069391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.096309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 08:48:57.097059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquired lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 08:48:57.180134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:57.188516 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b16c7a32-0966-43fb-aa01-83b799a40e69 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1480 microversion: 2.1 time: 0.198104 Oct 12 08:48:57.189089 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 734/1377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:56 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1480 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:57.198695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-48e0e13b-86b0-46b9-a10d-66f7edd6f06e tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Calling method '.version_select at 0x7f9848c97040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:57.209058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Releasing lock "refresh_cache-5a0652c7-d354-40cf-9549-ad84d90f209a" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 08:48:57.209844 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] HTTP exception thrown: floating IP not found Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Request method failure captured: Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action HTTP/1.1 Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 41 Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9Ev_JBk7IB6187UgEUw6QSIbldUIbOc2Tly8FTXBjd1c3aX8toUo5PBm0tZSENrGAnk0DYjZTBtV-hSbrcvXleGzzQJNDex1rPD9QR_IRiC169ICT0piqF4hCJWFrzfOaXkX4R7T35sdRcx9X7cjWjvmiICWksL2oIlr6l5_5CKnE Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:48:57.213397 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}] Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 7026dc1487554cdf8ef2b31fe14ef0a3 Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:48:57.214909 n-d-858383-10 devstack@n-api.service[127007]: exception: floating IP not found Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5a0652c7-d354-40cf-9549-ad84d90f209a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:57.215689 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 12 08:48:57.216865 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.220426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Returning 404 to user: floating IP not found {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:57.220426 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7a731b09-4c55-4f1d-baf5-0a98c241eb15 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action" status: 404 len: 67 microversion: 2.1 time: 0.163721 Oct 12 08:48:57.220426 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 644/1378] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:57 2022] POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action => generated 67 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:48:57.222563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-319343418", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:57.265418 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-48e0e13b-86b0-46b9-a10d-66f7edd6f06e tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/3a23bc056fb84e6ea8304e21e0c6a7a5" status: 200 len: 371 microversion: 2.1 time: 0.075001 Oct 12 08:48:57.266094 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 735/1379] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 08:48:57 2022] GET /compute/v2.1/os-quota-sets/3a23bc056fb84e6ea8304e21e0c6a7a5 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:57.273869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38ddef0b-757f-4843-ad77-1ea1b9f869c4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:57.274491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:48:57.335535 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-38ddef0b-757f-4843-ad77-1ea1b9f869c4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38ddef0b-757f-4843-ad77-1ea1b9f869c4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Request method failure captured: Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action HTTP/1.1 Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 44 Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9Ev_JBk7IB6187UgEUw6QSIbldUIbOc2Tly8FTXBjd1c3aX8toUo5PBm0tZSENrGAnk0DYjZTBtV-hSbrcvXleGzzQJNDex1rPD9QR_IRiC169ICT0piqF4hCJWFrzfOaXkX4R7T35sdRcx9X7cjWjvmiICWksL2oIlr6l5_5CKnE Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:48:57.337273 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}] Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 7026dc1487554cdf8ef2b31fe14ef0a3 Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:48:57.338712 n-d-858383-10 devstack@n-api.service[127006]: exception: Floating IP not found for address 0.0.0.0. Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5a0652c7-d354-40cf-9549-ad84d90f209a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:48:57.339513 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 12 08:48:57.340693 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:48:57.342017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38ddef0b-757f-4843-ad77-1ea1b9f869c4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:48:57.342017 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38ddef0b-757f-4843-ad77-1ea1b9f869c4 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action" status: 404 len: 88 microversion: 2.1 time: 0.071897 Oct 12 08:48:57.342017 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 736/1380] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:57 2022] POST /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a/action => generated 88 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:48:57.349618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:57.350095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:57.357686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.358173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.358741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.359452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.359914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.360340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.386362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:48:57.470983 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-146946fc-d588-4577-8605-a947363ea038 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 204 len: 0 microversion: 2.1 time: 0.125122 Oct 12 08:48:57.471699 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 737/1381] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:48:57 2022] DELETE /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:48:57.478602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dae357ee-8199-4705-be80-0a89e0b386c1 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Calling method '.version_select at 0x7f9848f7d8b0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:57.669347 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dae357ee-8199-4705-be80-0a89e0b386c1 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/68757faf337e4799a15aef6d34735678/defaults" status: 200 len: 371 microversion: 2.1 time: 0.195738 Oct 12 08:48:57.670004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 738/1382] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:48:57 2022] GET /compute/v2.1/os-quota-sets/68757faf337e4799a15aef6d34735678/defaults => generated 371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:57.674784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:57.675583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:57.678838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:57.689676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.690462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.691083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.691821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.692279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.692708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.771264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:57.785478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:57.785478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:57.790662 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d534cf88-583d-4f67-9db2-a93893ad76f6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.119673 Oct 12 08:48:57.791696 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 739/1383] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:57 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:57.795950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:57.796561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:57.802279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.802756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.803191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.804423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.804423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.804723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.823074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:48:57.823490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:48:57.824013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:48:57.824420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:48:57.824821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:48:57.833865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.834378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.834814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.835553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.836001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.836426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.860166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:48:57.860166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Getting quotas for user 5631063704964af4a1d7780077789e48 and project 94a0f8d18f724f789b822a70fc97797a. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:48:57.870992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:48:57.872194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:48:57.924682 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1540726f-25de-4199-a931-5ac1d7cd3408 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707035 Oct 12 08:48:57.925234 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 645/1384] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:48:57.935861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:57.936602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:57.945212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.946562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.946562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.947423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.947882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.948303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.960338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:57.968468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c32fac69-b2f2-40a8-9a12-de504da95d3e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1541 microversion: 2.1 time: 0.175951 Oct 12 08:48:57.979159 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 740/1385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:57 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:57.979159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:57.979159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:57.981293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.981852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.982311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:57.982998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:57.983434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:57.983856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.049046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.059241 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e23dcbfa-4ab9-40a9-a906-f186ed3ae818 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1220 microversion: 2.1 time: 0.089023 Oct 12 08:48:58.068117 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 741/1386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:57 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:58.068117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3216d2ca-f245-4c63-88f7-e4aa0b7a47b6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Action: 'update', calling method: .version_select at 0x7f98490c1ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:58.110373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.119165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.120664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.122150 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0cb6e636-2d2b-42bb-9a39-79fa5a5446bd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.191501 Oct 12 08:48:58.122785 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 646/1387] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:57 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:58.127454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4febd7cf-23c5-4012-a601-83d6bc03817d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:58.128056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4febd7cf-23c5-4012-a601-83d6bc03817d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:58.194212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4febd7cf-23c5-4012-a601-83d6bc03817d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.202140 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4febd7cf-23c5-4012-a601-83d6bc03817d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1212 microversion: 2.1 time: 0.078231 Oct 12 08:48:58.202749 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 647/1388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:58 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:58.207497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:58.208103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:58.215595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.216411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.217061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.218217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.218681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.219116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.220351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3216d2ca-f245-4c63-88f7-e4aa0b7a47b6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.220945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3216d2ca-f245-4c63-88f7-e4aa0b7a47b6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.221385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3216d2ca-f245-4c63-88f7-e4aa0b7a47b6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.222522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3216d2ca-f245-4c63-88f7-e4aa0b7a47b6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.223097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3216d2ca-f245-4c63-88f7-e4aa0b7a47b6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.223450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3216d2ca-f245-4c63-88f7-e4aa0b7a47b6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.305195 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3216d2ca-f245-4c63-88f7-e4aa0b7a47b6 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6bcda6f6b9e14736b447b722396d6a0d" status: 200 len: 328 microversion: 2.1 time: 0.244055 Oct 12 08:48:58.306364 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 742/1389] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:48:58 2022] PUT /compute/v2.1/os-quota-sets/6bcda6f6b9e14736b447b722396d6a0d => generated 328 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:58.316056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:58.316519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.317113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:58.324038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.324784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.325526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.326476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.326938 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-be2030bd-c288-439a-a987-f243f551a284 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1269 microversion: 2.1 time: 0.123162 Oct 12 08:48:58.327124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.327784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.329616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 648/1390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:58 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:58.336526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d522dad6-503b-4b8f-8661-4c316c784597 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Calling method '.version_select at 0x7f984888ca60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:58.446306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d522dad6-503b-4b8f-8661-4c316c784597 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.446446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d522dad6-503b-4b8f-8661-4c316c784597 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.448989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d522dad6-503b-4b8f-8661-4c316c784597 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.449390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d522dad6-503b-4b8f-8661-4c316c784597 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.449889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d522dad6-503b-4b8f-8661-4c316c784597 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.450314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d522dad6-503b-4b8f-8661-4c316c784597 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.479250 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d522dad6-503b-4b8f-8661-4c316c784597 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6bcda6f6b9e14736b447b722396d6a0d/detail" status: 200 len: 916 microversion: 2.1 time: 0.148260 Oct 12 08:48:58.479889 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 649/1391] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:48:58 2022] GET /compute/v2.1/os-quota-sets/6bcda6f6b9e14736b447b722396d6a0d/detail => generated 916 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:58.544832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.553314 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fea6db6b-6870-4d84-8279-1ce459977a9f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1467 microversion: 2.1 time: 0.245698 Oct 12 08:48:58.557488 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 743/1392] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:58 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1467 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:58.576695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1207112567"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:58.579057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:58.586137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.586774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.587337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.588093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.588798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.589107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.643357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Action: 'update', calling method: .version_select at 0x7f9848c25dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:58.705786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.706649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.707436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.708267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.708794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.709509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.754553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.755032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.755460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.756182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.756806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.757226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.799289 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ae6e604-d704-4150-995b-a2a59119434f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "POST /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d/action" status: 202 len: 0 microversion: 2.1 time: 0.226444 Oct 12 08:48:58.799926 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 650/1393] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:48:58 2022] POST /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:48:58.811451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-84fbd85c-02e7-45c0-bd19-3aeeb0c17615 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848922040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:58.814957 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-03cd2136-7bf2-45f1-9f54-12ba6d5566bc tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6bcda6f6b9e14736b447b722396d6a0d?user_id=cecc48cb5c074d46b67d7f8a56ffacf1" status: 200 len: 328 microversion: 2.1 time: 0.174728 Oct 12 08:48:58.815965 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 744/1394] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 08:48:58 2022] PUT /compute/v2.1/os-quota-sets/6bcda6f6b9e14736b447b722396d6a0d?user_id=cecc48cb5c074d46b67d7f8a56ffacf1 => generated 328 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:48:58.823162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:58.823831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:58.831785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.832277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.832711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.833407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:58.833909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:58.834358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:58.875547 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-84fbd85c-02e7-45c0-bd19-3aeeb0c17615 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.068829 Oct 12 08:48:58.876160 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 651/1395] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:58 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:58.884457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6350c3fe-90fa-4dc0-8e44-50240b4fa0d8 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Calling method '.version_select at 0x7f98488910d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:58.921352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.929787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.931635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:58.937067 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8327ec5d-a0bb-437a-b39b-96d57256ca4d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.119846 Oct 12 08:48:58.937749 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 745/1396] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:58 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:58.957637 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6350c3fe-90fa-4dc0-8e44-50240b4fa0d8 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6bcda6f6b9e14736b447b722396d6a0d?user_id=cecc48cb5c074d46b67d7f8a56ffacf1" status: 200 len: 370 microversion: 2.1 time: 0.079926 Oct 12 08:48:58.958143 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 652/1397] 10.222.0.40 () {58 vars in 1323 bytes} [Wed Oct 12 08:48:58 2022] GET /compute/v2.1/os-quota-sets/6bcda6f6b9e14736b447b722396d6a0d?user_id=cecc48cb5c074d46b67d7f8a56ffacf1 => generated 370 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:58.992793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:58.994294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:59.000998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.001756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.002356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.003173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.004285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.004881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.083125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:59.083881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:59.091979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.092844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.093362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.094310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.095069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.095559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.160502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:59.169748 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f274d6bc-74b7-4466-a5aa-e80ad20716bc tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1541 microversion: 2.1 time: 0.181030 Oct 12 08:48:59.170890 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 746/1398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:58 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1541 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:59.186485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:59.187522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:59.195690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.196630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.197340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.198320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.199121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.199867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.201717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:59.209594 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7b12e718-c7f2-4a4e-b6eb-3e8db8154a1e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1220 microversion: 2.1 time: 0.130214 Oct 12 08:48:59.210719 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 653/1399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:59 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:59.225826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:59.226715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:59.233329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.234163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.234808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.235719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.236361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.237177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.319437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:59.328908 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ca35cad-70e6-43ac-9ccc-5832c5a48693 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1208 microversion: 2.1 time: 0.107215 Oct 12 08:48:59.346215 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 654/1400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:59 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:59.352799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0b5ee6d-039c-4e65-ab27-4261594f8ef8 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Calling method '.version_select at 0x7f9848897ca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:59.400504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:59.411469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:59.412899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:59.414131 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ba5e846-af3a-49f9-9ae9-a04432d4d8bb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.242160 Oct 12 08:48:59.414692 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 747/1401] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:59 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:48:59.419222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:59.419818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:59.425769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.426245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.426677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.427421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.427865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.428282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.430996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:59.498886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:48:59.508306 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd3d0880-8bc6-467e-9ca4-83e8f833855b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1269 microversion: 2.1 time: 0.092351 Oct 12 08:48:59.509024 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 748/1402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:48:59 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1269 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:48:59.582189 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0b5ee6d-039c-4e65-ab27-4261594f8ef8 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/68757faf337e4799a15aef6d34735678/defaults" status: 200 len: 371 microversion: 2.1 time: 0.234586 Oct 12 08:48:59.582853 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 655/1403] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:48:59 2022] GET /compute/v2.1/os-quota-sets/68757faf337e4799a15aef6d34735678/defaults => generated 371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:48:59.591587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-06241b1e-8d37-46c3-af0e-3cbc5a416c0c req-1a2a51f5-ce1e-4610-819f-944b1cd456ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0652c7-d354-40cf-9549-ad84d90f209a", "name": "network-vif-deleted", "tag": "f959cb06-3887-4728-8808-065c73b19749"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:59.598890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77b65693-7659-4d4e-9321-c80771c3c0ab tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Action: 'update', calling method: .version_select at 0x7f9848897ee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:48:59.608228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-06241b1e-8d37-46c3-af0e-3cbc5a416c0c req-1a2a51f5-ce1e-4610-819f-944b1cd456ff service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.608789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-06241b1e-8d37-46c3-af0e-3cbc5a416c0c req-1a2a51f5-ce1e-4610-819f-944b1cd456ff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.610043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-06241b1e-8d37-46c3-af0e-3cbc5a416c0c req-1a2a51f5-ce1e-4610-819f-944b1cd456ff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.622177 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-06241b1e-8d37-46c3-af0e-3cbc5a416c0c req-1a2a51f5-ce1e-4610-819f-944b1cd456ff service nova] Creating event network-vif-deleted:f959cb06-3887-4728-8808-065c73b19749 for instance 5a0652c7-d354-40cf-9549-ad84d90f209a on n-h1-858383-10 Oct 12 08:48:59.626893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-06241b1e-8d37-46c3-af0e-3cbc5a416c0c req-1a2a51f5-ce1e-4610-819f-944b1cd456ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039613 Oct 12 08:48:59.627521 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 749/1404] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:48:59.667266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77b65693-7659-4d4e-9321-c80771c3c0ab tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.667957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77b65693-7659-4d4e-9321-c80771c3c0ab tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.668545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77b65693-7659-4d4e-9321-c80771c3c0ab tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.669269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77b65693-7659-4d4e-9321-c80771c3c0ab tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.669739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77b65693-7659-4d4e-9321-c80771c3c0ab tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.670190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77b65693-7659-4d4e-9321-c80771c3c0ab tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.691892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:48:59.891621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a7874de6-34ac-4bd4-b21b-04ac03031c53 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848983c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:59.960703 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a7874de6-34ac-4bd4-b21b-04ac03031c53 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.073458 Oct 12 08:48:59.961593 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 750/1405] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:48:59 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:48:59.972980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:48:59.973772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:48:59.979846 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77b65693-7659-4d4e-9321-c80771c3c0ab tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/68757faf337e4799a15aef6d34735678" status: 200 len: 329 microversion: 2.1 time: 0.388087 Oct 12 08:48:59.980576 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 656/1406] 10.222.0.40 () {60 vars in 1263 bytes} [Wed Oct 12 08:48:59 2022] PUT /compute/v2.1/os-quota-sets/68757faf337e4799a15aef6d34735678 => generated 329 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:48:59.982583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.983258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.983860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:48:59.984772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:48:59.985228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:48:59.985836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.002301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d12c0e7-2647-4ddf-ab49-eb6b780a13f7 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Action: 'update', calling method: .version_select at 0x7f9848891160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:00.123862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d12c0e7-2647-4ddf-ab49-eb6b780a13f7 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.124920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d12c0e7-2647-4ddf-ab49-eb6b780a13f7 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.126388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d12c0e7-2647-4ddf-ab49-eb6b780a13f7 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.130767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d12c0e7-2647-4ddf-ab49-eb6b780a13f7 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.131371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d12c0e7-2647-4ddf-ab49-eb6b780a13f7 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.131902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d12c0e7-2647-4ddf-ab49-eb6b780a13f7 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.208313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:00.230766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:00.236833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:00.252831 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2ba72bef-d3d9-49de-8b42-affd4624fc13 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.288101 Oct 12 08:49:00.269639 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 751/1407] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:48:59 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:00.280768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:00.281643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:00.293278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.294407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.295489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.298365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.303802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.304484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.347804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.348721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.350246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.350969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lazy-loading 'fault' on Instance uuid 5a0652c7-d354-40cf-9549-ad84d90f209a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:49:00.501626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7026dc1487554cdf8ef2b31fe14ef0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6730ea24a78f4ee0ac1bd784286e0c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:00.509226 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a43fa70-1c46-4817-aace-3b80e2117ae7 tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 200 len: 1322 microversion: 2.1 time: 0.238375 Oct 12 08:49:00.509886 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 752/1408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:00 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:00.540063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:00.540795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:00.557277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.557731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.558236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.559011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.559521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.561247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.659605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:00.667865 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ec79559-4766-439b-8ca6-dc05b266f6b5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1276 microversion: 2.1 time: 0.140777 Oct 12 08:49:00.668682 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 753/1409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:00 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:00.673518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:00.674337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:00.680812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.681696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.682311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.683261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.684013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.684620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.698793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=28,nova_api:UPDATE=14 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:00.712818 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d12c0e7-2647-4ddf-ab49-eb6b780a13f7 tempest-QuotasAdminTestJSON-1130781377 tempest-QuotasAdminTestJSON-1130781377-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/68757faf337e4799a15aef6d34735678" status: 200 len: 329 microversion: 2.1 time: 0.714751 Oct 12 08:49:00.713845 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 657/1410] 10.222.0.40 () {60 vars in 1263 bytes} [Wed Oct 12 08:48:59 2022] PUT /compute/v2.1/os-quota-sets/68757faf337e4799a15aef6d34735678 => generated 329 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:00.720217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9abe6852-27ba-49e2-b2ca-8248d336cfe7 req-c5a15008-e45a-4891-bea4-9d5e474d3ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1edd0a71-0c50-4935-8219-d14471f1ea58", "name": "network-vif-unplugged", "status": "completed", "tag": "158b51b0-0d4a-4b31-baf5-01b3851b508f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:00.747037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9abe6852-27ba-49e2-b2ca-8248d336cfe7 req-c5a15008-e45a-4891-bea4-9d5e474d3ef1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.747821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9abe6852-27ba-49e2-b2ca-8248d336cfe7 req-c5a15008-e45a-4891-bea4-9d5e474d3ef1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.748249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9abe6852-27ba-49e2-b2ca-8248d336cfe7 req-c5a15008-e45a-4891-bea4-9d5e474d3ef1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.760713 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9abe6852-27ba-49e2-b2ca-8248d336cfe7 req-c5a15008-e45a-4891-bea4-9d5e474d3ef1 service nova] Creating event network-vif-unplugged:158b51b0-0d4a-4b31-baf5-01b3851b508f for instance 1edd0a71-0c50-4935-8219-d14471f1ea58 on n-h2-858383-10 Oct 12 08:49:00.766508 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9abe6852-27ba-49e2-b2ca-8248d336cfe7 req-c5a15008-e45a-4891-bea4-9d5e474d3ef1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051189 Oct 12 08:49:00.767433 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 658/1411] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:00.775168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:00.776276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:00.782981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.783326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.783775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.784543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.785006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.785554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.798559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:00.813479 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-18184e49-c287-4559-9403-4ef66426c498 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1208 microversion: 2.1 time: 0.143234 Oct 12 08:49:00.814078 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 754/1412] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:00 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1208 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:00.820691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:00.826282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:00.835312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.835806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.836376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.837175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:00.846306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:00.846905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:00.995856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:01.005723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:01.007479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:01.008774 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cdb4bb52-b3b6-48bb-b42c-cbc46ee4f678 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.239887 Oct 12 08:49:01.021461 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 659/1413] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:00 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:01.021461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c172ea16-3819-4176-8e77-5027c71a835b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98488971f0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:01.048691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:01.059535 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2dfafd5f-724d-479b-925a-6d43e99c72f7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1275 microversion: 2.1 time: 0.244418 Oct 12 08:49:01.060179 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 755/1414] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:00 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1275 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:01.078745 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c172ea16-3819-4176-8e77-5027c71a835b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.068171 Oct 12 08:49:01.079739 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 660/1415] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:01 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:01.286538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:01.287151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:01.300047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.300561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.304160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.304974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.305659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.306069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.497982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:01.515856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:01.518936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:01.526692 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-20f57758-4ebc-4b2c-a49a-b8f49b05d9b3 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1531 microversion: 2.91 time: 0.245003 Oct 12 08:49:01.528647 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 756/1416] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:01 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1531 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:01.538716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:01.539351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] [instance: 5a0652c7-d354-40cf-9549-ad84d90f209a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:01.546254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.546790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.547226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.550018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.550484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.557961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:01.558737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:01.559599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.577407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.578970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.580124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.593871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.594378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.594822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.613314 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] HTTP exception thrown: Instance 5a0652c7-d354-40cf-9549-ad84d90f209a could not be found. Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Request method failure captured: Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a HTTP/1.1 Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9Ev_JBk7IB6187UgEUw6QSIbldUIbOc2Tly8FTXBjd1c3aX8toUo5PBm0tZSENrGAnk0DYjZTBtV-hSbrcvXleGzzQJNDex1rPD9QR_IRiC169ICT0piqF4hCJWFrzfOaXkX4R7T35sdRcx9X7cjWjvmiICWksL2oIlr6l5_5CKnE Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:49:01.615014 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6730ea24a78f4ee0ac1bd784286e0c7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6730ea24a78f4ee0ac1bd784286e0c7b"}]}] Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 6730ea24a78f4ee0ac1bd784286e0c7b Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485 Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 7026dc1487554cdf8ef2b31fe14ef0a3 Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:49:01.616452 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 5a0652c7-d354-40cf-9549-ad84d90f209a could not be found. Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5a0652c7-d354-40cf-9549-ad84d90f209a'} Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0652c7-d354-40cf-9549-ad84d90f209a could not be found. Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:01.617259 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0652c7-d354-40cf-9549-ad84d90f209a could not be found. Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0652c7-d354-40cf-9549-ad84d90f209a could not be found. Oct 12 08:49:01.618650 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:01.619848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] Returning 404 to user: Instance 5a0652c7-d354-40cf-9549-ad84d90f209a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:01.626716 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4bc53c2c-39e0-4813-a455-1ffbdcc96b6e tempest-FloatingIPsAssociationNegativeTestJSON-555502485 tempest-FloatingIPsAssociationNegativeTestJSON-555502485-project] 10.222.0.40 "GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a" status: 404 len: 111 microversion: 2.1 time: 0.094315 Oct 12 08:49:01.631555 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 661/1417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:01 2022] GET /compute/v2.1/servers/5a0652c7-d354-40cf-9549-ad84d90f209a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:49:01.700607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:01.701239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:01.714362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.714903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.715347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.716166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.716573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.717056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.756113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lazy-loading 'services' on Instance uuid bcebfe48-986f-41ff-b116-c90382f42b65 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:49:01.776835 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45f4ffc5-0a38-46d1-80ff-d3d094ad7bc0 tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1938 microversion: 2.91 time: 0.224050 Oct 12 08:49:01.778670 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 757/1418] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:01 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1938 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:01.808491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:01.809409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:01.818554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.818889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:01.819588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.820279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.821636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.822522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.823256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.843234 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efd718b5-5265-4cbb-823f-e68a0753b129 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1282 microversion: 2.1 time: 0.147386 Oct 12 08:49:01.848824 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 662/1419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:01 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:01.856759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:01.858323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:01.870132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.880259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lazy-loading 'flavor' on Instance uuid bcebfe48-986f-41ff-b116-c90382f42b65 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:49:01.884062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.884972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.887532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:01.888841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:01.889281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:01.902789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:02.064176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:02.073803 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2208ffa5-b6cd-49e0-8bc1-5da17718ccc8 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1264 microversion: 2.1 time: 0.223332 Oct 12 08:49:02.079060 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 663/1420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:01 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:02.097869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:02.098789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:02.111014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:02.111655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:02.112448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:02.127525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:02.130008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:02.131464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:02.160965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d87319cc-34f0-45ad-a344-b01a9cc0bcc7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "POST /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65/action" status: 202 len: 0 microversion: 2.91 time: 0.359267 Oct 12 08:49:02.161894 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 758/1421] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:49:01 2022] POST /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:49:02.174077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:02.177179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:02.195621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:02.196384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:02.198248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:02.199023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:02.202498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:02.204285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:02.644674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:02.653979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:02.655554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:02.657177 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d033b9bc-b5d3-4033-ba84-aaebc5fdc945 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.575517 Oct 12 08:49:02.676496 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 664/1422] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:02 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:02.684050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eb1d9afd-2bd1-4104-8f59-1c2541cb03ec tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98488574c0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:02.738616 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eb1d9afd-2bd1-4104-8f59-1c2541cb03ec tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.060861 Oct 12 08:49:02.740402 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 665/1423] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:02 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:02.745994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:02.746844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:02.758212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:02.758921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:02.759562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:02.760557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:02.761287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:02.761888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:02.892150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:02.906324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:02.908070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:02.913657 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bef5c465-7a1c-4f4c-9be2-e6a1196c9a79 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.171995 Oct 12 08:49:02.914678 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 666/1424] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:02 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:02.919853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:02.920587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:02.926816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:02.927427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:02.927960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:02.928760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:02.930750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:02.930750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:03.045042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:03.055981 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fb987cd0-03c8-4b01-aab1-80f5e9dd0477 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1282 microversion: 2.1 time: 0.139700 Oct 12 08:49:03.070040 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 667/1425] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:02 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:03.103290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:03.106059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:03.108420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:03.115716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:03.116287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:03.116522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0ea5588b-2642-4a74-9242-8472a9ad0a26 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.951806 Oct 12 08:49:03.116955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:03.118176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:03.118781 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 759/1426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:02 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:03.119192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:03.119725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:03.283301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:03.298267 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-617c8d93-717c-4168-b03f-43537af64154 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1270 microversion: 2.1 time: 0.200515 Oct 12 08:49:03.313846 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 668/1427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:03 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:03.558381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-83419461-7198-42f5-a41b-3cd5ae55b8eb req-54dc632e-7e5f-4569-b2a3-940c5406f99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8519af08-ba91-4304-a23c-97cdf484974c", "tag": "9071c962-6516-4840-bb06-bba569196928"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:03.583092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83419461-7198-42f5-a41b-3cd5ae55b8eb req-54dc632e-7e5f-4569-b2a3-940c5406f99f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:03.583092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83419461-7198-42f5-a41b-3cd5ae55b8eb req-54dc632e-7e5f-4569-b2a3-940c5406f99f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:03.583705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83419461-7198-42f5-a41b-3cd5ae55b8eb req-54dc632e-7e5f-4569-b2a3-940c5406f99f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:03.600350 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-83419461-7198-42f5-a41b-3cd5ae55b8eb req-54dc632e-7e5f-4569-b2a3-940c5406f99f service nova] Creating event network-changed:9071c962-6516-4840-bb06-bba569196928 for instance 8519af08-ba91-4304-a23c-97cdf484974c on n-h2-858383-10 Oct 12 08:49:03.605337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-83419461-7198-42f5-a41b-3cd5ae55b8eb req-54dc632e-7e5f-4569-b2a3-940c5406f99f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051481 Oct 12 08:49:03.605975 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 760/1428] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:03.690941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:03.694394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:03.708622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:03.709909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:03.710546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:03.711448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:03.713557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:03.714196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:03.755260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-788cbef0-4a5e-4dc2-9797-9ce98156ac53 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848c97430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:03.820682 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-788cbef0-4a5e-4dc2-9797-9ce98156ac53 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.069685 Oct 12 08:49:03.821933 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 761/1429] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:03 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:03.942794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:03.944038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:03.956068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:03.956910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:03.957639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:03.967463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:03.973889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:03.974723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:04.112888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.129984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.131349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.145612 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d7dd94a-f4df-4813-9411-5a03c31fc962 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.207795 Oct 12 08:49:04.146209 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 762/1430] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:03 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:49:04.165033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.175059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:04.176188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:04.179743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.183665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.187001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:04.187738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:04.188362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:04.191172 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e9adb2cb-2db7-4f9a-a4b0-0ea8bb9d94a4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.507585 Oct 12 08:49:04.191869 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 669/1431] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:03 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:04.192241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:04.192947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:04.193620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:04.244495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:04.245100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:04.263458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:04.264026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:04.264376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:04.265074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:04.265944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:04.266551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:04.403767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.412055 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae28469d-8995-44ec-aba0-3192352e1103 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.247535 Oct 12 08:49:04.413896 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 763/1432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:04 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:04.418675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:04.419289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:04.425340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:04.425861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:04.426330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:04.427193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:04.427497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:04.427926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:04.606833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.615992 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b28c38a6-f9ab-4616-805a-c19c871e50e6 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.201043 Oct 12 08:49:04.616661 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 764/1433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:04 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:04.648647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:04.650651 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dc7843dd-be36-4eb9-b083-caa6c50cf82a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.430543 Oct 12 08:49:04.653481 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 670/1434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:04 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:04.850086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aaba45af-d467-46cb-b8ab-2247e78f327c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98490c19d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:04.921608 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aaba45af-d467-46cb-b8ab-2247e78f327c tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.085775 Oct 12 08:49:04.924362 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 765/1435] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:04 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:05.042646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-46c5e699-a5de-478e-a6a1-51adc334648b req-12741890-2c6c-4bd4-a73f-fcadb69d1f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd399ffd-4151-4122-9901-a61d55e2e70d", "name": "network-vif-plugged", "status": "completed", "tag": "8ae947b8-c972-44eb-a547-9e84edfdee53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:05.068447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46c5e699-a5de-478e-a6a1-51adc334648b req-12741890-2c6c-4bd4-a73f-fcadb69d1f9d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.068952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46c5e699-a5de-478e-a6a1-51adc334648b req-12741890-2c6c-4bd4-a73f-fcadb69d1f9d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.069396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46c5e699-a5de-478e-a6a1-51adc334648b req-12741890-2c6c-4bd4-a73f-fcadb69d1f9d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.089427 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-46c5e699-a5de-478e-a6a1-51adc334648b req-12741890-2c6c-4bd4-a73f-fcadb69d1f9d service nova] Creating event network-vif-plugged:8ae947b8-c972-44eb-a547-9e84edfdee53 for instance fd399ffd-4151-4122-9901-a61d55e2e70d on n-h2-858383-10 Oct 12 08:49:05.101597 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-46c5e699-a5de-478e-a6a1-51adc334648b req-12741890-2c6c-4bd4-a73f-fcadb69d1f9d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063643 Oct 12 08:49:05.105988 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 671/1436] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:05.180907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:05.182200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:05.193091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.193830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.194774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.195668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.196310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.196990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.228662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:05.230094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:05.237892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.238687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.238834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:05.239320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.240226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.240814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.244498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.408546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:05.417721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:05.425598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:05.441667 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d4fe8e9-f23f-40bf-96f5-978974273324 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.262840 Oct 12 08:49:05.442579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 766/1437] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:05 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:05.463792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:05.464513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:05.470941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:05.472814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.473381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.473939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.474713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.475229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.475722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.830139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:05.867124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:05.879764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:05.890871 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aba3dc59-c019-4390-aa17-174608e81bcf tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.669619 Oct 12 08:49:05.897629 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 672/1438] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:05 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:05.902653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:05.906176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:05.924979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.925479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.925924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.926627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.927074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.939946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:05.943097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.949572 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a05131a9-b3c5-434d-a97d-f38613881a65 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.503307 Oct 12 08:49:05.951435 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 767/1439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:05 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:05.967609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:05.968804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:05.987304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.988061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.988980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:05.989950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:05.991448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:05.992035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:06.452468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:06.464842 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb65c346-9929-4e5a-bace-42cce4648413 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.511916 Oct 12 08:49:06.466998 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 768/1440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:05 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:06.540353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:06.554217 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-44b59209-9b78-4e63-98da-b4903ca734f3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.655419 Oct 12 08:49:06.555034 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 673/1441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:05 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:06.573343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ad7bb54-f75e-4b98-ab4e-8d02cb5034c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848856040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:06.665728 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ad7bb54-f75e-4b98-ab4e-8d02cb5034c2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.106747 Oct 12 08:49:06.671016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 674/1442] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:06 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:06.685504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-6ee5446f-617e-4619-b76f-6c41e85281cb req-771cabbf-ee9c-4779-a195-ee146746c13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:06.688859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34520b58-db77-4322-8f34-39808f009ab2 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Action: 'update', calling method: .version_select at 0x7f9848c25940>, body: {"quota_set": {"ram": "5120"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:06.773805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ee5446f-617e-4619-b76f-6c41e85281cb req-771cabbf-ee9c-4779-a195-ee146746c13a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:06.774814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ee5446f-617e-4619-b76f-6c41e85281cb req-771cabbf-ee9c-4779-a195-ee146746c13a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:06.779239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ee5446f-617e-4619-b76f-6c41e85281cb req-771cabbf-ee9c-4779-a195-ee146746c13a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:06.812223 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-6ee5446f-617e-4619-b76f-6c41e85281cb req-771cabbf-ee9c-4779-a195-ee146746c13a service nova] Creating event network-changed:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h2-858383-10 Oct 12 08:49:06.831854 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-6ee5446f-617e-4619-b76f-6c41e85281cb req-771cabbf-ee9c-4779-a195-ee146746c13a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150266 Oct 12 08:49:06.836161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 675/1443] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:06.847738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:06.848674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:06.849834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34520b58-db77-4322-8f34-39808f009ab2 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:06.850319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34520b58-db77-4322-8f34-39808f009ab2 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:06.850909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34520b58-db77-4322-8f34-39808f009ab2 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:06.851646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34520b58-db77-4322-8f34-39808f009ab2 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:06.852097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34520b58-db77-4322-8f34-39808f009ab2 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:06.855398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34520b58-db77-4322-8f34-39808f009ab2 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:06.857111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:06.858034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:06.858766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:06.859648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:06.860369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:06.861041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:06.980739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34520b58-db77-4322-8f34-39808f009ab2 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/917aac71da564197931636fa17e69db0" status: 200 len: 148 microversion: 2.57 time: 0.512455 Oct 12 08:49:06.983222 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 769/1444] 10.222.0.40 () {62 vars in 1303 bytes} [Wed Oct 12 08:49:06 2022] PUT /compute/v2.1/os-quota-sets/917aac71da564197931636fa17e69db0 => generated 148 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:06.988460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:06.989406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:06.996948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:06.997995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.002023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.004332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.005072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.005778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.207988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:07.217350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:07.223407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:07.245274 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a68429bd-7af9-4eea-b65d-e831646a1d1d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.406740 Oct 12 08:49:07.246454 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 676/1445] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:06 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:07.251054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:07.251666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:07.265536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.265994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.266442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.267148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.267605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.268040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.536539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:07.551998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:07.565824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:07.567576 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7518f341-57ff-4a50-93a4-c28ca85610cd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.582919 Oct 12 08:49:07.568792 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 770/1446] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:06 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:07.590799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7954864-4f0b-4bfb-be79-7ff282e34261 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Calling method '.version_select at 0x7f984932b280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:07.687422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7954864-4f0b-4bfb-be79-7ff282e34261 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.688006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7954864-4f0b-4bfb-be79-7ff282e34261 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.688506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7954864-4f0b-4bfb-be79-7ff282e34261 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.689598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7954864-4f0b-4bfb-be79-7ff282e34261 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.690448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7954864-4f0b-4bfb-be79-7ff282e34261 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.690941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7954864-4f0b-4bfb-be79-7ff282e34261 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.716082 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b7954864-4f0b-4bfb-be79-7ff282e34261 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/917aac71da564197931636fa17e69db0/detail" status: 200 len: 463 microversion: 2.57 time: 0.145718 Oct 12 08:49:07.717234 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 771/1447] 10.222.0.40 () {60 vars in 1304 bytes} [Wed Oct 12 08:49:07 2022] GET /compute/v2.1/os-quota-sets/917aac71da564197931636fa17e69db0/detail => generated 463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:07.724496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-bd058a61-1cdc-4f5d-87c4-77850099dc86 req-9a7404e3-a75f-4529-9e95-b65a55307c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd903e71-5940-400c-834c-1854e86d5424", "tag": "f672ff37-e0ef-48d1-988e-9eba040de277"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:07.737115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bd058a61-1cdc-4f5d-87c4-77850099dc86 req-9a7404e3-a75f-4529-9e95-b65a55307c62 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.737954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bd058a61-1cdc-4f5d-87c4-77850099dc86 req-9a7404e3-a75f-4529-9e95-b65a55307c62 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.738526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bd058a61-1cdc-4f5d-87c4-77850099dc86 req-9a7404e3-a75f-4529-9e95-b65a55307c62 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.758767 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-bd058a61-1cdc-4f5d-87c4-77850099dc86 req-9a7404e3-a75f-4529-9e95-b65a55307c62 service nova] Creating event network-changed:f672ff37-e0ef-48d1-988e-9eba040de277 for instance cd903e71-5940-400c-834c-1854e86d5424 on n-h2-858383-10 Oct 12 08:49:07.764401 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-bd058a61-1cdc-4f5d-87c4-77850099dc86 req-9a7404e3-a75f-4529-9e95-b65a55307c62 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045207 Oct 12 08:49:07.765378 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 772/1448] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:07.771707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:07.773065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:07.781477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.782119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.782712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.783701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.784153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.784572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.794836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:07.803978 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b2f9c62-4411-40e0-b83c-72ad99e3d701 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.556353 Oct 12 08:49:07.805198 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 677/1449] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:07 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:07.811528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:07.812408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:07.818896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.819706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.820615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.821664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:07.822332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:07.822970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:07.952633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:07.966501 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf48750f-e812-4d07-aef0-be5976133c30 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.199615 Oct 12 08:49:07.967768 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 773/1450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:07 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:07.972622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0703c96-21a1-42df-8edf-ff104c01c682 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848ca41f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:08.033527 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0703c96-21a1-42df-8edf-ff104c01c682 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.064160 Oct 12 08:49:08.034410 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 774/1451] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:07 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:08.038991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Action: 'update', calling method: .version_select at 0x7f9848bb98b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:08.130231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.131067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.131919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.133036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.133786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.134479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.174245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.175184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.175835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.176772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.177479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.178117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.244693 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8dabd412-bfe2-4fa5-8b46-848a4dc743d0 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/917aac71da564197931636fa17e69db0?user_id=da0ddda4001146ab87a180afa1b9b332" status: 200 len: 148 microversion: 2.57 time: 0.209087 Oct 12 08:49:08.246280 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 775/1452] 10.222.0.40 () {62 vars in 1384 bytes} [Wed Oct 12 08:49:08 2022] PUT /compute/v2.1/os-quota-sets/917aac71da564197931636fa17e69db0?user_id=da0ddda4001146ab87a180afa1b9b332 => generated 148 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:08.263469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f1fa03f-550d-4100-9679-ce5b12dc8b74 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] Calling method '.version_select at 0x7f9849203820>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:08.270439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:08.279467 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a8313765-c937-41aa-bc51-568b04b97466 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.472492 Oct 12 08:49:08.280049 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 678/1453] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:07 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:08.292113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:08.293242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:08.309587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.310335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.311249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.312281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.312902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.313507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.408243 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f1fa03f-550d-4100-9679-ce5b12dc8b74 tempest-QuotasAdminTestV257-938457379 tempest-QuotasAdminTestV257-938457379-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/917aac71da564197931636fa17e69db0?user_id=da0ddda4001146ab87a180afa1b9b332" status: 200 len: 190 microversion: 2.57 time: 0.149074 Oct 12 08:49:08.409548 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 776/1454] 10.222.0.40 () {60 vars in 1364 bytes} [Wed Oct 12 08:49:08 2022] GET /compute/v2.1/os-quota-sets/917aac71da564197931636fa17e69db0?user_id=da0ddda4001146ab87a180afa1b9b332 => generated 190 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:08.493374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:08.506633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:08.508362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:08.515044 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f34ed29-f92c-43a5-afef-9b8826fd152f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.229073 Oct 12 08:49:08.516339 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 679/1455] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:08 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:08.601514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:08.602243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:08.616402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.628696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.632068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.632861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.633343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.634748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.833697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:08.835371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:08.865020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.868356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.870649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.873694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:08.879037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:08.883263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:08.975260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:08.991541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:08.993335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:09.001860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4644728-551c-4a26-9da9-bcf153c8c56d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.410848 Oct 12 08:49:09.005194 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 777/1456] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:08 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:09.016355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:09.016970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:09.031603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:09.032763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:09.034528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:09.036170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:09.036976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:09.038942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:09.167437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:09.195799 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-16b817f5-b584-4328-8b33-829c7b9845b4 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.366554 Oct 12 08:49:09.215250 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 680/1457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:08 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:09.226641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e8c3910-d43c-4e4b-8c98-342045b618ac tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848856700>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:09.289050 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e8c3910-d43c-4e4b-8c98-342045b618ac tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.072243 Oct 12 08:49:09.290079 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 681/1458] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:09 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:09.294642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:09.305772 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-96434f84-1409-4470-b8e8-0f0b63e05d5e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.298501 Oct 12 08:49:09.316231 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 778/1459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:09 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:09.320299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:09.322003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:09.339221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:09.339737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:09.341867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:09.344023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:09.346053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:09.346743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:09.544614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:09.547074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:09.555612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:09.560011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:09.561004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:09.563744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:09.567555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:09.568301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:09.890843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:09.899460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:09.900919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:09.920039 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-32d4df9c-6022-4be0-9bfc-0bd6ca06b37e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.379639 Oct 12 08:49:09.921815 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 779/1460] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:09 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:10.030884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:10.031697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:10.040362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:10.051824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:10.052580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:10.054367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:10.054993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:10.055639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:10.097594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:10.108253 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-25221c47-c4d1-4619-a9f2-203a9f8fe11b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.807580 Oct 12 08:49:10.108833 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 682/1461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:09 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:10.122960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-7be6d670-9ea1-499d-8251-d0a1d0e956d9 req-d5dd9acb-3981-48c3-8b55-f9169426cf4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21", "name": "network-vif-unplugged", "status": "completed", "tag": "f197b63f-1a58-4a19-b284-61862fdfca13"}, {"name": "network-changed", "server_uuid": "5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21", "tag": "f197b63f-1a58-4a19-b284-61862fdfca13"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:10.133875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7be6d670-9ea1-499d-8251-d0a1d0e956d9 req-d5dd9acb-3981-48c3-8b55-f9169426cf4c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:10.134575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7be6d670-9ea1-499d-8251-d0a1d0e956d9 req-d5dd9acb-3981-48c3-8b55-f9169426cf4c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:10.135166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7be6d670-9ea1-499d-8251-d0a1d0e956d9 req-d5dd9acb-3981-48c3-8b55-f9169426cf4c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:10.149330 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7be6d670-9ea1-499d-8251-d0a1d0e956d9 req-d5dd9acb-3981-48c3-8b55-f9169426cf4c service nova] Creating event network-vif-unplugged:f197b63f-1a58-4a19-b284-61862fdfca13 for instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 on n-h1-858383-10 Oct 12 08:49:10.150235 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7be6d670-9ea1-499d-8251-d0a1d0e956d9 req-d5dd9acb-3981-48c3-8b55-f9169426cf4c service nova] Creating event network-changed:f197b63f-1a58-4a19-b284-61862fdfca13 for instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 on n-h1-858383-10 Oct 12 08:49:10.156399 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-7be6d670-9ea1-499d-8251-d0a1d0e956d9 req-d5dd9acb-3981-48c3-8b55-f9169426cf4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.045930 Oct 12 08:49:10.157347 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 683/1462] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:10.225181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:10.226507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:10.233589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=12 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:10.237049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:10.237892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:10.238593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:10.242610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:10.243422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:10.244092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:10.707312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=98 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:10.768688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:10.776726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:10.780849 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fdce7737-11f1-4b4b-bf2f-f77f32bd643d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.561879 Oct 12 08:49:10.792124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:10.808402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:10.811920 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 684/1463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:10 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:10.813363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:10.816470 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7245d44f-a41a-4697-a6b5-dbda44c4116d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.789660 Oct 12 08:49:10.821335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3c4ccf45-354d-4490-a1cd-b5480e262d07 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848832ee0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:10.840281 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 780/1464] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:10 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:49:10.850602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:10.854553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:10.871437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:10.872720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:10.875299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:10.877112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:10.878851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:10.882053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:10.943275 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3c4ccf45-354d-4490-a1cd-b5480e262d07 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.129826 Oct 12 08:49:10.945275 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 685/1465] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:10 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:10.960664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:10.962970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:10.982208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:10.986348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:10.999440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:11.000700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:11.001354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:11.001981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:11.115863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:11.125483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:11.128711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:11.145943 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7aa274a-6b81-483a-ad76-7d2644f20b43 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.197110 Oct 12 08:49:11.147175 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 686/1466] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:10 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:11.152442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:11.157055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:11.173835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:11.174653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:11.175304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:11.176506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:11.177773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:11.178525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:11.364875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:11.375769 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-70e5e4e4-c64a-4b84-8fe0-6f4d0b67fc17 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.534288 Oct 12 08:49:11.376350 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 781/1467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:10 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:11.581601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:11.590798 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-554cfbe5-cf68-4a9f-a6a8-16e6a3359d8f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.442366 Oct 12 08:49:11.591382 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 687/1468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:11 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:11.808235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:11.809310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:11.827724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:11.828233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:11.828672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:11.831835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:11.833498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:11.837042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:11.866536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:11.868223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:11.875522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:11.876349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:11.877034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:11.878013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:11.878692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:11.879589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:12.122867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:12.133041 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-af654c6b-0d6b-42ae-bc60-3cc4c94302d3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.331131 Oct 12 08:49:12.139815 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 782/1469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:11 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:12.144823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-37f00824-85aa-4993-9b68-43fee35d3c75 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984923f3a0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:12.236290 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-37f00824-85aa-4993-9b68-43fee35d3c75 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.095125 Oct 12 08:49:12.236872 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 783/1470] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:12 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:12.253852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:12.255620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:12.270230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:12.270744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:12.271191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:12.271912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:12.272372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:12.272802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:12.351278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:12.364830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:12.366302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:12.367487 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0072c9e3-8846-404f-a241-9a5e96493d5b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.517688 Oct 12 08:49:12.368099 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 688/1471] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:11 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:12.400081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:12.400697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:12.408214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:12.408712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:12.408920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:12.409363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:12.410174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:12.410571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:12.410977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:12.433734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:12.437466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:12.445913 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c51def6e-cebc-4f0d-af3d-ea68890bf6c0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.207943 Oct 12 08:49:12.470757 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 784/1472] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:12 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:12.624148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:12.625081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:12.644545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:12.646864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:12.649483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:12.650423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:12.656212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:12.657685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:12.975639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:12.986257 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cda3b013-6c42-494f-a276-e8c50e19075f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.589920 Oct 12 08:49:12.997807 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 689/1473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:12 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:13.074422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:13.084666 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-74e3bddd-228b-4188-b1de-52fbbf902a83 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.470117 Oct 12 08:49:13.096810 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 785/1474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:12 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:13.163907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:13.164862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:13.177195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:13.177997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:13.178440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:13.182756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:13.183364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:13.183804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:13.252258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5a5cca7-859a-4477-ad52-57c348e35a3a tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98491b6820>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:13.334640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5a5cca7-859a-4477-ad52-57c348e35a3a tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.086319 Oct 12 08:49:13.351298 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 786/1475] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:13 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:13.396129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:13.396738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:13.405599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:13.406399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:13.407023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:13.408056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:13.408793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:13.409960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:13.664881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:13.681183 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-27427adf-1014-48bf-b70e-8435aab219ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.514512 Oct 12 08:49:13.682260 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 690/1476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:13 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:13.699600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:13.700828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:13.703570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:13.713370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:13.714833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:13.716372 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ba164e3-a4a4-410a-9111-5be5849fb74f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.325466 Oct 12 08:49:13.717542 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 787/1477] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:13 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:49:13.720884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:13.726440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b2f7758a-a17f-4ece-bb61-387ee43476ef req-6840a881-da32-4cc9-8bb8-f7dbc9a69d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8519af08-ba91-4304-a23c-97cdf484974c", "name": "network-vif-plugged", "status": "completed", "tag": "9071c962-6516-4840-bb06-bba569196928"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:13.728391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:13.728943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:13.730036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:13.730598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:13.731123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:13.762702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b2f7758a-a17f-4ece-bb61-387ee43476ef req-6840a881-da32-4cc9-8bb8-f7dbc9a69d38 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:13.763704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b2f7758a-a17f-4ece-bb61-387ee43476ef req-6840a881-da32-4cc9-8bb8-f7dbc9a69d38 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:13.763704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b2f7758a-a17f-4ece-bb61-387ee43476ef req-6840a881-da32-4cc9-8bb8-f7dbc9a69d38 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:13.788905 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b2f7758a-a17f-4ece-bb61-387ee43476ef req-6840a881-da32-4cc9-8bb8-f7dbc9a69d38 service nova] Creating event network-vif-plugged:9071c962-6516-4840-bb06-bba569196928 for instance 8519af08-ba91-4304-a23c-97cdf484974c on n-h2-858383-10 Oct 12 08:49:13.816333 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b2f7758a-a17f-4ece-bb61-387ee43476ef req-6840a881-da32-4cc9-8bb8-f7dbc9a69d38 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097316 Oct 12 08:49:13.822444 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 788/1478] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:13.839916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:13.850269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:13.852052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:13.858158 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-879706ac-983b-4107-9d43-e6be2605d305 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.174594 Oct 12 08:49:13.859215 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 691/1479] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:13 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:14.009511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:14.011153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:14.023923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:14.024682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:14.025656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:14.027036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:14.027988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:14.030597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:14.127516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:14.128363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:14.136043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:14.136843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:14.137500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:14.138479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:14.139088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:14.139793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:14.334063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:14.338404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:14.348411 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-81eb45ad-0b73-4da1-842f-13bfb5dab316 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.341575 Oct 12 08:49:14.350717 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 789/1480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:14 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:14.360721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e63c4bf0-1a5d-4f12-a19f-1d69764b0544 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848c5cb80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:14.441150 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e63c4bf0-1a5d-4f12-a19f-1d69764b0544 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.086164 Oct 12 08:49:14.446348 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 790/1481] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:14 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:14.448428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:14.466065 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0ee670a-2b5a-4325-a18b-af5be6630aa3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.337424 Oct 12 08:49:14.467081 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 692/1482] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:14 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:14.707253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:14.708118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:14.738348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:14.746276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:14.747603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:14.751065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:14.751908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:14.752873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:14.753667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:14.754302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:14.757625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:14.758119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:14.758671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:14.761684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:14.762312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:14.762788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:15.015784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.029804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.032234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.034038 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c0cb01b0-a7ca-4d56-ba9a-fc2733b80684 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.293519 Oct 12 08:49:15.051934 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 693/1483] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:14 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:49:15.068645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:15.069570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:15.084952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:15.088729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:15.089371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:15.090296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:15.091105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:15.091709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:15.101692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.112206 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c693adaa-a56c-447b-abd7-14a8042bf50e tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.408742 Oct 12 08:49:15.114656 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 791/1484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:14 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:15.262993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.286354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.288250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.306109 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c033f63-e69a-4656-af3f-537d5901941b tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.252669 Oct 12 08:49:15.310205 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 694/1485] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:15 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:15.375938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:15.377191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:15.406224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:15.407432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:15.412949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:15.416650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:15.417669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:15.422348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:15.461202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-666e7d73-7b8d-45bc-a60f-eba99c7cd39b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848856a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:15.635964 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-666e7d73-7b8d-45bc-a60f-eba99c7cd39b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.178327 Oct 12 08:49:15.645217 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 695/1486] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:15 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:15.651137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:15.652167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:15.669086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:15.674699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:15.676139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:15.678822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:15.679457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:15.681647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:15.879977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.885297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:15.890553 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c2b3d98-f4e4-4d7d-9ed3-1acfb230959a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.251034 Oct 12 08:49:15.891984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 696/1487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:15 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:15.908836 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a9936c6d-72c4-4137-9930-32e698ba9856 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1317 microversion: 2.1 time: 0.537252 Oct 12 08:49:15.909709 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 792/1488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:15 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:16.069313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:16.070311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:16.080680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:16.089534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:16.091315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:16.093847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:16.096083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:16.101154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:16.139776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:16.140743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:16.156340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:16.158994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:16.160232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:16.168084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:16.169338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:16.170017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:16.609240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:16.620583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:16.627808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:16.632387 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1d8801a1-31e5-4f07-b634-fa55f123fc0d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.572046 Oct 12 08:49:16.633630 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 697/1489] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:16 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:16.645403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:16.646242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:16.677412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:16.678103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:16.678722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:16.681767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:16.683963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:16.692753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:16.867128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:16.885101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:16.893181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:16.923887 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5dd11073-3fa3-4c77-bd57-9095f7aba475 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.276420 Oct 12 08:49:16.926165 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 698/1490] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:16 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:16.957171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-512532b9-1145-43e8-9b3e-5283df6b6033 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98488978b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:17.003219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:17.016615 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cecbad35-1b4f-417f-8909-8d55dc081505 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.881367 Oct 12 08:49:17.017206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 793/1491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:16 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:17.037842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:17.041305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:17.070573 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-512532b9-1145-43e8-9b3e-5283df6b6033 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.127335 Oct 12 08:49:17.071515 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 699/1492] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:16 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:17.075975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:17.077764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:17.078432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:17.086258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:17.087198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:17.087714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:17.091455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:17.092211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:17.119004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:17.119594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:17.125046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:17.126254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:17.126816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:17.127329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:17.507363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:17.519539 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8f5ca73a-2646-4b3e-90b7-9276f557b91f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1467 microversion: 2.1 time: 0.445670 Oct 12 08:49:17.521992 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 700/1493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:17 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1467 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:17.531945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-614ad2e3-5618-4bc9-a67c-b1ecf9ddcb8c req-86961f8b-213d-4e18-9eea-5c29d0cb7da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "name": "network-vif-plugged", "status": "completed", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:17.553073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:17.563549 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57dd08e4-ce86-4f46-813b-ae17ce7aeb1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.534892 Oct 12 08:49:17.565782 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 794/1494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:17 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:17.580768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-614ad2e3-5618-4bc9-a67c-b1ecf9ddcb8c req-86961f8b-213d-4e18-9eea-5c29d0cb7da3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:17.581252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-614ad2e3-5618-4bc9-a67c-b1ecf9ddcb8c req-86961f8b-213d-4e18-9eea-5c29d0cb7da3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:17.591700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-614ad2e3-5618-4bc9-a67c-b1ecf9ddcb8c req-86961f8b-213d-4e18-9eea-5c29d0cb7da3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:17.622262 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-614ad2e3-5618-4bc9-a67c-b1ecf9ddcb8c req-86961f8b-213d-4e18-9eea-5c29d0cb7da3 service nova] Creating event network-vif-plugged:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h2-858383-10 Oct 12 08:49:17.636171 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-614ad2e3-5618-4bc9-a67c-b1ecf9ddcb8c req-86961f8b-213d-4e18-9eea-5c29d0cb7da3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112057 Oct 12 08:49:17.637065 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 701/1495] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:17.667510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:17.678013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:17.699195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:17.700141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:17.701481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:17.704768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:17.705762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:17.715456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.070439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:18.071126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:18.080754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:18.087827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:18.088535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.089490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:18.090099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:18.090704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.120570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:18.130360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:18.145909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:18.147440 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf92314d-092b-4f3f-b5a7-85e988fa01c1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.484373 Oct 12 08:49:18.154212 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 702/1496] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:17 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:18.170549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:18.172748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:18.191755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:18.193751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:18.197290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=18 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:18.197943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.198950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:18.201939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:18.203835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.327257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:18.338389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:18.340684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:18.346330 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3322e18-a129-40ab-80af-b70f564c3f53 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.188173 Oct 12 08:49:18.362079 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 703/1497] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:18 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:18.373372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:18.374378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:18.380965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:18.381942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:18.382618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.383619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:18.385019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:18.385708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.399168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=54 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:18.546227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:18.555261 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8c05e1e0-c36d-44ab-ab02-680a3640dec2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.191649 Oct 12 08:49:18.558794 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 704/1498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:18 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:18.588312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15d214fa-ccfb-4bac-82d3-39f113c1851e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98487fb790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:18.665412 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15d214fa-ccfb-4bac-82d3-39f113c1851e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.104842 Oct 12 08:49:18.666335 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 705/1499] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:18 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:18.678594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:18.679187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:18.684859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:18.699287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:18.700479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:18.700921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.704219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:18.704704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:18.705140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:18.716553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:19.023746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:19.034575 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d42516ee-b8ee-4b38-9026-28de579cc54f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1312 microversion: 2.1 time: 0.366497 Oct 12 08:49:19.035163 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 706/1500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:18 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1312 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:19.092595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b1e1405-f604-41e3-93e0-8b3bcd824639 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1620 microversion: 2.1 time: 1.522225 Oct 12 08:49:19.107037 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 795/1501] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:17 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1620 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:19.117316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4cac9306-1522-4d5e-8278-caaffd3aa3ab tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Action: 'create', calling method: .version_select at 0x7f984880e040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-577846242", "policies": ["affinity"]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:19.183845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:19.184508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:19.198022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:19.198772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:19.201488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:19.202908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:19.203551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:19.204307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:19.205322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-4cac9306-1522-4d5e-8278-caaffd3aa3ab tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:19.227701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-4cac9306-1522-4d5e-8278-caaffd3aa3ab tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:19.428054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-4cac9306-1522-4d5e-8278-caaffd3aa3ab tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:19.444235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-4cac9306-1522-4d5e-8278-caaffd3aa3ab tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:19.486831 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4cac9306-1522-4d5e-8278-caaffd3aa3ab tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.373232 Oct 12 08:49:19.488270 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 707/1502] 10.222.0.40 () {60 vars in 1174 bytes} [Wed Oct 12 08:49:19 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:19.500110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:19.501071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:19.517170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:19.518336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:19.519126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:19.523320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:19.525120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:19.528700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:19.607241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:19.623987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:19.626850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:19.628267 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d3c73a9-67e4-4127-9205-4e6a7e00b501 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.449586 Oct 12 08:49:19.629410 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 796/1503] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:19 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:19.634535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:19.635390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:19.641895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:19.642591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:19.643384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:19.644289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:19.644966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:19.645606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:19.976764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:19.986073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:19.997458 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e676bf86-bf00-4c91-84e5-b88c8fe9afc5 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.366670 Oct 12 08:49:19.998810 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 797/1504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:19 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:19.999004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:20.000520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:20.004588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28b8c53c-2d36-48ec-8a6e-ce79a2d235da tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848e5d3a0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:20.029377 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5c602120-178e-4201-8217-d3b98b97a50a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.537149 Oct 12 08:49:20.030007 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 708/1505] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:19 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:20.051854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-144553893", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "689d6444-84a2-4ed0-90bf-1e80435622af"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:20.069048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-28b8c53c-2d36-48ec-8a6e-ce79a2d235da tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.068665 Oct 12 08:49:20.072332 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 798/1506] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:19 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:20.080024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:20.080931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:20.106540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:20.107311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:20.108024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:20.108785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:20.109241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:20.113012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:20.210192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:49:20.362821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:20.378553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-490624ef-9bac-4167-8809-2d6d3276a9f7 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1462 microversion: 2.1 time: 0.304915 Oct 12 08:49:20.380734 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 799/1507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:20 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1462 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:20.408515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:20.409512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:20.426954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:20.432077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:20.435212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:20.436310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:20.437533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:20.438269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:20.438903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:20.671645 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b9fa2b6b-4dd2-45b5-ac03-2a8c86e0723f tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1615 microversion: 2.1 time: 0.267911 Oct 12 08:49:20.673970 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 800/1508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:20 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1615 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:20.682886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:20.684627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:20.699122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:20.700075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:20.700690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:20.704096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:20.704890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:20.706144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:20.993337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:21.011591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:21.015884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:21.017188 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fbfa4c05-19b2-4a19-95c6-e4c9cdac008e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.341988 Oct 12 08:49:21.029469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 801/1509] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:20 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:21.029469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:21.029469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:21.038451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:21.038451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:21.038451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:21.038451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:21.038906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:21.038906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:21.079866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'aefd7aaea5564dccac221b08755a4bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569b8de08dc140fa949d9c6b7a33887b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:21.080476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] flavor_id is None. Assuming migration. {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 12 08:49:21.081170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 08:49:21.220737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:49:21.221978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:49:21.222653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:49:21.223261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:49:21.223887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:49:21.302947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:21.303423 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c7d1730a-0b88-4a9e-8b5c-edb2bfb313da tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322/action" status: 202 len: 0 microversion: 2.1 time: 0.281638 Oct 12 08:49:21.304329 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 802/1510] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:49:21 2022] POST /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:49:21.305263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:21.307826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:21.308894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:21.309593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:21.310277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:21.310571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:21.311775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:21.319358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:21.320151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:21.320604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:21.321733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:21.322402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:21.322843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:21.364332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:21.377934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:21.422640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Going to run 2 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:49:21.428873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:49:21.515919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127007) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 12 08:49:21.575340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:21.592464 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3efb0506-6c27-4e2e-b719-cf34ee6fc55f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 0.286561 Oct 12 08:49:21.595980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:21.606635 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 803/1511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:21 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:21.615005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:21.615637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:21.618876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:21.623062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:21.623560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:21.624071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:21.625537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:21.625537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:21.625917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:21.729990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:21.740908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:21.781706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=94b3b9cb-de6c-4762-bb16-bab9cbde5277,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:49:21.788742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:21.802964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:21.806806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:21.818910 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f516aad1-1db3-4383-b24a-a9a0ceacdf2a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.211052 Oct 12 08:49:21.822248 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 804/1512] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:21 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:21.842277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3054530-ba77-4942-b62b-0fcb61736eff tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984923f670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:21.911072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:21.920071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:21.947055 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3054530-ba77-4942-b62b-0fcb61736eff tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.117013 Oct 12 08:49:21.947998 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 805/1513] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:21 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:21.967416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-669cbdd9-3acf-4a45-a019-050c102cc4ed req-035805ac-7613-4fed-82db-62b50476fa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd903e71-5940-400c-834c-1854e86d5424", "name": "network-vif-plugged", "status": "completed", "tag": "f672ff37-e0ef-48d1-988e-9eba040de277"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:22.013005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-669cbdd9-3acf-4a45-a019-050c102cc4ed req-035805ac-7613-4fed-82db-62b50476fa52 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:22.016994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-669cbdd9-3acf-4a45-a019-050c102cc4ed req-035805ac-7613-4fed-82db-62b50476fa52 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:22.019145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-669cbdd9-3acf-4a45-a019-050c102cc4ed req-035805ac-7613-4fed-82db-62b50476fa52 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:22.028164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:22.036310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:22.039967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:22.071049 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-669cbdd9-3acf-4a45-a019-050c102cc4ed req-035805ac-7613-4fed-82db-62b50476fa52 service nova] Creating event network-vif-plugged:f672ff37-e0ef-48d1-988e-9eba040de277 for instance cd903e71-5940-400c-834c-1854e86d5424 on n-h2-858383-10 Oct 12 08:49:22.111337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-669cbdd9-3acf-4a45-a019-050c102cc4ed req-035805ac-7613-4fed-82db-62b50476fa52 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161208 Oct 12 08:49:22.112805 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 806/1514] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:22.118980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:22.119927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:22.128333 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2066bbe1-75e6-4f49-83e3-bf26a91a598a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.097216 Oct 12 08:49:22.132523 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 709/1515] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:49:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 2102 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 08:49:22.135894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:22.136657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:22.137252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:22.141121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:22.141812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:22.143006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:22.150120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:22.150959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:22.165012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:22.166002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:22.169155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:22.170522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:22.173412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:22.177653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:22.478846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:22.492585 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3a5c1ac-460a-4d19-a37f-ebd134272a42 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1471 microversion: 2.1 time: 0.377108 Oct 12 08:49:22.495085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 807/1516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:22 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1471 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:22.504592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:22.514134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:22.515171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Searching by: {'deleted': False, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:49:22.536439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:22.537203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:22.537822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:22.538863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:22.539713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:22.540425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:22.701902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:49:22.706884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:22.815344 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9112047c-6411-4b20-84b0-6ddf308f50e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.316609 Oct 12 08:49:22.822975 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 808/1517] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 08:49:22 2022] GET /compute/v2.1/servers => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:23.148161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c4d8edab-0801-4985-9aae-d1c54481fd13 tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] Action: 'create', calling method: .version_select at 0x7f9848c97a60>, body: {"security_group": {"name": "tempest-securitygroup-1685876174", "description": "tempest-description-1148861865"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:23.223635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:23.235631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:23.242877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:23.244342 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1991a6fb-5b11-42c7-ba75-67938c8a4c48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 1.110838 Oct 12 08:49:23.249739 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 710/1518] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:22 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:23.265502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:23.266446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:23.278180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:23.279007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:23.279845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:23.286336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:23.287066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:23.287664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:23.929717 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c4d8edab-0801-4985-9aae-d1c54481fd13 tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.111841 Oct 12 08:49:23.930386 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 809/1519] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:49:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:23.935474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:23.936620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:23.950684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:23.955245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:23.955992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:23.958219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:23.959913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:23.963007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:24.063690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:24.072817 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-624edbc9-50e7-46b0-991c-d6190bd201d6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1222 microversion: 2.1 time: 0.141139 Oct 12 08:49:24.073418 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 810/1520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:23 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:24.085733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:24.085733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:24.085733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:24.086281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:24.086720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:24.087389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:24.087847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:24.088333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:24.180530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:24.190554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:24.192576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:24.199133 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34f6221d-9329-47d5-a3a3-5dc3e8e66503 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.123579 Oct 12 08:49:24.200476 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 811/1521] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:24 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:24.223882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-da73e429-26e3-42ae-926e-12de72d16183 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848ede700>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:24.291777 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-da73e429-26e3-42ae-926e-12de72d16183 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.090009 Oct 12 08:49:24.292902 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 812/1522] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:24 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:24.300340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:24.300340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:24.306596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:24.307177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:24.307723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:24.308547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:24.309213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:24.309923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:24.534429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:24.550204 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0ec01151-20fe-49fd-b600-751991190f03 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1324 microversion: 2.1 time: 1.299077 Oct 12 08:49:24.550895 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 711/1523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:23 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1324 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:24.566131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-29bece1f-01e8-48b5-813e-28b74d41ec56 tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] Action: 'create', calling method: .version_select at 0x7f9848774550>, body: {"security_group": {"name": "tempest-securitygroup-155951918", "description": "tempest-description-368880751"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:24.685319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:24.697114 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-147c0ad1-4270-4271-8704-6453db97bf8c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1471 microversion: 2.1 time: 0.401927 Oct 12 08:49:24.716201 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 813/1524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:24 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:24.727197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:24.727808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:24.737613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:24.738142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:24.738591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:24.739278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:24.739745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:24.740227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:25.016792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:25.036884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:25.039193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:25.041142 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39fe2734-48bf-4eda-89ef-a0c1b95bf108 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.323673 Oct 12 08:49:25.041874 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 814/1525] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:24 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:25.103674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:25.104623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:25.114410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:25.115503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:25.116022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:25.116856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:25.117385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:25.118223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:25.220134 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-29bece1f-01e8-48b5-813e-28b74d41ec56 tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.667833 Oct 12 08:49:25.221122 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 712/1526] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:49:24 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:25.235543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:25.246595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5342156d-9a45-4101-961a-8eff31b6326b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1214 microversion: 2.1 time: 0.146832 Oct 12 08:49:25.257522 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 815/1527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:25 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:25.265910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:25.266544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:25.286333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:25.288259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:25.288668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:25.289424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:25.292326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:25.292930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:25.352436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-001da3c3-1552-4398-8b99-08d95c3a3717 tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] Action: 'create', calling method: .version_select at 0x7f98487fb790>, body: {"security_group": {"name": "tempest-securitygroup-320653756", "description": "tempest-description-876748817"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:25.466747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:25.476702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:25.480964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:25.495435 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd98fcad-0347-4da0-9b37-97c1fe6f3b8d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.242668 Oct 12 08:49:25.497522 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 816/1528] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:25 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:25.517907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-671911d9-089c-4630-a4b6-aebf1c442f04 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9849162280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:25.641759 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-671911d9-089c-4630-a4b6-aebf1c442f04 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.138321 Oct 12 08:49:25.645314 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 817/1529] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:25 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:25.655526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:25.658677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:25.669987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:25.671915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:25.672536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:25.673451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:25.674083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:25.674665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:25.945682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:25.959110 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7227585b-5663-4468-9fd1-0248765e5914 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1521 microversion: 2.1 time: 0.311962 Oct 12 08:49:25.966198 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 818/1530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:25 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:25.982861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:25.989052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:26.006343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.006843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.007279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.015416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.015917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.016378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.220840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:26.232458 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-65401fb2-6352-4b40-ae07-6ecd7016eb74 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1471 microversion: 2.1 time: 0.264794 Oct 12 08:49:26.256791 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 819/1531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:25 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:26.262278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:26.263082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:26.270419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.271225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.271981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.273781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.274612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.276300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.313061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:49:26.462452 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34de0f2c-07c7-4263-93f5-f036560dbbe3 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 204 len: 0 microversion: 2.1 time: 0.203077 Oct 12 08:49:26.463181 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 820/1532] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:49:26 2022] DELETE /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:49:26.474498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:26.475869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:26.484611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.485454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.486141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.487066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.488239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.489620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.675116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:26.689913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:26.691642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:26.693061 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-18c38d62-0329-4a13-a155-093a9138a73c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.226936 Oct 12 08:49:26.694343 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 821/1533] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:26 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:26.700251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:26.701136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:26.709983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.710941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.711966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.713395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.714269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.714926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.795307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:26.804536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c9053268-2925-430a-9a37-43e636eb1f23 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1276 microversion: 2.1 time: 0.108874 Oct 12 08:49:26.805498 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 822/1534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:26 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:26.810208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:26.811379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:26.820140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.820569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.820846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:26.821643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:26.822105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:26.822531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:27.003471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:27.015933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f0cace8-9b3a-4bee-9ddc-6cc75cf62b0b tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1527 microversion: 2.1 time: 0.209179 Oct 12 08:49:27.017664 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 823/1535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:26 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:27.028685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:27.029806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:27.042044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:27.042698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:27.043141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:27.043872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:27.044326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:27.044819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:27.117803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:27.129786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:27.131673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:27.141099 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86236d27-daea-42cb-87a2-139319ea8e8a tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.121679 Oct 12 08:49:27.155921 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 824/1536] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:27 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:27.173490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c97ae75d-dead-4c2c-946d-4b888f25e346 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848861430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:27.226720 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c97ae75d-dead-4c2c-946d-4b888f25e346 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.068792 Oct 12 08:49:27.227587 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 825/1537] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:27 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:27.262534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:27.263218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:27.269465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:27.270094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:27.270626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:27.271433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:27.271970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:27.272486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:27.447371 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-001da3c3-1552-4398-8b99-08d95c3a3717 tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.216429 Oct 12 08:49:27.448288 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 713/1538] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:49:25 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:27.463743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24a7aed0-cffa-44d4-8513-9595dc58ebef tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] Action: 'create', calling method: .version_select at 0x7f9848832820>, body: {"security_group": {"name": "tempest-securitygroup-2028479715", "description": "tempest-description-193102259"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:27.492163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:27.501547 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3337738d-77b0-4e1c-ba18-651cdd7972dc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1471 microversion: 2.1 time: 0.242895 Oct 12 08:49:27.502135 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 826/1539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:27 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1471 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:27.722399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:27.723013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:27.729771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:27.730283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:27.730896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:27.731604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:27.732054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:27.732474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:27.739523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:27.959630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:27.974602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:27.976289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:27.977602 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-96df9e2e-d4bb-4489-8f2a-0c60d2da039a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.259150 Oct 12 08:49:27.989462 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 827/1540] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:27 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:49:27.989462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:27.989462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:27.991175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:27.991627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:27.997471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:27.997471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:27.997471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:27.997471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:28.086534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:28.096080 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d53e5f91-8d39-4913-bb3f-9391bbd531e4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1276 microversion: 2.1 time: 0.115582 Oct 12 08:49:28.109506 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 828/1541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:27 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:28.109506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:28.109506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:28.111567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:28.112060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:28.112494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:28.113264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:28.116640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:28.116640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:28.283484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:28.294825 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-342696f0-23be-40db-91d7-db274aa3724d tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1527 microversion: 2.1 time: 0.195998 Oct 12 08:49:28.310397 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 829/1542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:28 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1527 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:28.313064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:28.313701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:28.324954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:28.325462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:28.326111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:28.327170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:28.327626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:28.328064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:28.413361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:28.414237 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24a7aed0-cffa-44d4-8513-9595dc58ebef tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.957122 Oct 12 08:49:28.415069 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 714/1543] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:49:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:49:28.420914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f4a94937-41b5-4d2c-94a8-4c389fe1429f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98487fb430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:28.424234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:28.428155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:28.436674 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a69675e7-18e3-4f70-9c90-ec8927b3e3b6 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.133943 Oct 12 08:49:28.451050 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 830/1544] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:28 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:28.472020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47d57cd2-060a-4297-a5c2-dc599682ad95 tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] Calling method '.version_select at 0x7f9849405310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:28.528735 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f4a94937-41b5-4d2c-94a8-4c389fe1429f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1453 microversion: 2.1 time: 0.109780 Oct 12 08:49:28.531253 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 715/1545] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:28 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:28.540723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:28.549276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:28.558894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:28.559919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:28.560643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:28.562307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:28.563175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:28.564576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:29.009952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:29.023267 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3c58ab22-094b-4c1b-8b12-b1c66f30ded4 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1471 microversion: 2.1 time: 0.490479 Oct 12 08:49:29.025696 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 716/1546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:28 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1471 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:29.032468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:29.033979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:29.048307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:29.050133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:29.050985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:29.052052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:29.052902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:29.053664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:29.597763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:29.612471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:29.615550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:29.617677 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dc8a70d3-6fa4-474b-abe7-8ae6261ff326 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1812 microversion: 2.25 time: 0.590681 Oct 12 08:49:29.635288 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 717/1547] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:29 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1812 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:29.648631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:29.649586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:29.660062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:29.660922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:29.661602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:29.662492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:29.663141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:29.663728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:29.798031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:29.812496 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4f8fba4f-8503-4b90-822b-d4e4f375dd82 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1276 microversion: 2.1 time: 0.174804 Oct 12 08:49:29.813090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 718/1548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:29 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:29.822171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:29.823066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:29.837877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:29.838653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:29.839290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:29.840191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:29.840878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:29.849570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:30.012154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288742d71ac1442a9bae776c2296935d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9affaa3c854de0919bb5fd833a92fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:30.046811 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-408482d6-1eab-4d37-811b-27d3b5a942ba tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 200 len: 1485 microversion: 2.1 time: 0.232361 Oct 12 08:49:30.049852 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 719/1549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:29 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 1485 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:30.163626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-895335031", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "67899179-7243-48c3-8d8a-0b6d7c5c1df4"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:30.295744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] validate_networks() for [('67899179-7243-48c3-8d8a-0b6d7c5c1df4', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:49:31.339056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:31.477947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47d57cd2-060a-4297-a5c2-dc599682ad95 tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12296 microversion: 2.1 time: 3.022027 Oct 12 08:49:31.493461 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 831/1550] 10.222.0.40 () {58 vars in 1191 bytes} [Wed Oct 12 08:49:28 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12296 bytes in 3032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:31.493461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:31.493461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:31.499318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:31.499818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:31.500254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:31.500956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:31.501402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:31.502320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:31.596392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:31.606509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:31.608019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:31.615162 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b10ab05e-65cb-4531-a399-2d3dee088c5d tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.127559 Oct 12 08:49:31.615760 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 832/1551] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:31 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:31.621213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0018a5d7-0ad5-4cf4-ae8d-c2a7f8a2257d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984ccd1ee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:31.684801 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0018a5d7-0ad5-4cf4-ae8d-c2a7f8a2257d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1462 microversion: 2.1 time: 0.067787 Oct 12 08:49:31.686267 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 833/1552] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:31 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1462 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:31.690920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-73a4e8d2-6922-4516-a071-804ce8f4b0ca req-655c588d-bb99-49a4-a4a5-fb2bda4f9d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd903e71-5940-400c-834c-1854e86d5424", "name": "network-vif-deleted", "tag": "f672ff37-e0ef-48d1-988e-9eba040de277"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:31.705478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-73a4e8d2-6922-4516-a071-804ce8f4b0ca req-655c588d-bb99-49a4-a4a5-fb2bda4f9d0c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:31.706380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-73a4e8d2-6922-4516-a071-804ce8f4b0ca req-655c588d-bb99-49a4-a4a5-fb2bda4f9d0c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:31.707001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-73a4e8d2-6922-4516-a071-804ce8f4b0ca req-655c588d-bb99-49a4-a4a5-fb2bda4f9d0c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:31.719523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-73a4e8d2-6922-4516-a071-804ce8f4b0ca req-655c588d-bb99-49a4-a4a5-fb2bda4f9d0c service nova] Creating event network-vif-deleted:f672ff37-e0ef-48d1-988e-9eba040de277 for instance cd903e71-5940-400c-834c-1854e86d5424 on n-h2-858383-10 Oct 12 08:49:31.724989 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-73a4e8d2-6922-4516-a071-804ce8f4b0ca req-655c588d-bb99-49a4-a4a5-fb2bda4f9d0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037277 Oct 12 08:49:31.725670 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 834/1553] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:31.734354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:31.735079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:31.741969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:31.742462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:31.743095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:31.743972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:31.744382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:31.744711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:31.883980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:31.892294 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c3b71f1-8440-4bc7-81da-92433ebc6bad tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.165119 Oct 12 08:49:31.906105 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 835/1554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:31 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:31.914179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:31.914948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:31.921769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:31.922298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:31.922935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:31.923814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:31.924262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:31.924852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.049468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:49:32.051003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:49:32.051980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:49:32.052578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:49:32.053188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:49:32.058934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=30 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:32.066479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.067505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.068437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.070423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.070924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.071762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.077577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:32.087153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:32.096285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:32.097595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0395851-7abf-4665-b301-0d4b5d27370f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1802 microversion: 2.25 time: 0.190319 Oct 12 08:49:32.098156 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 836/1555] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:31 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1802 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:32.110586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Getting quotas for project e340e8d545194205b2182fb9bd5477f3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:32.118304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Getting quotas for user 9fb5a13df5004b208f2f2ddeeb35452a and project e340e8d545194205b2182fb9bd5477f3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:32.132036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:49:32.132267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.132844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:32.135148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:49:32.140110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.140588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.141016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.141736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.142873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.143309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.202781 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d0252177-1954-4dc7-9ace-d1108dc7d1ec tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.150855 Oct 12 08:49:32.209348 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 720/1556] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:49:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:49:32.214949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.215562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: cd903e71-5940-400c-834c-1854e86d5424] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:32.222315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.223156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.223777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.224638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.225098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.225584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.244885 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Instance cd903e71-5940-400c-834c-1854e86d5424 could not be found. Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 HTTP/1.1 Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:49:32.247256 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance cd903e71-5940-400c-834c-1854e86d5424 could not be found. Oct 12 08:49:32.248988 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'cd903e71-5940-400c-834c-1854e86d5424'} Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd903e71-5940-400c-834c-1854e86d5424 could not be found. Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:32.250024 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd903e71-5940-400c-834c-1854e86d5424 could not be found. Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd903e71-5940-400c-834c-1854e86d5424 could not be found. Oct 12 08:49:32.252903 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.256411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Instance cd903e71-5940-400c-834c-1854e86d5424 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:32.257611 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9e437f6e-f349-41df-b348-921e70b6c22f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424" status: 404 len: 111 microversion: 2.1 time: 0.046971 Oct 12 08:49:32.258860 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 721/1557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:32 2022] GET /compute/v2.1/servers/cd903e71-5940-400c-834c-1854e86d5424 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:49:32.264305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0d46cdb1-58dc-4b58-bf10-7c3fdf047748 tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] Calling method '.version_select at 0x7f98487a6670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.385735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:32.398513 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c2bbb441-28e9-46ff-817b-0c412216321a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1318 microversion: 2.1 time: 0.299058 Oct 12 08:49:32.399144 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 837/1558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:32 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:32.407262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4889083-4686-466b-89a6-469179fdbea6 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848ca4160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.471398 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4889083-4686-466b-89a6-469179fdbea6 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 200 len: 1462 microversion: 2.1 time: 0.070953 Oct 12 08:49:32.472136 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 838/1559] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:32 2022] GET /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 1462 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:32.489578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7cd03b16-a247-4884-999d-4b15d048d5b7 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '.version_select at 0x7f98491625e0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.493798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cd03b16-a247-4884-999d-4b15d048d5b7 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.494659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cd03b16-a247-4884-999d-4b15d048d5b7 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.495252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cd03b16-a247-4884-999d-4b15d048d5b7 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.514509 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7cd03b16-a247-4884-999d-4b15d048d5b7 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 3237 microversion: 2.25 time: 0.029144 Oct 12 08:49:32.515293 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 839/1560] 10.222.0.40 () {60 vars in 1184 bytes} [Wed Oct 12 08:49:32 2022] GET /compute/v2.1/os-migrations => generated 3237 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:32.520965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2793ee2d-9427-4b00-8997-7bcbbbab7a65 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.521842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2793ee2d-9427-4b00-8997-7bcbbbab7a65 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:32.599261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2793ee2d-9427-4b00-8997-7bcbbbab7a65 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:32.610406 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2793ee2d-9427-4b00-8997-7bcbbbab7a65 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1215 microversion: 2.1 time: 0.093127 Oct 12 08:49:32.621676 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 840/1561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:32 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:32.621676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-92ded25e-162b-4572-ab86-189d0336b367 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '.version_select at 0x7f9848fa1820>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.637492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:32.676399 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-92ded25e-162b-4572-ab86-189d0336b367 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Image not found. Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-92ded25e-162b-4572-ab86-189d0336b367 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/images/a3260ae9-370b-43a3-bc11-3d99af2aa2a9 HTTP/1.1 Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:49:32.678279 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: exception: Image not found. Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a3260ae9-370b-43a3-bc11-3d99af2aa2a9'} Oct 12 08:49:32.679628 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a3260ae9-370b-43a3-bc11-3d99af2aa2a9 to delete Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:32.680518 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3260ae9-370b-43a3-bc11-3d99af2aa2a9 could not be found. Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:32.681736 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-92ded25e-162b-4572-ab86-189d0336b367 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Image not found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:32.682979 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-92ded25e-162b-4572-ab86-189d0336b367 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/images/a3260ae9-370b-43a3-bc11-3d99af2aa2a9" status: 404 len: 62 microversion: 2.1 time: 0.067203 Oct 12 08:49:32.685250 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 841/1562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:32 2022] DELETE /compute/v2.1/images/a3260ae9-370b-43a3-bc11-3d99af2aa2a9 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:49:32.692415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-21e288d2-8954-4cdd-baf4-ebbc322ae4be req-16e4dde0-b2a8-4edd-8477-2750945ad433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94b3b9cb-de6c-4762-bb16-bab9cbde5277", "tag": "a02a1787-8fb6-4ba8-a91a-f6851ccecdf8"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:32.707492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-21e288d2-8954-4cdd-baf4-ebbc322ae4be req-16e4dde0-b2a8-4edd-8477-2750945ad433 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.707982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-21e288d2-8954-4cdd-baf4-ebbc322ae4be req-16e4dde0-b2a8-4edd-8477-2750945ad433 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.708408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-21e288d2-8954-4cdd-baf4-ebbc322ae4be req-16e4dde0-b2a8-4edd-8477-2750945ad433 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.720013 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-21e288d2-8954-4cdd-baf4-ebbc322ae4be req-16e4dde0-b2a8-4edd-8477-2750945ad433 service nova] Creating event network-changed:a02a1787-8fb6-4ba8-a91a-f6851ccecdf8 for instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 on n-h1-858383-10 Oct 12 08:49:32.725262 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-21e288d2-8954-4cdd-baf4-ebbc322ae4be req-16e4dde0-b2a8-4edd-8477-2750945ad433 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039353 Oct 12 08:49:32.727126 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 842/1563] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:32.732622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.733312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:32.740011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.740572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.741133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.741887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.742330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.743021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.797023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0d46cdb1-58dc-4b58-bf10-7c3fdf047748 tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.536237 Oct 12 08:49:32.797403 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 722/1564] 10.222.0.40 () {58 vars in 1191 bytes} [Wed Oct 12 08:49:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:32.801486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:32.802076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:32.822124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.822624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.823063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.823782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:32.824244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:32.824670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:32.984765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:32.994139 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ababa34d-a319-4013-937a-32367e1c9ac2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d" status: 200 len: 1467 microversion: 2.1 time: 0.265759 Oct 12 08:49:33.009637 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 843/1565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:32 2022] GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d => generated 1467 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:33.020949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.021581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:33.027698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.028178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.028609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.029304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.029780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.030356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.094235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:33.103642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:33.104861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:49:33.105472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:33.110938 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02dda3f7-499b-4075-a02d-d5b84bfe3529 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1558 microversion: 2.91 time: 0.093730 Oct 12 08:49:33.111413 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 844/1566] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:33 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1558 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:33.115925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.116451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:33.118940 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-84d02aaf-575f-4b78-87b0-9ef71789a832 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 2422 microversion: 2.25 time: 0.320846 Oct 12 08:49:33.119589 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 723/1567] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:32 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 2422 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:33.122366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.123068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.123712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.124598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.125233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.125351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-442ce629-e506-46c4-845c-a0beff7c626a tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] Calling method '.version_select at 0x7f984881faf0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.125981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.141965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 HTTP/1.1 Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:49:33.143626 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.145138 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '1515a4a6-8145-4651-8d70-b3d88c404ed8'} Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:33.145954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.147312 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.149201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:33.149201 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb332d2d-7b91-426c-990a-44fd0251cdc2 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 404 len: 111 microversion: 2.1 time: 0.032663 Oct 12 08:49:33.149201 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 845/1568] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:49:33 2022] DELETE /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:49:33.153313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.153957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:33.160431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.161170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.161742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.162512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.162960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.163379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.310467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:33.319354 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db890424-3f87-4839-974e-8012ab68e104 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.169778 Oct 12 08:49:33.319926 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 846/1569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:33 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:33.324532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d85a9559-aac7-4be6-9de1-5b04f9dbf911 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848fa1ca0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.494713 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d85a9559-aac7-4be6-9de1-5b04f9dbf911 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images?changes-since=2022-10-12T08%3A47%3A42Z" status: 200 len: 2374 microversion: 2.1 time: 0.173686 Oct 12 08:49:33.496344 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 847/1570] 10.222.0.40 () {58 vars in 1199 bytes} [Wed Oct 12 08:49:33 2022] GET /compute/v2.1/images?changes-since=2022-10-12T08%3A47%3A42Z => generated 2374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:33.501033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.501877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:33.508700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.509189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.509828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.510718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.511327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.511914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.697356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:49:33.709535 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-442ce629-e506-46c4-845c-a0beff7c626a tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/fbaea52c-da34-4c19-af60-6fcc8d7fd3da" status: 202 len: 0 microversion: 2.1 time: 0.588637 Oct 12 08:49:33.714628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 724/1571] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:49:33 2022] DELETE /compute/v2.1/os-security-groups/fbaea52c-da34-4c19-af60-6fcc8d7fd3da => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:49:33.719619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9176f451-443b-4428-8f69-72bf34453ccb tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 2422 microversion: 2.25 time: 0.221521 Oct 12 08:49:33.729724 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 848/1572] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:33 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 2422 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:33.730897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.732161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: 1515a4a6-8145-4651-8d70-b3d88c404ed8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:33.744713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.745508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:33.751874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:33.754451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.755317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.755860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.756675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.757236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.757786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.786077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.799441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.801744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.806470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.807791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.808544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.850784 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 HTTP/1.1 Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:49:33.858306 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.859710 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1515a4a6-8145-4651-8d70-b3d88c404ed8'} Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:33.860534 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. Oct 12 08:49:33.862194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:33.866239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Instance 1515a4a6-8145-4651-8d70-b3d88c404ed8 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:33.867340 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-52f9c5c2-dee7-4651-8619-65d012801e69 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8" status: 404 len: 111 microversion: 2.1 time: 0.151092 Oct 12 08:49:33.869367 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 725/1573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:33 2022] GET /compute/v2.1/servers/1515a4a6-8145-4651-8d70-b3d88c404ed8 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:49:33.875443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b6e779c5-5809-4ea4-880e-9713c5b9263f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848774f70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.924915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:33.936334 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-50c9fc68-d7ff-4be0-94fa-f5e585e6b401 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1318 microversion: 2.1 time: 0.213465 Oct 12 08:49:33.937241 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 849/1574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:33 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:33.947302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.947976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:33.958265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.958759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.959239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:33.959849 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b6e779c5-5809-4ea4-880e-9713c5b9263f tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1547746921" status: 200 len: 485 microversion: 2.1 time: 0.089204 Oct 12 08:49:33.960003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:33.960372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:33.960730 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 726/1575] 10.222.0.40 () {58 vars in 1231 bytes} [Wed Oct 12 08:49:33 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1547746921 => generated 485 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:33.965307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9930421-07a0-4953-9f96-fe2a84b321a7 tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] Calling method '.version_select at 0x7f984878eca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:33.970066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.042226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:34.053204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c43ea7c4-2d27-4470-b85f-1c1d3afd3c91 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1267 microversion: 2.1 time: 0.115046 Oct 12 08:49:34.053833 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 850/1576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:33 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:34.058430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-799441f7-29f3-45f3-8f82-e33685b2bad9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '.version_select at 0x7f9848c5caf0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.078101 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-799441f7-29f3-45f3-8f82-e33685b2bad9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934976847" status: 202 len: 0 microversion: 2.1 time: 0.023256 Oct 12 08:49:34.078708 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 851/1577] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 08:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934976847 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:49:34.083718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.084243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:34.090560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.091038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.091465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.092163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.092609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.093025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.149391 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9930421-07a0-4953-9f96-fe2a84b321a7 tempest-SecurityGroupsTestAdminJSON-1408218453 tempest-SecurityGroupsTestAdminJSON-1408218453-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/e6ee2a5a-c92f-472e-a1f7-2a847d8bced5" status: 202 len: 0 microversion: 2.1 time: 0.187336 Oct 12 08:49:34.153869 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 727/1578] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:49:33 2022] DELETE /compute/v2.1/os-security-groups/e6ee2a5a-c92f-472e-a1f7-2a847d8bced5 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:49:34.159630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a791520f-6fb9-427c-87a5-c6ee4d543f65 req-220b7bdb-ca28-45d0-9362-fdf5c9a5b08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd399ffd-4151-4122-9901-a61d55e2e70d", "name": "network-vif-unplugged", "status": "completed", "tag": "8ae947b8-c972-44eb-a547-9e84edfdee53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:34.172758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a791520f-6fb9-427c-87a5-c6ee4d543f65 req-220b7bdb-ca28-45d0-9362-fdf5c9a5b08b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.173309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a791520f-6fb9-427c-87a5-c6ee4d543f65 req-220b7bdb-ca28-45d0-9362-fdf5c9a5b08b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.174044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a791520f-6fb9-427c-87a5-c6ee4d543f65 req-220b7bdb-ca28-45d0-9362-fdf5c9a5b08b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.185256 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a791520f-6fb9-427c-87a5-c6ee4d543f65 req-220b7bdb-ca28-45d0-9362-fdf5c9a5b08b service nova] Creating event network-vif-unplugged:8ae947b8-c972-44eb-a547-9e84edfdee53 for instance fd399ffd-4151-4122-9901-a61d55e2e70d on n-h2-858383-10 Oct 12 08:49:34.192392 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a791520f-6fb9-427c-87a5-c6ee4d543f65 req-220b7bdb-ca28-45d0-9362-fdf5c9a5b08b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036813 Oct 12 08:49:34.193354 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 728/1579] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:34.200067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb42bcbb-c96e-4f6e-ab6c-90404e47e6f5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98487a6f70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.236288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lazy-loading 'services' on Instance uuid 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:49:34.271912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:34.300847 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb42bcbb-c96e-4f6e-ab6c-90404e47e6f5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images?server=fd399ffd-4151-4122-9901-a61d55e2e70d" status: 200 len: 958 microversion: 2.1 time: 0.106051 Oct 12 08:49:34.301806 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 729/1580] 10.222.0.40 () {58 vars in 1209 bytes} [Wed Oct 12 08:49:34 2022] GET /compute/v2.1/images?server=fd399ffd-4151-4122-9901-a61d55e2e70d => generated 958 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:34.306865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.307884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:34.319789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.324038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.324613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.325197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.325682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.329803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.386600 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-44b7d2cc-7fbe-4aad-9dd4-c919b3259286 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments/232127e6-d624-4d60-baf5-c933e472ae7c" status: 202 len: 0 microversion: 2.25 time: 0.306548 Oct 12 08:49:34.387547 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 852/1581] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Oct 12 08:49:34 2022] DELETE /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments/232127e6-d624-4d60-baf5-c933e472ae7c => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:49:34.395769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d8f3211-c764-4196-a221-d06c4ecd153c tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] Calling method '.version_select at 0x7f98493a6b80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.401621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:34.410500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:34.412677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:34.417924 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6f99bf28-3f0a-491d-9491-7d53c0eef947 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1558 microversion: 2.91 time: 0.114867 Oct 12 08:49:34.418854 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 730/1582] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:34 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1558 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:34.434366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-78dbdd12-7f9c-42f5-90d7-7ca6aae0d338 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98487a6d30>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.495553 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-78dbdd12-7f9c-42f5-90d7-7ca6aae0d338 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 484 microversion: 2.1 time: 0.075555 Oct 12 08:49:34.503269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 731/1583] 10.222.0.40 () {58 vars in 1317 bytes} [Wed Oct 12 08:49:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 484 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:34.503664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.503930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:34.510321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.510826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.511259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.511962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.512406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.512823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.648556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:34.656441 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-584c2dea-0730-481c-8504-ceb2c76089ea tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.159009 Oct 12 08:49:34.657008 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 732/1584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:34 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:34.665623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.665623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:34.670589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.671067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.671494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.672184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.672630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.673049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.703538 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-09a7f96d-2156-4992-bf89-930a64bf9976 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.045352 Oct 12 08:49:34.708655 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 733/1585] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 08:49:34 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:34.708655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10e1d1bd-caab-40d0-89ab-41c6f1537d6e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984877c280>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.737577 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d8f3211-c764-4196-a221-d06c4ecd153c tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/abd0e15f-ccd6-4444-b1be-b5a1b42ed8d3" status: 202 len: 0 microversion: 2.1 time: 0.348146 Oct 12 08:49:34.742803 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 853/1586] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:49:34 2022] DELETE /compute/v2.1/os-security-groups/abd0e15f-ccd6-4444-b1be-b5a1b42ed8d3 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:49:34.748469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a049452b-9c34-44f6-8f70-db5eb5b6f83b tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] Calling method '.version_select at 0x7f984ccdf700>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.780755 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10e1d1bd-caab-40d0-89ab-41c6f1537d6e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 484 microversion: 2.1 time: 0.075384 Oct 12 08:49:34.783069 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 734/1587] 10.222.0.40 () {58 vars in 1303 bytes} [Wed Oct 12 08:49:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 484 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:34.797895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0327589-18a2-4a8d-ba2b-bb602a0699e2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98487a6d30>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:34.927169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0327589-18a2-4a8d-ba2b-bb602a0699e2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.133388 Oct 12 08:49:34.928118 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 735/1588] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:49:34 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:34.932625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f471a75d-c906-421a-90b1-5b83e81a2cbd req-6d23f9f8-ca43-4680-b0b3-399f26be6b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7753b798-4301-4a65-9412-154b59047db2", "tag": "b9bacb15-a33b-497e-b135-06e1f7ade2c1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:34.943496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f471a75d-c906-421a-90b1-5b83e81a2cbd req-6d23f9f8-ca43-4680-b0b3-399f26be6b19 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:34.944116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f471a75d-c906-421a-90b1-5b83e81a2cbd req-6d23f9f8-ca43-4680-b0b3-399f26be6b19 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:34.944560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f471a75d-c906-421a-90b1-5b83e81a2cbd req-6d23f9f8-ca43-4680-b0b3-399f26be6b19 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:34.956486 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f471a75d-c906-421a-90b1-5b83e81a2cbd req-6d23f9f8-ca43-4680-b0b3-399f26be6b19 service nova] Creating event network-changed:b9bacb15-a33b-497e-b135-06e1f7ade2c1 for instance 7753b798-4301-4a65-9412-154b59047db2 on n-h1-858383-10 Oct 12 08:49:34.961602 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f471a75d-c906-421a-90b1-5b83e81a2cbd req-6d23f9f8-ca43-4680-b0b3-399f26be6b19 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032251 Oct 12 08:49:34.962198 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 736/1589] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:34.967390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-78700444-66b7-404d-84fd-51944557f10b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98487fb700>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.060358 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-78700444-66b7-404d-84fd-51944557f10b tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.096957 Oct 12 08:49:35.061485 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a049452b-9c34-44f6-8f70-db5eb5b6f83b tempest-SecurityGroupsTestAdminJSON-922905225 tempest-SecurityGroupsTestAdminJSON-922905225-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/a31896e1-a731-4a3b-b694-f70ec61ddab8" status: 202 len: 0 microversion: 2.1 time: 0.316636 Oct 12 08:49:35.061631 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 737/1590] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:49:34 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:35.067196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.067196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:35.068057 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 854/1591] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:49:34 2022] DELETE /compute/v2.1/os-security-groups/a31896e1-a731-4a3b-b694-f70ec61ddab8 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:49:35.077879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d8fea4f-9bf2-448b-9b91-410b0ca16b7f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '.version_select at 0x7f984ccdf160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.078932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.079423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.079989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.081837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.082358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.082801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.124244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9d8fea4f-9bf2-448b-9b91-410b0ca16b7f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Image not found. Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d8fea4f-9bf2-448b-9b91-410b0ca16b7f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/images/9a4a3dcc-18c3-4bd8-afa5-38b5aa301fde HTTP/1.1 Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:49:35.129140 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: exception: Image not found. Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '9a4a3dcc-18c3-4bd8-afa5-38b5aa301fde'} Oct 12 08:49:35.130538 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9a4a3dcc-18c3-4bd8-afa5-38b5aa301fde to delete Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:35.131459 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a4a3dcc-18c3-4bd8-afa5-38b5aa301fde could not be found. Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:35.132658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:49:35.133967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.135634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d8fea4f-9bf2-448b-9b91-410b0ca16b7f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Image not found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:35.136649 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d8fea4f-9bf2-448b-9b91-410b0ca16b7f tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/images/9a4a3dcc-18c3-4bd8-afa5-38b5aa301fde" status: 404 len: 62 microversion: 2.1 time: 0.067323 Oct 12 08:49:35.137214 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 855/1592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:35 2022] DELETE /compute/v2.1/images/9a4a3dcc-18c3-4bd8-afa5-38b5aa301fde => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:49:35.143547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bead7843-5ff0-480c-9ee3-3eddb0101203 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848c5caf0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.281732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:35.290437 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f83c021a-0a11-4dcc-9bc2-58e9230145b9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1318 microversion: 2.1 time: 0.227766 Oct 12 08:49:35.292157 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 738/1593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:35.301247 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bead7843-5ff0-480c-9ee3-3eddb0101203 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.162949 Oct 12 08:49:35.302636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.303527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:35.307993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 856/1594] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:35.312886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.313742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.314353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.315427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.316214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.317142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.320637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.321284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:35.343525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.344018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.344447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.345151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.345629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.346049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.364708 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 HTTP/1.1 Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:49:35.366877 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.368527 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'e369824a-bd0d-4c88-a06f-219dabefea87'} Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:35.369477 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.371079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.373658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:35.374800 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95b953e2-dd56-4bc9-ae4a-dae2c6659cc9 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 404 len: 111 microversion: 2.1 time: 0.058960 Oct 12 08:49:35.375541 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 857/1595] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:49:35 2022] DELETE /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:49:35.380739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3fac016-16bb-49db-bba1-56a1a0a6fd96 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848897790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.402572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:35.415847 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-117565cc-a05e-490b-8a16-75e8959efd83 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1275 microversion: 2.1 time: 0.122317 Oct 12 08:49:35.417652 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 739/1596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:35.426623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.429289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] [instance: e369824a-bd0d-4c88-a06f-219dabefea87] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:35.444268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.444977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.445178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.451047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.451523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.451959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.476789 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] HTTP exception thrown: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Request method failure captured: Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 HTTP/1.1 Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8j3q5pCZOoyBL6vJ80yszjJU8SDgKK4X5u2deEe8HM4NE1S0T6WZKgD-rfmj8G9llmC1ngIpUw67YojNVrcA4gT6uJ4i1c4e_5_RebUwn9OIhN2uCNsT94q6jUio2NOFpb8oB0D1xqJm4yu4xsA1jLMCMFx7gh-1E_udQQVrjzqQ8 Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:49:35.479359 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c9affaa3c854de0919bb5fd833a92fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c9affaa3c854de0919bb5fd833a92fd"}]}] Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9c9affaa3c854de0919bb5fd833a92fd Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360 Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 288742d71ac1442a9bae776c2296935d Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1622934360-project Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.480990 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e369824a-bd0d-4c88-a06f-219dabefea87'} Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:35.481929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. Oct 12 08:49:35.483388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:35.484708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] Returning 404 to user: Instance e369824a-bd0d-4c88-a06f-219dabefea87 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:35.484708 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ec981e5-4137-40bc-9641-598ace1d2fd1 tempest-ImagesOneServerNegativeTestJSON-1622934360 tempest-ImagesOneServerNegativeTestJSON-1622934360-project] 10.222.0.40 "GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87" status: 404 len: 111 microversion: 2.1 time: 0.060118 Oct 12 08:49:35.485566 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 740/1597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/servers/e369824a-bd0d-4c88-a06f-219dabefea87 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:49:35.491333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.492248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:35.500136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.500953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.501946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.502858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.503468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.504057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.510955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:35.632441 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3fac016-16bb-49db-bba1-56a1a0a6fd96 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/detail?changes-since=2022-10-12T08%3A47%3A38Z" status: 200 len: 6327 microversion: 2.1 time: 0.253933 Oct 12 08:49:35.634238 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 858/1598] 10.222.0.40 () {58 vars in 1220 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-12T08%3A47%3A38Z => generated 6327 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:35.656454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71fadc2e-5918-40d0-9ecd-df9045f2f8e6 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98494dc1f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.791562 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71fadc2e-5918-40d0-9ecd-df9045f2f8e6 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1547746921" status: 200 len: 665 microversion: 2.1 time: 0.140668 Oct 12 08:49:35.793393 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 859/1599] 10.222.0.40 () {58 vars in 1252 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1547746921 => generated 665 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:49:35.799459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.800337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:35.809681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.810541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.811503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.812491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.813166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:35.813986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:35.932322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:35.951285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:35.952928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:35.958629 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-076d4b7d-db47-4208-930a-688868cab8d0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.471941 Oct 12 08:49:35.959187 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 741/1600] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:35.977898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:35.985780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:35.999405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:35.999892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:36.002586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:36.004689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:36.005266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:36.006784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:36.030870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:36.042573 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34673daf-a93e-4f85-97e5-2db9a131574a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.245901 Oct 12 08:49:36.043627 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 860/1601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:36.053099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-567f29ab-d8ef-430f-b41c-f7850fc1bdff tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984cc7df70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:36.083838 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a035b3db-b85c-4653-879f-f7e05593662c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123508 Oct 12 08:49:36.089138 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 742/1602] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 08:49:35 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:36.213798 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-567f29ab-d8ef-430f-b41c-f7850fc1bdff tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1464 microversion: 2.1 time: 0.168710 Oct 12 08:49:36.225635 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 861/1603] 10.222.0.40 () {58 vars in 1338 bytes} [Wed Oct 12 08:49:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:36.229936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6df31c18-44b3-4d06-844e-d897be0e5287 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984880ed30>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:36.315956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:36.315956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:36.325810 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6df31c18-44b3-4d06-844e-d897be0e5287 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1464 microversion: 2.1 time: 0.099800 Oct 12 08:49:36.326580 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 743/1604] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Oct 12 08:49:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:36.331500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:36.332004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:36.332448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:36.333173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:36.333665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:36.334097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:36.353200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fb637b9b-7021-4e86-8676-3f83dfc0b476 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f98487a69d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:36.533111 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fb637b9b-7021-4e86-8676-3f83dfc0b476 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.185964 Oct 12 08:49:36.535731 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 744/1605] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 12 08:49:36 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:36.554364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:36.554364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:36.565034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:36.565596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:36.566046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:36.566774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:36.568546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:36.569007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:36.639722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:36.656173 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ee753d7-9db1-446c-881b-85f74be765f6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1318 microversion: 2.1 time: 0.345645 Oct 12 08:49:36.656767 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 862/1606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:36 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:36.681545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de84171a-5bf3-40f9-ace9-0a399d0ad94a tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984cc7d430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:36.776068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de84171a-5bf3-40f9-ace9-0a399d0ad94a tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.098333 Oct 12 08:49:36.787949 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 863/1607] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 12 08:49:36 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:36.800650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3f1811d-2ee6-4be9-98e9-0933919e4a7d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984cc09160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:36.864435 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3f1811d-2ee6-4be9-98e9-0933919e4a7d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/3816cc90-eecd-445f-9498-be8ec212c308" status: 200 len: 784 microversion: 2.1 time: 0.070670 Oct 12 08:49:36.865599 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 864/1608] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:49:36 2022] GET /compute/v2.1/images/3816cc90-eecd-445f-9498-be8ec212c308 => generated 784 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:36.883809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73228b97-5dcb-44e9-9860-6e5844889595 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984ccd21f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:36.950720 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73228b97-5dcb-44e9-9860-6e5844889595 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.068580 Oct 12 08:49:36.952163 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 865/1609] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:49:36 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:36.980542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f3365961-5a09-48ad-b577-43ad25d525b5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984cc7d430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:37.371370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:37.386933 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b036ca7b-086a-4714-bdd0-3aabdcb77c33 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1273 microversion: 2.1 time: 0.848866 Oct 12 08:49:37.388099 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 745/1610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:36 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1273 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:37.406512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:37.411885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:37.426857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:37.427532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:37.428181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:37.429066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:37.429552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:37.430085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:37.676387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:37.705951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:37.707478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:37.724567 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1b08b2d9-9c30-4919-a737-9800e181414f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.332904 Oct 12 08:49:37.725823 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 746/1611] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:37 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:37.731261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:37.732408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:37.740708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:37.742573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:37.743864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:37.744901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:37.745742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:37.746429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:38.140986 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f3365961-5a09-48ad-b577-43ad25d525b5 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "DELETE /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44" status: 204 len: 0 microversion: 2.1 time: 1.176719 Oct 12 08:49:38.141829 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 866/1612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:36 2022] DELETE /compute/v2.1/images/1cb31ea0-7490-4b4e-9e67-63f2a5f68b44 => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:49:38.150411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:38.155569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:38.176025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:38.177783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:38.178857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:38.182899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:38.183658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:38.184911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:38.263928 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a754b537-30e9-488b-bde7-f632f725ccf6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118608 Oct 12 08:49:38.265158 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 867/1613] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 08:49:38 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:38.273173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:38.274309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:38.282136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:38.283047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:38.283585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:38.284538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:38.285349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:38.285910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:38.548875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:38.565487 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4d9dd1a6-3281-49f9-8a17-25f43d2f53a3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1318 microversion: 2.1 time: 0.298502 Oct 12 08:49:38.580699 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 868/1614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:38 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:38.596070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f7e9ecb-c39a-4c49-87bd-b7f32ed84e41 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984cc7d8b0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:39.149130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:39.159211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c80c56b-d1f1-4afe-b8b7-6073dc7d79fa tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 1.431252 Oct 12 08:49:39.167516 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 747/1615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:37 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:39.186437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:39.187217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:39.196212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:39.196708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:39.201394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:39.202267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:39.202965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:39.204023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:39.375064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:39.390453 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c8a8001c-f51b-46b1-8038-90bce8ea897a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1273 microversion: 2.1 time: 0.220853 Oct 12 08:49:39.393091 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 748/1616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:39 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:39.404823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:39.405596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:39.418798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:39.422048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:39.422741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:39.423700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:39.424391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:39.430100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:39.605007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:39.628014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:39.632293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:39.641465 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5e7b288-3715-49d0-80d8-e66094602631 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.240106 Oct 12 08:49:39.644761 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 749/1617] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:39 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:39.651616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:39.654708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:39.664204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:39.666854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:39.667635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:39.668584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:39.669461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:39.670153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:39.920467 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-209ef983-71be-47a1-b328-b92bcb13893d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.268799 Oct 12 08:49:39.925152 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 750/1618] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 08:49:39 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments => generated 197 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:39.938590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:39.939592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:39.955363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:39.957531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:39.958231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:39.962101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:39.963047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:39.963699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:39.979447 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f7e9ecb-c39a-4c49-87bd-b7f32ed84e41 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "DELETE /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d" status: 204 len: 0 microversion: 2.1 time: 1.403016 Oct 12 08:49:39.980480 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 869/1619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:38 2022] DELETE /compute/v2.1/images/4334bd6f-7ec9-4787-ad89-ab32f46ed12d => generated 0 bytes in 1406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:49:39.996134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a7c98152-2978-4d27-a80d-af8f90d6d013 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984cc379d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:40.833804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:40.846572 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-652fbce9-d5ea-47c1-ace1-736ee91b681b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1318 microversion: 2.1 time: 0.918504 Oct 12 08:49:40.847073 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 751/1620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:39 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1318 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:40.864217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:40.866394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:40.882155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:40.887908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:40.889624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:40.899863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:40.900451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:40.900984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:41.294801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:41.308793 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c0b925f0-bf10-4576-9995-eee0fceee84a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.458357 Oct 12 08:49:41.310745 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 752/1621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:40 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:41.332406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ab0f2cd8-2f57-44da-b856-8ba739ab9be4 req-0c030ff6-9c9a-4863-989f-4d0bb554cec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7753b798-4301-4a65-9412-154b59047db2", "name": "network-vif-plugged", "status": "completed", "tag": "b9bacb15-a33b-497e-b135-06e1f7ade2c1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:41.350274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ab0f2cd8-2f57-44da-b856-8ba739ab9be4 req-0c030ff6-9c9a-4863-989f-4d0bb554cec3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:41.350771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ab0f2cd8-2f57-44da-b856-8ba739ab9be4 req-0c030ff6-9c9a-4863-989f-4d0bb554cec3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:41.351280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ab0f2cd8-2f57-44da-b856-8ba739ab9be4 req-0c030ff6-9c9a-4863-989f-4d0bb554cec3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:41.373870 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ab0f2cd8-2f57-44da-b856-8ba739ab9be4 req-0c030ff6-9c9a-4863-989f-4d0bb554cec3 service nova] Creating event network-vif-plugged:b9bacb15-a33b-497e-b135-06e1f7ade2c1 for instance 7753b798-4301-4a65-9412-154b59047db2 on n-h1-858383-10 Oct 12 08:49:41.387470 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ab0f2cd8-2f57-44da-b856-8ba739ab9be4 req-0c030ff6-9c9a-4863-989f-4d0bb554cec3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074811 Oct 12 08:49:41.392900 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 753/1622] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:41.405160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:41.409287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:41.422329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:41.423153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:41.423820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:41.424738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:41.425386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:41.435375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:41.773319 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a7c98152-2978-4d27-a80d-af8f90d6d013 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "DELETE /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d" status: 204 len: 0 microversion: 2.1 time: 1.788373 Oct 12 08:49:41.774982 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 870/1623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:39 2022] DELETE /compute/v2.1/images/e33d524c-53a6-41bf-940a-afc64f9ff91d => generated 0 bytes in 1791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:49:41.781606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:41.782628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:41.812354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:41.813275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:41.814099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:41.815363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:41.816104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:41.816862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:41.946935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:41.969044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:41.979787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:42.005095 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-335c4538-f2f6-43c7-a52d-9e22b5d5a162 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.228630 Oct 12 08:49:42.022640 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 871/1624] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:41 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:42.044795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:42.057339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:42.078536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.080080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.080862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.081837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.082506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.082979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:42.083809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.091604 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f72adfca-7499-446e-95f8-2f8a83b47413 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1315 microversion: 2.1 time: 0.696841 Oct 12 08:49:42.094666 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 754/1625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:41 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:42.119459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:42.125253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:42.128101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:42.137605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:42.144689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.145527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.147051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.152391 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e46f1b53-8aea-4605-9817-ec9d71c0c48f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126832 Oct 12 08:49:42.152856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.153410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.153853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.157471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 872/1626] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 08:49:42 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:49:42.163951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:42.164954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:42.173751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.174496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.178586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.182348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.182826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.183256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.195454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:49:42.334613 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-def31497-331a-4a46-ad78-4d827bcdc290 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 204 len: 0 microversion: 2.1 time: 0.219213 Oct 12 08:49:42.339101 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 755/1627] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:49:42 2022] DELETE /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:49:42.440924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:42.450851 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d60d2a5d-0a70-4d9e-8a44-3584add4f186 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1318 microversion: 2.1 time: 0.291698 Oct 12 08:49:42.465465 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 873/1628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:42 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:42.469402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:42.470051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:42.480311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.481079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.482260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.483179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.483795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.484380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.573053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Action: 'update', calling method: .version_select at 0x7f98487fb820>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:42.578194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.578901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.579512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.589036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.590058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.590790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.600082 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] HTTP exception thrown: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.604932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Request method failure captured: Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631 HTTP/1.1 Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 56 Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-lOCsU_b-Cknu59rDOzEoAOYXfo8JkZLroMuiuFfW8rNtPvhSK756AFjknaTnCQa_J4iJkQNGgqXgiOwoc_NeiTp5ZO0cux_m8RqNoV3DPkcLlqI1tli-XCwTO5SxX-EAKqCvG57uWr2dgvmhvMNLPS9D-sSGvwms9QGYCeNgNwLU Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c0e8202372c34a6d9381c1ab68393804 Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:49:42.612225 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0e8202372c34a6d9381c1ab68393804"}]}] Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c0e8202372c34a6d9381c1ab68393804 Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f0f26ad8735940ea8f0f161d532c50fe Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:49:42.614280 n-d-858383-10 devstack@n-api.service[127007]: exception: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f371e2f4-1cdd-4d69-8c78-d00fc0715631', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.615209 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:42.616543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:42.617917 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:42.617917 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.617917 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.617917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Returning 404 to user: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:42.617917 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c9b5778-a612-4ebe-94c9-e0ea581d9633 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631" status: 404 len: 110 microversion: 2.53 time: 0.272587 Oct 12 08:49:42.617917 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 756/1629] 10.222.0.40 () {62 vars in 1309 bytes} [Wed Oct 12 08:49:42 2022] PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631 => generated 110 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:49:42.627765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:42.628796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:42.635670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.636633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.637954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.638874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.639482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.640059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.678039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:42.689964 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3877fbd8-53b8-48db-bab0-2fcfc6fd6daf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.230560 Oct 12 08:49:42.690887 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 874/1630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:42 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:42.710307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Action: 'update', calling method: .version_select at 0x7f984cc09670>, body: {"status": "disabled"} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:42.715472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.716281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.716958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.727093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.727985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.728643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.739391 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] HTTP exception thrown: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Request method failure captured: Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631 HTTP/1.1 Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 22 Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-lOCsU_b-Cknu59rDOzEoAOYXfo8JkZLroMuiuFfW8rNtPvhSK756AFjknaTnCQa_J4iJkQNGgqXgiOwoc_NeiTp5ZO0cux_m8RqNoV3DPkcLlqI1tli-XCwTO5SxX-EAKqCvG57uWr2dgvmhvMNLPS9D-sSGvwms9QGYCeNgNwLU Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: c0e8202372c34a6d9381c1ab68393804 Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:49:42.743047 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0e8202372c34a6d9381c1ab68393804"}]}] Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: c0e8202372c34a6d9381c1ab68393804 Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f0f26ad8735940ea8f0f161d532c50fe Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: {"status": "disabled"} Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: exception: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.744510 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'f371e2f4-1cdd-4d69-8c78-d00fc0715631', 'body': {'status': 'disabled'}} Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.745399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:42.746684 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:42.747915 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.747915 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.749856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Returning 404 to user: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:42.750957 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1cef1f1c-f377-4d84-a5ec-eb39ce958148 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631" status: 404 len: 110 microversion: 2.53 time: 0.059048 Oct 12 08:49:42.759886 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 875/1631] 10.222.0.40 () {62 vars in 1309 bytes} [Wed Oct 12 08:49:42 2022] PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:49:42.765030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Action: 'update', calling method: .version_select at 0x7f9848968a60>, body: {"status": "enabled"} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:42.768892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.769693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.770367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.782601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.784147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.784940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.791506 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] HTTP exception thrown: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Request method failure captured: Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631 HTTP/1.1 Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 21 Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-lOCsU_b-Cknu59rDOzEoAOYXfo8JkZLroMuiuFfW8rNtPvhSK756AFjknaTnCQa_J4iJkQNGgqXgiOwoc_NeiTp5ZO0cux_m8RqNoV3DPkcLlqI1tli-XCwTO5SxX-EAKqCvG57uWr2dgvmhvMNLPS9D-sSGvwms9QGYCeNgNwLU Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: c0e8202372c34a6d9381c1ab68393804 Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:49:42.793304 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0e8202372c34a6d9381c1ab68393804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0e8202372c34a6d9381c1ab68393804"}]}] Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: c0e8202372c34a6d9381c1ab68393804 Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761 Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f0f26ad8735940ea8f0f161d532c50fe Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: {"status": "enabled"} Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: exception: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.794766 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'f371e2f4-1cdd-4d69-8c78-d00fc0715631', 'body': {'status': 'enabled'}} Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.795648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:42.798198 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:42.802073 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. Oct 12 08:49:42.802073 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:42.803703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Returning 404 to user: Service f371e2f4-1cdd-4d69-8c78-d00fc0715631 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:42.804759 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-adb7a634-15df-4845-b0fe-03f4a052c548 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631" status: 404 len: 110 microversion: 2.53 time: 0.043697 Oct 12 08:49:42.811140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 876/1632] 10.222.0.40 () {62 vars in 1309 bytes} [Wed Oct 12 08:49:42 2022] PUT /compute/v2.1/os-services/f371e2f4-1cdd-4d69-8c78-d00fc0715631 => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:49:42.815748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d96182db-cb92-405e-8eee-1539b776ac79 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:42.822026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96182db-cb92-405e-8eee-1539b776ac79 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.822788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96182db-cb92-405e-8eee-1539b776ac79 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.823949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96182db-cb92-405e-8eee-1539b776ac79 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.824893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96182db-cb92-405e-8eee-1539b776ac79 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.825593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96182db-cb92-405e-8eee-1539b776ac79 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.826195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96182db-cb92-405e-8eee-1539b776ac79 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.883735 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d96182db-cb92-405e-8eee-1539b776ac79 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.070758 Oct 12 08:49:42.893386 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 877/1633] 10.222.0.40 () {60 vars in 1178 bytes} [Wed Oct 12 08:49:42 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:42.899979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72e7f127-17d3-4c54-91ba-ac2f227224ff tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:42.903881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72e7f127-17d3-4c54-91ba-ac2f227224ff tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.904370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72e7f127-17d3-4c54-91ba-ac2f227224ff tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.904821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72e7f127-17d3-4c54-91ba-ac2f227224ff tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.905581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72e7f127-17d3-4c54-91ba-ac2f227224ff tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.906029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72e7f127-17d3-4c54-91ba-ac2f227224ff tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.906767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72e7f127-17d3-4c54-91ba-ac2f227224ff tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.951147 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-72e7f127-17d3-4c54-91ba-ac2f227224ff tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.056316 Oct 12 08:49:42.960653 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 878/1634] 10.222.0.40 () {60 vars in 1211 bytes} [Wed Oct 12 08:49:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:42.967017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0d32a4b-bb63-4a50-840e-a91ab3322145 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:42.972422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0d32a4b-bb63-4a50-840e-a91ab3322145 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.973646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0d32a4b-bb63-4a50-840e-a91ab3322145 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.974071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0d32a4b-bb63-4a50-840e-a91ab3322145 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:42.974864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0d32a4b-bb63-4a50-840e-a91ab3322145 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:42.975251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0d32a4b-bb63-4a50-840e-a91ab3322145 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:42.975756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0d32a4b-bb63-4a50-840e-a91ab3322145 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.004850 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0d32a4b-bb63-4a50-840e-a91ab3322145 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.042855 Oct 12 08:49:43.013169 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 879/1635] 10.222.0.40 () {60 vars in 1178 bytes} [Wed Oct 12 08:49:42 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:43.017821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ee9f1f0d-7d80-4d82-b8e7-cf075b86d40d tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:43.021526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee9f1f0d-7d80-4d82-b8e7-cf075b86d40d tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.022009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee9f1f0d-7d80-4d82-b8e7-cf075b86d40d tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.022450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee9f1f0d-7d80-4d82-b8e7-cf075b86d40d tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.023327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee9f1f0d-7d80-4d82-b8e7-cf075b86d40d tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.023841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee9f1f0d-7d80-4d82-b8e7-cf075b86d40d tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.024268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee9f1f0d-7d80-4d82-b8e7-cf075b86d40d tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.051284 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ee9f1f0d-7d80-4d82-b8e7-cf075b86d40d tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-858383-10&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.036989 Oct 12 08:49:43.051909 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 880/1636] 10.222.0.40 () {60 vars in 1237 bytes} [Wed Oct 12 08:49:43 2022] GET /compute/v2.1/os-services?host=n-d-858383-10&binary=xxx => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:43.064536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:43.065154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:43.071408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.071899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.072337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.073042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.073514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.074089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.096227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:43.105462 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d4caae82-0d6d-4d85-9bdf-d26577ea393e tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1473 microversion: 2.1 time: 0.488791 Oct 12 08:49:43.108498 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 757/1637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:42 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1473 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:43.121859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d8ae06a-5283-4eb9-b21a-f1dd9b6322a2 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:43.129630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8ae06a-5283-4eb9-b21a-f1dd9b6322a2 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.130381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8ae06a-5283-4eb9-b21a-f1dd9b6322a2 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.134731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8ae06a-5283-4eb9-b21a-f1dd9b6322a2 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.135792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8ae06a-5283-4eb9-b21a-f1dd9b6322a2 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.136419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8ae06a-5283-4eb9-b21a-f1dd9b6322a2 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.137168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8ae06a-5283-4eb9-b21a-f1dd9b6322a2 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.165384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:43.186770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:43.195845 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d8ae06a-5283-4eb9-b21a-f1dd9b6322a2 tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.077924 Oct 12 08:49:43.197699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:43.198545 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 758/1638] 10.222.0.40 () {60 vars in 1178 bytes} [Wed Oct 12 08:49:43 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:43.206329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:43.207269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:43.214640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cd4b7bd-1ba4-4ca2-a852-5602d0245177 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.153825 Oct 12 08:49:43.215702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:43.215933 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 881/1639] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:43 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:43.225405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:43.226424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.226954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.227390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.228097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.228557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.228866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:43.229005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.241061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.241919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.242448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.243828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.244266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.244694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.283799 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-571346b8-c7f1-432d-aa62-80542f082482 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.065990 Oct 12 08:49:43.290782 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 882/1640] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 08:49:43 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:43.295818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88fed5b2-ac1c-42cf-a433-6c54db132d7c tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:43.299563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88fed5b2-ac1c-42cf-a433-6c54db132d7c tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.300049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88fed5b2-ac1c-42cf-a433-6c54db132d7c tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.300557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88fed5b2-ac1c-42cf-a433-6c54db132d7c tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.301409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88fed5b2-ac1c-42cf-a433-6c54db132d7c tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.302348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88fed5b2-ac1c-42cf-a433-6c54db132d7c tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.302604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88fed5b2-ac1c-42cf-a433-6c54db132d7c tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.328871 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88fed5b2-ac1c-42cf-a433-6c54db132d7c tempest-ServicesAdminNegativeV253TestJSON-896034761 tempest-ServicesAdminNegativeV253TestJSON-896034761-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036940 Oct 12 08:49:43.329840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 883/1641] 10.222.0.40 () {60 vars in 1239 bytes} [Wed Oct 12 08:49:43 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:43.640596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07b52273-87fc-442f-9cb3-0d9d42b345b2 tempest-ServicesAdminNegativeV253TestJSON-794209844 tempest-ServicesAdminNegativeV253TestJSON-794209844-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:43.645059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07b52273-87fc-442f-9cb3-0d9d42b345b2 tempest-ServicesAdminNegativeV253TestJSON-794209844 tempest-ServicesAdminNegativeV253TestJSON-794209844-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f87e19600c8e4cf1ac5d4f97f8f8cf41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67aa309168bc4f90a8de7b2ca1efde5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07b52273-87fc-442f-9cb3-0d9d42b345b2 tempest-ServicesAdminNegativeV253TestJSON-794209844 tempest-ServicesAdminNegativeV253TestJSON-794209844-project] Request method failure captured: Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-kDym9q5Xua8GKWtJsoY5K1KX-uG-SV5KojxipyBuNIw0YwucpatUyGwmkL0oPBpwvhVijzQtvczfXfUeuyiyX7DQFzLcGcTwwJtVctj8xKgSjCuBFe69v7cGMJwW1xLzrfR9Vcjb_WfR20Rc7oEfsgeDH6ZiPsZ4gyCuW8ET8UHE Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.53 Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 67aa309168bc4f90a8de7b2ca1efde5b Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-794209844 Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:49:43.646712 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67aa309168bc4f90a8de7b2ca1efde5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/67aa309168bc4f90a8de7b2ca1efde5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_67aa309168bc4f90a8de7b2ca1efde5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67aa309168bc4f90a8de7b2ca1efde5b"}]}] Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-794209844 Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 67aa309168bc4f90a8de7b2ca1efde5b Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-794209844 Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServicesAdminNegativeV253TestJSON-794209844-project Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f87e19600c8e4cf1ac5d4f97f8f8cf41 Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-794209844-project Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 08:49:43.648392 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:49:43.649426 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 08:49:43.651120 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:49:43.652377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07b52273-87fc-442f-9cb3-0d9d42b345b2 tempest-ServicesAdminNegativeV253TestJSON-794209844 tempest-ServicesAdminNegativeV253TestJSON-794209844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:43.652377 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-07b52273-87fc-442f-9cb3-0d9d42b345b2 tempest-ServicesAdminNegativeV253TestJSON-794209844 tempest-ServicesAdminNegativeV253TestJSON-794209844-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.309551 Oct 12 08:49:43.652377 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 884/1642] 10.222.0.40 () {60 vars in 1178 bytes} [Wed Oct 12 08:49:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:49:43.660472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4b565ed4-a5d2-4411-aeab-16e16d2baa6b req-381831d4-b627-4838-b268-97048af303bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b3b9cb-de6c-4762-bb16-bab9cbde5277", "name": "network-vif-plugged", "status": "completed", "tag": "a02a1787-8fb6-4ba8-a91a-f6851ccecdf8"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:43.683882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4b565ed4-a5d2-4411-aeab-16e16d2baa6b req-381831d4-b627-4838-b268-97048af303bb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.684364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4b565ed4-a5d2-4411-aeab-16e16d2baa6b req-381831d4-b627-4838-b268-97048af303bb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.684786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4b565ed4-a5d2-4411-aeab-16e16d2baa6b req-381831d4-b627-4838-b268-97048af303bb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.707802 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4b565ed4-a5d2-4411-aeab-16e16d2baa6b req-381831d4-b627-4838-b268-97048af303bb service nova] Creating event network-vif-plugged:a02a1787-8fb6-4ba8-a91a-f6851ccecdf8 for instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 on n-h1-858383-10 Oct 12 08:49:43.713133 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4b565ed4-a5d2-4411-aeab-16e16d2baa6b req-381831d4-b627-4838-b268-97048af303bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063015 Oct 12 08:49:43.719118 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 885/1643] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:43.730164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:43.731393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:43.761543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.762854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.763445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:43.765169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:43.772668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:43.773676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.099053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:44.109926 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1d43832-1ee5-4946-aa47-181aa3f080ad tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1468 microversion: 2.1 time: 0.385126 Oct 12 08:49:44.112334 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 886/1644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:43 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1468 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:44.129501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:44.130269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:44.140462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.141128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.141680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.143361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.145964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.146596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.278101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:44.287301 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b02da1f3-da15-4662-96b5-4f486fc7daa6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1315 microversion: 2.1 time: 1.085015 Oct 12 08:49:44.289625 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 759/1645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:43 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1315 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:44.482035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:44.501936 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d1f1e66d-8fb9-4c35-bd3a-b93200cc81dd tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.388359 Oct 12 08:49:44.518792 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 887/1646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:44 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:44.524082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:44.525373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:44.532901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.533729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.534749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.536589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.537199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.537991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.594792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-083dda00-563e-4eea-a8a7-9e7a262ae390 req-ae75e490-cfa6-442a-bd0c-838deb632255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa8cebd-34a5-45eb-a594-122d9f86bac2", "tag": "5c51700d-4928-4718-b701-40591849f148"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:44.611389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-083dda00-563e-4eea-a8a7-9e7a262ae390 req-ae75e490-cfa6-442a-bd0c-838deb632255 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.612121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-083dda00-563e-4eea-a8a7-9e7a262ae390 req-ae75e490-cfa6-442a-bd0c-838deb632255 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.612785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-083dda00-563e-4eea-a8a7-9e7a262ae390 req-ae75e490-cfa6-442a-bd0c-838deb632255 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.623828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:44.627036 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-083dda00-563e-4eea-a8a7-9e7a262ae390 req-ae75e490-cfa6-442a-bd0c-838deb632255 service nova] Creating event network-changed:5c51700d-4928-4718-b701-40591849f148 for instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 on n-h1-858383-10 Oct 12 08:49:44.632163 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-083dda00-563e-4eea-a8a7-9e7a262ae390 req-ae75e490-cfa6-442a-bd0c-838deb632255 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339388 Oct 12 08:49:44.635447 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 760/1647] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:44.644324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:44.645881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:44.656470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.657166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.657807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.658664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.659264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.659836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.746052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:44.757106 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eeb7af2e-bba7-4de5-bb53-f884c77ac74d tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1473 microversion: 2.1 time: 0.236475 Oct 12 08:49:44.766007 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 888/1648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:44 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1473 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:44.772734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:44.773732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:44.782445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.783350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.785890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.787439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:44.788178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:44.789082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:44.794797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:44.911898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:44.923639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:44.927439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:44.938097 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45d22781-464c-432d-b9ec-73f03cd154c7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.169907 Oct 12 08:49:44.939218 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 889/1649] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:44 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:45.086616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:45.099902 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1bc5db71-5aa5-47b5-910a-cdf2ad229e15 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 200 len: 1318 microversion: 2.1 time: 0.462950 Oct 12 08:49:45.100834 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 761/1650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:44 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:45.313211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:45.313984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:45.325128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:45.325659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:45.326823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:45.327328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:45.328074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:45.328209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:45.525189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:45.525973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:45.535233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:45.535639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:45.543262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:45.544153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:45.544867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:45.545068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:45.721972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:45.743684 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c0a558d-ea86-40de-938c-35014a14edda tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1315 microversion: 2.1 time: 0.434587 Oct 12 08:49:45.746634 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 890/1651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:45 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:45.790928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:45.791812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:45.801920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:45.803256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:45.806437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:45.806437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:45.807779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:45.810775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.237929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:46.249107 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3e9eac88-22ad-4c28-b5c5-d4d73d1c3528 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1473 microversion: 2.1 time: 0.462170 Oct 12 08:49:46.258469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 891/1652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:45 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:46.264469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:46.265213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:46.281286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.296873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:46.299737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.300570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.306462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.308433 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d51838b-8c6c-49a8-a0cc-f0511ae27cef tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.787368 Oct 12 08:49:46.309103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.316554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.330141 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 762/1653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:45 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:46.337555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:46.343518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:46.370905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.387547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.390146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.391036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.397568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.400776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.476585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:46.487257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:46.488945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:46.509900 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69ebeec3-7e59-4001-94e4-071d5179a410 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.246086 Oct 12 08:49:46.521494 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 892/1654] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:46 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:46.716495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-84434a0f-3e83-4ba0-9018-d0dc442db88e req-c86c356f-cc8c-4413-839e-bb5ca6457ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1edd0a71-0c50-4935-8219-d14471f1ea58", "name": "network-vif-deleted", "tag": "158b51b0-0d4a-4b31-baf5-01b3851b508f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:46.745023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-84434a0f-3e83-4ba0-9018-d0dc442db88e req-c86c356f-cc8c-4413-839e-bb5ca6457ff8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.754306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-84434a0f-3e83-4ba0-9018-d0dc442db88e req-c86c356f-cc8c-4413-839e-bb5ca6457ff8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.755305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-84434a0f-3e83-4ba0-9018-d0dc442db88e req-c86c356f-cc8c-4413-839e-bb5ca6457ff8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.804057 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-84434a0f-3e83-4ba0-9018-d0dc442db88e req-c86c356f-cc8c-4413-839e-bb5ca6457ff8 service nova] Creating event network-vif-deleted:158b51b0-0d4a-4b31-baf5-01b3851b508f for instance 1edd0a71-0c50-4935-8219-d14471f1ea58 on n-h2-858383-10 Oct 12 08:49:46.820651 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-84434a0f-3e83-4ba0-9018-d0dc442db88e req-c86c356f-cc8c-4413-839e-bb5ca6457ff8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108142 Oct 12 08:49:46.823274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:46.831777 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 893/1655] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:46.844683 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-72d5fd1d-d98a-475c-b338-73ecc0419ba6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 200 len: 1467 microversion: 2.1 time: 0.510818 Oct 12 08:49:46.844683 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 763/1656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:46 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 1467 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:46.869503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:46.871642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:46.873877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:46.879480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:46.882682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Searching by: {'reservation_id': 'r-sb8a2n5h', 'deleted': False, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:49:46.896601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.901771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.902305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.902535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.902797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.903085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.905392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.909105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.914367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:46.919352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:46.919863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:46.920310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:47.241195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:49:47.442233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:47.459368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:47.460112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:47.460725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:47.581358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:47.595822 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be4e78e5-a51d-4ce8-b70b-1ac3463cae90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1315 microversion: 2.1 time: 0.762315 Oct 12 08:49:47.613491 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 894/1657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:46 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:47.626273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:47.628531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:47.647170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:47.647667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:47.648103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:47.648858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:47.649309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:47.649758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:47.754903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:47.755420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:47.756355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:47.756820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lazy-loading 'fault' on Instance uuid 1edd0a71-0c50-4935-8219-d14471f1ea58 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:49:47.991559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:48.002268 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7641f956-1ef2-435b-a6d2-adcf16798320 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 200 len: 1308 microversion: 2.1 time: 0.399416 Oct 12 08:49:48.002862 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 895/1658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:47 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:48.018257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:48.018924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:48.041720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.044361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.045239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:48.047735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.048840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.051567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:48.129296 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-85eae79c-6785-400d-a150-9f7e027f68ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-sb8a2n5h" status: 200 len: 2928 microversion: 2.1 time: 1.261417 Oct 12 08:49:48.131406 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 764/1659] 10.222.0.40 () {58 vars in 1197 bytes} [Wed Oct 12 08:49:46 2022] GET /compute/v2.1/servers/detail?reservation_id=r-sb8a2n5h => generated 2928 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:48.137809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:48.138413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:48.159844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.163275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.165927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:48.185763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.187502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.188433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:48.381510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:48.390357 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4fb4cb8c-8af0-4a7a-90d2-04f546b32c30 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.384131 Oct 12 08:49:48.395057 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 896/1660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:48 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:48.406689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a522f89-9357-4b80-90ef-adbf98a1b3fb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:48.470846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.server_groups [None req-5a522f89-9357-4b80-90ef-adbf98a1b3fb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Querying cell 0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) for 2 instances {{(pid=127006) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 08:49:48.471839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a522f89-9357-4b80-90ef-adbf98a1b3fb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.472739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a522f89-9357-4b80-90ef-adbf98a1b3fb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.473329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a522f89-9357-4b80-90ef-adbf98a1b3fb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:48.545522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5a522f89-9357-4b80-90ef-adbf98a1b3fb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/689d6444-84a2-4ed0-90bf-1e80435622af" status: 200 len: 265 microversion: 2.1 time: 0.149121 Oct 12 08:49:48.549370 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 897/1661] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:49:48 2022] GET /compute/v2.1/os-server-groups/689d6444-84a2-4ed0-90bf-1e80435622af => generated 265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:48.556662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:48.560854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:48.563920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:48.572180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:48.573965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:48.579925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.581932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.582565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:48.584450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.584926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.585360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:48.600652 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c96ddc84-845b-470b-8d65-a8e503504114 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.467937 Oct 12 08:49:48.607400 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 765/1662] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:48 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:48.625692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:48.626695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:48.642715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.650236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.651016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:48.652034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:48.652523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:48.652978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:49.162363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:49.175113 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8facc204-a51a-42b5-bd3c-31b46b56c41c tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1315 microversion: 2.1 time: 0.553200 Oct 12 08:49:49.178505 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 766/1663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:48 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:49.185418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:49.190588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: 1edd0a71-0c50-4935-8219-d14471f1ea58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:49.204713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:49.210212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:49.211004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:49.212033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:49.213025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:49.213721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:49.225635 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-54cb3ba7-cc5c-4008-a06f-9798fe84f22e tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 200 len: 1621 microversion: 2.1 time: 0.669590 Oct 12 08:49:49.242649 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 898/1664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:48 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 1621 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:49:49.268386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:49.269002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:49.287874 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] HTTP exception thrown: Instance 1edd0a71-0c50-4935-8219-d14471f1ea58 could not be found. Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Request method failure captured: Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 HTTP/1.1 Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8p86GwBXbTMOuBBVaj-sDllga5k2gQReTDxlin0mdmdSna1oa7R7jjRk3YaTwOqG1Gm6-7pYrTVRJzPqmsPl5uLxPolZsxwF0poXRNXlH36qcbbYb3SRcbEFvAZ-Pk-4-Qclhg0DAmK40_TvA5RXYQkbuoiVpR3O7Gb5ZSwt6Q5rY Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 3df3fefb313e4c52839e79e0ffd22f54 Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListImageFiltersTestJSON-919944417 Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:49:49.296359 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3df3fefb313e4c52839e79e0ffd22f54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3df3fefb313e4c52839e79e0ffd22f54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3df3fefb313e4c52839e79e0ffd22f54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3df3fefb313e4c52839e79e0ffd22f54"}]}] Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListImageFiltersTestJSON-919944417 Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 3df3fefb313e4c52839e79e0ffd22f54 Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-919944417 Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListImageFiltersTestJSON-919944417-project Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 98ab7edcece8460aa4b645ef65561ded Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListImageFiltersTestJSON-919944417-project Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 1edd0a71-0c50-4935-8219-d14471f1ea58 could not be found. Oct 12 08:49:49.298391 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1edd0a71-0c50-4935-8219-d14471f1ea58'} Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1edd0a71-0c50-4935-8219-d14471f1ea58 could not be found. Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:49.299463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1edd0a71-0c50-4935-8219-d14471f1ea58 could not be found. Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1edd0a71-0c50-4935-8219-d14471f1ea58 could not be found. Oct 12 08:49:49.301142 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:49.308935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:49.309455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:49.309900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:49.311440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:49.311440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:49.311757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Returning 404 to user: Instance 1edd0a71-0c50-4935-8219-d14471f1ea58 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:49.311879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:49.312856 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dfdf9703-e8aa-4e3b-a894-c98e04a38875 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58" status: 404 len: 111 microversion: 2.1 time: 0.132880 Oct 12 08:49:49.321713 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 767/1665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:49 2022] GET /compute/v2.1/servers/1edd0a71-0c50-4935-8219-d14471f1ea58 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:49:49.326906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:49.330687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:49.356817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:49.357321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:49.357796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:49.358529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:49.366713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:49.367174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:49.463346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:49:49.641070 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e6404de3-e1f6-453f-a09d-5f4fa224eb08 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d" status: 204 len: 0 microversion: 2.1 time: 0.317750 Oct 12 08:49:49.641992 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 768/1666] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:49:49 2022] DELETE /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:49:49.649284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:49.650006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:49.672533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:49.672533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:49.672533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:49.673228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:49.674073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:49.674663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:50.013037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:50.028415 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-40ad588c-d168-4afb-ac67-be42b2696915 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.385117 Oct 12 08:49:50.030271 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 769/1667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:49 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:50.039999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:50.041961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:50.065389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:50.067725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:50.072776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:50.072776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:50.072776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:50.072776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:50.120794 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68763093-eeeb-4681-842d-d568cc8733f4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 200 len: 1620 microversion: 2.1 time: 0.855989 Oct 12 08:49:50.129917 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 899/1668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:49 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 1620 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:50.154253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:50.156076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:50.171557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:50.207039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:50.208470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:50.210778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:50.211694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:50.212975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:50.520758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:50.529575 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe94969c-ffa2-4d2a-84e2-291d45187d01 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d" status: 200 len: 1473 microversion: 2.1 time: 0.497296 Oct 12 08:49:50.536501 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 770/1669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:50 2022] GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d => generated 1473 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:50.546236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54cf2a60-ff27-4ea7-8be5-b0b5184cea99 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Action: 'create', calling method: .version_select at 0x7f984888cca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-453015213", "policies": ["anti-affinity"]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:50.604273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-54cf2a60-ff27-4ea7-8be5-b0b5184cea99 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:50.618123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-54cf2a60-ff27-4ea7-8be5-b0b5184cea99 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:50.657075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:50.680975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:50.694767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:50.710490 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7a343d77-7850-4b90-8411-45c5465e77f2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.571412 Oct 12 08:49:50.711711 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 900/1670] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:50 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:50.730183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:50.731118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:50.755582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:50.756547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:50.757202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:50.758181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:50.760837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:50.761854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:50.768394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-54cf2a60-ff27-4ea7-8be5-b0b5184cea99 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:49:50.786765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-54cf2a60-ff27-4ea7-8be5-b0b5184cea99 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:49:50.837090 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54cf2a60-ff27-4ea7-8be5-b0b5184cea99 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.298759 Oct 12 08:49:50.841171 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 771/1671] 10.222.0.40 () {60 vars in 1174 bytes} [Wed Oct 12 08:49:50 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:51.059315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:51.060095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:51.079654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:51.086128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:51.089790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:51.096107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:51.104647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:51.105345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:51.107800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:51.109337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02f73129-15cd-487c-b2cb-7eca53e75b6b tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1315 microversion: 2.1 time: 0.391824 Oct 12 08:49:51.111491 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 901/1672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:50 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:51.193215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1077408206", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "45536584-24a8-4542-bd40-163f2a9facbc"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:51.206293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:51.395355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:51.404427 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0cb8b9ad-032e-4d2c-b38e-e09c7cb20a45 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.349891 Oct 12 08:49:51.423299 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 772/1673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:51 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:51.562918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:51.567566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:51.577919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:51.578421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:51.578987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:51.595085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:51.595619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:51.596824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:52.012366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:52.024147 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9881a6c1-74b2-4793-954a-42fc70d178d3 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d" status: 200 len: 1473 microversion: 2.1 time: 0.467087 Oct 12 08:49:52.025905 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 773/1674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:51 2022] GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d => generated 1473 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:52.035653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:52.038410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:52.063787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:52.066831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:52.068159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:52.072869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:52.073949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:52.075852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:52.200063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:52.215137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:52.217423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:52.227142 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-666d4397-1b8d-4722-b5a5-6c9b323b3de0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.197856 Oct 12 08:49:52.228124 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 774/1675] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:52 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:52.235631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:52.236502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:52.245891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:52.247000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:52.247961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:52.248896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:52.249624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:52.250275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:52.674443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:52.684035 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4fc26e2e-7aa3-4f42-addb-a3b0713d2f41 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1315 microversion: 2.1 time: 0.454097 Oct 12 08:49:52.692182 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 775/1676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:52 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:52.707436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:52.708070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:52.723405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:52.726120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:52.728177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:52.729122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:52.730524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:52.731116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:53.310241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=14 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:53.487693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:53.491628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:53.509142 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1f8be17e-defe-4de9-a3f3-d9d53e73c99d tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.815795 Oct 12 08:49:53.510701 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 776/1677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:52 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:53.527622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:53.528240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:53.547270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:53.547771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:53.548205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:53.548925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:53.556578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:53.557280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:53.742523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab7edcece8460aa4b645ef65561ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3fefb313e4c52839e79e0ffd22f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:53.763469 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f4b7e13-a97b-4ea9-90f3-1daade716726 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d" status: 200 len: 1431 microversion: 2.1 time: 0.246913 Oct 12 08:49:53.778953 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 777/1678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:53 2022] GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d => generated 1431 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:53.796629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:53.800245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:53.819352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:53.824585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:53.826024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:53.827345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:53.829299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:53.829760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:53.944127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:53.961131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:53.964183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:53.980448 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d457e01e-008d-4df9-a197-726d34e6a4a2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.197659 Oct 12 08:49:53.985626 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 778/1679] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:53 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:53.994688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-38e0c967-d5bd-45f3-bbc3-2afcc506b0a9 req-39ac647c-5a83-4cd1-9481-cc91779109bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd399ffd-4151-4122-9901-a61d55e2e70d", "name": "network-vif-deleted", "tag": "8ae947b8-c972-44eb-a547-9e84edfdee53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:54.015327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-38e0c967-d5bd-45f3-bbc3-2afcc506b0a9 req-39ac647c-5a83-4cd1-9481-cc91779109bc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:54.017531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-38e0c967-d5bd-45f3-bbc3-2afcc506b0a9 req-39ac647c-5a83-4cd1-9481-cc91779109bc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:54.018298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-38e0c967-d5bd-45f3-bbc3-2afcc506b0a9 req-39ac647c-5a83-4cd1-9481-cc91779109bc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:54.054523 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-38e0c967-d5bd-45f3-bbc3-2afcc506b0a9 req-39ac647c-5a83-4cd1-9481-cc91779109bc service nova] Creating event network-vif-deleted:8ae947b8-c972-44eb-a547-9e84edfdee53 for instance fd399ffd-4151-4122-9901-a61d55e2e70d on n-h2-858383-10 Oct 12 08:49:54.067605 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-38e0c967-d5bd-45f3-bbc3-2afcc506b0a9 req-39ac647c-5a83-4cd1-9481-cc91779109bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079642 Oct 12 08:49:54.070481 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 779/1680] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:54.077384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:54.078124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:54.099835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:54.100555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:54.100993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:54.101823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:54.105352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:54.105969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:54.368315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:54.386088 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-03b25d3c-a38c-45e5-982c-6b6734e9973a tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1315 microversion: 2.1 time: 0.312487 Oct 12 08:49:54.397525 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 780/1681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:54 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:54.508423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c1a8886f-2cfd-468d-9948-c3ddc941d4f0 req-b37fa21e-925a-40ff-9963-95188273110f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa8cebd-34a5-45eb-a594-122d9f86bac2", "name": "network-vif-plugged", "status": "completed", "tag": "5c51700d-4928-4718-b701-40591849f148"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:49:54.518609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c1a8886f-2cfd-468d-9948-c3ddc941d4f0 req-b37fa21e-925a-40ff-9963-95188273110f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:54.519467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c1a8886f-2cfd-468d-9948-c3ddc941d4f0 req-b37fa21e-925a-40ff-9963-95188273110f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:54.520146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c1a8886f-2cfd-468d-9948-c3ddc941d4f0 req-b37fa21e-925a-40ff-9963-95188273110f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:54.539624 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c1a8886f-2cfd-468d-9948-c3ddc941d4f0 req-b37fa21e-925a-40ff-9963-95188273110f service nova] Creating event network-vif-plugged:5c51700d-4928-4718-b701-40591849f148 for instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 on n-h1-858383-10 Oct 12 08:49:54.557485 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c1a8886f-2cfd-468d-9948-c3ddc941d4f0 req-b37fa21e-925a-40ff-9963-95188273110f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052146 Oct 12 08:49:54.558629 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 781/1682] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:49:54.568140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:54.573469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:54.587892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:54.592327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:54.593273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:54.594303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:54.595002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:54.595659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:55.218316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:55.226724 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0082560c-a493-46a6-8fce-d6712955d199 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.666475 Oct 12 08:49:55.227357 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 782/1683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:54 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:55.231744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:55.232347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] [instance: fd399ffd-4151-4122-9901-a61d55e2e70d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:55.261799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:55.262283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:55.263036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:55.263428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:55.263881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:55.264302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:55.299319 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] HTTP exception thrown: Instance fd399ffd-4151-4122-9901-a61d55e2e70d could not be found. Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Request method failure captured: Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d HTTP/1.1 Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8p86GwBXbTMOuBBVaj-sDllga5k2gQReTDxlin0mdmdSna1oa7R7jjRk3YaTwOqG1Gm6-7pYrTVRJzPqmsPl5uLxPolZsxwF0poXRNXlH36qcbbYb3SRcbEFvAZ-Pk-4-Qclhg0DAmK40_TvA5RXYQkbuoiVpR3O7Gb5ZSwt6Q5rY Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 3df3fefb313e4c52839e79e0ffd22f54 Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListImageFiltersTestJSON-919944417 Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:49:55.305653 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3df3fefb313e4c52839e79e0ffd22f54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3df3fefb313e4c52839e79e0ffd22f54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3df3fefb313e4c52839e79e0ffd22f54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3df3fefb313e4c52839e79e0ffd22f54"}]}] Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListImageFiltersTestJSON-919944417 Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 3df3fefb313e4c52839e79e0ffd22f54 Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-919944417 Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListImageFiltersTestJSON-919944417-project Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 98ab7edcece8460aa4b645ef65561ded Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListImageFiltersTestJSON-919944417-project Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance fd399ffd-4151-4122-9901-a61d55e2e70d could not be found. Oct 12 08:49:55.307255 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'fd399ffd-4151-4122-9901-a61d55e2e70d'} Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd399ffd-4151-4122-9901-a61d55e2e70d could not be found. Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:49:55.308223 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd399ffd-4151-4122-9901-a61d55e2e70d could not be found. Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd399ffd-4151-4122-9901-a61d55e2e70d could not be found. Oct 12 08:49:55.309625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:49:55.313792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Returning 404 to user: Instance fd399ffd-4151-4122-9901-a61d55e2e70d could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:49:55.313792 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-017c6478-dc0e-4e28-9c8a-1e771df246db tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d" status: 404 len: 111 microversion: 2.1 time: 0.079246 Oct 12 08:49:55.313792 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 783/1684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:55 2022] GET /compute/v2.1/servers/fd399ffd-4151-4122-9901-a61d55e2e70d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:49:55.330416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:55.331024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:55.339369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:55.339879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:55.340467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:55.341369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:55.341862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:55.342286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:55.541249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:55.551507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:55.558949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:55.572766 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d26b3c17-569a-40a5-9854-7134458b6228 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.263779 Oct 12 08:49:55.574515 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 784/1685] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:49:55 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:49:55.589513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-470485ec-f203-49fa-91ad-5813c9295cca tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984877c160>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:57.022653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:49:59.459813 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-470485ec-f203-49fa-91ad-5813c9295cca tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "DELETE /compute/v2.1/images/4c4435df-16b5-4cb3-a7df-2141a6035976" status: 204 len: 0 microversion: 2.1 time: 3.883924 Oct 12 08:49:59.464278 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 785/1686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:55 2022] DELETE /compute/v2.1/images/4c4435df-16b5-4cb3-a7df-2141a6035976 => generated 0 bytes in 3885 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:49:59.470209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:59.471416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:59.487989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:59.488561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:59.489385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:59.490151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:59.490783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:59.491364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:59.534936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:49:59.871391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:49:59.891454 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-713f11a4-b06d-48f2-9e4b-7044e461d3b1 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1504 microversion: 2.1 time: 0.424914 Oct 12 08:49:59.896541 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 786/1687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:59 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:49:59.908904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:49:59.909762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:49:59.927386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:59.928370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:59.929028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:49:59.930341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:49:59.931005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:49:59.931584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:00.299346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:00.319709 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3096c2c6-c2c8-4622-956f-4c35b6086156 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1476 microversion: 2.1 time: 0.420274 Oct 12 08:50:00.334587 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 787/1688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:49:59 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1476 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:00.340118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:50:00.340987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:50:00.341713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:50:00.342499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:50:00.342778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:00.343214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:50:00.344063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:00.351054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:00.351853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:00.352447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:00.353581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:00.354622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:00.355207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:00.388691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:00.389184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:00.389658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:00.390383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:00.394926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:00.395653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:00.455272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:00.460709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:00.484769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Going to run 2 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:50:00.487990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:50:00.539556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127006) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 12 08:50:00.568102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:00.573817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:00.582280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:00.609483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:00.611766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:00.636483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:00.639958 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-441e374a-4b8f-4b28-b66c-5812c99ac830 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1553 microversion: 2.91 time: 0.303552 Oct 12 08:50:00.642187 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 788/1689] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:00 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:00.657873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:00.666112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:00.672366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6644ac03-02b6-4173-a752-b874693d93a1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f9848891670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:00.724097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=87afdca0-7aca-4b7d-8a37-b4d9c2a8af32,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:50:00.820971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:00.871345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:00.883142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:00.989420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:01.000246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:01.135952 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd6e48a6-a99b-4f73-a747-d940233cce4c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 9.948637 Oct 12 08:50:01.139612 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 902/1690] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:49:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 9956 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 08:50:01.152770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:01.153928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:01.175280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:01.175780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:01.176212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:01.178238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:01.180135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:01.185880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:01.246772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:50:01.303062 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6644ac03-02b6-4173-a752-b874693d93a1 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "DELETE /compute/v2.1/images/9556fc16-0120-46eb-b585-8737776351ae" status: 204 len: 0 microversion: 2.1 time: 0.641488 Oct 12 08:50:01.303930 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 789/1691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:00 2022] DELETE /compute/v2.1/images/9556fc16-0120-46eb-b585-8737776351ae => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:50:01.309061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:01.330708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:01.334996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Searching by: {'deleted': False, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:50:01.386387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:01.387604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:01.389456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:01.390485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:01.396630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:01.399344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:01.513171 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d70a45c-67fc-48ed-8c4a-a7df18e38859 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 204 len: 0 microversion: 2.1 time: 0.371954 Oct 12 08:50:01.514097 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 903/1692] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:50:01 2022] DELETE /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:50:01.528992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f891be61-d668-45ac-91a4-bd49b84f90f2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] Calling method '.version_select at 0x7f984cbc3310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:01.590185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:50:01.712960 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-11183270-d6ed-4e84-b821-99c46d084ff9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.407720 Oct 12 08:50:01.713894 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 790/1693] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 08:50:01 2022] GET /compute/v2.1/servers => generated 1664 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:01.719110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:01.719971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:01.727092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:01.727595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:01.728044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:01.729660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:01.730344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:01.730786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:02.119716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:02.134284 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2a4ac2d2-dbc5-4ef7-9180-671226ee4004 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1475 microversion: 2.1 time: 0.414429 Oct 12 08:50:02.154633 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 791/1694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:01 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1475 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:02.169620 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f891be61-d668-45ac-91a4-bd49b84f90f2 tempest-ListImageFiltersTestJSON-919944417 tempest-ListImageFiltersTestJSON-919944417-project] 10.222.0.40 "DELETE /compute/v2.1/images/38e20e67-fb94-4e00-9276-df5661040ebf" status: 204 len: 0 microversion: 2.1 time: 0.650626 Oct 12 08:50:02.170327 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 904/1695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:01 2022] DELETE /compute/v2.1/images/38e20e67-fb94-4e00-9276-df5661040ebf => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:50:02.177838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:02.178576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:02.186308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:02.186941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:02.197850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:02.198429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:02.199536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:02.200260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:02.200716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:02.201150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:02.233858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:02.234806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:02.237806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:02.243387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:02.244083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:02.244776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:02.887759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:02.903169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d7aa8639-6759-40f8-b06d-a65b0adea8de tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1510 microversion: 2.1 time: 0.743699 Oct 12 08:50:02.919781 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 792/1696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:02 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1510 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:02.934610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a68c0038-dc24-4f37-b2dc-99022231ffc7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:02.937576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a68c0038-dc24-4f37-b2dc-99022231ffc7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:03.180304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:03.199749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:03.204012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:03.217597 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6adae440-ded5-4907-8ceb-bded38815026 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1535 microversion: 2.91 time: 1.046098 Oct 12 08:50:03.222378 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 905/1697] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:02 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1535 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:03.272185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a68c0038-dc24-4f37-b2dc-99022231ffc7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:03.285379 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a68c0038-dc24-4f37-b2dc-99022231ffc7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1219 microversion: 2.1 time: 0.363337 Oct 12 08:50:03.288684 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 793/1698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:02 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1219 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:03.293967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:03.298309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:03.326580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:03.329932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:03.331597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:03.332857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:03.334734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:03.335762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:03.713146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1db5cab4-ae1d-426a-a808-0bda360c5649 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f984cb73550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1575692403", "description": "tempest-description-316832484"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:04.204239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1db5cab4-ae1d-426a-a808-0bda360c5649 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.953753 Oct 12 08:50:04.206024 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 906/1699] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:04.214246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:04.215245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:04.229372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:04.242606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:04.243061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:04.244440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:04.244440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:04.246881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:04.297061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:04.528501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:04.569264 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9dcb514a-f56f-42a4-b286-c2ff3203d569 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1510 microversion: 2.1 time: 0.358487 Oct 12 08:50:04.581684 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 907/1700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:04 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:04.592107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b15400da-8567-4136-8011-273cf34ec113 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f984cbd8160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-998202611", "description": "tempest-description-104393297"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:05.325423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:05.348796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b15400da-8567-4136-8011-273cf34ec113 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.773948 Oct 12 08:50:05.350246 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 908/1701] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:04 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:05.355532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:05.357171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:05.369396 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-90a14158-0608-48d9-a132-49c861024ded tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1475 microversion: 2.1 time: 2.075354 Oct 12 08:50:05.371600 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 794/1702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:03 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1475 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:05.381925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:05.386064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:05.388534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:05.389245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:05.392377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:05.399087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:05.400269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:05.401026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:05.432400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:05.433853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:05.436520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:05.438360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:05.442107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:05.445495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:05.687466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:05.701802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:05.703267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:05.712584 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c93940d8-a284-421b-a65d-20a732dc7ff2 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1538 microversion: 2.91 time: 0.361066 Oct 12 08:50:05.752822 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 909/1703] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:05 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1538 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:05.755576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:05.764638 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-da5d8c23-fcbe-460b-894d-24c1ba91f926 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1277 microversion: 2.1 time: 0.391204 Oct 12 08:50:05.768456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-228522953", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "151cd688-532c-4516-be33-fbd98f5b8f38"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:05.769296 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 795/1704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:05 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1277 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:05.783501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:05.790311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:05.810587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:05.811408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:05.811841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:05.812554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:05.822332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:05.824750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:05.869259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] validate_networks() for [('151cd688-532c-4516-be33-fbd98f5b8f38', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:50:06.622235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:50:06.623670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:50:06.626033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:50:06.626699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:50:06.627361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:50:06.655662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:06.656157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:06.656823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:06.657338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:06.657957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:06.658389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:06.704791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Getting quotas for project 835727d058524514b4fc66d4c8e8dedc. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:06.715227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Getting quotas for user c765279afc5a4682b5e525416c13db87 and project 835727d058524514b4fc66d4c8e8dedc. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:06.747414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:06.749120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:50:06.758459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:50:06.850335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b77d22b1-b0d9-45bd-afa8-3cd12903c790 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095891 Oct 12 08:50:06.851649 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 910/1705] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:50:06.865115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858383-10"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:06.883383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:06.892972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:06.892972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:06.894765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:06.896566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:06.899317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:06.900005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:06.987326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858383-10". {{(pid=127006) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 12 08:50:07.067803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:07.077136 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20fc8e0f-fee1-42d3-8b96-a529df8188d9 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1510 microversion: 2.1 time: 1.306109 Oct 12 08:50:07.077755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 796/1706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:05 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1510 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:07.093765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:07.097709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:07.110642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:07.111710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:07.112327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:07.113761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:07.114866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:07.115727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:07.166263 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-25957035-e823-4937-bcfd-44d5f9c137ac tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65/action" status: 202 len: 0 microversion: 2.91 time: 0.311781 Oct 12 08:50:07.172675 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 911/1707] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:50:06 2022] POST /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:50:07.506481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94d4ded6-ce6d-42fd-b2e5-ee98057ee06e tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Action: 'create', calling method: .version_select at 0x7f984cc095e0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL9Y1pXIaLnYjTU/zM2/0msTnnNY2hG3jyJfnzIwnHzftlvloCf9k4lw9muGR7g/ajvsAZjxaU1xanUpT/Vl9R8l2YFY7JjlcyydCpjQvLYLtVsO618GHqaUCPqrXhHSQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94d4ded6-ce6d-42fd-b2e5-ee98057ee06e tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Request method failure captured: Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 257 Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn--OwTV4fFXW74bw--VkDpzgbxjZ-ZnaWE8NvSMgrnkA10mBNQwTgro-TnQGLF3DURmpAnLojUQSZ9KenOQ80SloocKUTzT2bTgdhges4AnjZfnoO_ZolyszuOQvzq9MI_-nWmJc3Tbk1ceAcR2t5tpHkKcoX1fYNi95bFALRw1wyk Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:07.529630 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}] Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e160d71e9670458f85c49305964dfdfa Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:07.531426 n-d-858383-10 devstack@n-api.service[127006]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL9Y1pXIaLnYjTU/zM2/0msTnnNY2hG3jyJfnzIwnHzftlvloCf9k4lw9muGR7g/ajvsAZjxaU1xanUpT/Vl9R8l2YFY7JjlcyydCpjQvLYLtVsO618GHqaUCPqrXhHSQ=="}} Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL9Y1pXIaLnYjTU/zM2/0msTnnNY2hG3jyJfnzIwnHzftlvloCf9k4lw9muGR7g/ajvsAZjxaU1xanUpT/Vl9R8l2YFY7JjlcyydCpjQvLYLtVsO618GHqaUCPqrXhHSQ=='}}} Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:07.532333 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:07.533733 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:50:07.535581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:50:07.537962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 12 08:50:07.537962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:07.539101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94d4ded6-ce6d-42fd-b2e5-ee98057ee06e tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:07.540146 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-94d4ded6-ce6d-42fd-b2e5-ee98057ee06e tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.366452 Oct 12 08:50:07.541237 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 912/1708] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:50:07 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:50:07.554267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:07.557264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:07.568742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:07.569723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:07.570733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:07.571888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:07.572508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:07.573100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:07.659991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:07.670296 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f094e1c1-bb96-4086-b2da-68dc1090d706 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1277 microversion: 2.1 time: 0.125151 Oct 12 08:50:07.671548 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 913/1709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:07 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:07.701839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7996c794-57fd-4c41-9602-e9c1d51cd64d req-6783654e-abc5-4312-b6c3-634744c04943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "name": "network-vif-unplugged", "status": "completed", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:07.712413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7996c794-57fd-4c41-9602-e9c1d51cd64d req-6783654e-abc5-4312-b6c3-634744c04943 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:07.712894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7996c794-57fd-4c41-9602-e9c1d51cd64d req-6783654e-abc5-4312-b6c3-634744c04943 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:07.713324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7996c794-57fd-4c41-9602-e9c1d51cd64d req-6783654e-abc5-4312-b6c3-634744c04943 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:07.728026 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7996c794-57fd-4c41-9602-e9c1d51cd64d req-6783654e-abc5-4312-b6c3-634744c04943 service nova] Creating event network-vif-unplugged:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h1-858383-10 Oct 12 08:50:07.736287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-7996c794-57fd-4c41-9602-e9c1d51cd64d req-6783654e-abc5-4312-b6c3-634744c04943 service nova] Instance e9a4d7be-3a27-416d-956c-16356acc1322 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:50:07.774142 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7996c794-57fd-4c41-9602-e9c1d51cd64d req-6783654e-abc5-4312-b6c3-634744c04943 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101297 Oct 12 08:50:07.775615 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 914/1710] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:07.780955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9ef842e-00ca-4b43-af1e-c06a4f13088e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:07.781895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f9ef842e-00ca-4b43-af1e-c06a4f13088e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:07.882862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f9ef842e-00ca-4b43-af1e-c06a4f13088e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:07.890701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9ef842e-00ca-4b43-af1e-c06a4f13088e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1215 microversion: 2.1 time: 0.113858 Oct 12 08:50:07.891283 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 915/1711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:07 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:07.906523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:07.907131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:07.919088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:07.923017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:07.928733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:07.930472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:07.931597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:07.932206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:08.062906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:08.073751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:08.075617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:08.081548 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be3ba55f-8990-4279-95f3-9bf860fedf78 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1486 microversion: 2.91 time: 0.178700 Oct 12 08:50:08.083149 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 916/1712] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:07 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1486 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:08.087778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-75bd6cfc-7617-4c91-9321-1c7ea507e67f tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Action: 'create', calling method: .version_select at 0x7f984cbf1790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1105745325", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:08.103702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-75bd6cfc-7617-4c91-9321-1c7ea507e67f tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:08.108640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-75bd6cfc-7617-4c91-9321-1c7ea507e67f tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for user e160d71e9670458f85c49305964dfdfa and project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:08.147727 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-75bd6cfc-7617-4c91-9321-1c7ea507e67f tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-75bd6cfc-7617-4c91-9321-1c7ea507e67f tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Request method failure captured: Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 2167 Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn--OwTV4fFXW74bw--VkDpzgbxjZ-ZnaWE8NvSMgrnkA10mBNQwTgro-TnQGLF3DURmpAnLojUQSZ9KenOQ80SloocKUTzT2bTgdhges4AnjZfnoO_ZolyszuOQvzq9MI_-nWmJc3Tbk1ceAcR2t5tpHkKcoX1fYNi95bFALRw1wyk Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}] Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e160d71e9670458f85c49305964dfdfa Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1105745325", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:08.182509 n-d-858383-10 devstack@n-api.service[127006]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1105745325', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:08.185228 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.188840 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.191534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-75bd6cfc-7617-4c91-9321-1c7ea507e67f tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:08.192659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-75bd6cfc-7617-4c91-9321-1c7ea507e67f tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.108927 Oct 12 08:50:08.201788 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 917/1713] 10.222.0.40 () {60 vars in 1160 bytes} [Wed Oct 12 08:50:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:50:08.208965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:08.209878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:08.267465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:08.268357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:08.270475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:08.271486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:08.275435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:08.277581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:08.408970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:08.436569 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3304e4e3-24de-4ddb-8e16-06fc74f67490 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1475 microversion: 2.1 time: 1.343649 Oct 12 08:50:08.440364 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 797/1714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:07 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1475 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:08.458814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9f66bcbb-b8ce-4f51-8f5f-3d1e0312a4cf tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Action: 'create', calling method: .version_select at 0x7f984894c1f0>, body: {"keypair": {"name": "tempest-keypair-1120230913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCZAPdkNQUbzqWYy+en9TswKXLhsPIF9c+o7B4rUxMkA2bcQi7VICF/mb0g+MKPjCOnTSwKv1B0yFM4HLLe3n0gFZKTlxYm0T5zuXa/289eis/hipPODCsDUz5FrJz3sA=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:08.485480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:08.497047 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-83420eca-a04a-4d9d-8d78-e97ecd83a0ba tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1468 microversion: 2.1 time: 0.293849 Oct 12 08:50:08.519891 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 918/1715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:08 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1468 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:08.527239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9f66bcbb-b8ce-4f51-8f5f-3d1e0312a4cf tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:08.533380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9f66bcbb-b8ce-4f51-8f5f-3d1e0312a4cf tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for user e160d71e9670458f85c49305964dfdfa and project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:08.560683 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9f66bcbb-b8ce-4f51-8f5f-3d1e0312a4cf tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118759 Oct 12 08:50:08.571039 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 798/1716] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:50:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:08.579124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6af63a6b-152f-4511-bc55-0f1dfe625764 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Action: 'create', calling method: .version_select at 0x7f984cc1e280>, body: {"keypair": {"name": "tempest-keypair-1120230913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKJU/vRm1VWffBp7wxNV78FtKzJKL4KVCyLv9hC93PuquOc0wgPutTGkU/F933P2sqHY/VnrDIGO5vOY3Qe8an7tZ9FEFVfkCeWVXI/78jNLqZglytnAKT/hQmyJPuHmg=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:08.605787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-6af63a6b-152f-4511-bc55-0f1dfe625764 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:08.612098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-6af63a6b-152f-4511-bc55-0f1dfe625764 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for user e160d71e9670458f85c49305964dfdfa and project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:08.667606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6af63a6b-152f-4511-bc55-0f1dfe625764 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] HTTP exception thrown: Key pair 'tempest-keypair-1120230913' already exists. Oct 12 08:50:08.700047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:08.700797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6af63a6b-152f-4511-bc55-0f1dfe625764 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Request method failure captured: Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 273 Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn--OwTV4fFXW74bw--VkDpzgbxjZ-ZnaWE8NvSMgrnkA10mBNQwTgro-TnQGLF3DURmpAnLojUQSZ9KenOQ80SloocKUTzT2bTgdhges4AnjZfnoO_ZolyszuOQvzq9MI_-nWmJc3Tbk1ceAcR2t5tpHkKcoX1fYNi95bFALRw1wyk Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}] Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e160d71e9670458f85c49305964dfdfa Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: {"keypair": {"name": "tempest-keypair-1120230913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKJU/vRm1VWffBp7wxNV78FtKzJKL4KVCyLv9hC93PuquOc0wgPutTGkU/F933P2sqHY/VnrDIGO5vOY3Qe8an7tZ9FEFVfkCeWVXI/78jNLqZglytnAKT/hQmyJPuHmg=="}} Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: exception: Key pair 'tempest-keypair-1120230913' already exists. Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1120230913', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKJU/vRm1VWffBp7wxNV78FtKzJKL4KVCyLv9hC93PuquOc0wgPutTGkU/F933P2sqHY/VnrDIGO5vOY3Qe8an7tZ9FEFVfkCeWVXI/78jNLqZglytnAKT/hQmyJPuHmg=='}}} Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result.read() Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'e160d71e9670458f85c49305964dfdfa-tempest-keypair-1120230913' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 12 08:50:08.709705 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi session.flush() Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result.read() Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 12 08:50:08.715481 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'e160d71e9670458f85c49305964dfdfa-tempest-keypair-1120230913' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 12, 8, 50, 8, 633827), 'updated_at': None, 'name': 'tempest-keypair-1120230913', 'user_id': 'e160d71e9670458f85c49305964dfdfa', 'fingerprint': 'd7:1d:62:f9:22:a9:1b:b7:9f:2b:70:50:f0:3b:87:74', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKJU/vRm1VWffBp7wxNV78FtKzJKL4KVCyLv9hC93PuquOc0wgPutTGkU/F933P2sqHY/VnrDIGO5vOY3Qe8an7tZ9FEFVfkCeWVXI/78jNLqZglytnAKT/hQmyJPuHmg==', 'type': 'ssh'}] Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6780, in import_key_pair Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi keypair.create() Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._create() Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1120230913' already exists. Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 12 08:50:08.720950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1120230913' already exists. Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1120230913' already exists. Oct 12 08:50:08.729782 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.730606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:08.730606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:08.730606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:08.731235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6af63a6b-152f-4511-bc55-0f1dfe625764 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Returning 409 to user: Key pair 'tempest-keypair-1120230913' already exists. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:08.731397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:08.731397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:08.731397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:08.731707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6af63a6b-152f-4511-bc55-0f1dfe625764 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.149528 Oct 12 08:50:08.731822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:08.734254 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 919/1717] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:50:08 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:50:08.754303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c12f44d-4d23-4c11-bf98-eee26ad1fc38 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Calling method '.version_select at 0x7f9848032e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:08.801389 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c12f44d-4d23-4c11-bf98-eee26ad1fc38 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120230913" status: 202 len: 0 microversion: 2.1 time: 0.064672 Oct 12 08:50:08.802461 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 920/1718] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 08:50:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120230913 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:08.816489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f203d203-d2e9-45ca-a512-7f51a104a5ca tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Action: 'create', calling method: .version_select at 0x7f984803c670>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLxTh9c1LKSApTCYlOy5xpWRju6e757PagicsZSSgJNvpTzfbkjiwMRSiZJ+hTuUcEUW04sCpjI3GXIUiaw0rc5cv4IBrZYN6a3iMwjll/Szzg/RhruIBDsFphT8gQcjA=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f203d203-d2e9-45ca-a512-7f51a104a5ca tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Request method failure captured: Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 247 Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn--OwTV4fFXW74bw--VkDpzgbxjZ-ZnaWE8NvSMgrnkA10mBNQwTgro-TnQGLF3DURmpAnLojUQSZ9KenOQ80SloocKUTzT2bTgdhges4AnjZfnoO_ZolyszuOQvzq9MI_-nWmJc3Tbk1ceAcR2t5tpHkKcoX1fYNi95bFALRw1wyk Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}] Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e160d71e9670458f85c49305964dfdfa Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLxTh9c1LKSApTCYlOy5xpWRju6e757PagicsZSSgJNvpTzfbkjiwMRSiZJ+hTuUcEUW04sCpjI3GXIUiaw0rc5cv4IBrZYN6a3iMwjll/Szzg/RhruIBDsFphT8gQcjA=="}} Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLxTh9c1LKSApTCYlOy5xpWRju6e757PagicsZSSgJNvpTzfbkjiwMRSiZJ+hTuUcEUW04sCpjI3GXIUiaw0rc5cv4IBrZYN6a3iMwjll/Szzg/RhruIBDsFphT8gQcjA=='}}} Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi '' Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:50:08.821577 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:50:08.828829 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.831580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f203d203-d2e9-45ca-a512-7f51a104a5ca tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:08.845244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f203d203-d2e9-45ca-a512-7f51a104a5ca tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.034839 Oct 12 08:50:08.846450 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 921/1719] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:50:08 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:50:08.866382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c457ce38-34b0-47ad-8aed-ab182887d9b3 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Action: 'create', calling method: .version_select at 0x7f98480328b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-904783786", "public_key": " "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:08.885247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c457ce38-34b0-47ad-8aed-ab182887d9b3 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:08.891606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c457ce38-34b0-47ad-8aed-ab182887d9b3 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for user e160d71e9670458f85c49305964dfdfa and project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:08.908413 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-c457ce38-34b0-47ad-8aed-ab182887d9b3 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c457ce38-34b0-47ad-8aed-ab182887d9b3 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Request method failure captured: Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 94 Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn--OwTV4fFXW74bw--VkDpzgbxjZ-ZnaWE8NvSMgrnkA10mBNQwTgro-TnQGLF3DURmpAnLojUQSZ9KenOQ80SloocKUTzT2bTgdhges4AnjZfnoO_ZolyszuOQvzq9MI_-nWmJc3Tbk1ceAcR2t5tpHkKcoX1fYNi95bFALRw1wyk Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}] Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e160d71e9670458f85c49305964dfdfa Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-904783786", "public_key": " "}} Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-904783786', 'public_key': ' '}}} Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.910305 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c457ce38-34b0-47ad-8aed-ab182887d9b3 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c457ce38-34b0-47ad-8aed-ab182887d9b3 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.060793 Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 922/1720] 10.222.0.40 () {60 vars in 1158 bytes} [Wed Oct 12 08:50:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:08.922639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:08.929781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:08.929781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:08.929781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:08.930203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:08.930486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:08.930912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.003844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:09.013578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-00c0227b-9360-418c-b34e-5b0fc136936c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1267 microversion: 2.1 time: 0.098920 Oct 12 08:50:09.014394 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 923/1721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:08 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:09.019854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d3f7c08-bfb6-41dd-9cd2-1cb52017fa7e tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Action: 'create', calling method: .version_select at 0x7f984803c8b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY7FoNkHSHtfD7Be82nKSyxClUmnw0zq4mO/jvoMf2JN43DqBcjg1VXv2JuIVryqOUhDttXz70Er198MiTKVO65nbsK4BLJbfvr6+KHn82fXcLIqDAB0PO1ExIeSybtiw=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d3f7c08-bfb6-41dd-9cd2-1cb52017fa7e tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Request method failure captured: Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 507 Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn--OwTV4fFXW74bw--VkDpzgbxjZ-ZnaWE8NvSMgrnkA10mBNQwTgro-TnQGLF3DURmpAnLojUQSZ9KenOQ80SloocKUTzT2bTgdhges4AnjZfnoO_ZolyszuOQvzq9MI_-nWmJc3Tbk1ceAcR2t5tpHkKcoX1fYNi95bFALRw1wyk Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}] Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e160d71e9670458f85c49305964dfdfa Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY7FoNkHSHtfD7Be82nKSyxClUmnw0zq4mO/jvoMf2JN43DqBcjg1VXv2JuIVryqOUhDttXz70Er198MiTKVO65nbsK4BLJbfvr6+KHn82fXcLIqDAB0PO1ExIeSybtiw=="}} Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY7FoNkHSHtfD7Be82nKSyxClUmnw0zq4mO/jvoMf2JN43DqBcjg1VXv2JuIVryqOUhDttXz70Er198MiTKVO65nbsK4BLJbfvr6+KHn82fXcLIqDAB0PO1ExIeSybtiw=='}}} Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 12 08:50:09.024373 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 12 08:50:09.028190 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.032689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d3f7c08-bfb6-41dd-9cd2-1cb52017fa7e tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:09.033847 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d3f7c08-bfb6-41dd-9cd2-1cb52017fa7e tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018191 Oct 12 08:50:09.034448 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 924/1722] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:50:09 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:50:09.044610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a22b0bf-979f-464e-a0a1-71b661e5c150 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Action: 'create', calling method: .version_select at 0x7f984804aa60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1845614800", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:09.063654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2a22b0bf-979f-464e-a0a1-71b661e5c150 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:09.068424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2a22b0bf-979f-464e-a0a1-71b661e5c150 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Getting quotas for user e160d71e9670458f85c49305964dfdfa and project da779589041041ddbe7b9c2c0fecdf4b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:09.085371 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-2a22b0bf-979f-464e-a0a1-71b661e5c150 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a22b0bf-979f-464e-a0a1-71b661e5c150 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Request method failure captured: Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 118 Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn--OwTV4fFXW74bw--VkDpzgbxjZ-ZnaWE8NvSMgrnkA10mBNQwTgro-TnQGLF3DURmpAnLojUQSZ9KenOQ80SloocKUTzT2bTgdhges4AnjZfnoO_ZolyszuOQvzq9MI_-nWmJc3Tbk1ceAcR2t5tpHkKcoX1fYNi95bFALRw1wyk Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}] Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e160d71e9670458f85c49305964dfdfa Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1845614800", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: exception: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1845614800', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 12 08:50:09.087585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.092471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a22b0bf-979f-464e-a0a1-71b661e5c150 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:09.095809 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a22b0bf-979f-464e-a0a1-71b661e5c150 tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.055361 Oct 12 08:50:09.101362 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 925/1723] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:50:09 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:50:09.107037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5445cccd-3c93-485c-b03f-a5805527fb5a tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Calling method '.version_select at 0x7f9848032790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:09.122439 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-5445cccd-3c93-485c-b03f-a5805527fb5a tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1387282813 not found for user e160d71e9670458f85c49305964dfdfa Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5445cccd-3c93-485c-b03f-a5805527fb5a tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Request method failure captured: Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1387282813 HTTP/1.1 Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn--OwTV4fFXW74bw--VkDpzgbxjZ-ZnaWE8NvSMgrnkA10mBNQwTgro-TnQGLF3DURmpAnLojUQSZ9KenOQ80SloocKUTzT2bTgdhges4AnjZfnoO_ZolyszuOQvzq9MI_-nWmJc3Tbk1ceAcR2t5tpHkKcoX1fYNi95bFALRw1wyk Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da779589041041ddbe7b9c2c0fecdf4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da779589041041ddbe7b9c2c0fecdf4b"}]}] Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: da779589041041ddbe7b9c2c0fecdf4b Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2124956569 Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e160d71e9670458f85c49305964dfdfa Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2124956569-project Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: exception: Keypair tempest-keypair-non-existent-1387282813 not found for user e160d71e9670458f85c49305964dfdfa Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'tempest-keypair-non-existent-1387282813'} Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6864, in delete_key_pair Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6885, in get_key_pair Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1387282813 not found for user e160d71e9670458f85c49305964dfdfa Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.124601 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1387282813 not found for user e160d71e9670458f85c49305964dfdfa Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1387282813 not found for user e160d71e9670458f85c49305964dfdfa Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:09.129526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5445cccd-3c93-485c-b03f-a5805527fb5a tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1387282813 not found for user e160d71e9670458f85c49305964dfdfa {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:09.136985 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5445cccd-3c93-485c-b03f-a5805527fb5a tempest-KeyPairsNegativeTestJSON-2124956569 tempest-KeyPairsNegativeTestJSON-2124956569-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1387282813" status: 404 len: 145 microversion: 2.1 time: 0.029030 Oct 12 08:50:09.136985 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 926/1724] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:50:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1387282813 => generated 145 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:09.140774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:09.141543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:09.148144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:09.148796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:09.149381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.150246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:09.150815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:09.151695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.225743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:09.254443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:09.257074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:09.276941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-727a1ad5-23f5-48bf-b8eb-d721be0a057f tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1488 microversion: 2.91 time: 0.136990 Oct 12 08:50:09.277753 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 927/1725] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:09 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1488 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:09.341657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:09.349912 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9546cce6-82dc-40e3-b502-0ba0bed09083 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1277 microversion: 2.1 time: 0.656548 Oct 12 08:50:09.355226 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 799/1726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:08 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1277 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:09.477816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:09.480854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:09.489473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:09.490226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:09.490763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.491599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:09.494736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:09.495317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.529351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:09.534528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:09.552349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:09.553013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:09.554590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.559886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:09.563018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:09.563018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.681372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:09.682101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:09.683068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.684762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lazy-loading 'fault' on Instance uuid 7fa8cebd-34a5-45eb-a594-122d9f86bac2 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:50:09.786556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:09.798599 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-97660077-830c-4730-980f-887c59af1ca2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1475 microversion: 2.1 time: 0.335431 Oct 12 08:50:09.799925 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 928/1727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:09 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1475 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:09.869249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb5a13df5004b208f2f2ddeeb35452a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e340e8d545194205b2182fb9bd5477f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:09.881695 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c7969bc-5739-44c1-b16b-80bccc5266f6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 200 len: 1305 microversion: 2.1 time: 0.359772 Oct 12 08:50:09.900516 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 800/1728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:09 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 1305 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:09.909514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-489b813b-31a0-43c9-80a0-8065600809ed req-593933a9-8108-4ae9-abcc-40eb872863ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa8cebd-34a5-45eb-a594-122d9f86bac2", "name": "network-vif-deleted", "tag": "5c51700d-4928-4718-b701-40591849f148"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:09.941742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-489b813b-31a0-43c9-80a0-8065600809ed req-593933a9-8108-4ae9-abcc-40eb872863ef service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:09.943232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-489b813b-31a0-43c9-80a0-8065600809ed req-593933a9-8108-4ae9-abcc-40eb872863ef service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:09.946417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-489b813b-31a0-43c9-80a0-8065600809ed req-593933a9-8108-4ae9-abcc-40eb872863ef service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:09.980744 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-489b813b-31a0-43c9-80a0-8065600809ed req-593933a9-8108-4ae9-abcc-40eb872863ef service nova] Creating event network-vif-deleted:5c51700d-4928-4718-b701-40591849f148 for instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 on n-h1-858383-10 Oct 12 08:50:09.997952 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-489b813b-31a0-43c9-80a0-8065600809ed req-593933a9-8108-4ae9-abcc-40eb872863ef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092073 Oct 12 08:50:09.999768 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 801/1729] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:10.043893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:10.045081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:10.059412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:10.060202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:10.063285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:10.064500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:10.066614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:10.067444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:10.150696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e86fbb9b-daf0-49e2-806d-9e007a40d43a tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f984803c3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1944948607", "description": "tempest-description-1099382466"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:10.465945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:10.479440 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-775210a0-fe5a-4a04-aa9c-31041979aedb tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1273 microversion: 2.1 time: 0.443982 Oct 12 08:50:10.482578 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 802/1730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:10 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1273 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:10.499402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:10.499402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:10.506248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:10.506956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:10.508463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:10.510732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:10.512050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:10.516069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:10.745084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:10.754231 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e86fbb9b-daf0-49e2-806d-9e007a40d43a tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.952682 Oct 12 08:50:10.755307 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 929/1731] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:09 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:10.756607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:10.761113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:10.761611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:10.762512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:10.773167 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0ce12174-8914-4964-b504-99b8aa325bf0 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.288764 Oct 12 08:50:10.775519 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 803/1732] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:10 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:10.775842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:10.776497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:10.778947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:10.780034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:10.783001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:10.783707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:10.784600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05767e8a-0d49-4263-94a9-45d46f2d136e tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f9848a54280>, body: {"security_group_rule": {"parent_group_id": "c2f297d1-46ed-4ec4-ab13-69932906382c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:10.961799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:10.975626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b8135244-0ff7-4a4f-b2e9-81301f84563c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1277 microversion: 2.1 time: 0.215393 Oct 12 08:50:10.976490 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 930/1733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:10 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:10.984436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:10.985526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:10.996082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:10.996840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:10.997342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:10.998610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:10.999117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:10.999545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.256004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:11.268553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-410fd5f2-0785-4862-bf53-4aa381e084bc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1475 microversion: 2.1 time: 0.286965 Oct 12 08:50:11.281466 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 931/1734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:10 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1475 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:11.292971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:11.292971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:11.301419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.301957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.302378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.303081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.303641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.304071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.340984 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] HTTP exception thrown: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Request method failure captured: Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 HTTP/1.1 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-ZavOrftn-JtczokOqlpMZyQIiKNm9gFavKoUuZerAV73NzJA7Mq3jN5hdKLjqs--tmqu-oVTD7cSumXl1ohABhSsuBuWBUdZkNR0IPKVPSrvMI9Abopv3RaOWKYekLR0AUTTzEy1gumPICklURtvDL3LxtC3ZOUKDdK6HVcn3M0Q Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}] Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 9fb5a13df5004b208f2f2ddeeb35452a Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7fa8cebd-34a5-45eb-a594-122d9f86bac2'} Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.350087 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Returning 404 to user: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:11.358860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c0cf8e7-ec97-4b65-b236-0c4eb189f4b6 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 404 len: 111 microversion: 2.1 time: 0.082739 Oct 12 08:50:11.361547 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 932/1735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:11 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:11.376798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1487806629", "metadata": {"image_type": "test"}}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:11.391295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:11.412076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.412688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.417548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.420357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.420927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.421399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.465480 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] HTTP exception thrown: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Request method failure captured: Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2/action HTTP/1.1 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 112 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-ZavOrftn-JtczokOqlpMZyQIiKNm9gFavKoUuZerAV73NzJA7Mq3jN5hdKLjqs--tmqu-oVTD7cSumXl1ohABhSsuBuWBUdZkNR0IPKVPSrvMI9Abopv3RaOWKYekLR0AUTTzEy1gumPICklURtvDL3LxtC3ZOUKDdK6HVcn3M0Q Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}] Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 9fb5a13df5004b208f2f2ddeeb35452a Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1487806629", "metadata": {"image_type": "test"}}} Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7fa8cebd-34a5-45eb-a594-122d9f86bac2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1487806629', 'metadata': {'image_type': 'test'}}}} Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 08:50:11.467109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.471647 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.473936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Returning 404 to user: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:11.475192 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ad32d3b-1538-4cd3-b401-1210fa0b1203 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "POST /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2/action" status: 404 len: 111 microversion: 2.1 time: 0.112525 Oct 12 08:50:11.475940 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 933/1736] 10.222.0.40 () {60 vars in 1279 bytes} [Wed Oct 12 08:50:11 2022] POST /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2/action => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:11.482817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:11.502544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f65e520-6838-4b0a-b0a3-adf9744d2685 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-289892150", "metadata": {"image_type": "test"}}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:11.506484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6f65e520-6838-4b0a-b0a3-adf9744d2685 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Failed to fetch instance by id tempest-invalid-1251203272 {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 08:50:11.509635 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6f65e520-6838-4b0a-b0a3-adf9744d2685 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] HTTP exception thrown: Instance tempest-invalid-1251203272 could not be found. Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f65e520-6838-4b0a-b0a3-adf9744d2685 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Request method failure captured: Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/tempest-invalid-1251203272/action HTTP/1.1 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 111 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-ZavOrftn-JtczokOqlpMZyQIiKNm9gFavKoUuZerAV73NzJA7Mq3jN5hdKLjqs--tmqu-oVTD7cSumXl1ohABhSsuBuWBUdZkNR0IPKVPSrvMI9Abopv3RaOWKYekLR0AUTTzEy1gumPICklURtvDL3LxtC3ZOUKDdK6HVcn3M0Q Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}] Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 9fb5a13df5004b208f2f2ddeeb35452a Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-289892150", "metadata": {"image_type": "test"}}} Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance tempest-invalid-1251203272 could not be found. Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'tempest-invalid-1251203272', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-289892150', 'metadata': {'image_type': 'test'}}}} Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1251203272 could not be found. Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:11.511567 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1251203272 could not be found. Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1251203272 could not be found. Oct 12 08:50:11.516281 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.519854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f65e520-6838-4b0a-b0a3-adf9744d2685 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Returning 404 to user: Instance tempest-invalid-1251203272 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:11.520692 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6f65e520-6838-4b0a-b0a3-adf9744d2685 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "POST /compute/v2.1/servers/tempest-invalid-1251203272/action" status: 404 len: 101 microversion: 2.1 time: 0.034496 Oct 12 08:50:11.521709 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 934/1737] 10.222.0.40 () {60 vars in 1249 bytes} [Wed Oct 12 08:50:11 2022] POST /compute/v2.1/servers/tempest-invalid-1251203272/action => generated 101 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:11.532811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:11.533463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:11.543094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.543871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.544607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.545558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.546203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.546822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.635922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:11.644405 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9c1c657e-ce7d-474f-9435-dafe36df0776 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1273 microversion: 2.1 time: 0.121495 Oct 12 08:50:11.645084 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 935/1738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:11 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:11.681341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f52149d-35d5-4690-a720-0b2ee5782d90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1423023044"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:11.685068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f52149d-35d5-4690-a720-0b2ee5782d90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 08:50:11.688523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-2f52149d-35d5-4690-a720-0b2ee5782d90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f52149d-35d5-4690-a720-0b2ee5782d90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Request method failure captured: Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 57 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-ZavOrftn-JtczokOqlpMZyQIiKNm9gFavKoUuZerAV73NzJA7Mq3jN5hdKLjqs--tmqu-oVTD7cSumXl1ohABhSsuBuWBUdZkNR0IPKVPSrvMI9Abopv3RaOWKYekLR0AUTTzEy1gumPICklURtvDL3LxtC3ZOUKDdK6HVcn3M0Q Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}] Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 9fb5a13df5004b208f2f2ddeeb35452a Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: {"createImage": {"name": "tempest-test-snap-1423023044"}} Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1423023044'}}} Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.692350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.698043 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.714696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f52149d-35d5-4690-a720-0b2ee5782d90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:11.716116 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f52149d-35d5-4690-a720-0b2ee5782d90 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.068526 Oct 12 08:50:11.717080 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 936/1739] 10.222.0.40 () {60 vars in 1275 bytes} [Wed Oct 12 08:50:11 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:11.746640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-094ccd8d-e712-42c1-b5ec-6067edc6e6f3 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-4256869"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:11.752432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-094ccd8d-e712-42c1-b5ec-6067edc6e6f3 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 08:50:11.753677 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-094ccd8d-e712-42c1-b5ec-6067edc6e6f3 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-094ccd8d-e712-42c1-b5ec-6067edc6e6f3 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Request method failure captured: Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 54 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-ZavOrftn-JtczokOqlpMZyQIiKNm9gFavKoUuZerAV73NzJA7Mq3jN5hdKLjqs--tmqu-oVTD7cSumXl1ohABhSsuBuWBUdZkNR0IPKVPSrvMI9Abopv3RaOWKYekLR0AUTTzEy1gumPICklURtvDL3LxtC3ZOUKDdK6HVcn3M0Q Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}] Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 9fb5a13df5004b208f2f2ddeeb35452a Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: {"createImage": {"name": "tempest-test-snap-4256869"}} Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-4256869'}}} Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.757991 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 12 08:50:11.763032 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.765199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-094ccd8d-e712-42c1-b5ec-6067edc6e6f3 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:11.766985 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-094ccd8d-e712-42c1-b5ec-6067edc6e6f3 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.032401 Oct 12 08:50:11.775242 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 937/1740] 10.222.0.40 () {60 vars in 1281 bytes} [Wed Oct 12 08:50:11 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:11.791436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:11.791962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:11.808405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.810130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.812905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.813710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.814191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.815971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.857593 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] HTTP exception thrown: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Request method failure captured: Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 HTTP/1.1 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-ZavOrftn-JtczokOqlpMZyQIiKNm9gFavKoUuZerAV73NzJA7Mq3jN5hdKLjqs--tmqu-oVTD7cSumXl1ohABhSsuBuWBUdZkNR0IPKVPSrvMI9Abopv3RaOWKYekLR0AUTTzEy1gumPICklURtvDL3LxtC3ZOUKDdK6HVcn3M0Q Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}] Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 9fb5a13df5004b208f2f2ddeeb35452a Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7fa8cebd-34a5-45eb-a594-122d9f86bac2'} Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:11.860944 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:11.865649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:11.869364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Returning 404 to user: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:11.871439 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-11c2e837-a329-4d84-8fa8-d85edfc3c423 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 404 len: 111 microversion: 2.1 time: 0.093412 Oct 12 08:50:11.874785 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 938/1741] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:50:11 2022] DELETE /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:11.888400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:11.891483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:11.899670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.900429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.901368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:11.902654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:11.904282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:11.905096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.035279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:12.048195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:12.049978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:12.055959 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d539bd9-5a84-4789-81fd-fde362e978e9 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.179693 Oct 12 08:50:12.056704 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 939/1742] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:11 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:12.064583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:12.065473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] [instance: 7fa8cebd-34a5-45eb-a594-122d9f86bac2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:12.070355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:12.076887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.077677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.078294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.079455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.080079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.080664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.105468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] HTTP exception thrown: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Request method failure captured: Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 HTTP/1.1 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-ZavOrftn-JtczokOqlpMZyQIiKNm9gFavKoUuZerAV73NzJA7Mq3jN5hdKLjqs--tmqu-oVTD7cSumXl1ohABhSsuBuWBUdZkNR0IPKVPSrvMI9Abopv3RaOWKYekLR0AUTTzEy1gumPICklURtvDL3LxtC3ZOUKDdK6HVcn3M0Q Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e340e8d545194205b2182fb9bd5477f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e340e8d545194205b2182fb9bd5477f3"}]}] Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e340e8d545194205b2182fb9bd5477f3 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-112646479 Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 9fb5a13df5004b208f2f2ddeeb35452a Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesNegativeTestJSON-112646479-project Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7fa8cebd-34a5-45eb-a594-122d9f86bac2'} Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:12.107095 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] Returning 404 to user: Instance 7fa8cebd-34a5-45eb-a594-122d9f86bac2 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a23e35c5-eebc-4968-9ca8-e3af80a2d840 tempest-ImagesNegativeTestJSON-112646479 tempest-ImagesNegativeTestJSON-112646479-project] 10.222.0.40 "GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2" status: 404 len: 111 microversion: 2.1 time: 0.050604 Oct 12 08:50:12.112400 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 940/1743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:12 2022] GET /compute/v2.1/servers/7fa8cebd-34a5-45eb-a594-122d9f86bac2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:12.124583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:12.126640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:12.153534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.154020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.154476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.155802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.155802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.156014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.200246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:12.438495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:12.447641 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4fcd3857-f8fb-4d57-b2ac-1a1c381a4090 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1319 microversion: 2.1 time: 0.337376 Oct 12 08:50:12.464925 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 941/1744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:12 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:12.488310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:12.491985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:12.508887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.510794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.512398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.513320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.515216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.516105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.804911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:12.830592 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cd82e0b-6f9e-4c5b-8631-6fdf1c264737 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1475 microversion: 2.1 time: 0.362547 Oct 12 08:50:12.833474 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 942/1745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:12 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:12.857571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d2e5fd85-007e-4a34-9b25-48a93c79aaac req-dd1c0ee9-b21a-43a1-bd49-ed72ef88d707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:12.893236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2e5fd85-007e-4a34-9b25-48a93c79aaac req-dd1c0ee9-b21a-43a1-bd49-ed72ef88d707 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.895113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2e5fd85-007e-4a34-9b25-48a93c79aaac req-dd1c0ee9-b21a-43a1-bd49-ed72ef88d707 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.895789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2e5fd85-007e-4a34-9b25-48a93c79aaac req-dd1c0ee9-b21a-43a1-bd49-ed72ef88d707 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.916991 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d2e5fd85-007e-4a34-9b25-48a93c79aaac req-dd1c0ee9-b21a-43a1-bd49-ed72ef88d707 service nova] Creating event network-changed:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h1-858383-10 Oct 12 08:50:12.928743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-d2e5fd85-007e-4a34-9b25-48a93c79aaac req-dd1c0ee9-b21a-43a1-bd49-ed72ef88d707 service nova] Instance e9a4d7be-3a27-416d-956c-16356acc1322 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:50:12.960917 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d2e5fd85-007e-4a34-9b25-48a93c79aaac req-dd1c0ee9-b21a-43a1-bd49-ed72ef88d707 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124482 Oct 12 08:50:12.962378 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 943/1746] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:12.971379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:12.973762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:12.982806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.983711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.985274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:12.986468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:12.987159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:12.987887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:13.362221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05767e8a-0d49-4263-94a9-45d46f2d136e tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.583486 Oct 12 08:50:13.363937 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 804/1747] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 08:50:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:13.378461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:13.379099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:13.395242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:13.396691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:13.398637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:13.399926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:13.403638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:13.405003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:13.707464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:13.727654 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-16dd6d67-679d-4d99-8404-72ed8de13a45 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1273 microversion: 2.1 time: 0.753480 Oct 12 08:50:13.738094 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 944/1748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:12 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1273 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:13.743349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4be7f977-32d5-47b8-8dbc-40db5030ebe7 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f9843fc1dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1149623974", "description": "tempest-description-147545361"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:14.089385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:14.104319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:14.109648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:14.147506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-481ba9be-cbd5-4e99-be30-d5895e7c9330 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.782374 Oct 12 08:50:14.150029 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 805/1749] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:13 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:14.156515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:14.164066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:14.192355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:14.196752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:14.197600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:14.198819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:14.199684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:14.204067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:15.410826 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4be7f977-32d5-47b8-8dbc-40db5030ebe7 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.670437 Oct 12 08:50:15.414271 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 945/1750] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:15.427310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:15.429996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:15.465718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:15.466229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:15.466704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:15.467587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:15.467948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:15.468382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:15.811694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:15.835039 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-961b5b48-282f-4f89-bb08-52604df37021 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1319 microversion: 2.1 time: 1.682308 Oct 12 08:50:15.843539 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 806/1751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:14 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1319 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:15.879108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:15.884920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:15.912167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:15.912994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:15.913726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:15.914713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:15.915435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:15.922382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:16.432256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:16.440626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-717f6b34-ac61-45a2-a5f8-f4eb86fea04c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1475 microversion: 2.1 time: 1.024839 Oct 12 08:50:16.441208 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 946/1752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:15 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1475 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:16.460698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:16.475470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:16.493879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:16.494617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:16.495233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:16.496131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:16.496762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:16.497346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:16.691245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:16.958156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:16.995298 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54f35558-49c4-4900-b1b1-63c667028341 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 1.136298 Oct 12 08:50:17.002654 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 807/1753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:15 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:17.016058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f87f8ed7-e14e-49eb-9141-d7a07a89a503 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f984894e1f0>, body: {"security_group_rule": {"parent_group_id": "4e417cdc-829d-40e6-aa39-a25630434aa3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:17.199683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:17.293003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:17.310548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:17.329001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-98bef3f1-8b99-41b5-8ffe-0b2f3f48e439 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.869568 Oct 12 08:50:17.336150 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 947/1754] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:16 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:17.371499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:17.372568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:17.396281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:17.398532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:17.399219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:17.402287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:17.403351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:17.404163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:18.037812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:18.049649 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aaddf103-6044-46d8-8de9-c0c1a37754e9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1319 microversion: 2.1 time: 0.708282 Oct 12 08:50:18.053305 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 948/1755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:17 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:18.062050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:18.073692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:18.086014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:18.089344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:18.090132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:18.095242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:18.096132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:18.097551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:18.417013 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f87f8ed7-e14e-49eb-9141-d7a07a89a503 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.405306 Oct 12 08:50:18.419097 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 808/1756] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 08:50:17 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:18.437882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:18.440685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:18.464235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:18.465301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:18.466422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:18.469722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:18.472046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:18.473259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:18.582392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:18.645578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:18.659427 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-52f19868-4a54-4282-9b48-4b488b20a1b3 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1473 microversion: 2.1 time: 0.604247 Oct 12 08:50:18.670329 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 949/1757] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:18 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1473 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:18.670812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d3360d00-caff-4e42-a25d-ae95a1aab885 req-5810ba01-3e89-4d8f-a170-d225f7713af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87afdca0-7aca-4b7d-8a37-b4d9c2a8af32", "tag": "25f4d920-1f22-4b73-b152-a386262bd173"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:18.693620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d3360d00-caff-4e42-a25d-ae95a1aab885 req-5810ba01-3e89-4d8f-a170-d225f7713af7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:18.695317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d3360d00-caff-4e42-a25d-ae95a1aab885 req-5810ba01-3e89-4d8f-a170-d225f7713af7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:18.697328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d3360d00-caff-4e42-a25d-ae95a1aab885 req-5810ba01-3e89-4d8f-a170-d225f7713af7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:18.742530 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d3360d00-caff-4e42-a25d-ae95a1aab885 req-5810ba01-3e89-4d8f-a170-d225f7713af7 service nova] Creating event network-changed:25f4d920-1f22-4b73-b152-a386262bd173 for instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 on n-h1-858383-10 Oct 12 08:50:18.760889 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d3360d00-caff-4e42-a25d-ae95a1aab885 req-5810ba01-3e89-4d8f-a170-d225f7713af7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098706 Oct 12 08:50:18.763085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 950/1758] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:18.772501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:18.773831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:18.793514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:18.794422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:18.795139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:18.796140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:18.796798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:18.798451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:19.076977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=46 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:19.161478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:19.175837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:19.177697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:19.196557 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aacbd6b7-16b2-441e-b5cb-160b9f4158fe tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.432017 Oct 12 08:50:19.197573 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 951/1759] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:18 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:19.202508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-785e6707-a8c2-4056-976e-56c6a1274e42 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f9843fe3ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-364812023", "description": "tempest-description-1805757673"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:20.193219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:20.205718 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94035cd5-1ee6-4193-9490-9366b7194e56 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 1.785435 Oct 12 08:50:20.221867 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 809/1760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:18 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:20.231150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:20.231972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:20.238969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:20.239817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:20.240641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:20.241819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:20.242545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:20.243261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:21.264125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:21.273818 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a29fe647-f561-4b1c-8a28-844031d6f5a7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1319 microversion: 2.1 time: 1.050355 Oct 12 08:50:21.294088 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 810/1761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:20 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1319 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:21.307622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:21.308300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:21.323173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:21.323795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:21.328114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:21.329252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:21.330072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:21.331091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:21.513920 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-785e6707-a8c2-4056-976e-56c6a1274e42 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.315012 Oct 12 08:50:21.515399 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 952/1762] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:21.521904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:21.523270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:21.576075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:21.578145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:21.583806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:21.585409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:21.586467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:21.590041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:21.813838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:21.823234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:21.824869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:21.852682 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b7e5dd0f-dfca-42fe-8d74-2042cc5780fc tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.335647 Oct 12 08:50:21.880998 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 953/1763] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:21 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:21.889198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-141696206", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3ff61c2d-1adb-4df2-9b11-32c76cd9be4b"}], "block_device_mapping_v2": [{"uuid": "86b21bdc-a7b2-47b1-a5f0-2064e34fad50", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:21.987605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] validate_networks() for [('3ff61c2d-1adb-4df2-9b11-32c76cd9be4b', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:50:22.202146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:22.219026 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c5e538c-5d54-4283-888b-f285f4a590cf tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1470 microversion: 2.1 time: 0.923422 Oct 12 08:50:22.219628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 811/1764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:21 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1470 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:22.225357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a2753284-fcb4-46c3-b815-a8d0a1c0e6a4 req-b8f351fb-4dc5-40dd-8c5d-2510ca6e0134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979a8fd2-1874-4df7-b407-c21f06a8ef93", "tag": "6dfcbb58-e844-4b48-bf45-ede1a949604b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:22.253101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2753284-fcb4-46c3-b815-a8d0a1c0e6a4 req-b8f351fb-4dc5-40dd-8c5d-2510ca6e0134 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:22.253608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2753284-fcb4-46c3-b815-a8d0a1c0e6a4 req-b8f351fb-4dc5-40dd-8c5d-2510ca6e0134 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:22.254037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2753284-fcb4-46c3-b815-a8d0a1c0e6a4 req-b8f351fb-4dc5-40dd-8c5d-2510ca6e0134 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:22.305536 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a2753284-fcb4-46c3-b815-a8d0a1c0e6a4 req-b8f351fb-4dc5-40dd-8c5d-2510ca6e0134 service nova] Creating event network-changed:6dfcbb58-e844-4b48-bf45-ede1a949604b for instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 on n-h2-858383-10 Oct 12 08:50:22.318775 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a2753284-fcb4-46c3-b815-a8d0a1c0e6a4 req-b8f351fb-4dc5-40dd-8c5d-2510ca6e0134 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096716 Oct 12 08:50:22.321864 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 812/1765] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:22.332216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:22.339923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:22.355959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:22.358335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:22.358992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:22.362252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:22.362936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:22.363557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:22.744655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:22.765321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6584dd8e-2220-4c07-8704-1bd55c6fcb83 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 0.441771 Oct 12 08:50:22.765966 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 813/1766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:22 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:22.790848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d2267d13-d59f-41bd-bb0d-ced641a95822 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f9848a54700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-367208731", "description": "tempest-description-1038368167"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:24.265704 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d2267d13-d59f-41bd-bb0d-ced641a95822 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.493442 Oct 12 08:50:24.267782 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 814/1767] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:24.272716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:24.273532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:24.289306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:24.290949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:24.292121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:24.296665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:24.297387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:24.298064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:24.591535 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-21a362bd-d808-4000-a1f2-7eed75633a47 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "POST /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322/action" status: 202 len: 0 microversion: 2.1 time: 0.318927 Oct 12 08:50:24.592309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:50:24.592797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:50:24.593652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:50:24.594241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:50:24.595180 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 815/1768] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:50:24 2022] POST /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:24.595747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:50:24.613902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:24.616987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:24.617906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:24.619687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:24.621779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:24.625824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:24.629171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:24.629982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:24.635367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:24.635871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:24.641172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:24.642018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:24.642503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:24.643041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:24.714739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:24.726673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Getting quotas for user 008f3287ba094f53971db283b5f303c5 and project e9dc112ec885461eae39dbe7d1abfe7d. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:24.889812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:50:24.893378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86b21bdc-a7b2-47b1-a5f0-2064e34fad50',volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:50:24.934261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:24.942953 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d021615-d31a-4132-b8f8-0a546f387bd0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1319 microversion: 2.1 time: 0.346273 Oct 12 08:50:24.955501 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 816/1769] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:24 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:24.961706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:24.972329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:24.980840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:24.981406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:24.982632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:24.982815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:24.983350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:24.985535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:25.100476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:25.111251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:25.113059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:25.119232 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f0eeaf8e-2d3b-4a73-847f-339632d3e430 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.162499 Oct 12 08:50:25.121636 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 817/1770] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:24 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:25.124804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:25.125561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:25.131644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:25.132274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:25.132764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:25.134059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:25.134747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:25.135234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:25.138535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:25.142331 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2ff90d26-5a7e-4c5a-94a6-46b02be34fe6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.259130 Oct 12 08:50:25.143088 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 954/1771] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:50:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3261 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:50:25.474877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-768794ce-6f1c-4cd8-8ec6-03117ea6b227 req-06722ad2-2a41-4f1f-afd1-cfb8d7b02d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "name": "network-vif-plugged", "status": "completed", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:25.505950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:25.513907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-768794ce-6f1c-4cd8-8ec6-03117ea6b227 req-06722ad2-2a41-4f1f-afd1-cfb8d7b02d11 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:25.515536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-768794ce-6f1c-4cd8-8ec6-03117ea6b227 req-06722ad2-2a41-4f1f-afd1-cfb8d7b02d11 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:25.518071 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad786ce4-dd46-42ba-b55d-57eb6ba445dc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 0.396170 Oct 12 08:50:25.518986 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 818/1772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:25 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:25.519778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-768794ce-6f1c-4cd8-8ec6-03117ea6b227 req-06722ad2-2a41-4f1f-afd1-cfb8d7b02d11 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:25.535501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe9eae00-28b3-4a83-a2b2-400589016df7 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f98488915e0>, body: {"security_group_rule": {"parent_group_id": "737c0fe5-0bba-4ea2-a2ce-7bfbdeefcc1d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b9e9037b-eda0-4aa4-9a0b-d15b4a2caecd"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:25.550455 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-768794ce-6f1c-4cd8-8ec6-03117ea6b227 req-06722ad2-2a41-4f1f-afd1-cfb8d7b02d11 service nova] Creating event network-vif-plugged:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h1-858383-10 Oct 12 08:50:25.565223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-768794ce-6f1c-4cd8-8ec6-03117ea6b227 req-06722ad2-2a41-4f1f-afd1-cfb8d7b02d11 service nova] Instance e9a4d7be-3a27-416d-956c-16356acc1322 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:50:25.603380 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-768794ce-6f1c-4cd8-8ec6-03117ea6b227 req-06722ad2-2a41-4f1f-afd1-cfb8d7b02d11 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.458144 Oct 12 08:50:25.604018 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 955/1773] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:25.609123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6ed0c5ce-ed0d-445a-b176-41290000ef60 req-4159c3ab-dab1-4ad2-8d8f-e33ae1223376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad3031b-2e27-424a-9ec0-6d590834783f", "tag": "ce2057b4-bb08-4477-8c3a-c2784285043a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:25.630345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6ed0c5ce-ed0d-445a-b176-41290000ef60 req-4159c3ab-dab1-4ad2-8d8f-e33ae1223376 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:25.635771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6ed0c5ce-ed0d-445a-b176-41290000ef60 req-4159c3ab-dab1-4ad2-8d8f-e33ae1223376 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:25.637498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6ed0c5ce-ed0d-445a-b176-41290000ef60 req-4159c3ab-dab1-4ad2-8d8f-e33ae1223376 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:25.654194 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6ed0c5ce-ed0d-445a-b176-41290000ef60 req-4159c3ab-dab1-4ad2-8d8f-e33ae1223376 service nova] Creating event network-changed:ce2057b4-bb08-4477-8c3a-c2784285043a for instance 8ad3031b-2e27-424a-9ec0-6d590834783f on n-h1-858383-10 Oct 12 08:50:25.670515 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6ed0c5ce-ed0d-445a-b176-41290000ef60 req-4159c3ab-dab1-4ad2-8d8f-e33ae1223376 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065038 Oct 12 08:50:25.672129 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 956/1774] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:25.679152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:25.680141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:25.690295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:25.691020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:25.691676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:25.692931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:25.693736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:25.697880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:26.370125 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe9eae00-28b3-4a83-a2b2-400589016df7 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.848856 Oct 12 08:50:26.370735 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 819/1775] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 08:50:25 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:26.386677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:26.387676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:26.404839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:26.405655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:26.406388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:26.407553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:26.408232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:26.408917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:26.608155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:26.618676 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5b8100b-ea9e-4c94-b827-c7b6fc89846f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1469 microversion: 2.1 time: 0.945012 Oct 12 08:50:26.620739 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 957/1776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:25 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1469 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:26.634360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:26.636044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:26.651971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:26.652722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:26.657640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:26.658621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:26.659280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:26.659874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:26.776815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:26.786266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:26.788019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:26.789415 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-989c1023-eb94-4dee-83e2-1de71181e598 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1184 microversion: 2.25 time: 0.417484 Oct 12 08:50:26.802607 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 820/1777] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:26 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1184 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:26.814841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:26.815751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:26.823146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:26.823862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:26.824580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:26.825582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:26.826260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:26.826848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:26.968842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:26.986690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:26.988949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:26.995391 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-307f1c67-86d2-4139-b232-c0ce95e458a4 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.191238 Oct 12 08:50:27.014000 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 821/1778] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:26 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:27.028845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ce7dfdca-4db0-405d-9eb9-7b9b2d7e442b tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f9848aaeb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1027005184", "description": "tempest-description-122008846"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:27.047047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:27.059961 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-07df62e8-62f7-460e-80c8-669d807a44eb tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1319 microversion: 2.1 time: 0.435600 Oct 12 08:50:27.063082 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 958/1779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:26 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:27.072778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:27.076159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:27.113068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:27.113728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:27.114214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:27.115087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:27.120177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:27.120914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:27.295825 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ce7dfdca-4db0-405d-9eb9-7b9b2d7e442b tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.280336 Oct 12 08:50:27.297984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 822/1780] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:27 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:27.313857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63087ea9-77cb-4b09-9043-67835315dbe0 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f984877c940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-516955065", "description": "tempest-description-19627286"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:27.453602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:27.475560 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2db31ba3-abd5-4713-b4c0-071dfcde43f7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 0.410530 Oct 12 08:50:27.476891 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 959/1781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:27 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:27.646825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:27.648513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:27.659927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:27.663531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:27.664132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:27.665176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:27.666680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:27.668194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:27.695666 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-63087ea9-77cb-4b09-9043-67835315dbe0 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.388070 Oct 12 08:50:27.717541 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 823/1782] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:27 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:27.735263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cedeb23f-37f8-4597-8f94-af4139f42ba0 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f98489ef1f0>, body: {"security_group_rule": {"parent_group_id": "95816c3e-336a-4060-bc81-2a84458e921d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7f54af25-e765-4df8-a605-62b29a61b110"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:28.072384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:28.083319 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2bf063c0-5398-4daa-9c8f-f234dc07ad7b tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1469 microversion: 2.1 time: 0.441377 Oct 12 08:50:28.100400 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 960/1783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:27 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1469 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:28.427041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:28.429329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:28.445941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:28.446536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:28.447086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:28.447868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:28.448400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:28.448900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:28.544741 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cedeb23f-37f8-4597-8f94-af4139f42ba0 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.825205 Oct 12 08:50:28.546421 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 824/1784] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 08:50:27 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:28.554289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:28.557881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:28.588579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:28.589093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:28.594041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:28.594041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:28.594041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:28.594041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:28.610072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:28.625770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:28.631608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:28.633557 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1d2c8a77-e420-4fd6-a4c0-03038c0cdb2a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1232 microversion: 2.25 time: 0.542940 Oct 12 08:50:28.635697 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 961/1785] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:28 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1232 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:28.654052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:28.654778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:28.662934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:28.663779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:28.664317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:28.665142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:28.665729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:28.666255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:28.812019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:28.829040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:28.832756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:28.848382 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a1a28d8c-35fd-464b-8f2a-7d775fa5fcb7 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.300182 Oct 12 08:50:28.851664 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 825/1786] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:28 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:28.861406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:28.867779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:28.882756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:28.884090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:28.885101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:28.888066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:28.890154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:28.890877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:29.025481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:29.029919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:29.041271 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4920ae80-8db5-4675-8c76-33bedb391ed8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1319 microversion: 2.1 time: 0.403153 Oct 12 08:50:29.045826 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 962/1787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:28 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:29.081210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-92c6ee84-cf02-4f8d-9010-db3d3958f9f6 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f984805f430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:29.557258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:29.572263 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2755aef9-bc70-484f-b72f-b7cb9d3ff631 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 0.717055 Oct 12 08:50:29.574201 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 826/1788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:28 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:29.865382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-026d99f1-9774-4b69-a66a-97cb7f02cfe9 tempest-ListImageFiltersNegativeTestJSON-649551599 tempest-ListImageFiltersNegativeTestJSON-649551599-project] Calling method '.version_select at 0x7f9848a64ee0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:29.910748 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-026d99f1-9774-4b69-a66a-97cb7f02cfe9 tempest-ListImageFiltersNegativeTestJSON-649551599 tempest-ListImageFiltersNegativeTestJSON-649551599-project] HTTP exception thrown: Image not found. Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-026d99f1-9774-4b69-a66a-97cb7f02cfe9 tempest-ListImageFiltersNegativeTestJSON-649551599 tempest-ListImageFiltersNegativeTestJSON-649551599-project] Request method failure captured: Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/images/09e8ec39-db36-42b1-85f8-df228a8df8f9 HTTP/1.1 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn_UieW9snvO2oCLlTo_HSwZ1SLdqmjKPE6gfPMw11SBhidtGItKRUOQCaSmA_YC9iJV7FJakfG92ZVxgrb3GHtDksFO1VSxleq0s7JXPMtoA-mcwxpox6WnUo4Qlm36TdRkvfuxdhnGwwq50gBAPlzCWDqXrj42kDirhZrFlw-_Kxk Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 414233cc23c24016a8e6862170b05559 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-649551599 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/414233cc23c24016a8e6862170b05559"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/414233cc23c24016a8e6862170b05559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_414233cc23c24016a8e6862170b05559"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/414233cc23c24016a8e6862170b05559"}]}] Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-649551599 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 414233cc23c24016a8e6862170b05559 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-649551599 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListImageFiltersNegativeTestJSON-649551599-project Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: e89eec7d242c4a649c50ffd8ecdeaa2d Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-649551599-project Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '09e8ec39-db36-42b1-85f8-df228a8df8f9'} Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 09e8ec39-db36-42b1-85f8-df228a8df8f9 Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:50:29.913108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 09e8ec39-db36-42b1-85f8-df228a8df8f9 could not be found. Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-026d99f1-9774-4b69-a66a-97cb7f02cfe9 tempest-ListImageFiltersNegativeTestJSON-649551599 tempest-ListImageFiltersNegativeTestJSON-649551599-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-026d99f1-9774-4b69-a66a-97cb7f02cfe9 tempest-ListImageFiltersNegativeTestJSON-649551599 tempest-ListImageFiltersNegativeTestJSON-649551599-project] 10.222.0.40 "GET /compute/v2.1/images/09e8ec39-db36-42b1-85f8-df228a8df8f9" status: 404 len: 62 microversion: 2.1 time: 0.339177 Oct 12 08:50:29.918719 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 827/1789] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:50:29 2022] GET /compute/v2.1/images/09e8ec39-db36-42b1-85f8-df228a8df8f9 => generated 62 bytes in 340 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:50:29.939365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:29.941174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:29.966747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:29.967579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:29.969501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:29.978854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:29.979686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:29.981252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:30.063252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-92c6ee84-cf02-4f8d-9010-db3d3958f9f6 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/7f54af25-e765-4df8-a605-62b29a61b110" status: 202 len: 0 microversion: 2.1 time: 1.015986 Oct 12 08:50:30.066468 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 963/1790] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:29 2022] DELETE /compute/v2.1/os-security-groups/7f54af25-e765-4df8-a605-62b29a61b110 => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:30.074400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7c0374ed-1afe-46a7-881e-d741736d569a req-dc136820-d6b5-42bd-a821-675cc99dc46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979a8fd2-1874-4df7-b407-c21f06a8ef93", "name": "network-vif-plugged", "status": "completed", "tag": "6dfcbb58-e844-4b48-bf45-ede1a949604b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:30.113500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7c0374ed-1afe-46a7-881e-d741736d569a req-dc136820-d6b5-42bd-a821-675cc99dc46c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:30.115199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7c0374ed-1afe-46a7-881e-d741736d569a req-dc136820-d6b5-42bd-a821-675cc99dc46c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:30.117334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7c0374ed-1afe-46a7-881e-d741736d569a req-dc136820-d6b5-42bd-a821-675cc99dc46c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:30.156770 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7c0374ed-1afe-46a7-881e-d741736d569a req-dc136820-d6b5-42bd-a821-675cc99dc46c service nova] Creating event network-vif-plugged:6dfcbb58-e844-4b48-bf45-ede1a949604b for instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 on n-h2-858383-10 Oct 12 08:50:30.171594 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7c0374ed-1afe-46a7-881e-d741736d569a req-dc136820-d6b5-42bd-a821-675cc99dc46c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100524 Oct 12 08:50:30.174515 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 964/1791] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:30.224764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:30.230278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:30.251539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:30.252659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:30.253465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:30.254411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:30.261615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:30.264774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:30.475940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:30.478763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:30.487545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:30.489007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:30.490186 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-852abad2-df3e-40be-9881-c4a63c67b2fd tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1250 microversion: 2.25 time: 0.313163 Oct 12 08:50:30.491918 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b2d09fa-763f-4878-94f4-a19dcff38615 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1469 microversion: 2.1 time: 0.574033 Oct 12 08:50:30.493195 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 828/1792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:29 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1469 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:30.502438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:30.503505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:30.516964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:30.519206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:30.522340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:30.523675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:30.525543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:30.527076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:30.534928 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 965/1793] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:30 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1250 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:30.551590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:30.554308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:30.566944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:30.567432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:30.567868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:30.574299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:30.575025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:30.575641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:30.713247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:30.722515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:30.726644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:30.739532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:30.745219 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2669d0cb-9488-477c-9f3c-9c4ff1855130 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1544 microversion: 2.91 time: 0.247267 Oct 12 08:50:30.746872 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 829/1794] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:30 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:30.755797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d576d00c-ac6f-4ae1-b345-5ab0af91c72a tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f9848a64430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:30.828413 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d576d00c-ac6f-4ae1-b345-5ab0af91c72a tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/95816c3e-336a-4060-bc81-2a84458e921d" status: 200 len: 247 microversion: 2.1 time: 0.079357 Oct 12 08:50:30.829770 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 830/1795] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:50:30 2022] GET /compute/v2.1/os-security-groups/95816c3e-336a-4060-bc81-2a84458e921d => generated 247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:31.000075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:31.012506 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3484d421-22a5-4e77-8d26-b2ac0993ae06 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1319 microversion: 2.1 time: 0.472012 Oct 12 08:50:31.015677 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 966/1796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:30 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:31.045266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:31.045961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:31.062925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:31.069758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:31.071163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:31.074403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:31.074965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:31.075522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:31.276833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-601293652", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5c67d799-0062-4dd5-8131-0ff04958cfab"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:31.371100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] validate_networks() for [('5c67d799-0062-4dd5-8131-0ff04958cfab', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:50:31.527875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:31.537148 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-872a3f52-16a6-4198-927e-03214aa34a72 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 0.519914 Oct 12 08:50:31.542458 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 967/1797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:31 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:31.547874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-336fce5a-0a4d-416c-af39-54a9657ea587 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f984805f820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-596201702", "description": "tempest-description-907172884"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:32.165768 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-336fce5a-0a4d-416c-af39-54a9657ea587 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.621385 Oct 12 08:50:32.167535 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 968/1798] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:31 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:32.174427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:32.177425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:32.197240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:32.198417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:32.199654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:32.200768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:32.201423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:32.202126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:32.760861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:50:32.761351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:50:32.761791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:50:32.762344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:50:32.762919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:50:32.774907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:32.775639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:32.776074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:32.777225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:32.777225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:32.777800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:32.805276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:32.814769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:32.815100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Getting quotas for project e612677bf8be4aee953bf54c1ee0a994. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:32.819392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Getting quotas for user a51ff84665bb49ef9ed92a5fbb46d25a and project e612677bf8be4aee953bf54c1ee0a994. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:32.819585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:32.820700 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b30b7216-f7b2-4e79-86a0-2a07ac045ea9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1292 microversion: 2.25 time: 0.651886 Oct 12 08:50:32.821308 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 969/1799] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:32 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1292 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:32.835658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Going to run 2 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:50:32.838368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 74e897a6-516b-4eda-8d1d-4d9a3a21858c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:50:32.840358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:32.841072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:32.854389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:32.860797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:32.861641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:32.862686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:32.863617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:32.864200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:32.897078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=74e897a6-516b-4eda-8d1d-4d9a3a21858c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:50:32.998769 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f85d06a7-1503-472b-89c0-ff3ea6102cf6 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.167578 Oct 12 08:50:32.999990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 831/1800] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:50:33.009796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:33.010665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:33.018231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:33.019069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:33.019866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:33.021325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:33.023697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:33.025391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:33.144402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:33.156126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:33.160967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:33.194107 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-00f4af9a-1f7e-4275-a366-1c6ff80df77e tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1531 microversion: 2.91 time: 0.191895 Oct 12 08:50:33.196052 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 832/1801] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:33 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1531 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:33.205726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:33.208731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:33.227207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:33.227700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:33.232224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:33.236385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:33.237038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:33.237925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:33.419381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:33.431298 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fcf876c0-e35b-4fb0-97b3-3d3d004e16fb tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1469 microversion: 2.1 time: 0.604514 Oct 12 08:50:33.471390 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 970/1802] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:32 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1469 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:33.483319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-afdd2b6a-31bc-4be8-86e3-cfbe2ab57d6b tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f9843fe99d0>, body: {"security_group_rule": {"parent_group_id": "5f219b27-755c-465e-b3e5-1ad783e10c99", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:33.560257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:33.569534 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2956ff97-ae7c-4b28-a46d-91a8fc48ccf7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1469 microversion: 2.1 time: 0.371510 Oct 12 08:50:33.575339 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 833/1803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:33 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1469 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:33.580079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-7ee4e54b-5fd6-485d-97e7-5e3495222972 req-04b8c2e8-2383-42ab-82ec-4d193c29bf17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87afdca0-7aca-4b7d-8a37-b4d9c2a8af32", "name": "network-vif-plugged", "status": "completed", "tag": "25f4d920-1f22-4b73-b152-a386262bd173"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:33.604849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ee4e54b-5fd6-485d-97e7-5e3495222972 req-04b8c2e8-2383-42ab-82ec-4d193c29bf17 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:33.605692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ee4e54b-5fd6-485d-97e7-5e3495222972 req-04b8c2e8-2383-42ab-82ec-4d193c29bf17 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:33.606516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ee4e54b-5fd6-485d-97e7-5e3495222972 req-04b8c2e8-2383-42ab-82ec-4d193c29bf17 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:33.633146 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7ee4e54b-5fd6-485d-97e7-5e3495222972 req-04b8c2e8-2383-42ab-82ec-4d193c29bf17 service nova] Creating event network-vif-plugged:25f4d920-1f22-4b73-b152-a386262bd173 for instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 on n-h1-858383-10 Oct 12 08:50:33.644902 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-7ee4e54b-5fd6-485d-97e7-5e3495222972 req-04b8c2e8-2383-42ab-82ec-4d193c29bf17 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068260 Oct 12 08:50:33.648089 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 834/1804] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:33.654559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:33.664297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:33.674601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:33.680942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:33.681659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:33.682620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:33.683311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:33.683961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.157321 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-afdd2b6a-31bc-4be8-86e3-cfbe2ab57d6b tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.684703 Oct 12 08:50:34.158021 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 971/1805] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 08:50:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:34.181692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:34.195516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:34.198700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Searching by: {'deleted': False, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:50:34.230366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:34.231667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:34.232194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.233012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:34.233607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:34.234107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.296216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:50:34.397167 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e137e9ef-da2c-4c7a-8812-68aad84e12aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.227262 Oct 12 08:50:34.403195 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 972/1806] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 08:50:34 2022] GET /compute/v2.1/servers => generated 675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:34.420388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:34.421213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:34.440197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:34.440948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:34.442044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.442780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:34.443739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:34.444666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.471326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:34.482620 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3dc5770-af0b-4df0-b118-00331e46ddb8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 0.832985 Oct 12 08:50:34.496755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 835/1807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:33 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:34.515713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:34.516341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:34.534400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:34.534880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:34.535324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.536037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:34.543437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:34.544150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.587566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] Lazy-loading 'services' on Instance uuid bcebfe48-986f-41ff-b116-c90382f42b65 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:50:34.615234 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8b7b2428-29d9-429e-a95d-400507efe8ee tempest-UnshelveToHostMultiNodesTest-1869274419 tempest-UnshelveToHostMultiNodesTest-1869274419-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1938 microversion: 2.91 time: 0.210522 Oct 12 08:50:34.616812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 973/1808] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:34 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1938 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:34.622330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:34.623007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:34.640723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:34.640723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:34.641174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.642340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:34.643014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:34.647182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:34.764461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:35.082520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:35.102841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:35.112017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:35.114828 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ba1c84b0-2c6d-48e8-9e53-4eda37f2ae1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1292 microversion: 2.25 time: 0.495549 Oct 12 08:50:35.140198 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 974/1809] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:34 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1292 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:35.152170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:35.163498 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-188aa619-8c8b-49a9-87d8-b1b86077caca tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32" status: 200 len: 1319 microversion: 2.1 time: 0.655866 Oct 12 08:50:35.166942 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 836/1810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:34 2022] GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 => generated 1319 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:35.176917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7fff0a5d-2707-4a69-ae92-9008945f29cd tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Action: 'create', calling method: .version_select at 0x7f9848a54550>, body: {"security_group_rule": {"parent_group_id": "5f219b27-755c-465e-b3e5-1ad783e10c99", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:35.491426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-18d34a40-9d9b-424b-b754-e9f14e19b716 req-1f9e314b-a987-4988-88e6-d4610a46d3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f1fe07-9eb6-4da6-8b88-0c4df059868e", "tag": "163ca692-7dfb-4edc-81ef-916821ba1cbc"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:35.506173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-18d34a40-9d9b-424b-b754-e9f14e19b716 req-1f9e314b-a987-4988-88e6-d4610a46d3e1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.506828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-18d34a40-9d9b-424b-b754-e9f14e19b716 req-1f9e314b-a987-4988-88e6-d4610a46d3e1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.507520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-18d34a40-9d9b-424b-b754-e9f14e19b716 req-1f9e314b-a987-4988-88e6-d4610a46d3e1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:35.527799 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7fff0a5d-2707-4a69-ae92-9008945f29cd tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.359656 Oct 12 08:50:35.529335 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 837/1811] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 08:50:35 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:35.533262 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-18d34a40-9d9b-424b-b754-e9f14e19b716 req-1f9e314b-a987-4988-88e6-d4610a46d3e1 service nova] Creating event network-changed:163ca692-7dfb-4edc-81ef-916821ba1cbc for instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e on n-h1-858383-10 Oct 12 08:50:35.535104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:35.535870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:35.540483 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-18d34a40-9d9b-424b-b754-e9f14e19b716 req-1f9e314b-a987-4988-88e6-d4610a46d3e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.396978 Oct 12 08:50:35.542945 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 975/1812] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:35.545011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.545807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.546693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:35.547802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.548567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.549746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:35.562358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:35.563481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:35.579561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.581385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.583190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:35.585285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.587937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.588615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:35.647304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:35.661834 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f4ae2ffe-77f1-4e0c-a923-f354f5fda623 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1271 microversion: 2.1 time: 0.129255 Oct 12 08:50:35.662910 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 838/1813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:35 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:35.676785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:35.677585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:35.692887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.695477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.697016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:35.701992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.702870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.703624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:35.780556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:50:35.964424 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-deee254d-3f61-4872-9a59-c041d7977713 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 204 len: 0 microversion: 2.91 time: 0.297563 Oct 12 08:50:35.965946 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 839/1814] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:50:35 2022] DELETE /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:50:35.980593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:35.982157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:35.992021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.992805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.994752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:35.996176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:35.997047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:35.997876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:36.184750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:36.193257 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-22401622-9940-45f7-9339-dafcf7ca0d1f tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1469 microversion: 2.1 time: 0.648539 Oct 12 08:50:36.210537 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 976/1815] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:35 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1469 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:36.216676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f076a71c-36fd-4431-8848-2795a63e8c5f tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f9843fe3b80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:36.486786 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f076a71c-36fd-4431-8848-2795a63e8c5f tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/5f219b27-755c-465e-b3e5-1ad783e10c99" status: 200 len: 663 microversion: 2.1 time: 0.274943 Oct 12 08:50:36.497095 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 977/1816] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:50:36 2022] GET /compute/v2.1/os-security-groups/5f219b27-755c-465e-b3e5-1ad783e10c99 => generated 663 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:36.506079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:36.507048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:36.526411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:36.528330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:36.528951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:36.530615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:36.531816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:36.532913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:36.534956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:36.542660 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f93fd572-73a5-411d-8498-d1b64b214991 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 0.574761 Oct 12 08:50:36.543246 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 840/1817] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:35 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:36.555597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:36.559564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:36.571187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:36.571981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:36.580100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:36.581186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:36.581868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:36.582460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:36.613990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:36.988408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:37.004201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:37.007481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a51547fb8a9941d99f7757f2ccdc4eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a12dfe3bd7d443e0840df5138f95e661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:37.020303 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-17dc4929-090b-4f99-baf4-3052a9a507c5 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 200 len: 1537 microversion: 2.91 time: 0.518963 Oct 12 08:50:37.021633 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 978/1818] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:36 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 1537 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:37.036069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:37.037116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:37.049983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:37.051146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:37.052073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:37.054328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:37.056376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:37.057968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:37.225769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:37.238976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:37.249202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:37.252354 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ca464b84-d849-408a-8498-9cef4622fbc9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1292 microversion: 2.25 time: 0.705831 Oct 12 08:50:37.254504 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 841/1819] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:36 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1292 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:37.267323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4051fd90-2c8d-4176-ac84-ad7938ec04af tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f9848a48a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:37.577891 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4051fd90-2c8d-4176-ac84-ad7938ec04af tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/5b89928c-375c-494f-85e8-654a78bc9dc0" status: 202 len: 0 microversion: 2.1 time: 0.319901 Oct 12 08:50:37.582393 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 842/1820] 10.222.0.40 () {58 vars in 1287 bytes} [Wed Oct 12 08:50:37 2022] DELETE /compute/v2.1/os-security-group-rules/5b89928c-375c-494f-85e8-654a78bc9dc0 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:37.585400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:37.586580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:37.599428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:37.601576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:37.602538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:37.603911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:37.605747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:37.607553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:37.762462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:37.777816 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f55cd145-3ef3-46d8-b61e-482c1d41ab31 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1289 microversion: 2.1 time: 0.197927 Oct 12 08:50:37.779356 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 843/1821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:37 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1289 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:37.787605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e743e018-9185-410f-9b2e-117cacd0c715 req-aa9f61df-c1c5-4ce2-9151-410e5ee2074c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad3031b-2e27-424a-9ec0-6d590834783f", "name": "network-vif-plugged", "status": "completed", "tag": "ce2057b4-bb08-4477-8c3a-c2784285043a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:37.817327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e743e018-9185-410f-9b2e-117cacd0c715 req-aa9f61df-c1c5-4ce2-9151-410e5ee2074c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:37.818312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e743e018-9185-410f-9b2e-117cacd0c715 req-aa9f61df-c1c5-4ce2-9151-410e5ee2074c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:37.819906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e743e018-9185-410f-9b2e-117cacd0c715 req-aa9f61df-c1c5-4ce2-9151-410e5ee2074c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:37.853751 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e743e018-9185-410f-9b2e-117cacd0c715 req-aa9f61df-c1c5-4ce2-9151-410e5ee2074c service nova] Creating event network-vif-plugged:ce2057b4-bb08-4477-8c3a-c2784285043a for instance 8ad3031b-2e27-424a-9ec0-6d590834783f on n-h1-858383-10 Oct 12 08:50:37.874204 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e743e018-9185-410f-9b2e-117cacd0c715 req-aa9f61df-c1c5-4ce2-9151-410e5ee2074c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093233 Oct 12 08:50:37.875977 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 844/1822] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:37.893107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:37.894473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:37.908735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:37.910536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:37.912171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:37.918221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:37.935385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:37.937234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:38.035325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:38.051156 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1efbe9d3-3aba-4ddc-a3cf-a360c6dd4e1e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32" status: 200 len: 1469 microversion: 2.1 time: 1.027385 Oct 12 08:50:38.054117 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 979/1823] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:37 2022] GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 => generated 1469 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:38.063682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0b5595a9-31c9-4934-8ccd-6928101e5cf4 req-19597825-c344-432d-a7c3-a24c39e25db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "name": "network-vif-unplugged", "status": "completed", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:38.096571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0b5595a9-31c9-4934-8ccd-6928101e5cf4 req-19597825-c344-432d-a7c3-a24c39e25db7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:38.097225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0b5595a9-31c9-4934-8ccd-6928101e5cf4 req-19597825-c344-432d-a7c3-a24c39e25db7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:38.099203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0b5595a9-31c9-4934-8ccd-6928101e5cf4 req-19597825-c344-432d-a7c3-a24c39e25db7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:38.146720 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0b5595a9-31c9-4934-8ccd-6928101e5cf4 req-19597825-c344-432d-a7c3-a24c39e25db7 service nova] Creating event network-vif-unplugged:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h2-858383-10 Oct 12 08:50:38.163451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-0b5595a9-31c9-4934-8ccd-6928101e5cf4 req-19597825-c344-432d-a7c3-a24c39e25db7 service nova] Instance e9a4d7be-3a27-416d-956c-16356acc1322 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:50:38.208398 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0b5595a9-31c9-4934-8ccd-6928101e5cf4 req-19597825-c344-432d-a7c3-a24c39e25db7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152397 Oct 12 08:50:38.220377 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 980/1824] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:38.243396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:38.244270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:38.253810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:38.255194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:38.256394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:38.257896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:38.258597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:38.260521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:38.878868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:38.893106 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0e7188a-8cb2-4f9d-b91c-25da99a43133 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1315 microversion: 2.1 time: 0.666681 Oct 12 08:50:38.895517 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 981/1825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:38 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:38.910931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a4717a5-5629-457a-a912-da6ef5515bd5 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f9843fe3d30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:38.988978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:39.002436 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c3a0a97d-7057-462b-9b99-0c389170d779 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1469 microversion: 2.1 time: 1.122812 Oct 12 08:50:39.004862 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 845/1826] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:37 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1469 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:39.020616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:39.021512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] [instance: bcebfe48-986f-41ff-b116-c90382f42b65] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:39.036760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:39.037857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:39.039368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:39.040973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:39.041704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:39.044520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:39.082267 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] HTTP exception thrown: Instance bcebfe48-986f-41ff-b116-c90382f42b65 could not be found. Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Request method failure captured: Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 HTTP/1.1 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn8b9mySoJT9MhMM8_CL-NZwCMFSZcgMlgY-MKT1hruKJ3_TkRnVnCuiiUmt-k9osdCB0d8OKpwuRAkVj9z-j35zIAs3JR7WRtQOEJidvYqE1YS2G-Aid6tyYcKEZIe7oejny0lCT6KDvzFN6yYSPc9cJ4o_g0nJxDoOU3hFJZKrhrs Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.91 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a12dfe3bd7d443e0840df5138f95e661 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-990229045 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a12dfe3bd7d443e0840df5138f95e661"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a12dfe3bd7d443e0840df5138f95e661"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a12dfe3bd7d443e0840df5138f95e661"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a12dfe3bd7d443e0840df5138f95e661"}]}] Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-990229045 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a12dfe3bd7d443e0840df5138f95e661 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-990229045 Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-UnshelveToHostMultiNodesTest-990229045-project Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: a51547fb8a9941d99f7757f2ccdc4eec Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-990229045-project Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance bcebfe48-986f-41ff-b116-c90382f42b65 could not be found. Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'bcebfe48-986f-41ff-b116-c90382f42b65'} Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcebfe48-986f-41ff-b116-c90382f42b65 could not be found. Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcebfe48-986f-41ff-b116-c90382f42b65 could not be found. Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:39.087189 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:39.092783 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:39.092783 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:39.092783 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:39.092783 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:39.092783 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:39.092783 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:39.092783 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcebfe48-986f-41ff-b116-c90382f42b65 could not be found. Oct 12 08:50:39.092783 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:39.098380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] Returning 404 to user: Instance bcebfe48-986f-41ff-b116-c90382f42b65 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:39.099648 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c798f09a-29d1-48af-90ba-bef9db89b522 tempest-UnshelveToHostMultiNodesTest-990229045 tempest-UnshelveToHostMultiNodesTest-990229045-project] 10.222.0.40 "GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65" status: 404 len: 111 microversion: 2.91 time: 0.093444 Oct 12 08:50:39.101078 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 846/1827] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:39 2022] GET /compute/v2.1/servers/bcebfe48-986f-41ff-b116-c90382f42b65 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:50:39.115393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:39.133310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:39.136030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Searching by: {'reservation_id': 'r-yj3858wi', 'deleted': False, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:50:39.156317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:39.157129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:39.157776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:39.160320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:39.161893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:39.165753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:39.414424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:50:39.598796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:39.608080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:39.608697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:39.635062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.231183 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c1739eb3-6783-4df8-b1ec-daed82d760c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-yj3858wi" status: 200 len: 2931 microversion: 2.1 time: 1.127110 Oct 12 08:50:40.232161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 847/1828] 10.222.0.40 () {58 vars in 1197 bytes} [Wed Oct 12 08:50:39 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yj3858wi => generated 2931 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:40.237374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:40.238336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:40.256051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.256550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.257041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.257949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.258602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.259208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.393399 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a4717a5-5629-457a-a912-da6ef5515bd5 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/5f219b27-755c-465e-b3e5-1ad783e10c99" status: 202 len: 0 microversion: 2.1 time: 1.496820 Oct 12 08:50:40.394951 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 982/1829] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:38 2022] DELETE /compute/v2.1/os-security-groups/5f219b27-755c-465e-b3e5-1ad783e10c99 => generated 0 bytes in 1499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:40.400635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:40.401413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:40.408696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.409186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.409657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.410362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.410813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.411389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.545669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:40.554157 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c36462c2-371d-470b-be27-8ab14d69265e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1277 microversion: 2.1 time: 0.157665 Oct 12 08:50:40.555013 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 983/1830] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:40 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:40.561736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:40.562709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:40.570970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.571768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.572544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.573461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.574088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.574515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.889788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:40.902040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:40.904111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:40.906552 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f4024761-9776-4dab-a529-19cb691b910d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 0.672303 Oct 12 08:50:40.907645 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 848/1831] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:40 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:40.911713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:40.925578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:40.935210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.936510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.936741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.936930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:40.937923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.938547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.939180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:40.946224 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8b1ed0cd-215a-4199-b62c-ab97c93e9b32 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1503 microversion: 2.1 time: 0.390017 Oct 12 08:50:40.959662 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 984/1832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:40 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:40.970222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b1cca396-ad8b-44d6-b32e-34b9c4fc5ac6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:40.977924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:40.988514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.server_groups [None req-b1cca396-ad8b-44d6-b32e-34b9c4fc5ac6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Querying cell 0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) for 2 instances {{(pid=127006) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 08:50:40.989304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1cca396-ad8b-44d6-b32e-34b9c4fc5ac6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:40.990005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1cca396-ad8b-44d6-b32e-34b9c4fc5ac6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:40.990611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1cca396-ad8b-44d6-b32e-34b9c4fc5ac6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:41.006297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:41.017966 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b1cca396-ad8b-44d6-b32e-34b9c4fc5ac6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/45536584-24a8-4542-bd40-163f2a9facbc" status: 200 len: 270 microversion: 2.1 time: 0.056505 Oct 12 08:50:41.025414 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 985/1833] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:50:40 2022] GET /compute/v2.1/os-server-groups/45536584-24a8-4542-bd40-163f2a9facbc => generated 270 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:41.033709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3df7b5d6-c44d-453e-8fd2-f417be768290 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f9843fa84c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:41.134081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-3df7b5d6-c44d-453e-8fd2-f417be768290 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f54af25-e765-4df8-a605-62b29a61b110 does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:50:41.134968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-3df7b5d6-c44d-453e-8fd2-f417be768290 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Neutron security group 7f54af25-e765-4df8-a605-62b29a61b110 not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:50:41.136128 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3df7b5d6-c44d-453e-8fd2-f417be768290 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] HTTP exception thrown: Security group 7f54af25-e765-4df8-a605-62b29a61b110 does not exist Oct 12 08:50:41.136128 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-6e16c1d2-df98-4309-8941-6e50e210a379'] Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3df7b5d6-c44d-453e-8fd2-f417be768290 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Request method failure captured: Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-security-groups/7f54af25-e765-4df8-a605-62b29a61b110 HTTP/1.1 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn_B4B3VZdWwgKARdQoJWiNLTGUI5L4pvd97Rm0VDnF90bX4Q0Ar9XHzS5LuWEbP5sTOdrTdjU0qlh790zP5V8rpJ3fE8UP2iQ_l4EIVXSZhhFhXp600nPtCY8xSt4nEDx2eN4InK4Hch-vhvsHpkIHRJudRZ0F1u9wubLum3w1KJr0 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1cb03cee39f24e5b998cc915ca7ff376 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1249528194 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb03cee39f24e5b998cc915ca7ff376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1cb03cee39f24e5b998cc915ca7ff376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1cb03cee39f24e5b998cc915ca7ff376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1cb03cee39f24e5b998cc915ca7ff376"}]}] Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1249528194 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1cb03cee39f24e5b998cc915ca7ff376 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1249528194 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupRulesTestJSON-1249528194-project Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: eaed46df82864d778293b3134beae33b Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1249528194-project Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group 7f54af25-e765-4df8-a605-62b29a61b110 does not exist Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-6e16c1d2-df98-4309-8941-6e50e210a379'] Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7f54af25-e765-4df8-a605-62b29a61b110'} Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:50:41.161461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f54af25-e765-4df8-a605-62b29a61b110 does not exist Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e16c1d2-df98-4309-8941-6e50e210a379'] Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f54af25-e765-4df8-a605-62b29a61b110 does not exist Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e16c1d2-df98-4309-8941-6e50e210a379'] Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f54af25-e765-4df8-a605-62b29a61b110 does not exist Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e16c1d2-df98-4309-8941-6e50e210a379'] Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f54af25-e765-4df8-a605-62b29a61b110 does not exist Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e16c1d2-df98-4309-8941-6e50e210a379'] Oct 12 08:50:41.165777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:41.173845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3df7b5d6-c44d-453e-8fd2-f417be768290 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Returning 404 to user: Security group 7f54af25-e765-4df8-a605-62b29a61b110 does not exist Oct 12 08:50:41.173845 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-6e16c1d2-df98-4309-8941-6e50e210a379'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:41.174872 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3df7b5d6-c44d-453e-8fd2-f417be768290 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/7f54af25-e765-4df8-a605-62b29a61b110" status: 404 len: 194 microversion: 2.1 time: 0.147470 Oct 12 08:50:41.176004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 986/1834] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:41 2022] DELETE /compute/v2.1/os-security-groups/7f54af25-e765-4df8-a605-62b29a61b110 => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:41.182082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5b1e6c14-e47d-49ea-b0d5-673453133080 req-1e25b452-81e0-47a6-8d76-f24bece2a63b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:41.195276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5b1e6c14-e47d-49ea-b0d5-673453133080 req-1e25b452-81e0-47a6-8d76-f24bece2a63b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:41.196018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5b1e6c14-e47d-49ea-b0d5-673453133080 req-1e25b452-81e0-47a6-8d76-f24bece2a63b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:41.197415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5b1e6c14-e47d-49ea-b0d5-673453133080 req-1e25b452-81e0-47a6-8d76-f24bece2a63b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:41.220003 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5b1e6c14-e47d-49ea-b0d5-673453133080 req-1e25b452-81e0-47a6-8d76-f24bece2a63b service nova] Creating event network-changed:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h2-858383-10 Oct 12 08:50:41.228391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:41.230505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-5b1e6c14-e47d-49ea-b0d5-673453133080 req-1e25b452-81e0-47a6-8d76-f24bece2a63b service nova] Instance e9a4d7be-3a27-416d-956c-16356acc1322 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 08:50:41.240992 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c9aa939a-045c-4d39-9338-7bc0ee5ebf80 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1469 microversion: 2.1 time: 0.332702 Oct 12 08:50:41.255562 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 849/1835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:40 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:41.261504 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5b1e6c14-e47d-49ea-b0d5-673453133080 req-1e25b452-81e0-47a6-8d76-f24bece2a63b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081323 Oct 12 08:50:41.263710 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 987/1836] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:41.270356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1575692403"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:41.271220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:41.272303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:41.273887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:41.279458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:41.281580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:41.282381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:41.282693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:41.283325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:41.283654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:41.284045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:41.284463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:41.284966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:41.285229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:41.285808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:41.286384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:41.471893 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.network.security_group_api [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Adding security group 9247390a-1fb4-4fd3-921d-830565eee933 to port ce2057b4-bb08-4477-8c3a-c2784285043a Oct 12 08:50:41.782297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d6b24b8-fccc-496d-b72d-7709c996dbf4 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32" status: 200 len: 1622 microversion: 2.1 time: 0.516852 Oct 12 08:50:41.783218 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 988/1837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:41 2022] GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 => generated 1622 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:41.791438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-58ba8003-2bbc-460b-b70d-f3d628bdd317 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f984803cee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:42.168717 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-778f0c0b-bf09-4e94-aa8e-32c9d9505316 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f/action" status: 202 len: 0 microversion: 2.1 time: 0.909591 Oct 12 08:50:42.169731 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 850/1838] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:50:41 2022] POST /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f/action => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:42.182598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:42.186378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:42.205757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:42.206443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:42.207169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:42.208120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:42.208873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:42.209676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:42.633251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:42.661527 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-667f9f69-0e71-4cc6-9aa9-8885204cbff3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1319 microversion: 2.1 time: 0.486158 Oct 12 08:50:42.688191 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 851/1839] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:42 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:42.705563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:42.706719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:42.748699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:42.749609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:42.752015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:42.754981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:42.757137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:42.758008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:42.918846 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-58ba8003-2bbc-460b-b70d-f3d628bdd317 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/95816c3e-336a-4060-bc81-2a84458e921d" status: 202 len: 0 microversion: 2.1 time: 1.133297 Oct 12 08:50:42.919433 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 989/1840] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:41 2022] DELETE /compute/v2.1/os-security-groups/95816c3e-336a-4060-bc81-2a84458e921d => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:42.925946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:42.926776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:42.941150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:42.942028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:42.944140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:42.945073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:42.946181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:42.948256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:43.120915 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-99375766-18f5-460f-8a44-8057d8b2c909 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1622 microversion: 2.1 time: 0.430331 Oct 12 08:50:43.122792 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 852/1841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:42 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1622 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:43.128975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-998202611"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:43.129836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:43.136868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:43.140956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:43.144755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:43.145856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:43.146549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:43.147149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:43.495392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:43.504913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:43.506726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:43.508088 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4fe2269-9aee-4fe5-a1b0-148d896f38ce tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 0.587558 Oct 12 08:50:43.509171 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 990/1842] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:42 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:43.529882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:43.530198 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.network.security_group_api [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Adding security group f7b5f0a5-99d1-4793-a0c7-092d6de6abd6 to port ce2057b4-bb08-4477-8c3a-c2784285043a Oct 12 08:50:43.530495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:43.538942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:43.539428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:43.539860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:43.540558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:43.541947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:43.544797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:43.905486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:43.915504 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-10664322-ba6e-4607-a593-a22e17145433 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1462 microversion: 2.1 time: 0.404387 Oct 12 08:50:43.916729 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 991/1843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:43 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1462 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:43.921721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-df29cfd7-081c-4ded-98eb-0c46b1db9c77 req-935c8083-b46b-4e0c-9ebe-c5ce017efc30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e897a6-516b-4eda-8d1d-4d9a3a21858c", "tag": "232f5860-2aec-420d-b401-3114769ac385"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:43.933913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df29cfd7-081c-4ded-98eb-0c46b1db9c77 req-935c8083-b46b-4e0c-9ebe-c5ce017efc30 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:43.934959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df29cfd7-081c-4ded-98eb-0c46b1db9c77 req-935c8083-b46b-4e0c-9ebe-c5ce017efc30 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:43.935560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df29cfd7-081c-4ded-98eb-0c46b1db9c77 req-935c8083-b46b-4e0c-9ebe-c5ce017efc30 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:43.952568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-df29cfd7-081c-4ded-98eb-0c46b1db9c77 req-935c8083-b46b-4e0c-9ebe-c5ce017efc30 service nova] Creating event network-changed:232f5860-2aec-420d-b401-3114769ac385 for instance 74e897a6-516b-4eda-8d1d-4d9a3a21858c on n-h2-858383-10 Oct 12 08:50:43.960483 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-df29cfd7-081c-4ded-98eb-0c46b1db9c77 req-935c8083-b46b-4e0c-9ebe-c5ce017efc30 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042005 Oct 12 08:50:43.963367 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 992/1844] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:43.972404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73cc0a29-4efc-40f6-9024-2afda2efccce tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f984803c4c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:44.162510 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d251dc29-6328-4790-b137-2680ebf8f3b3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f/action" status: 202 len: 0 microversion: 2.1 time: 1.038005 Oct 12 08:50:44.163331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 853/1845] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:50:43 2022] POST /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f/action => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:44.170533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2087488073", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8519af08-ba91-4304-a23c-97cdf484974c"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:44.262153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:44.286780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:50:44.516637 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73cc0a29-4efc-40f6-9024-2afda2efccce tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/b9e9037b-eda0-4aa4-9a0b-d15b4a2caecd" status: 202 len: 0 microversion: 2.1 time: 0.551765 Oct 12 08:50:44.520427 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 993/1846] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:43 2022] DELETE /compute/v2.1/os-security-groups/b9e9037b-eda0-4aa4-9a0b-d15b4a2caecd => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:44.532231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d229a2b8-e733-4cfd-834d-af3b2007464b req-ffcaaea0-4cdb-4365-97b1-d37a18535c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad3031b-2e27-424a-9ec0-6d590834783f", "tag": "ce2057b4-bb08-4477-8c3a-c2784285043a"}, {"name": "network-changed", "server_uuid": "6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8", "tag": "7e40513e-c5d3-4ab8-ac88-3adaf445553c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:44.586830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d229a2b8-e733-4cfd-834d-af3b2007464b req-ffcaaea0-4cdb-4365-97b1-d37a18535c50 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:44.589646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d229a2b8-e733-4cfd-834d-af3b2007464b req-ffcaaea0-4cdb-4365-97b1-d37a18535c50 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:44.590963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d229a2b8-e733-4cfd-834d-af3b2007464b req-ffcaaea0-4cdb-4365-97b1-d37a18535c50 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:44.622958 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d229a2b8-e733-4cfd-834d-af3b2007464b req-ffcaaea0-4cdb-4365-97b1-d37a18535c50 service nova] Creating event network-changed:ce2057b4-bb08-4477-8c3a-c2784285043a for instance 8ad3031b-2e27-424a-9ec0-6d590834783f on n-h1-858383-10 Oct 12 08:50:44.630899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:50:44.631684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:50:44.632189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:50:44.632813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:50:44.633242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:50:44.640698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d229a2b8-e733-4cfd-834d-af3b2007464b req-ffcaaea0-4cdb-4365-97b1-d37a18535c50 service nova] Creating event network-changed:7e40513e-c5d3-4ab8-ac88-3adaf445553c for instance 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 on n-h1-858383-10 Oct 12 08:50:44.648881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:44.649395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:44.649856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:44.650585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:44.651040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:44.651465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:44.665233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d229a2b8-e733-4cfd-834d-af3b2007464b req-ffcaaea0-4cdb-4365-97b1-d37a18535c50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.144592 Oct 12 08:50:44.667449 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 994/1847] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:44.679477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:44.680321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:44.689973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:44.690748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:44.691233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:44.691666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:44.694568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:44.701504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:44.702188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:44.702654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:44.706476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:50:44.709070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:50:44.758392 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cfd6b896-93bf-4f12-ae4b-78ec26d2bd3c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593907 Oct 12 08:50:44.759764 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 854/1848] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:50:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:50:45.126819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:45.127730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:45.140109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:45.141055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:45.141929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:45.144416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:45.145137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:45.149245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:45.374185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:45.406893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7888a8d2-7df7-4e59-beb6-71e01eb33437 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1319 microversion: 2.1 time: 0.735394 Oct 12 08:50:45.407716 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 995/1849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:44 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1319 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:45.426319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:45.428239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:45.448047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:45.450347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:45.451675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:45.455618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:45.456347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:45.457094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:45.514536 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-055ddb75-08c6-4839-9be9-b212f3ded771 tempest-MigrationsAdminTest-241151849 tempest-MigrationsAdminTest-241151849-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1615 microversion: 2.1 time: 0.752187 Oct 12 08:50:45.531496 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 855/1850] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:44 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1615 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:45.550115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b639b0fa-0ff7-4ada-b054-c58967e33615 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f98489ef670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:45.918909 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b639b0fa-0ff7-4ada-b054-c58967e33615 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/737c0fe5-0bba-4ea2-a2ce-7bfbdeefcc1d" status: 202 len: 0 microversion: 2.1 time: 0.383984 Oct 12 08:50:45.919845 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 856/1851] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:45 2022] DELETE /compute/v2.1/os-security-groups/737c0fe5-0bba-4ea2-a2ce-7bfbdeefcc1d => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:45.925504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:45.926544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:45.942367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:45.943618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:45.945040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:45.946307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:45.947678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:45.948620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:46.039899 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f2a53860-c9dd-49b5-87dc-933989159e24 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.629484 Oct 12 08:50:46.040786 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 996/1852] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 12 08:50:45 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f/os-security-groups => generated 1156 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:46.049727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:46.054336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:46.062937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:46.063822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:46.064517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:46.065497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:46.066178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:46.066827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:46.135524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:46.149233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:46.150746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:46.152130 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b4e29102-8d7d-4ade-9fb2-274627160236 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 0.231163 Oct 12 08:50:46.154447 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 857/1853] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:45 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:46.165028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:46.165781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:46.172187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:46.172679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:46.173113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:46.174039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:46.174659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:46.175266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:46.188618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:46.198760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-812d0b38-993d-4721-99c9-0dc52f7c833c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1221 microversion: 2.1 time: 0.156328 Oct 12 08:50:46.199509 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 997/1854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:46 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1221 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:46.205785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:50:46.206593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8eaae0d2-1a77-4d42-9432-ec1d45053906 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f984803c1f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:46.351247 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-19254f04-d635-4be9-947c-92a15af7deca tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 204 len: 0 microversion: 2.1 time: 0.191141 Oct 12 08:50:46.352236 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 858/1855] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:50:46 2022] DELETE /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:50:46.584526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-67238b40-ab73-40fd-a49d-07bf0869bea0 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:46.590353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67238b40-ab73-40fd-a49d-07bf0869bea0 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:46.592138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67238b40-ab73-40fd-a49d-07bf0869bea0 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:46.592807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67238b40-ab73-40fd-a49d-07bf0869bea0 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:46.594886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67238b40-ab73-40fd-a49d-07bf0869bea0 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:46.595817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67238b40-ab73-40fd-a49d-07bf0869bea0 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:46.596775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67238b40-ab73-40fd-a49d-07bf0869bea0 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:46.616508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:46.635142 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-67238b40-ab73-40fd-a49d-07bf0869bea0 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.281357 Oct 12 08:50:46.636043 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 859/1856] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:50:46 2022] GET /compute/v2.1/os-services => generated 949 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:46.642243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-41969c2a-5d6e-4882-8460-a95fa159a5e5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f9848c0eb80>, body: {"security_group": {"name": " tempest-securitygroup -1799891203 ", "description": "tempest-description-618989653"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:46.781383 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8eaae0d2-1a77-4d42-9432-ec1d45053906 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/4e417cdc-829d-40e6-aa39-a25630434aa3" status: 202 len: 0 microversion: 2.1 time: 0.580213 Oct 12 08:50:46.782600 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 998/1857] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:46 2022] DELETE /compute/v2.1/os-security-groups/4e417cdc-829d-40e6-aa39-a25630434aa3 => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:46.789686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:46.790600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:46.798711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:46.800254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:46.802119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:46.803317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:46.804547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:46.805339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:47.053185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:47.061833 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d87c4802-19cb-4c0b-8cd9-48cab170a8df tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1468 microversion: 2.1 time: 0.277979 Oct 12 08:50:47.066305 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 999/1858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:46 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1468 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:47.072286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:47.073124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:47.080310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:47.081022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:47.087463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:47.089696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:47.090187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:47.090634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:47.419292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:47.431895 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b512a234-a7fe-435b-94e7-d78420b95871 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1319 microversion: 2.1 time: 0.363291 Oct 12 08:50:47.432499 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1000/1859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:47 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:47.450986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eddfd2f1-71be-4df5-84dc-567391bdea28 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:47.456883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eddfd2f1-71be-4df5-84dc-567391bdea28 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:47.463570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eddfd2f1-71be-4df5-84dc-567391bdea28 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:47.466125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eddfd2f1-71be-4df5-84dc-567391bdea28 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:47.472501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eddfd2f1-71be-4df5-84dc-567391bdea28 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:47.474066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eddfd2f1-71be-4df5-84dc-567391bdea28 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:47.474764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eddfd2f1-71be-4df5-84dc-567391bdea28 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:47.516220 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eddfd2f1-71be-4df5-84dc-567391bdea28 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-858383-10" status: 200 len: 581 microversion: 2.1 time: 0.078144 Oct 12 08:50:47.516953 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1001/1860] 10.222.0.40 () {58 vars in 1174 bytes} [Wed Oct 12 08:50:47 2022] GET /compute/v2.1/os-services?host=n-d-858383-10 => generated 581 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:47.524744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80b4b970-028a-4b43-abb1-4982334d74b0 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] Calling method '.version_select at 0x7f984805f940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:47.545886 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-41969c2a-5d6e-4882-8460-a95fa159a5e5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.907998 Oct 12 08:50:47.546744 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 860/1861] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:46 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:47.552613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9255666d-d8d1-445e-be4f-94c5a9004735 req-54400073-6e82-40df-bf03-cea97f1f7020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad3031b-2e27-424a-9ec0-6d590834783f", "tag": "ce2057b4-bb08-4477-8c3a-c2784285043a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:47.563727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9255666d-d8d1-445e-be4f-94c5a9004735 req-54400073-6e82-40df-bf03-cea97f1f7020 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:47.564389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9255666d-d8d1-445e-be4f-94c5a9004735 req-54400073-6e82-40df-bf03-cea97f1f7020 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:47.564993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9255666d-d8d1-445e-be4f-94c5a9004735 req-54400073-6e82-40df-bf03-cea97f1f7020 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:47.581965 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9255666d-d8d1-445e-be4f-94c5a9004735 req-54400073-6e82-40df-bf03-cea97f1f7020 service nova] Creating event network-changed:ce2057b4-bb08-4477-8c3a-c2784285043a for instance 8ad3031b-2e27-424a-9ec0-6d590834783f on n-h1-858383-10 Oct 12 08:50:47.588583 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9255666d-d8d1-445e-be4f-94c5a9004735 req-54400073-6e82-40df-bf03-cea97f1f7020 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040566 Oct 12 08:50:47.589683 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 861/1862] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:47.595137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:47.596075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:47.615916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:47.618598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:47.619347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:47.620262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:47.620720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:47.621145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:48.355496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:48.362442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:48.369946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:48.372319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:48.377552 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e747119c-2d3f-4a9e-823d-01e3587782f5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 0.782485 Oct 12 08:50:48.378331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 862/1863] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:47 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:48.402563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:48.403621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:48.411549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:48.412655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:48.413423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:48.414384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:48.414997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:48.415825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:48.473995 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80b4b970-028a-4b43-abb1-4982334d74b0 tempest-SecurityGroupRulesTestJSON-1249528194 tempest-SecurityGroupRulesTestJSON-1249528194-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/c2f297d1-46ed-4ec4-ab13-69932906382c" status: 202 len: 0 microversion: 2.1 time: 0.955348 Oct 12 08:50:48.475813 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1002/1864] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:47 2022] DELETE /compute/v2.1/os-security-groups/c2f297d1-46ed-4ec4-ab13-69932906382c => generated 0 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:48.482234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-12779af8-d2bc-471c-89fe-9f8236b60816 req-69a6f8ae-2514-4367-97f6-242ab97c523f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "name": "network-vif-plugged", "status": "completed", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:48.507430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12779af8-d2bc-471c-89fe-9f8236b60816 req-69a6f8ae-2514-4367-97f6-242ab97c523f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:48.510883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12779af8-d2bc-471c-89fe-9f8236b60816 req-69a6f8ae-2514-4367-97f6-242ab97c523f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:48.519181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12779af8-d2bc-471c-89fe-9f8236b60816 req-69a6f8ae-2514-4367-97f6-242ab97c523f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:48.539073 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-12779af8-d2bc-471c-89fe-9f8236b60816 req-69a6f8ae-2514-4367-97f6-242ab97c523f service nova] Creating event network-vif-plugged:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h2-858383-10 Oct 12 08:50:48.551583 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-12779af8-d2bc-471c-89fe-9f8236b60816 req-69a6f8ae-2514-4367-97f6-242ab97c523f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071962 Oct 12 08:50:48.552557 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1003/1865] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:48.567661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b39f09a-05dc-4c07-b47e-68a6654cb338 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:48.576411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b39f09a-05dc-4c07-b47e-68a6654cb338 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:48.577342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b39f09a-05dc-4c07-b47e-68a6654cb338 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:48.577981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b39f09a-05dc-4c07-b47e-68a6654cb338 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:48.579020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b39f09a-05dc-4c07-b47e-68a6654cb338 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:48.579957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b39f09a-05dc-4c07-b47e-68a6654cb338 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:48.581311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b39f09a-05dc-4c07-b47e-68a6654cb338 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:48.616331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:48.626439 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1f9419c0-f3e3-4037-9448-5a1d61497e88 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1275 microversion: 2.1 time: 0.229602 Oct 12 08:50:48.634317 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 863/1866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:48 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:48.654330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1770e39c-279f-4c57-91e9-d8a7bc6109c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f98489e1af0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:48.682476 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9b39f09a-05dc-4c07-b47e-68a6654cb338 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.125617 Oct 12 08:50:48.697846 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1004/1867] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 08:50:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:48.703054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:48.703796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:48.720062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:48.720572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:48.721011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:48.721770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:48.722223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:48.725050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:49.207524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:49.225387 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4daf9a2f-24c2-4baa-a9a9-df38b49c5d13 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1468 microversion: 2.1 time: 0.524011 Oct 12 08:50:49.228969 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1005/1868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:48 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1468 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:49.249121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:49.249771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:49.262500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:49.264672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:49.266365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:49.267494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:49.270581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:49.271311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:49.403904 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1770e39c-279f-4c57-91e9-d8a7bc6109c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da" status: 200 len: 223 microversion: 2.1 time: 0.766447 Oct 12 08:50:49.405034 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 864/1869] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:50:48 2022] GET /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da => generated 223 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:49.410673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c28311c-777f-4d2d-bf06-c5f5a5458440 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:49.417885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c28311c-777f-4d2d-bf06-c5f5a5458440 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:49.422010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c28311c-777f-4d2d-bf06-c5f5a5458440 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:49.424920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c28311c-777f-4d2d-bf06-c5f5a5458440 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:49.430384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c28311c-777f-4d2d-bf06-c5f5a5458440 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:49.431380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c28311c-777f-4d2d-bf06-c5f5a5458440 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:49.432059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c28311c-777f-4d2d-bf06-c5f5a5458440 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:49.503857 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c28311c-777f-4d2d-bf06-c5f5a5458440 tempest-ServicesAdminTestJSON-148134721 tempest-ServicesAdminTestJSON-148134721-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.087122 Oct 12 08:50:49.513109 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 865/1870] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:50:49 2022] GET /compute/v2.1/os-services => generated 949 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:49.513109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:49.513109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:49.530250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:49.530930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:49.531480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:49.534463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:49.535396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:49.542019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:49.608117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:49.618691 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29b79ba6-9e16-48ed-a6f7-91b09be98b6a tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1319 microversion: 2.1 time: 0.385343 Oct 12 08:50:49.625815 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1006/1871] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:49 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:49.639771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b6a36715-ce77-49b4-9f3b-79a0af483f94 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9843fa81f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:50.590410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:50.615537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:50.618129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:50.619590 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-acb3e769-3045-44e0-a7e1-79365b621b20 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 1.112890 Oct 12 08:50:50.638264 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 866/1872] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:49 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:50.643751 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b6a36715-ce77-49b4-9f3b-79a0af483f94 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da" status: 202 len: 0 microversion: 2.1 time: 1.015900 Oct 12 08:50:50.645077 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1007/1873] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:49 2022] DELETE /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:50.651660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:50.652492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:50.657827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:50.659790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:50.659951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:50.664639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:50.665331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:50.666331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:50.666996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:50.667660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:50.678472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:50.680362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:50.681227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:50.682835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:50.685058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:50.686166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:50.812482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:50.824837 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c975ae9f-4a4b-4716-9e93-b0bcea42ad84 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 200 len: 1426 microversion: 2.1 time: 0.176092 Oct 12 08:50:50.827139 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1008/1874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:50 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 1426 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:50.847319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:50.849677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:50.867597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:50.868381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:50.869003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:50.870120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:50.870750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:50.873195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:51.258824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:51.271663 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-148858a5-a6a3-40e8-9371-54df81ab7f3a tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1317 microversion: 2.1 time: 0.632178 Oct 12 08:50:51.272594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 867/1875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:50 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:51.291062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b6a0008-bf5a-4ce7-87df-3f619d6b5a12 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848ad7a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:51.394251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-0b6a0008-bf5a-4ce7-87df-3f619d6b5a12 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:50:51.395133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.security_group_api [None req-0b6a0008-bf5a-4ce7-87df-3f619d6b5a12 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group f0cab814-b4d8-40e8-ac64-f9daeb2516da not found {{(pid=127007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:50:51.395906 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-0b6a0008-bf5a-4ce7-87df-3f619d6b5a12 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:50:51.395906 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-3de98859-453d-4621-bc77-c0f41fe610bb'] Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b6a0008-bf5a-4ce7-87df-3f619d6b5a12 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da HTTP/1.1 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: exception: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-3de98859-453d-4621-bc77-c0f41fe610bb'] Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f0cab814-b4d8-40e8-ac64-f9daeb2516da'} Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:50:51.399872 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3de98859-453d-4621-bc77-c0f41fe610bb'] Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3de98859-453d-4621-bc77-c0f41fe610bb'] Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3de98859-453d-4621-bc77-c0f41fe610bb'] Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3de98859-453d-4621-bc77-c0f41fe610bb'] Oct 12 08:50:51.404107 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.413349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b6a0008-bf5a-4ce7-87df-3f619d6b5a12 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:50:51.413349 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-3de98859-453d-4621-bc77-c0f41fe610bb'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:51.414682 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b6a0008-bf5a-4ce7-87df-3f619d6b5a12 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da" status: 404 len: 194 microversion: 2.1 time: 0.140988 Oct 12 08:50:51.415714 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 868/1876] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:50:51 2022] GET /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:51.427294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e5bece38-e65c-42b8-8533-113f462783e8 req-816fd19f-d651-4cbe-b16c-2d1263ec6f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a4d7be-3a27-416d-956c-16356acc1322", "name": "network-vif-deleted", "tag": "7757fc9f-e0b3-4820-88aa-235b54cba135"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:51.458163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e5bece38-e65c-42b8-8533-113f462783e8 req-816fd19f-d651-4cbe-b16c-2d1263ec6f18 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:51.459967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e5bece38-e65c-42b8-8533-113f462783e8 req-816fd19f-d651-4cbe-b16c-2d1263ec6f18 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:51.463885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e5bece38-e65c-42b8-8533-113f462783e8 req-816fd19f-d651-4cbe-b16c-2d1263ec6f18 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:51.491849 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e5bece38-e65c-42b8-8533-113f462783e8 req-816fd19f-d651-4cbe-b16c-2d1263ec6f18 service nova] Creating event network-vif-deleted:7757fc9f-e0b3-4820-88aa-235b54cba135 for instance e9a4d7be-3a27-416d-956c-16356acc1322 on n-h2-858383-10 Oct 12 08:50:51.506880 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e5bece38-e65c-42b8-8533-113f462783e8 req-816fd19f-d651-4cbe-b16c-2d1263ec6f18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084163 Oct 12 08:50:51.509563 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 869/1877] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:51.523322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6dcae428-03ed-4a21-883d-f79cd2c27fc9 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f9848afe670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1580890026", "description": "tempest-description-1507064690"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:51.690873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:51.702173 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d65fa75f-2fb6-4e03-94d8-1eb77e3001a9 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1319 microversion: 2.1 time: 0.873622 Oct 12 08:50:51.703231 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1009/1878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:50 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1319 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:51.710797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:51.711844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:51.719922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:51.720739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:51.722046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:51.725809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:51.726662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:51.727347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:51.883237 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6dcae428-03ed-4a21-883d-f79cd2c27fc9 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.371252 Oct 12 08:50:51.885013 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 870/1879] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:51 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:51.891458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:51.892647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: e9a4d7be-3a27-416d-956c-16356acc1322] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:51.901488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:51.902154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:51.902748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:51.903831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:51.904441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:51.906456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:51.958703 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] HTTP exception thrown: Instance e9a4d7be-3a27-416d-956c-16356acc1322 could not be found. Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Request method failure captured: Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 HTTP/1.1 Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6E3zx6C1aAbPTOjfhvojTzNFdlhUfVsbRFTy9maVCBN7Sa-AkJzrSpi4fkOnjxjkRJCU9aFc055ydHjQt0VP74Ju_9uojuCk0-I8KdnYerQDQIcDRrZmtWafl-CABIQNXVTqp5ZTLr-GtQ9CcgSVBfMsKG3M5z0u7WuJEPBWhhSLI Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 94a0f8d18f724f789b822a70fc97797a Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-MigrationsAdminTest-918826596 Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/94a0f8d18f724f789b822a70fc97797a"}]}] Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-MigrationsAdminTest-918826596 Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 94a0f8d18f724f789b822a70fc97797a Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-MigrationsAdminTest-918826596 Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-MigrationsAdminTest-918826596-project Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5631063704964af4a1d7780077789e48 Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-MigrationsAdminTest-918826596-project Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e9a4d7be-3a27-416d-956c-16356acc1322 could not be found. Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e9a4d7be-3a27-416d-956c-16356acc1322'} Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a4d7be-3a27-416d-956c-16356acc1322 could not be found. Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a4d7be-3a27-416d-956c-16356acc1322 could not be found. Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:51.962924 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.971299 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:51.971299 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:51.971299 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:51.971299 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:51.971299 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:51.971299 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a4d7be-3a27-416d-956c-16356acc1322 could not be found. Oct 12 08:50:51.971299 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:51.986580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Returning 404 to user: Instance e9a4d7be-3a27-416d-956c-16356acc1322 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:51.988978 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82a1f31b-a940-4713-a5cb-f7142d1ec753 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322" status: 404 len: 111 microversion: 2.1 time: 0.102731 Oct 12 08:50:51.995290 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 871/1880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:51 2022] GET /compute/v2.1/servers/e9a4d7be-3a27-416d-956c-16356acc1322 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:52.006726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-befaf1d6-1c43-4492-8589-b66be45a9ea3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f9848ba4ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1312729040", "description": "tempest-description-1389771269"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:52.059083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:52.073266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:52.078351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:52.082570 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ffaf0e4-ae6f-458c-8d19-9f15ee7d2973 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 0.375245 Oct 12 08:50:52.084654 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1010/1881] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:51 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:52.095773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:52.096721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:52.104353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.105086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.106095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:52.107196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.107810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.108389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:52.140366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:50:52.171527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:52.316863 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-742d007d-2b58-4917-9116-06c747e0684a tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 204 len: 0 microversion: 2.1 time: 0.227503 Oct 12 08:50:52.319500 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1011/1882] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:50:52 2022] DELETE /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:50:52.336166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:52.336917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:52.351770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.352499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.354021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:52.356600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.359333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.361571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:52.489007 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-befaf1d6-1c43-4492-8589-b66be45a9ea3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.491085 Oct 12 08:50:52.490373 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 872/1883] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:51 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:52.495624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:52.496439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:52.510087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.525494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.525968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:52.528715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.529240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.529719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:52.792118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:52.805037 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-838c8bb3-a934-4d28-b8ec-e332b31dd1ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1534 microversion: 2.1 time: 0.312923 Oct 12 08:50:52.805848 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 873/1884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:52 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1534 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:52.813767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-85ee2fc4-a73f-4c3c-a0dd-e192462195f4 req-b5cc36a1-5661-4527-abe0-b3c00105c46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68d4300-929d-46de-bb5e-4010c2d60be3", "tag": "d04f2e52-f07c-4667-82e2-c9b8d1f82d6a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:52.829696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-85ee2fc4-a73f-4c3c-a0dd-e192462195f4 req-b5cc36a1-5661-4527-abe0-b3c00105c46c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.830500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-85ee2fc4-a73f-4c3c-a0dd-e192462195f4 req-b5cc36a1-5661-4527-abe0-b3c00105c46c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.831161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-85ee2fc4-a73f-4c3c-a0dd-e192462195f4 req-b5cc36a1-5661-4527-abe0-b3c00105c46c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:52.866418 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-85ee2fc4-a73f-4c3c-a0dd-e192462195f4 req-b5cc36a1-5661-4527-abe0-b3c00105c46c service nova] Creating event network-changed:d04f2e52-f07c-4667-82e2-c9b8d1f82d6a for instance f68d4300-929d-46de-bb5e-4010c2d60be3 on n-h1-858383-10 Oct 12 08:50:52.882265 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-85ee2fc4-a73f-4c3c-a0dd-e192462195f4 req-b5cc36a1-5661-4527-abe0-b3c00105c46c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073767 Oct 12 08:50:52.884943 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 874/1885] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:52.898502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bd87fa9-7529-428e-91e0-d93b184096d9 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f9848afed30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-383534134", "description": "tempest-description-548936666"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:52.915884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:52.928252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fccefc38-b3ce-4e40-a6ad-72440363847f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1317 microversion: 2.1 time: 0.606964 Oct 12 08:50:52.929325 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1012/1886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:52 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1317 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:52.934559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:52.935462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:52.944967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.945512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.945961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:52.946672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:52.947119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:52.948180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:53.113910 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8bd87fa9-7529-428e-91e0-d93b184096d9 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.224351 Oct 12 08:50:53.114902 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 875/1887] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:52 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:53.122519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:53.125630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:53.135270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:53.136109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:53.136944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:53.138640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:53.139474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:53.139916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:53.291451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:53.301110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:53.302598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:53.303813 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0363ad4e-4102-456e-9055-309d1e813d4c tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 0.187645 Oct 12 08:50:53.304380 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 876/1888] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:53 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:53.309306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e497048-5bb8-4b28-b394-65456e972700 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848a53c10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:53.568960 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e497048-5bb8-4b28-b394-65456e972700 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.263125 Oct 12 08:50:53.569764 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 877/1889] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:50:53 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:53.574879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4cd98e0e-118e-4b58-bf24-827455512968 req-b6ec150f-0565-46d6-b878-34746f791735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f1fe07-9eb6-4da6-8b88-0c4df059868e", "name": "network-vif-plugged", "status": "completed", "tag": "163ca692-7dfb-4edc-81ef-916821ba1cbc"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:53.593517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4cd98e0e-118e-4b58-bf24-827455512968 req-b6ec150f-0565-46d6-b878-34746f791735 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:53.594004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4cd98e0e-118e-4b58-bf24-827455512968 req-b6ec150f-0565-46d6-b878-34746f791735 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:53.595670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4cd98e0e-118e-4b58-bf24-827455512968 req-b6ec150f-0565-46d6-b878-34746f791735 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:53.610241 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4cd98e0e-118e-4b58-bf24-827455512968 req-b6ec150f-0565-46d6-b878-34746f791735 service nova] Creating event network-vif-plugged:163ca692-7dfb-4edc-81ef-916821ba1cbc for instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e on n-h1-858383-10 Oct 12 08:50:53.617155 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4cd98e0e-118e-4b58-bf24-827455512968 req-b6ec150f-0565-46d6-b878-34746f791735 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045166 Oct 12 08:50:53.618242 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 878/1890] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:53.625565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4c385aa1-81fe-4ea0-b59f-19db38008474 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848ad7430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:53.904101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:53.919845 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b7f1ee0-8759-4820-b703-b06a7a0f2a97 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1319 microversion: 2.1 time: 0.989049 Oct 12 08:50:53.938166 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1013/1891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:52 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1319 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:53.951495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:53.953105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:53.968486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:53.970778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:53.972537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:53.974381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:53.974856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:53.979868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:54.474448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:54.491885 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14390efc-3730-413a-8674-b8bd67f87631 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1534 microversion: 2.1 time: 0.551085 Oct 12 08:50:54.493798 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1014/1892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:53 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1534 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:54.506346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:54.508543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:54.519691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:54.520551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:54.521192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:54.522321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:54.523607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:54.524277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:54.703975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=14 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:54.817175 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4c385aa1-81fe-4ea0-b59f-19db38008474 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/52691548-8860-4de5-822b-b4724a04ecdd" status: 202 len: 0 microversion: 2.1 time: 1.197474 Oct 12 08:50:54.818332 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 879/1893] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:53 2022] DELETE /compute/v2.1/os-security-groups/52691548-8860-4de5-822b-b4724a04ecdd => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:54.824955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:54.826606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:54.859909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:54.859909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:54.859909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:54.860894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:54.861410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:54.864163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:54.970999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:54.981757 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-03b567c0-89ca-447a-b1f6-47376309495f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1317 microversion: 2.1 time: 0.482103 Oct 12 08:50:54.982399 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1015/1894] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:54 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:54.989746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-606b6f51-41f4-4eaf-a9a8-45dab13c0e52 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9843fe9160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:55.060670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-606b6f51-41f4-4eaf-a9a8-45dab13c0e52 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:50:55.062130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-606b6f51-41f4-4eaf-a9a8-45dab13c0e52 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group 52691548-8860-4de5-822b-b4724a04ecdd not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:50:55.062905 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-606b6f51-41f4-4eaf-a9a8-45dab13c0e52 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:50:55.062905 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-ea49d714-4ae6-45c4-89e0-c134954921f7'] Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-606b6f51-41f4-4eaf-a9a8-45dab13c0e52 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-security-groups/52691548-8860-4de5-822b-b4724a04ecdd HTTP/1.1 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-ea49d714-4ae6-45c4-89e0-c134954921f7'] Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '52691548-8860-4de5-822b-b4724a04ecdd'} Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:50:55.065208 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea49d714-4ae6-45c4-89e0-c134954921f7'] Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea49d714-4ae6-45c4-89e0-c134954921f7'] Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea49d714-4ae6-45c4-89e0-c134954921f7'] Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea49d714-4ae6-45c4-89e0-c134954921f7'] Oct 12 08:50:55.070462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:50:55.079062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-606b6f51-41f4-4eaf-a9a8-45dab13c0e52 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:50:55.079062 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-ea49d714-4ae6-45c4-89e0-c134954921f7'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:55.080087 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-606b6f51-41f4-4eaf-a9a8-45dab13c0e52 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/52691548-8860-4de5-822b-b4724a04ecdd" status: 404 len: 194 microversion: 2.1 time: 0.094017 Oct 12 08:50:55.081241 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1016/1895] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:50:54 2022] GET /compute/v2.1/os-security-groups/52691548-8860-4de5-822b-b4724a04ecdd => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:55.089706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:55.092388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:55.107430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:55.110436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:55.112538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:55.113669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:55.117023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:55.118103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:55.379215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:55.391666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:55.395532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:55.399196 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-11212cb7-a903-46a6-9b10-30361a697b6d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 0.577624 Oct 12 08:50:55.403487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:55.414107 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-359b2e23-4df0-4ae9-b2f6-2746e6a3b1aa tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1319 microversion: 2.1 time: 0.331495 Oct 12 08:50:55.415811 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 880/1896] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:54 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:55.426884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4a7a02f1-5804-4834-a41d-48a1bc3356fc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f98489b9700>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:55.430730 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1017/1897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:55 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:55.436835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-362433399", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "bcb2997d-af4c-4583-bf5c-69f9e50b80ec"}, {"uuid": "63f47bff-aa3a-4b91-801b-3256e499857d"}, {"uuid": "bcb2997d-af4c-4583-bf5c-69f9e50b80ec"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:55.544952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] validate_networks() for [('bcb2997d-af4c-4583-bf5c-69f9e50b80ec', None, None, None, None, None), ('63f47bff-aa3a-4b91-801b-3256e499857d', None, None, None, None, None), ('bcb2997d-af4c-4583-bf5c-69f9e50b80ec', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:50:55.765660 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4a7a02f1-5804-4834-a41d-48a1bc3356fc tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/52365071-5dad-4d16-a251-965fa07c0075" status: 202 len: 0 microversion: 2.1 time: 0.348453 Oct 12 08:50:55.770822 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 881/1898] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:55 2022] DELETE /compute/v2.1/os-security-groups/52365071-5dad-4d16-a251-965fa07c0075 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:55.781275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-decc7e4e-1b4c-480b-90cb-1566b5fb43bc req-f1f60c62-3216-474d-85e5-5ddff317baa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b2667-5bc6-4cc8-9d0e-1f19493c2686", "name": "network-vif-deleted", "tag": "60ef2109-3f1a-4df6-b73e-aea034386764"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:55.815590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-decc7e4e-1b4c-480b-90cb-1566b5fb43bc req-f1f60c62-3216-474d-85e5-5ddff317baa9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:55.816099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-decc7e4e-1b4c-480b-90cb-1566b5fb43bc req-f1f60c62-3216-474d-85e5-5ddff317baa9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:55.816529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-decc7e4e-1b4c-480b-90cb-1566b5fb43bc req-f1f60c62-3216-474d-85e5-5ddff317baa9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:55.855975 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-decc7e4e-1b4c-480b-90cb-1566b5fb43bc req-f1f60c62-3216-474d-85e5-5ddff317baa9 service nova] Creating event network-vif-deleted:60ef2109-3f1a-4df6-b73e-aea034386764 for instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 on n-h2-858383-10 Oct 12 08:50:55.866865 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-decc7e4e-1b4c-480b-90cb-1566b5fb43bc req-f1f60c62-3216-474d-85e5-5ddff317baa9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092496 Oct 12 08:50:55.867500 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 882/1899] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:55.882280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:55.884047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:55.891677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:55.892398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:55.893110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:55.894052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:55.894717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:55.895574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:55.931884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:55.932364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:55.932791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:55.933515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lazy-loading 'fault' on Instance uuid cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:50:56.007723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:56.019298 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9eb662f-fef5-494d-aa2b-369950dae4ac tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 200 len: 1368 microversion: 2.1 time: 0.147391 Oct 12 08:50:56.020907 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 883/1900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:55 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:56.027551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-68ba444e-4988-48e6-a321-7a92d7d4d39c req-30f4c9e3-4f96-4c9b-9368-68f35209ad5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e897a6-516b-4eda-8d1d-4d9a3a21858c", "name": "network-vif-plugged", "status": "completed", "tag": "232f5860-2aec-420d-b401-3114769ac385"}, {"server_uuid": "6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8", "name": "network-vif-plugged", "status": "completed", "tag": "7e40513e-c5d3-4ab8-ac88-3adaf445553c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:56.048436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-68ba444e-4988-48e6-a321-7a92d7d4d39c req-30f4c9e3-4f96-4c9b-9368-68f35209ad5c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:56.049633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-68ba444e-4988-48e6-a321-7a92d7d4d39c req-30f4c9e3-4f96-4c9b-9368-68f35209ad5c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:56.050083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-68ba444e-4988-48e6-a321-7a92d7d4d39c req-30f4c9e3-4f96-4c9b-9368-68f35209ad5c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:56.074950 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-68ba444e-4988-48e6-a321-7a92d7d4d39c req-30f4c9e3-4f96-4c9b-9368-68f35209ad5c service nova] Creating event network-vif-plugged:232f5860-2aec-420d-b401-3114769ac385 for instance 74e897a6-516b-4eda-8d1d-4d9a3a21858c on n-h2-858383-10 Oct 12 08:50:56.076637 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-68ba444e-4988-48e6-a321-7a92d7d4d39c req-30f4c9e3-4f96-4c9b-9368-68f35209ad5c service nova] Creating event network-vif-plugged:7e40513e-c5d3-4ab8-ac88-3adaf445553c for instance 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 on n-h1-858383-10 Oct 12 08:50:56.089485 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-68ba444e-4988-48e6-a321-7a92d7d4d39c req-30f4c9e3-4f96-4c9b-9368-68f35209ad5c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067105 Oct 12 08:50:56.091226 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 884/1901] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:56.099242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2141ac3-f423-456f-b053-a0f19dd95949 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f984880e3a0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:56.136234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-c2141ac3-f423-456f-b053-a0f19dd95949 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:50:56.137123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.security_group_api [None req-c2141ac3-f423-456f-b053-a0f19dd95949 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group 52365071-5dad-4d16-a251-965fa07c0075 not found {{(pid=127007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:50:56.138206 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-c2141ac3-f423-456f-b053-a0f19dd95949 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:50:56.138206 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-e7922463-8300-40f9-afea-7602e10c3ada'] Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2141ac3-f423-456f-b053-a0f19dd95949 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-security-groups/52365071-5dad-4d16-a251-965fa07c0075 HTTP/1.1 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: exception: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-e7922463-8300-40f9-afea-7602e10c3ada'] Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '52365071-5dad-4d16-a251-965fa07c0075'} Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:50:56.140887 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7922463-8300-40f9-afea-7602e10c3ada'] Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7922463-8300-40f9-afea-7602e10c3ada'] Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7922463-8300-40f9-afea-7602e10c3ada'] Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7922463-8300-40f9-afea-7602e10c3ada'] Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2141ac3-f423-456f-b053-a0f19dd95949 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-e7922463-8300-40f9-afea-7602e10c3ada'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:56.145350 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c2141ac3-f423-456f-b053-a0f19dd95949 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/52365071-5dad-4d16-a251-965fa07c0075" status: 404 len: 194 microversion: 2.1 time: 0.049360 Oct 12 08:50:56.152019 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 885/1902] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:50:56 2022] GET /compute/v2.1/os-security-groups/52365071-5dad-4d16-a251-965fa07c0075 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:56.153882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:56.154974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:56.162276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:56.162907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:56.163404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:56.164165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:56.164800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:56.165224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:56.313276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:56.344225 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c69852ec-ecd5-4c06-a4ae-dbfd939defe5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1317 microversion: 2.1 time: 0.195300 Oct 12 08:50:56.345514 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 886/1903] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:56 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:56.353814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4bcc4bc0-7721-4a13-8d01-13cfbe14908a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848a6f550>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:56.685543 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4bcc4bc0-7721-4a13-8d01-13cfbe14908a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f33f7e82-134d-4827-8310-d13725704b2b" status: 202 len: 0 microversion: 2.1 time: 0.338235 Oct 12 08:50:56.686893 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 887/1904] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:50:56 2022] DELETE /compute/v2.1/os-security-groups/f33f7e82-134d-4827-8310-d13725704b2b => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:56.691969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:56.692605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:56.701277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:56.702055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:56.702531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:56.703929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:56.704437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:56.704895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:57.015388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:57.028854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:57.036360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:57.037897 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a774b4e2-4ab4-433d-ad7e-429dc772f0b4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1280 microversion: 2.25 time: 0.350003 Oct 12 08:50:57.041316 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 888/1905] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:56 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1280 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:57.064187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:57.065097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:57.074652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:57.075340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:57.075940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:57.076827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:57.077273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:57.077726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:57.244774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:57.253807 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a1444704-f0b7-463d-91a2-d0a495dfd145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1319 microversion: 2.1 time: 0.198649 Oct 12 08:50:57.269430 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 889/1906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:57 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:57.274774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2f9892b4-9e39-48e9-ac0d-b3c636baa356 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848afee50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:57.305912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-2f9892b4-9e39-48e9-ac0d-b3c636baa356 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:50:57.306816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.security_group_api [None req-2f9892b4-9e39-48e9-ac0d-b3c636baa356 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group f33f7e82-134d-4827-8310-d13725704b2b not found {{(pid=127007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:50:57.307318 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2f9892b4-9e39-48e9-ac0d-b3c636baa356 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:50:57.307318 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-3a99f5bf-2b90-4dbe-bfb3-0f602b96b062'] Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2f9892b4-9e39-48e9-ac0d-b3c636baa356 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-security-groups/f33f7e82-134d-4827-8310-d13725704b2b HTTP/1.1 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: exception: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-3a99f5bf-2b90-4dbe-bfb3-0f602b96b062'] Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f33f7e82-134d-4827-8310-d13725704b2b'} Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:50:57.309137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a99f5bf-2b90-4dbe-bfb3-0f602b96b062'] Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a99f5bf-2b90-4dbe-bfb3-0f602b96b062'] Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a99f5bf-2b90-4dbe-bfb3-0f602b96b062'] Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a99f5bf-2b90-4dbe-bfb3-0f602b96b062'] Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2f9892b4-9e39-48e9-ac0d-b3c636baa356 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-3a99f5bf-2b90-4dbe-bfb3-0f602b96b062'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2f9892b4-9e39-48e9-ac0d-b3c636baa356 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/f33f7e82-134d-4827-8310-d13725704b2b" status: 404 len: 194 microversion: 2.1 time: 0.039746 Oct 12 08:50:57.315277 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 890/1907] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:50:57 2022] GET /compute/v2.1/os-security-groups/f33f7e82-134d-4827-8310-d13725704b2b => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:57.322710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:57.322710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: cb7b2667-5bc6-4cc8-9d0e-1f19493c2686] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:57.329511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:57.329957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:57.330373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:57.331084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:57.331571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:57.332220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:57.347928 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] HTTP exception thrown: Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 could not be found. Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Request method failure captured: Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 HTTP/1.1 Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6E3zx6C1aAbPTOjfhvojTzNFdlhUfVsbRFTy9maVCBN7Sa-AkJzrSpi4fkOnjxjkRJCU9aFc055ydHjQt0VP74Ju_9uojuCk0-I8KdnYerQDQIcDRrZmtWafl-CABIQNXVTqp5ZTLr-GtQ9CcgSVBfMsKG3M5z0u7WuJEPBWhhSLI Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 94a0f8d18f724f789b822a70fc97797a Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-MigrationsAdminTest-918826596 Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/94a0f8d18f724f789b822a70fc97797a"}]}] Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-MigrationsAdminTest-918826596 Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 94a0f8d18f724f789b822a70fc97797a Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-MigrationsAdminTest-918826596 Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-MigrationsAdminTest-918826596-project Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5631063704964af4a1d7780077789e48 Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-MigrationsAdminTest-918826596-project Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 could not be found. Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'cb7b2667-5bc6-4cc8-9d0e-1f19493c2686'} Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 could not be found. Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 could not be found. Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:50:57.349900 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.354538 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:50:57.354538 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:50:57.354538 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:50:57.354538 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:50:57.354538 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:50:57.354538 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 could not be found. Oct 12 08:50:57.354538 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:50:57.356827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Returning 404 to user: Instance cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:50:57.358315 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-66a70752-a17b-4b7d-af76-867688bff444 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686" status: 404 len: 111 microversion: 2.1 time: 0.045993 Oct 12 08:50:57.359427 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 891/1908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:57 2022] GET /compute/v2.1/servers/cb7b2667-5bc6-4cc8-9d0e-1f19493c2686 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:50:57.366931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed56f03a-8c7f-4b44-92e9-10b2e2ad3a8a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848aae430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:57.592011 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed56f03a-8c7f-4b44-92e9-10b2e2ad3a8a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.231116 Oct 12 08:50:57.593867 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 892/1909] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:50:57 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:57.599681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:57.600559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:57.610170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:57.610934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:57.612005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:57.613878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:57.614537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:57.615666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:57.839253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:57.856071 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c88fdf5d-1344-4f85-8c8a-1addc5eb0842 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1317 microversion: 2.1 time: 0.260750 Oct 12 08:50:57.894534 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 893/1910] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:57 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:57.915170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1420a54c-31b3-422c-974a-3e7b532158e0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '.version_select at 0x7f9848aaec10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:57.967081 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1420a54c-31b3-422c-974a-3e7b532158e0 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263836956" status: 202 len: 0 microversion: 2.1 time: 0.065671 Oct 12 08:50:57.968359 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 894/1911] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 08:50:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263836956 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:50:57.992290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-de5eb049-993a-4353-8ca6-70e9e4f1e088 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f9848afe8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-512778808", "description": "tempest-description-1254338628"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:58.500863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:50:58.502922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:50:58.503623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:50:58.504821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:50:58.505523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:50:58.545499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:58.546010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:58.547017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:58.548621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:58.549311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:58.549983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:58.588409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Getting quotas for project a52c8325195f4024b1a917f2a1f0ca7e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:50:58.603274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Getting quotas for user 9a533e9e2ed84f6eb570e389be2f2feb and project a52c8325195f4024b1a917f2a1f0ca7e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:50:58.642972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:50:58.646384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:50:58.779714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-de5eb049-993a-4353-8ca6-70e9e4f1e088 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.806723 Oct 12 08:50:58.789396 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 895/1912] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:58.795438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:58.796440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:58.803369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b0f7b5ef-802e-462e-a143-bdb0f9814697 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.370321 Oct 12 08:50:58.804943 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1018/1913] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:50:58.811745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:58.815841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:58.816817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:58.817544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:58.820514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:58.821029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:58.822885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:58.824169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:58.833117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:58.833973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:58.834744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:58.837993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:58.838739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:58.840330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:59.147704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:59.157286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:59.159769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:59.161292 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5131db66-445f-4255-b55c-dffa5786bd48 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1476 microversion: 2.25 time: 0.370564 Oct 12 08:50:59.179273 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 896/1914] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:58 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:50:59.194084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86e3c2ce-1e0a-4935-bb1b-ebfd8d347aa0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f9848afedc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1919593562", "description": "tempest-description-1579192387"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:50:59.391317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:59.409999 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e29940ab-29fb-4223-860b-c079c988ae85 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 200 len: 1508 microversion: 2.1 time: 0.603443 Oct 12 08:50:59.413367 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1019/1915] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:58 2022] GET /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:59.444481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:59.445232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:59.458642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:50:59.461299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:59.462739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:59.465687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:59.466774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:59.469647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:59.469965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:59.492331 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86e3c2ce-1e0a-4935-bb1b-ebfd8d347aa0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.311159 Oct 12 08:50:59.510766 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 897/1916] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:50:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:50:59.517372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:59.521014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:59.536999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:59.537944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:59.538571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:59.541781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:59.542428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:59.543024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:59.677786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:59.697081 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c6a558af-3a36-4aab-8b36-c56777fa3a7b tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1216 microversion: 2.1 time: 0.281313 Oct 12 08:50:59.706018 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1020/1917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:59 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1216 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:59.937027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:50:59.948033 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d15040f4-34dc-4fb8-bac8-01bf2dc9d702 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1317 microversion: 2.1 time: 0.435665 Oct 12 08:50:59.961507 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 898/1918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:59 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:50:59.969259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:50:59.977882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 74e897a6-516b-4eda-8d1d-4d9a3a21858c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:50:59.988515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:59.990641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:59.995017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:50:59.996186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:50:59.997843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:50:59.999132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.016243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:00.017072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:00.025214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.025969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.026597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.027799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.028553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.029149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.049532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:00.219737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:00.229925 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f404da9a-8fa0-444b-8a66-52518378fbd3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/74e897a6-516b-4eda-8d1d-4d9a3a21858c" status: 200 len: 1508 microversion: 2.1 time: 0.266274 Oct 12 08:51:00.246551 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 899/1919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:50:59 2022] GET /compute/v2.1/servers/74e897a6-516b-4eda-8d1d-4d9a3a21858c => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:00.253775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-579644897", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "151cd688-532c-4516-be33-fbd98f5b8f38"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:00.316262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] validate_networks() for [('151cd688-532c-4516-be33-fbd98f5b8f38', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:51:00.400310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 88f1fe07-9eb6-4da6-8b88-0c4df059868e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:51:00.441061 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-709fe92c-f108-4477-9b02-fab2abb477d3 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1970 microversion: 2.25 time: 0.732512 Oct 12 08:51:00.443758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1021/1920] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:50:59 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1970 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:00.460700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:00.461210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:00.486522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.487060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.487508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.488283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.488761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.490856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.567542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:00.727220 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5fe51cd6-d9c6-4a2f-9f74-b40359485cb2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 204 len: 0 microversion: 2.1 time: 0.277682 Oct 12 08:51:00.727918 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1022/1921] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:51:00 2022] DELETE /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:00.736240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f5d5ae31-a1b5-42bd-90f4-e6a96abfbe81 req-56b9e0fe-6266-4457-bea2-8352351e4d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68d4300-929d-46de-bb5e-4010c2d60be3", "name": "network-vif-plugged", "status": "completed", "tag": "d04f2e52-f07c-4667-82e2-c9b8d1f82d6a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:00.754028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f5d5ae31-a1b5-42bd-90f4-e6a96abfbe81 req-56b9e0fe-6266-4457-bea2-8352351e4d2d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.754749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f5d5ae31-a1b5-42bd-90f4-e6a96abfbe81 req-56b9e0fe-6266-4457-bea2-8352351e4d2d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.755341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f5d5ae31-a1b5-42bd-90f4-e6a96abfbe81 req-56b9e0fe-6266-4457-bea2-8352351e4d2d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.807660 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f5d5ae31-a1b5-42bd-90f4-e6a96abfbe81 req-56b9e0fe-6266-4457-bea2-8352351e4d2d service nova] Creating event network-vif-plugged:d04f2e52-f07c-4667-82e2-c9b8d1f82d6a for instance f68d4300-929d-46de-bb5e-4010c2d60be3 on n-h1-858383-10 Oct 12 08:51:00.822128 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f5d5ae31-a1b5-42bd-90f4-e6a96abfbe81 req-56b9e0fe-6266-4457-bea2-8352351e4d2d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089827 Oct 12 08:51:00.824657 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1023/1922] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:00.846323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:00.852128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 74e897a6-516b-4eda-8d1d-4d9a3a21858c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:00.872518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.874008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.874313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.877574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.879545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.880209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.929393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:51:00.930660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:51:00.931040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:51:00.931464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:51:00.931884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:51:00.945239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.945917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.946180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.947218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:00.948361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 74e897a6-516b-4eda-8d1d-4d9a3a21858c] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:00.948713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:00.949970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:00.974283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Getting quotas for project 835727d058524514b4fc66d4c8e8dedc. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:51:00.980819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Getting quotas for user c765279afc5a4682b5e525416c13db87 and project 835727d058524514b4fc66d4c8e8dedc. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:51:00.995198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:51:00.998149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:51:01.069620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:01.074337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12b1db9a-5456-4316-8c75-7dd923c531ad tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/74e897a6-516b-4eda-8d1d-4d9a3a21858c" status: 204 len: 0 microversion: 2.1 time: 0.246444 Oct 12 08:51:01.075480 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1024/1923] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:51:00 2022] DELETE /compute/v2.1/servers/74e897a6-516b-4eda-8d1d-4d9a3a21858c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:01.081993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:01.082760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:01.091703 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d2544614-152e-4c70-b0fb-d0e9ed5fe839 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843829 Oct 12 08:51:01.092358 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 900/1924] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:51:01.092518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.094966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.096155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.098756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:01.099862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:01.101098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.103734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.104603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.108539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.109029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.114052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.114841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.115332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.118610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.246167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:01.264821 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cfccc04b-67db-452c-834a-d61f23af0418 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1272 microversion: 2.1 time: 0.170253 Oct 12 08:51:01.278322 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 901/1925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:01 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:01.283633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:01.288127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:01.297373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.298202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.299581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.302131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.302816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.303319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.513865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 88f1fe07-9eb6-4da6-8b88-0c4df059868e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:51:01.551973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:01.570981 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ebdc951d-4512-4411-a45d-adaa6e1106f5 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1970 microversion: 2.25 time: 0.491698 Oct 12 08:51:01.574465 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1025/1926] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:01 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1970 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:01.593425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:01.594355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:01.601716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:01.614480 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-636caa5e-8f37-4e82-92c4-58a88de64ea2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1467 microversion: 2.1 time: 0.345672 Oct 12 08:51:01.625472 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 902/1927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:01 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1467 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:01.629189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.629189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.629429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:01.629575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.629686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:01.629786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.629786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.630193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.638179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.639211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.639839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.641321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.641984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.642617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.686247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:01.873067 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5849aae2-fd7d-487d-999d-03c55bb4fbb5 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8" status: 204 len: 0 microversion: 2.1 time: 0.244710 Oct 12 08:51:01.887571 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 903/1928] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:51:01 2022] DELETE /compute/v2.1/servers/6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:01.898656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:01.899982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:01.918705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.919005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.919450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:01.920397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:01.920858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:01.921286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:02.040461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:02.053591 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-31e401ed-526e-436e-b37c-a0fb78db91c2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1219 microversion: 2.1 time: 0.160529 Oct 12 08:51:02.067806 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 904/1929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:01 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:02.086492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c2ffc38-75e7-4ffe-861a-64e5812b3c24 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:02.120332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2ffc38-75e7-4ffe-861a-64e5812b3c24 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:02.121331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2ffc38-75e7-4ffe-861a-64e5812b3c24 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:02.125066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2ffc38-75e7-4ffe-861a-64e5812b3c24 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:02.133526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2ffc38-75e7-4ffe-861a-64e5812b3c24 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:02.135606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2ffc38-75e7-4ffe-861a-64e5812b3c24 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:02.137230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c2ffc38-75e7-4ffe-861a-64e5812b3c24 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:02.206821 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c2ffc38-75e7-4ffe-861a-64e5812b3c24 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.127852 Oct 12 08:51:02.217337 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 905/1930] 10.222.0.40 () {60 vars in 1217 bytes} [Wed Oct 12 08:51:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:51:02.231832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2001352585", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5c67d799-0062-4dd5-8131-0ff04958cfab"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:02.332808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] validate_networks() for [('5c67d799-0062-4dd5-8131-0ff04958cfab', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:51:02.503420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:02.527659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4e802a63-571a-40f1-9a14-39fb71251a47 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1317 microversion: 2.1 time: 0.951849 Oct 12 08:51:02.530860 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1026/1931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:01 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1317 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:02.537696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": "auto"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:02.547298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:02.565064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:02.567594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:02.568161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:02.569052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:02.571021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:02.572371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:02.662960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'flavor' on Instance uuid 88f1fe07-9eb6-4da6-8b88-0c4df059868e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:51:02.699518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Going to try to live migrate instance to n-h2-858383-10 {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:51:02.855850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:51:02.856413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:51:02.856886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:51:02.857292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:51:02.857898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:51:02.879722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:02.880211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:02.880656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:02.881399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:02.881880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:02.882301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:02.900976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Getting quotas for project e612677bf8be4aee953bf54c1ee0a994. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:51:02.903397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:02.906762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Getting quotas for user a51ff84665bb49ef9ed92a5fbb46d25a and project e612677bf8be4aee953bf54c1ee0a994. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:51:02.920916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Going to run 2 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:51:02.924010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:51:02.962550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=8d8fcb2b-557f-4c4d-9132-c5b920654d66,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:51:03.029405 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65291f84-8ad3-422f-9fc2-4b5e68425be7 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.810557 Oct 12 08:51:03.033219 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 906/1932] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:51:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 12 08:51:03.035769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:03.036380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:03.043396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:03.044063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:03.044519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:03.045836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:03.046296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:03.046828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:03.546952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:03.575723 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-605c9874-c1e5-4e61-882e-a13c9dea6d7e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1272 microversion: 2.1 time: 0.540128 Oct 12 08:51:03.579203 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 907/1933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:03 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1272 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:03.609013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:03.610024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:03.640813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:03.641660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:03.642343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:03.644568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:03.645952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:03.646837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:04.352903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:04.367117 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-821187ee-8f02-4cbb-9a04-eba0bff13d5c tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1467 microversion: 2.1 time: 0.784278 Oct 12 08:51:04.369747 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 908/1934] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:03 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1467 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:04.722797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10b9b6fa-6e1c-4aa0-8abb-1dc9ec05b93f tempest-AZV2TestJSON-1492689838 tempest-AZV2TestJSON-1492689838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:04.724419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10b9b6fa-6e1c-4aa0-8abb-1dc9ec05b93f tempest-AZV2TestJSON-1492689838 tempest-AZV2TestJSON-1492689838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:04.725136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10b9b6fa-6e1c-4aa0-8abb-1dc9ec05b93f tempest-AZV2TestJSON-1492689838 tempest-AZV2TestJSON-1492689838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:04.725851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10b9b6fa-6e1c-4aa0-8abb-1dc9ec05b93f tempest-AZV2TestJSON-1492689838 tempest-AZV2TestJSON-1492689838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:04.726866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10b9b6fa-6e1c-4aa0-8abb-1dc9ec05b93f tempest-AZV2TestJSON-1492689838 tempest-AZV2TestJSON-1492689838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:04.730739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10b9b6fa-6e1c-4aa0-8abb-1dc9ec05b93f tempest-AZV2TestJSON-1492689838 tempest-AZV2TestJSON-1492689838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:04.733135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10b9b6fa-6e1c-4aa0-8abb-1dc9ec05b93f tempest-AZV2TestJSON-1492689838 tempest-AZV2TestJSON-1492689838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:04.956915 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10b9b6fa-6e1c-4aa0-8abb-1dc9ec05b93f tempest-AZV2TestJSON-1492689838 tempest-AZV2TestJSON-1492689838-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.583442 Oct 12 08:51:04.960433 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 909/1935] 10.222.0.40 () {58 vars in 1164 bytes} [Wed Oct 12 08:51:04 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:51:04.974894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:04.990245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:05.021790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Searching by: {'deleted': False, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:51:05.033229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:05.036625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:05.040340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:05.045824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:05.048076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:05.048638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:05.168495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:51:05.299213 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9143fcc2-af42-4de9-a406-4e33d897eceb tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.336522 Oct 12 08:51:05.312614 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 910/1936] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 08:51:04 2022] GET /compute/v2.1/servers => generated 1335 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:05.331306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:05.331938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:05.353060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:05.358201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:05.358988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:05.360027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:05.362816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:05.363574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:05.765678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:05.775768 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dbedf8cb-c4f8-420a-9416-e2fcf777ba08 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1275 microversion: 2.1 time: 0.461927 Oct 12 08:51:05.794267 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 911/1937] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:05 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1275 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:05.805932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:05.806554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:05.843402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:05.844434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:05.847234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:05.848644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:05.851385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:05.854134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:07.588419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:07.600360 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-056d0186-fdf6-4566-81cf-8a65648456da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1467 microversion: 2.1 time: 1.803366 Oct 12 08:51:07.613058 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 912/1938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:05 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1467 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:07.618194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:07.640808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:07.671217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:07.675821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:07.677626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:07.679463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:07.692017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:07.693348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:08.490051 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2fc87555-b131-4303-968e-d1cdee3582f0 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e/action" status: 202 len: 0 microversion: 2.25 time: 5.956637 Oct 12 08:51:08.490699 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1027/1939] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:51:02 2022] POST /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e/action => generated 0 bytes in 5958 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:08.499949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-620d5898-5230-41cc-aab7-923e2d6e1186 req-7ba1dad8-4f51-4d16-9141-7afc0a574ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e897a6-516b-4eda-8d1d-4d9a3a21858c", "name": "network-vif-deleted", "tag": "232f5860-2aec-420d-b401-3114769ac385"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:08.531139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-620d5898-5230-41cc-aab7-923e2d6e1186 req-7ba1dad8-4f51-4d16-9141-7afc0a574ac1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:08.531739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-620d5898-5230-41cc-aab7-923e2d6e1186 req-7ba1dad8-4f51-4d16-9141-7afc0a574ac1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:08.532184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-620d5898-5230-41cc-aab7-923e2d6e1186 req-7ba1dad8-4f51-4d16-9141-7afc0a574ac1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:08.564355 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-620d5898-5230-41cc-aab7-923e2d6e1186 req-7ba1dad8-4f51-4d16-9141-7afc0a574ac1 service nova] Creating event network-vif-deleted:232f5860-2aec-420d-b401-3114769ac385 for instance 74e897a6-516b-4eda-8d1d-4d9a3a21858c on n-h2-858383-10 Oct 12 08:51:08.571796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-620d5898-5230-41cc-aab7-923e2d6e1186 req-7ba1dad8-4f51-4d16-9141-7afc0a574ac1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077693 Oct 12 08:51:08.573696 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1028/1940] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:08.584148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:08.585992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:08.591228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:08.599329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:08.600383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:08.601303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:08.602185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:08.602695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:08.603335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:08.631619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:08.644784 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f8844b3-15bf-46f5-9bd7-b111fc28d183 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1312 microversion: 2.1 time: 1.030460 Oct 12 08:51:08.645389 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 913/1941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:07 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1312 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:08.676575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-33ec8bcf-c173-42b2-9e57-e89779516ae1 req-6f0bce08-4456-4755-9cae-59794b0eaf9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8", "name": "network-vif-deleted", "tag": "7e40513e-c5d3-4ab8-ac88-3adaf445553c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:08.679780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:08.712475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33ec8bcf-c173-42b2-9e57-e89779516ae1 req-6f0bce08-4456-4755-9cae-59794b0eaf9b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:08.712998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33ec8bcf-c173-42b2-9e57-e89779516ae1 req-6f0bce08-4456-4755-9cae-59794b0eaf9b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:08.713506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33ec8bcf-c173-42b2-9e57-e89779516ae1 req-6f0bce08-4456-4755-9cae-59794b0eaf9b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:08.738464 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-33ec8bcf-c173-42b2-9e57-e89779516ae1 req-6f0bce08-4456-4755-9cae-59794b0eaf9b service nova] Creating event network-vif-deleted:7e40513e-c5d3-4ab8-ac88-3adaf445553c for instance 6aec1d9a-b3c4-43f9-b6fb-1430ab85f4c8 on n-h1-858383-10 Oct 12 08:51:08.747230 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-33ec8bcf-c173-42b2-9e57-e89779516ae1 req-6f0bce08-4456-4755-9cae-59794b0eaf9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074059 Oct 12 08:51:08.748247 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 914/1942] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:08.753661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:08.754681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:08.761828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:08.762662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:08.763310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:08.764480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:08.765158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:08.766272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:08.802908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:08.805811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:08.806376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:08.807015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lazy-loading 'fault' on Instance uuid ecf50845-c51f-4d7f-8210-a04d9e628357 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:51:08.973056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:08.983199 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4b8ffed-5f7e-418b-bafb-00ccdb0843d2 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1276 microversion: 2.1 time: 0.407068 Oct 12 08:51:08.993764 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1029/1943] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:08 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1276 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:09.002425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:09.003057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:09.011120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:09.011882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:09.013101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:09.014246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:09.015297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:09.016133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:09.052514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:09.063116 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ce508b5-7526-45a1-9f8f-94514e3ba729 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 200 len: 1302 microversion: 2.1 time: 0.313349 Oct 12 08:51:09.066595 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 915/1944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:08 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 1302 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:09.071549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:09.081233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:09.098757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:09.099726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:09.100501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:09.101307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:09.102144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:09.102879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:09.777157 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-357bfe99-e104-4e0b-94af-ded6871ce363 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1620 microversion: 2.1 time: 0.709138 Oct 12 08:51:09.780829 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 916/1945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:09 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1620 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:09.790276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:09.791300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:09.803619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:09.805559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:09.806407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:09.808270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:09.808993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:09.809704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:09.815147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:09.889174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:09.932357 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f12ddeb2-1b61-42e2-b5fe-b7a27e4efbe7 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 0.936322 Oct 12 08:51:09.933860 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1030/1946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:08 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:09.942449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:09.943943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:09.953703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:09.954745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:09.955605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:09.956530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:09.957175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:09.957890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.338669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:10.356760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:10.359306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:10.360997 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-974f2a88-1f96-4d46-9021-7f21fe5405b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.575238 Oct 12 08:51:10.361865 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 917/1947] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:09 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:10.388392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:10.389669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:10.396775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.397658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.398354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.399383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.400247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.400704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.412466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:10.426286 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eef2ab1f-e6f7-40bb-98bb-59a97b5aa1b3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1312 microversion: 2.1 time: 0.490849 Oct 12 08:51:10.427480 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1031/1948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:09 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:10.440008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1887317465", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8519af08-ba91-4304-a23c-97cdf484974c"]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:10.525807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:51:10.607899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:10.616419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1083561e-f452-4f6b-bd44-75a8866d0202 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1276 microversion: 2.1 time: 0.239397 Oct 12 08:51:10.630013 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 918/1949] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:10 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:10.637520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:10.638145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: ecf50845-c51f-4d7f-8210-a04d9e628357] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:10.645165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.645896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.646911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.647727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.648478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.649302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.664974 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] HTTP exception thrown: Instance ecf50845-c51f-4d7f-8210-a04d9e628357 could not be found. Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Request method failure captured: Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 HTTP/1.1 Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6E3zx6C1aAbPTOjfhvojTzNFdlhUfVsbRFTy9maVCBN7Sa-AkJzrSpi4fkOnjxjkRJCU9aFc055ydHjQt0VP74Ju_9uojuCk0-I8KdnYerQDQIcDRrZmtWafl-CABIQNXVTqp5ZTLr-GtQ9CcgSVBfMsKG3M5z0u7WuJEPBWhhSLI Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 94a0f8d18f724f789b822a70fc97797a Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-MigrationsAdminTest-918826596 Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/94a0f8d18f724f789b822a70fc97797a"}]}] Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-MigrationsAdminTest-918826596 Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 94a0f8d18f724f789b822a70fc97797a Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-MigrationsAdminTest-918826596 Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-MigrationsAdminTest-918826596-project Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5631063704964af4a1d7780077789e48 Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-MigrationsAdminTest-918826596-project Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance ecf50845-c51f-4d7f-8210-a04d9e628357 could not be found. Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'ecf50845-c51f-4d7f-8210-a04d9e628357'} Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf50845-c51f-4d7f-8210-a04d9e628357 could not be found. Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf50845-c51f-4d7f-8210-a04d9e628357 could not be found. Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:10.666676 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf50845-c51f-4d7f-8210-a04d9e628357 could not be found. Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Returning 404 to user: Instance ecf50845-c51f-4d7f-8210-a04d9e628357 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c61a09c7-0ec6-49cd-a1d6-2227302448a1 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357" status: 404 len: 111 microversion: 2.1 time: 0.037134 Oct 12 08:51:10.671922 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 919/1950] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:10 2022] GET /compute/v2.1/servers/ecf50845-c51f-4d7f-8210-a04d9e628357 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:51:10.677410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:10.677984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:10.684402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.685472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.686238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.686949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.687404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.687832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.723727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:10.875188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4bc519f8-e6e3-486b-89da-f5fdc1d14170 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 204 len: 0 microversion: 2.1 time: 0.201025 Oct 12 08:51:10.876366 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 920/1951] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:51:10 2022] DELETE /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:10.890429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c8dae654-1141-4eb7-83c1-79df46ae431e req-9f678ecb-f850-4543-8449-ba57dbf3cb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf50845-c51f-4d7f-8210-a04d9e628357", "name": "network-vif-deleted", "tag": "62d17ea7-d92a-4239-aa4f-2df03bf6a199"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:10.902887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c8dae654-1141-4eb7-83c1-79df46ae431e req-9f678ecb-f850-4543-8449-ba57dbf3cb47 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.903762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c8dae654-1141-4eb7-83c1-79df46ae431e req-9f678ecb-f850-4543-8449-ba57dbf3cb47 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.904424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c8dae654-1141-4eb7-83c1-79df46ae431e req-9f678ecb-f850-4543-8449-ba57dbf3cb47 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.919162 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c8dae654-1141-4eb7-83c1-79df46ae431e req-9f678ecb-f850-4543-8449-ba57dbf3cb47 service nova] Creating event network-vif-deleted:62d17ea7-d92a-4239-aa4f-2df03bf6a199 for instance ecf50845-c51f-4d7f-8210-a04d9e628357 on n-h2-858383-10 Oct 12 08:51:10.925727 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c8dae654-1141-4eb7-83c1-79df46ae431e req-9f678ecb-f850-4543-8449-ba57dbf3cb47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047729 Oct 12 08:51:10.927515 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 921/1952] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:10.933716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:10.934766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:10.942085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.942898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.943630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:10.944548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:10.945188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:10.945849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:11.540665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:11.549504 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5645d31b-1a55-4de9-9595-de42030c53c2 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1469 microversion: 2.1 time: 0.620404 Oct 12 08:51:11.555855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:51:11.557763 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 922/1953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:10 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1469 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:11.558030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:51:11.558576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:51:11.559042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:51:11.559534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:51:11.570396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:11.571371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:11.588591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:11.589716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:11.590473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:11.591489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:11.592571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:11.593241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:11.599161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:11.600081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:11.601161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:11.602371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:11.603117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:11.603798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:11.643499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:51:11.658574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:51:11.676276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:51:11.679791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:51:11.790770 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-93413069-e291-4da7-ae18-320427b1e8a0 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361579 Oct 12 08:51:11.800047 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1032/1954] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:51:11.811348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:11.815349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:11.832880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:11.834783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:11.837099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:11.838049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:11.839864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:11.841377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:12.665249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:12.673499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:12.674927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:12.676097 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-479b9eac-9e53-4961-9c00-773864bea092 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.874805 Oct 12 08:51:12.676661 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1033/1955] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:11 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:12.689191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:12.689860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:12.706532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:12.707365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:12.717369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:12.719722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:12.721842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:12.722675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:12.917132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=12 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:13.027219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:13.036792 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-abe1e3fa-e7e8-40f1-b078-09df76c0922e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1333 microversion: 2.1 time: 0.350893 Oct 12 08:51:13.040491 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1034/1956] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:12 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1333 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:13.046757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:13.048718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:13.072511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:13.073646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:13.075933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:13.077044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:13.079295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:13.082087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:13.150640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:13.161894 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a1963122-dbec-4f92-a04d-b6b7ae4c7630 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 1.602355 Oct 12 08:51:13.167207 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 923/1957] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:11 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:13.172220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:13.186293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:13.213341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:13.213818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:13.214312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:13.214949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:13.215396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:13.215817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:13.911370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:13.946068 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-944069c5-46ff-4c2e-9724-3802a8c8f788 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1213 microversion: 2.1 time: 0.772671 Oct 12 08:51:13.951256 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 924/1958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:13 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1213 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:13.972853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:13.976367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:13.994596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:13.996276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:13.996735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:13.998609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:13.999073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:14.000687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:14.100357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:14.109014 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a138f94-33b1-4b99-9a44-243d724a292d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1318 microversion: 2.1 time: 1.066981 Oct 12 08:51:14.109729 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1035/1959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:13 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1318 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:14.126117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:14.126732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:14.139255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:14.142061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:14.142649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:14.143401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:14.143861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:14.144283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:14.907060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:14.927485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:14.929400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:14.930834 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a81fecaf-53ac-40ca-b6a0-701d596c0013 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.816385 Oct 12 08:51:14.945870 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1036/1960] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:14 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:14.955065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-783b7eaa-3957-445e-afe3-9d9a01820ddf req-6feb06ec-87fd-4cbd-a1f5-ca235a85bceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a51d2b-5b6d-4a71-9352-8077991fc24a", "tag": "59a421c6-093f-49ff-8651-dd75acf22037"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:14.976164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-783b7eaa-3957-445e-afe3-9d9a01820ddf req-6feb06ec-87fd-4cbd-a1f5-ca235a85bceb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:14.981111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-783b7eaa-3957-445e-afe3-9d9a01820ddf req-6feb06ec-87fd-4cbd-a1f5-ca235a85bceb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:14.981786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-783b7eaa-3957-445e-afe3-9d9a01820ddf req-6feb06ec-87fd-4cbd-a1f5-ca235a85bceb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:15.003878 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-783b7eaa-3957-445e-afe3-9d9a01820ddf req-6feb06ec-87fd-4cbd-a1f5-ca235a85bceb service nova] Creating event network-changed:59a421c6-093f-49ff-8651-dd75acf22037 for instance 32a51d2b-5b6d-4a71-9352-8077991fc24a on n-h1-858383-10 Oct 12 08:51:15.022950 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-783b7eaa-3957-445e-afe3-9d9a01820ddf req-6feb06ec-87fd-4cbd-a1f5-ca235a85bceb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075458 Oct 12 08:51:15.024133 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1037/1961] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:15.029890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:15.032017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:15.049785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:15.050485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:15.051105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:15.052011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:15.052778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:15.053401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:15.110760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:15.414673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:15.431656 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc8bee46-7422-4910-b1c6-b63302fd72cc tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1469 microversion: 2.1 time: 1.478961 Oct 12 08:51:15.443037 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 925/1962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:13 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1469 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:15.450885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:15.451846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:15.461189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:15.462177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:15.462864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:15.463836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:15.465422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:15.466381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:16.093597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:16.108138 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-460d406d-3d6b-42fb-a983-701afff41c61 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 1.082583 Oct 12 08:51:16.116205 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1038/1963] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:15 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:16.134251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-424b7e37-10bf-4d17-b8df-48c48544e51a req-a99d692e-cd13-4ded-94f7-dfb108ad4cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8fcb2b-557f-4c4d-9132-c5b920654d66", "tag": "78b0414c-4b02-482c-b1c5-0f008249450c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:16.189403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-424b7e37-10bf-4d17-b8df-48c48544e51a req-a99d692e-cd13-4ded-94f7-dfb108ad4cf4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:16.191356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-424b7e37-10bf-4d17-b8df-48c48544e51a req-a99d692e-cd13-4ded-94f7-dfb108ad4cf4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:16.192647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-424b7e37-10bf-4d17-b8df-48c48544e51a req-a99d692e-cd13-4ded-94f7-dfb108ad4cf4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:16.266919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-424b7e37-10bf-4d17-b8df-48c48544e51a req-a99d692e-cd13-4ded-94f7-dfb108ad4cf4 service nova] Creating event network-changed:78b0414c-4b02-482c-b1c5-0f008249450c for instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 on n-h1-858383-10 Oct 12 08:51:16.274704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-424b7e37-10bf-4d17-b8df-48c48544e51a req-a99d692e-cd13-4ded-94f7-dfb108ad4cf4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156873 Oct 12 08:51:16.277094 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1039/1964] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:16.298772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:16.304424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:16.324413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:16.325151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:16.325919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:16.326933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:16.327685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:16.328330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:16.614591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:16.623366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2939ec2e-6569-4640-afcb-ff670f93c32a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 1.178860 Oct 12 08:51:16.629303 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 926/1965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:15 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:16.634440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:16.635055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:16.653831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:16.654623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:16.655227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:16.657478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:16.659488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:16.660683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:16.839184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:16.866452 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-50caf4b4-5a55-42f2-8882-a6661d033d5c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1275 microversion: 2.1 time: 0.587878 Oct 12 08:51:16.873841 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1040/1966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:16 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1275 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:16.879386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:16.889115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:16.908774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:16.922270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:16.922839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:16.923694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:16.924229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:16.924912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:17.586412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:17.598435 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d1457b05-2c46-4471-b6ae-779d26cfd454 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1318 microversion: 2.1 time: 0.967837 Oct 12 08:51:17.603682 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 927/1967] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:16 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1318 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:17.623289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:17.630266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:17.631095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:17.635733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:17.643448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:17.644967 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd5e6095-7d46-4578-b7db-e4a00cb232b5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.769706 Oct 12 08:51:17.646694 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1041/1968] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:16 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:17.649763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:17.654143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:17.654940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:17.655786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:17.658085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:17.658261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:17.658697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:17.665234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:17.685964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:17.686800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:17.687413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:17.688326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:17.688952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:17.689576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:17.782960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:17.789964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:17.795127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:17.796876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lazy-loading 'fault' on Instance uuid 744cfd99-597c-4504-af66-6ba5723fcbee {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:51:18.294971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:18.319760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f53cea79-d62f-43eb-84e2-78e4b9f78a42 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.668583 Oct 12 08:51:18.340396 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1042/1969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:17 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:18.363470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1fc4cb93-ffc1-4b5e-ae8b-2ea3a85dc5ae req-241c0887-2103-40cb-b12f-c12e0ac3c064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "744cfd99-597c-4504-af66-6ba5723fcbee", "name": "network-vif-deleted", "tag": "865792b9-525d-4c68-888b-8212face2199"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:18.379313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fc4cb93-ffc1-4b5e-ae8b-2ea3a85dc5ae req-241c0887-2103-40cb-b12f-c12e0ac3c064 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:18.380902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fc4cb93-ffc1-4b5e-ae8b-2ea3a85dc5ae req-241c0887-2103-40cb-b12f-c12e0ac3c064 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:18.381658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fc4cb93-ffc1-4b5e-ae8b-2ea3a85dc5ae req-241c0887-2103-40cb-b12f-c12e0ac3c064 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:18.387760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:18.408017 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1fc4cb93-ffc1-4b5e-ae8b-2ea3a85dc5ae req-241c0887-2103-40cb-b12f-c12e0ac3c064 service nova] Creating event network-vif-deleted:865792b9-525d-4c68-888b-8212face2199 for instance 744cfd99-597c-4504-af66-6ba5723fcbee on n-h2-858383-10 Oct 12 08:51:18.414972 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1fc4cb93-ffc1-4b5e-ae8b-2ea3a85dc5ae req-241c0887-2103-40cb-b12f-c12e0ac3c064 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073012 Oct 12 08:51:18.416202 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1043/1970] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:18.435048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:18.437071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:18.466190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:18.470339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:18.471082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:18.472016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:18.473102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:18.474219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:18.817573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5631063704964af4a1d7780077789e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0f8d18f724f789b822a70fc97797a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:18.846412 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-024f1313-e343-4466-9964-8c47d036b29e tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 200 len: 1303 microversion: 2.1 time: 1.240388 Oct 12 08:51:18.847887 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 928/1971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:17 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 1303 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:18.857247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:18.858744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:18.891110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:18.898581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:18.899872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:18.901120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:18.901993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:18.903357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:18.998884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:19.012818 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88804795-798f-4d3c-af6b-726a4749aa8e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 0.594400 Oct 12 08:51:19.034210 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1044/1972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:18 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:19.042559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c9d2e05e-a5c8-466e-afb9-deb44bcad9ae req-2e2a0ff8-1e04-4634-86f4-3c248d7d0ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7d95ee-3487-4dff-a5bd-fdb822960eb4", "tag": "b45dd050-5e1d-4d87-a8a3-65ba4aec6906"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:19.056245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c9d2e05e-a5c8-466e-afb9-deb44bcad9ae req-2e2a0ff8-1e04-4634-86f4-3c248d7d0ce8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:19.057114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c9d2e05e-a5c8-466e-afb9-deb44bcad9ae req-2e2a0ff8-1e04-4634-86f4-3c248d7d0ce8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:19.058742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c9d2e05e-a5c8-466e-afb9-deb44bcad9ae req-2e2a0ff8-1e04-4634-86f4-3c248d7d0ce8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:19.080232 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c9d2e05e-a5c8-466e-afb9-deb44bcad9ae req-2e2a0ff8-1e04-4634-86f4-3c248d7d0ce8 service nova] Creating event network-changed:b45dd050-5e1d-4d87-a8a3-65ba4aec6906 for instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 on n-h2-858383-10 Oct 12 08:51:19.089093 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c9d2e05e-a5c8-466e-afb9-deb44bcad9ae req-2e2a0ff8-1e04-4634-86f4-3c248d7d0ce8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050974 Oct 12 08:51:19.091630 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1045/1973] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:19.130565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:19.131748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:19.147776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:19.150858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:19.151972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:19.154661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:19.159702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:19.159702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:19.481345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:19.507992 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2e86c3d-8e70-43e9-a959-3c30a253a39d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 0.657620 Oct 12 08:51:19.513310 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 929/1974] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:18 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:19.519863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:19.522997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:19.541924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:19.543775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:19.550718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:19.552658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:19.555171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:19.555756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:19.896907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:19.913357 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7492ac52-fe8e-49b8-a7ff-6f710570bd5e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1318 microversion: 2.1 time: 0.820127 Oct 12 08:51:19.914247 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1046/1975] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:19 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:19.923150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:19.925170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:19.944551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:19.946631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:19.947704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:19.949101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:19.950909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:19.952980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:20.046143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:20.061629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:20.066813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:20.068371 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94f840ac-9cf6-434b-ba0e-188ec618dfa0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.553385 Oct 12 08:51:20.077501 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 930/1976] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:19 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:20.082772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:20.083752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] [instance: 744cfd99-597c-4504-af66-6ba5723fcbee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:20.097346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:20.099446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:20.100160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:20.103287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:20.103984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:20.107261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:20.138916 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] HTTP exception thrown: Instance 744cfd99-597c-4504-af66-6ba5723fcbee could not be found. Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Request method failure captured: Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee HTTP/1.1 Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn6E3zx6C1aAbPTOjfhvojTzNFdlhUfVsbRFTy9maVCBN7Sa-AkJzrSpi4fkOnjxjkRJCU9aFc055ydHjQt0VP74Ju_9uojuCk0-I8KdnYerQDQIcDRrZmtWafl-CABIQNXVTqp5ZTLr-GtQ9CcgSVBfMsKG3M5z0u7WuJEPBWhhSLI Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 94a0f8d18f724f789b822a70fc97797a Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-MigrationsAdminTest-918826596 Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_94a0f8d18f724f789b822a70fc97797a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/94a0f8d18f724f789b822a70fc97797a"}]}] Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-MigrationsAdminTest-918826596 Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 94a0f8d18f724f789b822a70fc97797a Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-MigrationsAdminTest-918826596 Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-MigrationsAdminTest-918826596-project Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5631063704964af4a1d7780077789e48 Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-MigrationsAdminTest-918826596-project Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 744cfd99-597c-4504-af66-6ba5723fcbee could not be found. Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '744cfd99-597c-4504-af66-6ba5723fcbee'} Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 744cfd99-597c-4504-af66-6ba5723fcbee could not be found. Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 744cfd99-597c-4504-af66-6ba5723fcbee could not be found. Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:20.140781 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 744cfd99-597c-4504-af66-6ba5723fcbee could not be found. Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] Returning 404 to user: Instance 744cfd99-597c-4504-af66-6ba5723fcbee could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:51:20.149606 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-981c37ad-9e0c-4141-b8f8-45a53b875e62 tempest-MigrationsAdminTest-918826596 tempest-MigrationsAdminTest-918826596-project] 10.222.0.40 "GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee" status: 404 len: 111 microversion: 2.1 time: 0.067955 Oct 12 08:51:20.150787 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 931/1977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:20 2022] GET /compute/v2.1/servers/744cfd99-597c-4504-af66-6ba5723fcbee => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:51:20.161870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:20.162588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:20.175560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:20.176056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:20.178598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:20.185164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:20.186897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:20.187373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:20.699538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:20.720659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-75a7010b-eda3-4520-b48a-ee5d7c02b7d7 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.802810 Oct 12 08:51:20.721597 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1047/1978] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:19 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:20.730121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:20.732053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:20.741273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:20.742963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:20.744518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:20.746067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:20.746805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:20.748292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:20.973513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:20.983017 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33cb8881-89e2-47f7-9b50-15706fd148b8 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 0.831233 Oct 12 08:51:20.983614 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 932/1979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:20 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:20.997861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-703e7ff7-11e2-47c7-835a-8b5e6313d747 req-4785ce77-6360-4178-b1f9-0102f9de9f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "tag": "5bced808-04d2-43fa-ad61-7f1b95feac13"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:21.017965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-703e7ff7-11e2-47c7-835a-8b5e6313d747 req-4785ce77-6360-4178-b1f9-0102f9de9f2f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:21.018572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-703e7ff7-11e2-47c7-835a-8b5e6313d747 req-4785ce77-6360-4178-b1f9-0102f9de9f2f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:21.019239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-703e7ff7-11e2-47c7-835a-8b5e6313d747 req-4785ce77-6360-4178-b1f9-0102f9de9f2f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:21.040484 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-703e7ff7-11e2-47c7-835a-8b5e6313d747 req-4785ce77-6360-4178-b1f9-0102f9de9f2f service nova] Creating event network-changed:5bced808-04d2-43fa-ad61-7f1b95feac13 for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:51:21.050581 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-703e7ff7-11e2-47c7-835a-8b5e6313d747 req-4785ce77-6360-4178-b1f9-0102f9de9f2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065669 Oct 12 08:51:21.052604 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 933/1980] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:21.069384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:21.071275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:21.085518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:21.086028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:21.086477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:21.089768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:21.090340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:21.090782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:21.142711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:21.618059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:21.628951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:21.651088 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a7dbb1bb-159b-41c5-9f17-2e41e14dca11 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 0.921258 Oct 12 08:51:21.652577 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1048/1981] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:20 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:21.671381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:21.673793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:21.675931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:21.695403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:21.697374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:21.698048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:21.699551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:21.700677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:21.702364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:22.608760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:22.626767 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad402945-0ad2-4aa4-81df-f59b06f99e45 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1318 microversion: 2.1 time: 1.572310 Oct 12 08:51:22.627380 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 934/1982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:21 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1318 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:22.632395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:22.632996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:22.646211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:22.648804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:22.649715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:22.650751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:22.651531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:22.652155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:22.753199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:22.812762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:22.829402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:22.835073 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa376550-4808-40d3-a560-7e13136c09d9 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 1.178256 Oct 12 08:51:22.837460 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1049/1983] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:21 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:22.855669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:22.857300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:22.887759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:22.889199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:22.889912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:22.892999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:22.893870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:22.895351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:23.377865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:23.395876 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3cc81704-144c-4b11-bbdf-d12d935a6dae tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 0.556677 Oct 12 08:51:23.418057 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1050/1984] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:22 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:23.425528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:23.426747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:23.436200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:23.436927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:23.437494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:23.438229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:23.438696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:23.439131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:23.478074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:23.487482 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-543e161b-aef9-43a3-90d9-cd540cf011a1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.858817 Oct 12 08:51:23.489032 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 935/1985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:22 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:23.656151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:23.657770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:23.669721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:23.670280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:23.672706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:23.674944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:23.675908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:23.676533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:23.826959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:23.885219 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-702f527a-d6d4-4846-ab5e-1e6a1c024b98 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 0.461441 Oct 12 08:51:23.887421 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1051/1986] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:23 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:23.902127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:23.906075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:23.921318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:23.922036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:23.922659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:23.924516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:23.925164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:23.926496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:24.341061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:24.353276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:24.359672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:24.364884 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-72dd621a-068e-442f-9ee4-eb53798df6c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.475964 Oct 12 08:51:24.389371 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1052/1987] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:23 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:24.396269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6c350c0c-9773-4045-82a7-302f9ad05474 req-5315001c-bbe5-439b-b566-f02ab1054f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7d95ee-3487-4dff-a5bd-fdb822960eb4", "name": "network-vif-plugged", "status": "completed", "tag": "b45dd050-5e1d-4d87-a8a3-65ba4aec6906"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:24.408013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6c350c0c-9773-4045-82a7-302f9ad05474 req-5315001c-bbe5-439b-b566-f02ab1054f9a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:24.408907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6c350c0c-9773-4045-82a7-302f9ad05474 req-5315001c-bbe5-439b-b566-f02ab1054f9a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:24.410033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6c350c0c-9773-4045-82a7-302f9ad05474 req-5315001c-bbe5-439b-b566-f02ab1054f9a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:24.431512 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6c350c0c-9773-4045-82a7-302f9ad05474 req-5315001c-bbe5-439b-b566-f02ab1054f9a service nova] Creating event network-vif-plugged:b45dd050-5e1d-4d87-a8a3-65ba4aec6906 for instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 on n-h2-858383-10 Oct 12 08:51:24.437802 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6c350c0c-9773-4045-82a7-302f9ad05474 req-5315001c-bbe5-439b-b566-f02ab1054f9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046568 Oct 12 08:51:24.439272 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1053/1988] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:24.448297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:24.459741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:24.470811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:24.472036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:24.474397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:24.475503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:24.476357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:24.477118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:24.751264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:24.768625 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57d6dbf9-4d9d-45ff-8947-e8a199623aa2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 0.322998 Oct 12 08:51:24.769924 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1054/1989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:24 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:24.782155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:24.784406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:24.800932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:24.801990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:24.803563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:24.806768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:24.807700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:24.812438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:24.959805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:24.978794 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-385352e2-4008-4ec1-bd48-5dbac5c0c145 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1318 microversion: 2.1 time: 1.327715 Oct 12 08:51:25.000138 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 936/1990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:23 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1318 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:25.017586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:25.018135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:25.038069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:25.040991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:25.041839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:25.042904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:25.046825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:25.047362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:25.422817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:25.440664 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e4ccb3af-ee85-4c2b-a9c1-2a7d0ab0321f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.669246 Oct 12 08:51:25.456914 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1055/1991] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:24 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:25.456914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:25.456914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:25.457875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:25.458737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:25.459282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:25.460166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:25.460728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:25.461229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:25.566277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:25.582435 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cb5bf4f0-b83a-4259-a7c5-5e8de5b1eab9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 0.580681 Oct 12 08:51:25.599878 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 937/1992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:25 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:25.638452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d4c1d5e8-7d02-4460-a0a4-6d2c0147fbcf req-6ff8a1ce-141c-48a4-826c-1bec6fe81ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefe319f-8432-4c1e-991c-0ae636dc43fa", "tag": "633af6c6-0c7b-4c06-ad95-d9e78e945be0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:25.662020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d4c1d5e8-7d02-4460-a0a4-6d2c0147fbcf req-6ff8a1ce-141c-48a4-826c-1bec6fe81ba8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:25.662504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d4c1d5e8-7d02-4460-a0a4-6d2c0147fbcf req-6ff8a1ce-141c-48a4-826c-1bec6fe81ba8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:25.662930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d4c1d5e8-7d02-4460-a0a4-6d2c0147fbcf req-6ff8a1ce-141c-48a4-826c-1bec6fe81ba8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:25.685763 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d4c1d5e8-7d02-4460-a0a4-6d2c0147fbcf req-6ff8a1ce-141c-48a4-826c-1bec6fe81ba8 service nova] Creating event network-changed:633af6c6-0c7b-4c06-ad95-d9e78e945be0 for instance cefe319f-8432-4c1e-991c-0ae636dc43fa on n-h1-858383-10 Oct 12 08:51:25.708102 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d4c1d5e8-7d02-4460-a0a4-6d2c0147fbcf req-6ff8a1ce-141c-48a4-826c-1bec6fe81ba8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069314 Oct 12 08:51:25.709808 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 938/1993] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:25.777680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:25.797874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:25.798589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:25.808457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:25.813473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:25.815313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:25.821156 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-867b3c35-cd9b-446d-b8f1-5c87d7de41d1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.376464 Oct 12 08:51:25.824768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:25.825232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:25.826991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:25.827256 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1056/1994] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:25 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:25.829527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:25.838798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:26.014022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:26.014831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:26.032606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:26.033464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:26.033951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:26.034676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:26.035326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:26.035958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:26.474924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:26.489355 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2f69232-7805-4ccd-8cd0-a908813cf375 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1318 microversion: 2.1 time: 0.479872 Oct 12 08:51:26.492403 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1057/1995] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:26 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:51:26.506370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:26.509079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:26.524292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:26.525307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:26.532019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:26.532839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:26.534108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:26.534695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:26.962225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:26.980259 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eaf1ee40-8f45-4fb1-b505-96be2d634c3e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.486340 Oct 12 08:51:26.980849 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1058/1996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:26 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:26.994666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-565c5dbe-ba76-4948-9f13-19edaf04478c req-eb1f77a2-442e-44f1-b16b-66f0a4b00818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8fcb2b-557f-4c4d-9132-c5b920654d66", "name": "network-vif-plugged", "status": "completed", "tag": "78b0414c-4b02-482c-b1c5-0f008249450c"}, {"server_uuid": "32a51d2b-5b6d-4a71-9352-8077991fc24a", "name": "network-vif-plugged", "status": "completed", "tag": "59a421c6-093f-49ff-8651-dd75acf22037"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:27.025936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-565c5dbe-ba76-4948-9f13-19edaf04478c req-eb1f77a2-442e-44f1-b16b-66f0a4b00818 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:27.026434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-565c5dbe-ba76-4948-9f13-19edaf04478c req-eb1f77a2-442e-44f1-b16b-66f0a4b00818 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:27.026870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-565c5dbe-ba76-4948-9f13-19edaf04478c req-eb1f77a2-442e-44f1-b16b-66f0a4b00818 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:27.051701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-565c5dbe-ba76-4948-9f13-19edaf04478c req-eb1f77a2-442e-44f1-b16b-66f0a4b00818 service nova] Creating event network-vif-plugged:78b0414c-4b02-482c-b1c5-0f008249450c for instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 on n-h1-858383-10 Oct 12 08:51:27.052130 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-565c5dbe-ba76-4948-9f13-19edaf04478c req-eb1f77a2-442e-44f1-b16b-66f0a4b00818 service nova] Creating event network-vif-plugged:59a421c6-093f-49ff-8651-dd75acf22037 for instance 32a51d2b-5b6d-4a71-9352-8077991fc24a on n-h1-858383-10 Oct 12 08:51:27.059575 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-565c5dbe-ba76-4948-9f13-19edaf04478c req-eb1f77a2-442e-44f1-b16b-66f0a4b00818 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071937 Oct 12 08:51:27.060105 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1059/1997] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:27.066037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:27.066774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:27.073196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:27.073793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:27.074997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:27.076189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:27.076811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:27.077400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:27.236562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:27.251171 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-df13ed64-9fe0-4f1d-8c03-3d6cdb34ec14 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 1.458436 Oct 12 08:51:27.253546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 939/1998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:25 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:27.258628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:27.259249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:27.271917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:27.272434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:27.272915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:27.273706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:27.274208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:27.274602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:27.365882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:27.375849 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-265e2248-386a-4c79-b0e7-153ab1adc6c7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 0.314177 Oct 12 08:51:27.376847 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1060/1999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:27 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:27.797302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9caa50c1-138b-499d-adf1-6bb06ce85cc1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'create', calling method: .version_select at 0x7f984804a040>, body: {"keypair": {"name": "tempest-keypair-979373535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzexptnkluFbl8y+giw8ymQuElTrMUpbGu1yX4eAW9X0v2Y0ns48uiIzMcEAmSLGELdMwFuH5fVC8U2Wkl62ZM9s4AFY+jK6U2fF6gKJ3Lbi0IYs7duEVNsqUnv0BIBiQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:27.814139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9caa50c1-138b-499d-adf1-6bb06ce85cc1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for project f1cad6e327a84a128250f945ec1444ac. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:51:27.818719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9caa50c1-138b-499d-adf1-6bb06ce85cc1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for user 54fad01e2e6e41d0887895b131051ee1 and project f1cad6e327a84a128250f945ec1444ac. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:51:27.830474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:27.851022 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9caa50c1-138b-499d-adf1-6bb06ce85cc1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.445102 Oct 12 08:51:27.857837 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1061/2000] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:51:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:51:27.932959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bdcff0c7-bfe4-4f93-a6ff-0cdca3d19314 tempest-QuotaClassesAdmin257Test-230184006 tempest-QuotaClassesAdmin257Test-230184006-project-admin] Calling method '.version_select at 0x7f9843f2d1f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:27.949121 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bdcff0c7-bfe4-4f93-a6ff-0cdca3d19314 tempest-QuotaClassesAdmin257Test-230184006 tempest-QuotaClassesAdmin257Test-230184006-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.094254 Oct 12 08:51:27.950329 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1062/2001] 10.222.0.40 () {60 vars in 1226 bytes} [Wed Oct 12 08:51:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:51:27.955710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:27.956581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:27.964572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:27.965992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:27.966639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:27.967793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:27.968497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:27.969158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:27.995991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:28.007910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:28.009928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:28.012444 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-95a252ee-a6d6-4d44-9f13-1e150c61d884 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.757684 Oct 12 08:51:28.013253 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 940/2002] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:27 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:28.019203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-796bd723-b47e-48e2-8808-3141747d365d req-82ffb04c-f6b8-4ebd-a1b2-4d925313ccda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "tag": "e045665c-7028-4af9-b920-60841faf44eb"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:28.033508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-796bd723-b47e-48e2-8808-3141747d365d req-82ffb04c-f6b8-4ebd-a1b2-4d925313ccda service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.034400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-796bd723-b47e-48e2-8808-3141747d365d req-82ffb04c-f6b8-4ebd-a1b2-4d925313ccda service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.035577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-796bd723-b47e-48e2-8808-3141747d365d req-82ffb04c-f6b8-4ebd-a1b2-4d925313ccda service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:28.051828 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-796bd723-b47e-48e2-8808-3141747d365d req-82ffb04c-f6b8-4ebd-a1b2-4d925313ccda service nova] Creating event network-changed:e045665c-7028-4af9-b920-60841faf44eb for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:51:28.058874 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-796bd723-b47e-48e2-8808-3141747d365d req-82ffb04c-f6b8-4ebd-a1b2-4d925313ccda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043731 Oct 12 08:51:28.060915 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 941/2003] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:28.073288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7dabad1b-6414-49d1-b044-8dc2fb9cd3cf tempest-QuotaClassesAdmin257Test-230184006 tempest-QuotaClassesAdmin257Test-230184006-project-admin] Action: 'update', calling method: .version_select at 0x7f98488915e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:28.110001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:28.329720 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7dabad1b-6414-49d1-b044-8dc2fb9cd3cf tempest-QuotaClassesAdmin257Test-230184006 tempest-QuotaClassesAdmin257Test-230184006-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.267228 Oct 12 08:51:28.331705 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 942/2004] 10.222.0.40 () {62 vars in 1247 bytes} [Wed Oct 12 08:51:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:51:28.337846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:28.339008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:28.350086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.351772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.352949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:28.354488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.355362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.356644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:28.403069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:28.415746 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73b1805c-b4dc-415e-a456-e152c6f62b56 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 200 len: 1506 microversion: 2.1 time: 0.463941 Oct 12 08:51:28.417004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1063/2005] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:27 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:28.425984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:28.425984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:28.433748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.434505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.435108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:28.436297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.436902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.437498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:28.462719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:28.742244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:28.751420 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66647a1a-54e4-448f-82d5-4a1ed61e8103 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 0.333064 Oct 12 08:51:28.753742 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1064/2006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:28 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:28.768056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:28.769537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1813fba6-8e3c-49a1-84e3-4e52b6abeed5 tempest-QuotaClassesAdmin257Test-230184006 tempest-QuotaClassesAdmin257Test-230184006-project-admin] Calling method '.version_select at 0x7f9843f51670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:28.780125 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d422ca4c-5764-463d-b129-655b05e336b0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.446817 Oct 12 08:51:28.781039 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 943/2007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:28 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:28.787116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:28.787741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:28.795583 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1813fba6-8e3c-49a1-84e3-4e52b6abeed5 tempest-QuotaClassesAdmin257Test-230184006 tempest-QuotaClassesAdmin257Test-230184006-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.037481 Oct 12 08:51:28.795955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.796294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.797139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:28.797368 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1065/2008] 10.222.0.40 () {60 vars in 1226 bytes} [Wed Oct 12 08:51:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:51:28.797914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.798460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.798892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:28.809594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:28.812045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:28.832139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.837168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.838935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:28.840205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:28.840978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:28.841678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:29.162696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:29.171550 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4992a6f2-0474-4a6f-a8bb-80f50aea6735 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66" status: 200 len: 1318 microversion: 2.1 time: 0.372101 Oct 12 08:51:29.177947 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1066/2009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:28 2022] GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:29.194744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-594cdd11-5432-4da5-8d22-b0abf8209e73 tempest-QuotaClassesAdmin257Test-230184006 tempest-QuotaClassesAdmin257Test-230184006-project-admin] Action: 'update', calling method: .version_select at 0x7f984cc374c0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:29.222173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:29.238482 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e7dbb30c-d1ca-4960-8801-e09348d5e927 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 0.456201 Oct 12 08:51:29.239486 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 944/2010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:28 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:29.255033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:29.255835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:29.263556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:29.264081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:29.264535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:29.265298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:29.269944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:29.270415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:29.300226 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-594cdd11-5432-4da5-8d22-b0abf8209e73 tempest-QuotaClassesAdmin257Test-230184006 tempest-QuotaClassesAdmin257Test-230184006-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.120896 Oct 12 08:51:29.310076 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1067/2011] 10.222.0.40 () {62 vars in 1247 bytes} [Wed Oct 12 08:51:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:51:29.780578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:29.781201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:29.794504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:29.798842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:29.799461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:29.800263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:29.814887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:29.821039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:29.893817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:29.906679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:29.911938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:29.916016 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-55176857-3d02-4d26-98ab-521bc0fb22a1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.674409 Oct 12 08:51:29.917335 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 945/2012] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:29 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:29.935841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:29.938887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:29.960248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:29.962273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:29.964459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:29.968717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:29.969541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:29.973192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:31.059144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:31.098372 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2453f618-320e-468d-aae1-1d7293e9f7a6 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1315 microversion: 2.1 time: 1.316793 Oct 12 08:51:31.102447 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1068/2013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:29 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1315 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:31.121532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:31.122788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:31.131744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:31.132290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:31.132882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:31.133797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:31.134650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:31.135629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:31.153429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:31.166415 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c47ca26-b3e6-4a26-b8bf-e29873f53309 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 1.245672 Oct 12 08:51:31.167276 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 946/2014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:29 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:31.192124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:31.193186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:31.208222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:31.210958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:31.211561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:31.214942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:31.215548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:31.216968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:31.432466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:31.458687 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a7b39e4c-38b5-4079-b445-4c628716fe9e tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66" status: 200 len: 1506 microversion: 2.1 time: 0.353793 Oct 12 08:51:31.528920 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1069/2015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:31 2022] GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:31.542920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-93479bd9-a451-4f1c-9872-2e882ad69873 req-fc838896-4550-438c-82c1-968c63f5f2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f1fe07-9eb6-4da6-8b88-0c4df059868e", "name": "network-vif-unplugged", "status": "completed", "tag": "163ca692-7dfb-4edc-81ef-916821ba1cbc"}, {"name": "network-changed", "server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "tag": "56a53eb6-be28-4a3c-8084-f457f6be5c2b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:31.592921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-93479bd9-a451-4f1c-9872-2e882ad69873 req-fc838896-4550-438c-82c1-968c63f5f2f6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:31.594965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-93479bd9-a451-4f1c-9872-2e882ad69873 req-fc838896-4550-438c-82c1-968c63f5f2f6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:31.595546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-93479bd9-a451-4f1c-9872-2e882ad69873 req-fc838896-4550-438c-82c1-968c63f5f2f6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:31.637741 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-93479bd9-a451-4f1c-9872-2e882ad69873 req-fc838896-4550-438c-82c1-968c63f5f2f6 service nova] Creating event network-vif-unplugged:163ca692-7dfb-4edc-81ef-916821ba1cbc for instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e on n-h1-858383-10 Oct 12 08:51:31.641593 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-93479bd9-a451-4f1c-9872-2e882ad69873 req-fc838896-4550-438c-82c1-968c63f5f2f6 service nova] Creating event network-changed:56a53eb6-be28-4a3c-8084-f457f6be5c2b for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:51:31.656497 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-93479bd9-a451-4f1c-9872-2e882ad69873 req-fc838896-4550-438c-82c1-968c63f5f2f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.125055 Oct 12 08:51:31.657836 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1070/2016] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:31.666660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:31.667647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:31.694268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:31.694864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:31.696217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:31.697034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:31.700026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:31.700958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:32.018194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:32.032544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:32.035543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:32.037220 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7bbb7660-867d-4f06-8bf9-42f30f3d0107 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.378023 Oct 12 08:51:32.038249 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1071/2017] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:31 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:32.044520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:32.045493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:32.053712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:32.054837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:32.055573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:32.056532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:32.057393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:32.058132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:32.103705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:32.242162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:32.258309 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e29bf54-acf0-4829-88c3-4d475b32902e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 1.078887 Oct 12 08:51:32.259802 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-100d3461-1a25-4f76-a99b-589f17fd6381 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66" status: 204 len: 0 microversion: 2.1 time: 0.219636 Oct 12 08:51:32.260573 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 947/2018] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:31 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:32.270272 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1072/2019] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:51:32 2022] DELETE /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:32.273533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-551894703", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d30a231a-ae95-4ebb-90c8-46232d6674b8"}], "security_groups": [{"name": "tempest-securitygroup--1743399421"}], "key_name": "tempest-keypair-979373535", "user_data": "}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:32.297679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:32.300278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:32.317688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:32.322317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:32.324039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:32.326341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:32.330672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:32.331700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:32.654932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] validate_networks() for [('d30a231a-ae95-4ebb-90c8-46232d6674b8', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:51:32.704796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:32.735682 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e002fcf6-c196-43cb-96d4-cca913d9f590 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1504 microversion: 2.1 time: 0.463450 Oct 12 08:51:32.742505 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1073/2020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:32 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:32.751584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:32.753768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:32.773635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:32.774500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:32.775179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:32.778225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:32.781127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:32.781885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:33.139167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:33.149252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a8943c7c-6fe4-4882-9f52-58b240928bed tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.405516 Oct 12 08:51:33.169259 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1074/2021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:32 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:33.174657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:33.177482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:33.193123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:33.193649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:33.199542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:33.204255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:33.206626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:33.207540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:33.275302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:33.433716 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3228c810-6eeb-4ac2-ac52-6a993c1ed40c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 204 len: 0 microversion: 2.1 time: 0.262714 Oct 12 08:51:33.434316 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1075/2022] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:51:33 2022] DELETE /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:33.446536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-512778808"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:33.447000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:33.459281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:33.460268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:33.460918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:33.462742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:33.463396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:33.464010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:33.669023 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.network.security_group_api [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Adding security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 to port 59a421c6-093f-49ff-8651-dd75acf22037 Oct 12 08:51:33.885468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:51:33.886039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:51:33.886595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:51:33.887005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:51:33.887443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:51:33.905632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:33.909818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:33.910366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:33.911599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:33.912076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:33.912509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:33.957687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:51:33.966432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for user 54fad01e2e6e41d0887895b131051ee1 and project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:51:33.995883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:51:34.000358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:51:34.081357 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb0017d9-d023-498b-84f3-534cd70f0248 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.818310 Oct 12 08:51:34.082540 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 948/2023] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:51:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:51:34.094442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:34.095300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:34.102832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.103553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.104197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.105303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.105933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.106520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.266809 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43c8fe4e-a0ab-4110-8643-d835d0f7243c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a/action" status: 202 len: 0 microversion: 2.1 time: 0.827643 Oct 12 08:51:34.270765 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1076/2024] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:51:33 2022] POST /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a/action => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:51:34.276116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:34.276854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:34.290559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.291086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.291869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.292713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.293396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.294134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.528806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:34.539855 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-30896226-ec08-4f24-a91c-f88576ce193c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 0.267601 Oct 12 08:51:34.540726 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1077/2025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:34 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:34.546446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:34.547535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:34.558837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.559479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.560188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.561541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.562215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.562911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.764177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:34.779545 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ffefe6e1-2743-4e0a-b630-f1867e5649ec tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66" status: 200 len: 1512 microversion: 2.1 time: 0.237021 Oct 12 08:51:34.795011 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1078/2026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:34 2022] GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:34.795011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cb711e35-9109-4b5f-ae01-b8f292218060 req-f3b67c12-6408-4f9e-8583-3d8911aa1c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f1fe07-9eb6-4da6-8b88-0c4df059868e", "tag": "163ca692-7dfb-4edc-81ef-916821ba1cbc"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:34.797588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb711e35-9109-4b5f-ae01-b8f292218060 req-f3b67c12-6408-4f9e-8583-3d8911aa1c18 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.798289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb711e35-9109-4b5f-ae01-b8f292218060 req-f3b67c12-6408-4f9e-8583-3d8911aa1c18 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.798901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb711e35-9109-4b5f-ae01-b8f292218060 req-f3b67c12-6408-4f9e-8583-3d8911aa1c18 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.812361 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cb711e35-9109-4b5f-ae01-b8f292218060 req-f3b67c12-6408-4f9e-8583-3d8911aa1c18 service nova] Creating event network-changed:163ca692-7dfb-4edc-81ef-916821ba1cbc for instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e on n-h1-858383-10 Oct 12 08:51:34.817986 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cb711e35-9109-4b5f-ae01-b8f292218060 req-f3b67c12-6408-4f9e-8583-3d8911aa1c18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036425 Oct 12 08:51:34.818856 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1079/2027] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:34.824773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:34.825509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:34.836893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.837391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.851823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.861596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.861993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.862445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.949925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:34.958336 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2f2be74-b12d-4243-8b12-256a14704649 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1241 microversion: 2.1 time: 0.138218 Oct 12 08:51:34.969825 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1080/2028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:34 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:34.978262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:34.978893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:34.986891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.988374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.989511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.990936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:34.991722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:34.992539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:34.997678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:35.018612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:35.020140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:35.022588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:35.028703 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f4d17b48-2313-424a-9ff0-5b419fedd6b2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.938885 Oct 12 08:51:35.044405 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 949/2029] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:34 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:35.065473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba0de3a6-59ef-4347-b9b3-0e416a920f6d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848ca7a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:35.376407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:35.385358 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-232d81c7-1c3f-469e-8713-adb192863da6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.413954 Oct 12 08:51:35.386144 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1081/2030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:34 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:35.391634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f2051e87-7d0d-4106-92b3-8876badc6702 req-04d1e901-a33e-4a91-90cd-b2ae57519007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a51d2b-5b6d-4a71-9352-8077991fc24a", "tag": "59a421c6-093f-49ff-8651-dd75acf22037"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:35.401761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f2051e87-7d0d-4106-92b3-8876badc6702 req-04d1e901-a33e-4a91-90cd-b2ae57519007 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.402461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f2051e87-7d0d-4106-92b3-8876badc6702 req-04d1e901-a33e-4a91-90cd-b2ae57519007 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.403042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f2051e87-7d0d-4106-92b3-8876badc6702 req-04d1e901-a33e-4a91-90cd-b2ae57519007 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.417191 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f2051e87-7d0d-4106-92b3-8876badc6702 req-04d1e901-a33e-4a91-90cd-b2ae57519007 service nova] Creating event network-changed:59a421c6-093f-49ff-8651-dd75acf22037 for instance 32a51d2b-5b6d-4a71-9352-8077991fc24a on n-h1-858383-10 Oct 12 08:51:35.423358 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f2051e87-7d0d-4106-92b3-8876badc6702 req-04d1e901-a33e-4a91-90cd-b2ae57519007 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035907 Oct 12 08:51:35.424566 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1082/2031] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:35.599210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7696b8a5-dbc6-400d-b18d-96d0628334bd tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:35.605036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7696b8a5-dbc6-400d-b18d-96d0628334bd tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.607713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7696b8a5-dbc6-400d-b18d-96d0628334bd tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.608371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7696b8a5-dbc6-400d-b18d-96d0628334bd tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.610384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7696b8a5-dbc6-400d-b18d-96d0628334bd tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.612214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7696b8a5-dbc6-400d-b18d-96d0628334bd tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.612830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7696b8a5-dbc6-400d-b18d-96d0628334bd tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.696769 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7696b8a5-dbc6-400d-b18d-96d0628334bd tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.270778 Oct 12 08:51:35.699397 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1083/2032] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:51:35 2022] GET /compute/v2.1/os-services => generated 949 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:35.707346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:35.713301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-ba0de3a6-59ef-4347-b9b3-0e416a920f6d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 in use.", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:51:35.714205 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ba0de3a6-59ef-4347-b9b3-0e416a920f6d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security Group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 in use. Oct 12 08:51:35.714205 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-349dcb2b-8dc4-4b1e-aa9a-b0718d3edf13'] Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba0de3a6-59ef-4347-b9b3-0e416a920f6d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-security-groups/f7d1fbf5-7cef-4428-9822-fd1978d54dd5 HTTP/1.1 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: exception: Security Group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 in use. Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-349dcb2b-8dc4-4b1e-aa9a-b0718d3edf13'] Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f7d1fbf5-7cef-4428-9822-fd1978d54dd5'} Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:51:35.722631 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 in use. Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-349dcb2b-8dc4-4b1e-aa9a-b0718d3edf13'] Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 in use. Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-349dcb2b-8dc4-4b1e-aa9a-b0718d3edf13'] Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 in use. Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-349dcb2b-8dc4-4b1e-aa9a-b0718d3edf13'] Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 in use. Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-349dcb2b-8dc4-4b1e-aa9a-b0718d3edf13'] Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba0de3a6-59ef-4347-b9b3-0e416a920f6d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 400 to user: Security Group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 in use. Oct 12 08:51:35.728816 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-349dcb2b-8dc4-4b1e-aa9a-b0718d3edf13'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:51:35.733009 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba0de3a6-59ef-4347-b9b3-0e416a920f6d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f7d1fbf5-7cef-4428-9822-fd1978d54dd5" status: 400 len: 185 microversion: 2.1 time: 0.681450 Oct 12 08:51:35.734407 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 950/2033] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:51:35 2022] DELETE /compute/v2.1/os-security-groups/f7d1fbf5-7cef-4428-9822-fd1978d54dd5 => generated 185 bytes in 689 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:51:35.737596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:35.742625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b9bfb0f8-6c63-4f7e-b662-129ef0ce195e tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:35.752518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.756957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.758147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0f8-6c63-4f7e-b662-129ef0ce195e tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.759023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0f8-6c63-4f7e-b662-129ef0ce195e tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.759458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.760506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.761218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0f8-6c63-4f7e-b662-129ef0ce195e tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.762312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0f8-6c63-4f7e-b662-129ef0ce195e tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.763063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.763795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.764576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0f8-6c63-4f7e-b662-129ef0ce195e tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.766994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9bfb0f8-6c63-4f7e-b662-129ef0ce195e tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.847147 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b9bfb0f8-6c63-4f7e-b662-129ef0ce195e tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.102260 Oct 12 08:51:35.848445 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 951/2034] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 12 08:51:35 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:35.853720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:35.860004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:35.869245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.870052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.870850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.871804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:35.872484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:35.873133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:35.975099 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a67ed88c-a5e4-44f6-ab28-47873741dbd0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a/action" status: 202 len: 0 microversion: 2.1 time: 0.125003 Oct 12 08:51:35.976826 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 952/2035] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:51:35 2022] POST /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:51:36.003226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.006128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:36.044316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.046842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.047694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.052255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.055681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.056456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.074267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:36.083251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8c1f01d1-b71b-41d2-9c56-b469c76ee128 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 0.381948 Oct 12 08:51:36.099152 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1084/2036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:35 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:36.108071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c04e44a1-f40f-44a3-baa0-3c423004883d tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.113484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c04e44a1-f40f-44a3-baa0-3c423004883d tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.114134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c04e44a1-f40f-44a3-baa0-3c423004883d tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.114738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c04e44a1-f40f-44a3-baa0-3c423004883d tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.115593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c04e44a1-f40f-44a3-baa0-3c423004883d tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.116635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c04e44a1-f40f-44a3-baa0-3c423004883d tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.117301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c04e44a1-f40f-44a3-baa0-3c423004883d tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.155161 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c04e44a1-f40f-44a3-baa0-3c423004883d tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.054205 Oct 12 08:51:36.156388 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1085/2037] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/os-services => generated 949 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:36.161872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b31dd9ca-730c-4479-901c-1f9f95340977 req-f9e3df65-75b3-43bf-b723-1cafa4eee049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefe319f-8432-4c1e-991c-0ae636dc43fa", "name": "network-vif-plugged", "status": "completed", "tag": "633af6c6-0c7b-4c06-ad95-d9e78e945be0"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:36.175253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b31dd9ca-730c-4479-901c-1f9f95340977 req-f9e3df65-75b3-43bf-b723-1cafa4eee049 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.175872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b31dd9ca-730c-4479-901c-1f9f95340977 req-f9e3df65-75b3-43bf-b723-1cafa4eee049 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.176437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b31dd9ca-730c-4479-901c-1f9f95340977 req-f9e3df65-75b3-43bf-b723-1cafa4eee049 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.193714 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b31dd9ca-730c-4479-901c-1f9f95340977 req-f9e3df65-75b3-43bf-b723-1cafa4eee049 service nova] Creating event network-vif-plugged:633af6c6-0c7b-4c06-ad95-d9e78e945be0 for instance cefe319f-8432-4c1e-991c-0ae636dc43fa on n-h1-858383-10 Oct 12 08:51:36.199193 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b31dd9ca-730c-4479-901c-1f9f95340977 req-f9e3df65-75b3-43bf-b723-1cafa4eee049 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041388 Oct 12 08:51:36.199945 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1086/2038] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:36.205733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.207463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:36.215261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:36.216993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.217939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.218840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.220679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.223233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.224002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.229269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bdf507a6-3a13-470a-81bc-5da37d3c6b7d tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66" status: 200 len: 1470 microversion: 2.1 time: 0.248829 Oct 12 08:51:36.234202 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 953/2039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:35 2022] GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66 => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:36.249724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.250448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:36.262634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.265747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.266436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.269773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.270696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.274809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.335352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:36.344477 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-919bd825-e045-4b24-bbeb-6f1e363b1263 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1297 microversion: 2.1 time: 0.142997 Oct 12 08:51:36.345722 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1087/2040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:36.356084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.363264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:36.369938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.370381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.370835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.371995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.372139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.372519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.598454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:36.608088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:36.610017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:36.611541 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-276b7086-718d-4095-a598-241806ef0158 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.264549 Oct 12 08:51:36.626638 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1088/2041] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:36.636181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-294777e7-51d1-48ea-975c-11579a7ee6fa tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.641122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-294777e7-51d1-48ea-975c-11579a7ee6fa tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.642231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-294777e7-51d1-48ea-975c-11579a7ee6fa tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.642850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-294777e7-51d1-48ea-975c-11579a7ee6fa tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.643823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-294777e7-51d1-48ea-975c-11579a7ee6fa tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.644275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-294777e7-51d1-48ea-975c-11579a7ee6fa tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.644879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-294777e7-51d1-48ea-975c-11579a7ee6fa tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.674331 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-294777e7-51d1-48ea-975c-11579a7ee6fa tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-858383-10&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.046216 Oct 12 08:51:36.675475 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1089/2042] 10.222.0.40 () {58 vars in 1196 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/os-services?host=n-d-858383-10&binary=xxx => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:51:36.680904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.681762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:36.688932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.689745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.690382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.691281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.691940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.692576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.777729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:36.783217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:36.807868 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-177b8084-6cbf-4123-8d81-46c337dcd420 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1574 microversion: 2.1 time: 0.572139 Oct 12 08:51:36.814673 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 954/2043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1574 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:36.820862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-829115c5-47fc-4838-9c8f-787a4d036a92 tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.828216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-829115c5-47fc-4838-9c8f-787a4d036a92 tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.829517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-829115c5-47fc-4838-9c8f-787a4d036a92 tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.830362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-829115c5-47fc-4838-9c8f-787a4d036a92 tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.832638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-829115c5-47fc-4838-9c8f-787a4d036a92 tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.835683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-829115c5-47fc-4838-9c8f-787a4d036a92 tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.837159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-829115c5-47fc-4838-9c8f-787a4d036a92 tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.872991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-829115c5-47fc-4838-9c8f-787a4d036a92 tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.055439 Oct 12 08:51:36.875599 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 955/2044] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/os-services => generated 949 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:36.888536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cad4f5ec-d50f-4fdd-9646-abd9eaf2f97b tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:36.893879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cad4f5ec-d50f-4fdd-9646-abd9eaf2f97b tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.894940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cad4f5ec-d50f-4fdd-9646-abd9eaf2f97b tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.895962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cad4f5ec-d50f-4fdd-9646-abd9eaf2f97b tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.897239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cad4f5ec-d50f-4fdd-9646-abd9eaf2f97b tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.898669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cad4f5ec-d50f-4fdd-9646-abd9eaf2f97b tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.899397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cad4f5ec-d50f-4fdd-9646-abd9eaf2f97b tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.908607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:36.928849 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b8116820-300a-48d9-b34e-79683f3e2be1 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.251925 Oct 12 08:51:36.930450 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1090/2045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:36.946079 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cad4f5ec-d50f-4fdd-9646-abd9eaf2f97b tempest-ServicesAdminNegativeTestJSON-762244795 tempest-ServicesAdminNegativeTestJSON-762244795-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.061868 Oct 12 08:51:36.956131 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 956/2046] 10.222.0.40 () {58 vars in 1198 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:51:36.967584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-470c14ed-ba24-4a59-9d00-0dfc0fa9d582 req-0a88d934-ab2b-4916-ba4b-21182ae4c43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8fcb2b-557f-4c4d-9132-c5b920654d66", "name": "network-vif-deleted", "tag": "78b0414c-4b02-482c-b1c5-0f008249450c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:36.978625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-470c14ed-ba24-4a59-9d00-0dfc0fa9d582 req-0a88d934-ab2b-4916-ba4b-21182ae4c43c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:36.979104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-470c14ed-ba24-4a59-9d00-0dfc0fa9d582 req-0a88d934-ab2b-4916-ba4b-21182ae4c43c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:36.979536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-470c14ed-ba24-4a59-9d00-0dfc0fa9d582 req-0a88d934-ab2b-4916-ba4b-21182ae4c43c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:36.992998 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-470c14ed-ba24-4a59-9d00-0dfc0fa9d582 req-0a88d934-ab2b-4916-ba4b-21182ae4c43c service nova] Creating event network-vif-deleted:78b0414c-4b02-482c-b1c5-0f008249450c for instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 on n-h1-858383-10 Oct 12 08:51:36.998340 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-470c14ed-ba24-4a59-9d00-0dfc0fa9d582 req-0a88d934-ab2b-4916-ba4b-21182ae4c43c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037228 Oct 12 08:51:36.999365 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 957/2047] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:37.084893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-287304e6-ec58-497f-83c5-f514ba50023b tempest-ServicesAdminNegativeTestJSON-216494353 tempest-ServicesAdminNegativeTestJSON-216494353-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:37.089232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-287304e6-ec58-497f-83c5-f514ba50023b tempest-ServicesAdminNegativeTestJSON-216494353 tempest-ServicesAdminNegativeTestJSON-216494353-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e7bd959c98e74df4b67840a0bf26b828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a2fa0a228945ba86b60e5763bea4c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-287304e6-ec58-497f-83c5-f514ba50023b tempest-ServicesAdminNegativeTestJSON-216494353 tempest-ServicesAdminNegativeTestJSON-216494353-project] Request method failure captured: Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoAVuJoORqkKm52d2nJnBOyuSL_jYmtyxAPp7Pfb6Ql3gpXByd0_DDJT4fnDOnxNd5UPdXs2utZCvZpbSCbdQE7CX67lLgBGJWiRTQ4wrLEagJZqR6R44aCQ5JK0V_kasy-hw0sTaR0Pr3gnXEhc7uOqlXURyvf-oGHJRMmnMHk3L5M Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 74a2fa0a228945ba86b60e5763bea4c8 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-216494353 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/74a2fa0a228945ba86b60e5763bea4c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/74a2fa0a228945ba86b60e5763bea4c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_74a2fa0a228945ba86b60e5763bea4c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/74a2fa0a228945ba86b60e5763bea4c8"}]}] Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-216494353 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 74a2fa0a228945ba86b60e5763bea4c8 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-216494353 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServicesAdminNegativeTestJSON-216494353-project Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e7bd959c98e74df4b67840a0bf26b828 Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-216494353-project Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 08:51:37.091528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-287304e6-ec58-497f-83c5-f514ba50023b tempest-ServicesAdminNegativeTestJSON-216494353 tempest-ServicesAdminNegativeTestJSON-216494353-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-287304e6-ec58-497f-83c5-f514ba50023b tempest-ServicesAdminNegativeTestJSON-216494353 tempest-ServicesAdminNegativeTestJSON-216494353-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.137410 Oct 12 08:51:37.096141 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1091/2048] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:51:36 2022] GET /compute/v2.1/os-services => generated 112 bytes in 139 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:51:37.122944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:37.124305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:37.141077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.141617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.142050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:37.142767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.143219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.143645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:37.255715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:37.256508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:37.272622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.280027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.285300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:37.289336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.290805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.291998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:37.404907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.405404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.414204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:37.414693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lazy-loading 'fault' on Instance uuid 8d8fcb2b-557f-4c4d-9132-c5b920654d66 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:51:37.544019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a51ff84665bb49ef9ed92a5fbb46d25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e612677bf8be4aee953bf54c1ee0a994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:37.556494 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b6f90e03-2290-440b-a352-152e6e1233dc tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66" status: 200 len: 1308 microversion: 2.1 time: 0.305347 Oct 12 08:51:37.560054 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1092/2049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:37 2022] GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66 => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:51:37.568783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:37.571239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:37.588320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.590569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.591228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:37.593841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.594777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.596657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:37.722584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:37.730944 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-594bf76e-c549-44e1-91bd-9093d4d4a34a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1297 microversion: 2.1 time: 0.167539 Oct 12 08:51:37.745156 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1093/2050] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:37 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1297 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:37.767621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:37.776201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:37.791870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=9 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:37.800994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.802394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.803413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:37.804873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:37.810017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:37.811399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:38.291613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:38.319707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:38.329323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:38.330915 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-006caaa5-883c-47f2-b6e4-674d3c620d1a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.594335 Oct 12 08:51:38.331865 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1094/2051] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:37 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:38.337742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:38.338961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:38.346086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:38.349022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:38.349782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:38.350416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:38.351343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:38.352001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:38.352638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:38.362278 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6784194b-29c5-4a05-9dab-a4f2089ea9ff tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1317 microversion: 2.1 time: 1.252792 Oct 12 08:51:38.362781 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 958/2052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:37 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1317 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:38.437837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:38.438590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:38.472950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:38.475971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:38.478775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:38.481386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:38.486059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:38.487842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:38.819129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:38.843016 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d773d7b0-8809-4e16-bf7b-bbc3e0058e88 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1574 microversion: 2.1 time: 0.507424 Oct 12 08:51:38.847700 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1095/2053] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:38 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1574 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:38.865194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:38.868872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 8d8fcb2b-557f-4c4d-9132-c5b920654d66] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:38.889091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:38.892244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:38.893611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:38.899223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:38.900190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:38.902407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:38.952087 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] HTTP exception thrown: Instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 could not be found. Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Request method failure captured: Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66 HTTP/1.1 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn_V6y-7hTEQCYQpU6a7QNyxq7T4lBRj_KpZ3KDDnhh-D_kVhCn0qFVgsvTGjxmF9SWuMaUF8np3LpL_IhVQyPz-lduuUmP8jZPt51yTN0Refhg45J4Gx6HFxd4mzJZeNlJkrVpyZxls4Hg5ySKsAL1Zx_uQAYJaoqNMcKEnifVgfl4 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e612677bf8be4aee953bf54c1ee0a994 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-MultipleCreateTestJSON-555164212 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e612677bf8be4aee953bf54c1ee0a994"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e612677bf8be4aee953bf54c1ee0a994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e612677bf8be4aee953bf54c1ee0a994"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e612677bf8be4aee953bf54c1ee0a994"}]}] Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-MultipleCreateTestJSON-555164212 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e612677bf8be4aee953bf54c1ee0a994 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-MultipleCreateTestJSON-555164212 Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-MultipleCreateTestJSON-555164212-project Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: a51ff84665bb49ef9ed92a5fbb46d25a Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-MultipleCreateTestJSON-555164212-project Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 could not be found. Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '8d8fcb2b-557f-4c4d-9132-c5b920654d66'} Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 could not be found. Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 could not be found. Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:38.957589 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 could not be found. Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Returning 404 to user: Instance 8d8fcb2b-557f-4c4d-9132-c5b920654d66 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f38b3807-31d8-46ef-829b-f41c0f2beed3 tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66" status: 404 len: 111 microversion: 2.1 time: 0.108986 Oct 12 08:51:38.967805 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1096/2054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:38 2022] GET /compute/v2.1/servers/8d8fcb2b-557f-4c4d-9132-c5b920654d66 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:51:38.973414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:38.975463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:38.997869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:38.998683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:38.999305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:39.000227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:39.000858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:39.001473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:39.182751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:39.198935 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-25ffccb8-380f-4ae2-b7aa-b8d581bf3b30 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1295 microversion: 2.1 time: 0.234736 Oct 12 08:51:39.219193 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1097/2055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:38 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1295 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:39.232693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:39.234792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] [instance: 2a7d95ee-3487-4dff-a5bd-fdb822960eb4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:39.252528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:39.257624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:39.257624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:39.257624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:39.257624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:39.257624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:39.300327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=10 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:39.308716 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] HTTP exception thrown: Instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 could not be found. Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Request method failure captured: Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 HTTP/1.1 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn_V6y-7hTEQCYQpU6a7QNyxq7T4lBRj_KpZ3KDDnhh-D_kVhCn0qFVgsvTGjxmF9SWuMaUF8np3LpL_IhVQyPz-lduuUmP8jZPt51yTN0Refhg45J4Gx6HFxd4mzJZeNlJkrVpyZxls4Hg5ySKsAL1Zx_uQAYJaoqNMcKEnifVgfl4 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e612677bf8be4aee953bf54c1ee0a994 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-MultipleCreateTestJSON-555164212 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e612677bf8be4aee953bf54c1ee0a994"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e612677bf8be4aee953bf54c1ee0a994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e612677bf8be4aee953bf54c1ee0a994"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e612677bf8be4aee953bf54c1ee0a994"}]}] Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-MultipleCreateTestJSON-555164212 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e612677bf8be4aee953bf54c1ee0a994 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-MultipleCreateTestJSON-555164212 Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-MultipleCreateTestJSON-555164212-project Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: a51ff84665bb49ef9ed92a5fbb46d25a Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-MultipleCreateTestJSON-555164212-project Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 could not be found. Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2a7d95ee-3487-4dff-a5bd-fdb822960eb4'} Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 could not be found. Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 could not be found. Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:39.313883 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 could not be found. Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] Returning 404 to user: Instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:51:39.319193 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a35ce708-34fc-417b-9e58-4aa230e6fe6c tempest-MultipleCreateTestJSON-555164212 tempest-MultipleCreateTestJSON-555164212-project] 10.222.0.40 "GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4" status: 404 len: 111 microversion: 2.1 time: 0.094680 Oct 12 08:51:39.320536 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1098/2056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:39 2022] GET /compute/v2.1/servers/2a7d95ee-3487-4dff-a5bd-fdb822960eb4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:51:39.377610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:39.382301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:39.409126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:39.409673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:39.410122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:39.410865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:39.411408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:39.411845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:39.921824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:39.950951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:39.952460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:39.953708 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9eb3bb9c-a8d0-4430-8b37-14299947ad31 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.586480 Oct 12 08:51:39.954283 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1099/2057] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:39 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:51:39.980734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:39.981347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:40.015181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:40.016099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:40.016720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:40.023254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:40.024154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:40.024956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:40.585690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:40.603014 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67d27349-2f19-496c-a88b-2b6ee3cebc79 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1466 microversion: 2.1 time: 0.617950 Oct 12 08:51:40.615216 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1100/2058] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:39 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1466 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:40.627664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-fc63f769-819d-4dc7-869d-2664058cb0e1 req-555975b2-d536-437a-8421-896a85972cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7d95ee-3487-4dff-a5bd-fdb822960eb4", "name": "network-vif-deleted", "tag": "b45dd050-5e1d-4d87-a8a3-65ba4aec6906"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:40.660434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fc63f769-819d-4dc7-869d-2664058cb0e1 req-555975b2-d536-437a-8421-896a85972cb5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:40.661327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fc63f769-819d-4dc7-869d-2664058cb0e1 req-555975b2-d536-437a-8421-896a85972cb5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:40.661975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fc63f769-819d-4dc7-869d-2664058cb0e1 req-555975b2-d536-437a-8421-896a85972cb5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:40.686252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-fc63f769-819d-4dc7-869d-2664058cb0e1 req-555975b2-d536-437a-8421-896a85972cb5 service nova] Creating event network-vif-deleted:b45dd050-5e1d-4d87-a8a3-65ba4aec6906 for instance 2a7d95ee-3487-4dff-a5bd-fdb822960eb4 on n-h2-858383-10 Oct 12 08:51:40.699293 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-fc63f769-819d-4dc7-869d-2664058cb0e1 req-555975b2-d536-437a-8421-896a85972cb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082384 Oct 12 08:51:40.701426 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1101/2059] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:40.715615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:40.720300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:40.731701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:40.737388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:40.738200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:40.739128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:40.739786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:40.743026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:40.817328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:40.826528 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad8126ac-4619-40b3-9681-d34e58b3c7db tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 2.434837 Oct 12 08:51:40.832588 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 959/2060] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:38 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 2469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:40.843542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:40.844548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:40.857165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:40.859130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:40.862426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:40.867968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:40.868714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:40.869473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:41.037126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:41.051542 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb946cc5-fc01-4d0e-a102-30fa48d3260e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1574 microversion: 2.1 time: 0.346720 Oct 12 08:51:41.052539 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1102/2061] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:40 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1574 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:41.064503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:41.065186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:41.074847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:41.077230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:41.081127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:41.082206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:41.082994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:41.085525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:41.249845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:41.263431 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-21014e51-f072-4ceb-b3c7-7de4c9c295d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1295 microversion: 2.1 time: 0.426007 Oct 12 08:51:41.266321 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 960/2062] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:40 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1295 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:41.278715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:41.283558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:41.317227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:41.319931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:41.321286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:41.322999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:41.324996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:41.326376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:41.469995 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cb808a24-036a-4a91-b907-6f62c4009c25 tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1619 microversion: 2.1 time: 0.412601 Oct 12 08:51:41.471134 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1103/2063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:41 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1619 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:41.883965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:41.885738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:41.894798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:41.895914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:41.897192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:41.899313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:41.900419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:41.901105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:41.938977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:42.074810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:42.090825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:42.094549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:42.098569 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e65310cd-f96f-4b43-b0c2-2a828628049d tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.828945 Oct 12 08:51:42.100045 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 961/2064] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:41 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:42.105861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-685777956", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8519af08-ba91-4304-a23c-97cdf484974c"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:42.227843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:51:42.681680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:42.696555 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-64354b7c-03b7-4dd0-85bf-ac5fc3768cce tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.842135 Oct 12 08:51:42.697206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1104/2065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:41 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:42.736990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:42.737646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:42.771964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:42.772714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:42.777686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:42.779465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:42.780172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:42.782531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:43.103809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:43.115268 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-27b9b0d2-93d0-4681-b97a-26cf036576f3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1574 microversion: 2.1 time: 0.416737 Oct 12 08:51:43.125403 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1105/2066] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:42 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1574 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:43.149928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:43.150807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:43.165490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:43.167121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:43.168924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:43.171070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:43.172518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:43.174081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:43.477718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:43.500390 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dcc153ee-1e66-40fc-b1fd-0baa25c78045 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1295 microversion: 2.1 time: 0.367587 Oct 12 08:51:43.502041 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1106/2067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:43 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1295 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:43.524560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:43.525910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:43.551239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:43.554729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:43.559047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:43.573044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:43.574011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:43.577768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:43.808064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:51:43.809960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:51:43.811050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:51:43.811824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:51:43.812514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:51:43.943242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:43.944785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:43.946671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:43.951185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:43.955701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:43.957421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:44.041727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:51:44.057880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:44.069800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Getting quotas for user 42733726966a4ab9ba5e9e160415358d and project 7002508409ec4f61b4d66eccdcd9f2ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:51:44.083077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=6,nova_api:INSERT=9 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:44.095138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:44.101394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:44.108822 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e916fb4-522a-461d-8c1b-9810148b2bc3 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.596949 Oct 12 08:51:44.109806 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1107/2068] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:43 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:44.131955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:44.132813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:44.133920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:51:44.159151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:44.161180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:44.161870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:44.162973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:44.164000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:44.164217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:51:44.164708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:44.303895 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d849af1e-b1ba-4073-aba1-d1936caf3977 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202223 Oct 12 08:51:44.305776 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 962/2069] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:51:44.313503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:44.314532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:44.334807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:44.336693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:44.341787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:44.344991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:44.347174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:44.368551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:45.196606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:45.210313 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3f12d088-661b-4104-a17c-ddb9952d0602 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1572 microversion: 2.1 time: 0.902893 Oct 12 08:51:45.214639 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 963/2070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:44 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1572 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:45.226731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77f0993b-328a-42f4-8ee6-e33eef6cfd62 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:45.228082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-77f0993b-328a-42f4-8ee6-e33eef6cfd62 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:45.413488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:45.427008 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec119f43-ebd6-48a7-b129-cef326bacada tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 1.313726 Oct 12 08:51:45.428178 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1108/2071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:44 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:45.433778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:45.434665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:45.444477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:45.446116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:45.447000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:45.447980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:45.448669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:45.449426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:45.600567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-77f0993b-328a-42f4-8ee6-e33eef6cfd62 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:45.611410 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77f0993b-328a-42f4-8ee6-e33eef6cfd62 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1216 microversion: 2.1 time: 0.395202 Oct 12 08:51:45.613577 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 964/2072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:45 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1216 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:45.633919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:45.634810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:45.648477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:45.654620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:45.656048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:45.657227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:45.658790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:45.659532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:45.796730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:45.807085 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-44b3da35-549f-4bab-93f6-b93cb3242e9d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1363 microversion: 2.1 time: 0.376121 Oct 12 08:51:45.809903 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1109/2073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:45 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:45.823669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1919593562"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:45.824252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:45.849828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:45.850628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:45.851270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:45.852372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:45.860575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:45.862421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:46.126066 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.network.security_group_api [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Adding security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 to port 59a421c6-093f-49ff-8651-dd75acf22037 Oct 12 08:51:46.503990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:46.528735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:46.540604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:46.547713 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-17a2ae2a-0896-482f-ab8f-8a45b400f1b0 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 0.921420 Oct 12 08:51:46.553109 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 965/2074] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:45 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:46.569488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:46.575551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:46.600491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:46.601360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:46.609702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:46.622697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:46.626238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:46.626692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:46.655474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:47.581890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:47.598446 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b352e688-f2fc-4787-8f58-1cafa1f14b09 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 1.042760 Oct 12 08:51:47.600424 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 966/2075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:46 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:47.612190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:47.617825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:47.632234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:47.634632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:47.636534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:47.638055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:47.639197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:47.640891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:48.046362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:48.061174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3e595a7a-ded7-40e6-898f-b33a29b8e7c1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1274 microversion: 2.1 time: 0.456845 Oct 12 08:51:48.063774 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 967/2076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:47 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1274 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:48.076936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:48.078590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:48.106738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:48.109470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:48.110175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:48.112627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:48.115556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:48.121544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:48.558029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-07694416-fabf-49fa-9964-6c9bd1cb8b84 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a/action" status: 202 len: 0 microversion: 2.1 time: 2.744406 Oct 12 08:51:48.562515 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1110/2077] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:51:45 2022] POST /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a/action => generated 0 bytes in 2749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:51:48.566631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-046d9ea0-b82e-4ddf-afa3-010e853c3193 req-5f227f9d-0375-46ea-b8b8-13a7fa94a532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "name": "network-vif-plugged", "status": "completed", "tag": "5bced808-04d2-43fa-ad61-7f1b95feac13"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:48.613345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-046d9ea0-b82e-4ddf-afa3-010e853c3193 req-5f227f9d-0375-46ea-b8b8-13a7fa94a532 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:48.613874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-046d9ea0-b82e-4ddf-afa3-010e853c3193 req-5f227f9d-0375-46ea-b8b8-13a7fa94a532 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:48.614385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-046d9ea0-b82e-4ddf-afa3-010e853c3193 req-5f227f9d-0375-46ea-b8b8-13a7fa94a532 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:48.643289 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-046d9ea0-b82e-4ddf-afa3-010e853c3193 req-5f227f9d-0375-46ea-b8b8-13a7fa94a532 service nova] Creating event network-vif-plugged:5bced808-04d2-43fa-ad61-7f1b95feac13 for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:51:48.664641 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-046d9ea0-b82e-4ddf-afa3-010e853c3193 req-5f227f9d-0375-46ea-b8b8-13a7fa94a532 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103140 Oct 12 08:51:48.671832 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1111/2078] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:48.684990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:48.688454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:48.714897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:48.715978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:48.716652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:48.719017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:48.719720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:48.721768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:49.969624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:49.980259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:49.982200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:49.983850 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e56c8e8-9cbf-4083-a0b7-39aee17e7e17 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1486 microversion: 2.25 time: 1.310431 Oct 12 08:51:50.046912 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1112/2079] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:48 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1486 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:50.062757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a43a00b-0569-4815-bb3e-04c2e6a1fca0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f984923fca0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:50.292254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:50.312119 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e71236f2-cb59-4512-b05c-9efeb0d5290d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1363 microversion: 2.1 time: 2.234384 Oct 12 08:51:50.333463 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 968/2080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:48 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1363 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:50.338635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-63b9666d-5e15-45cc-879c-3b295718d094 req-fff81d73-6058-4467-8169-161b02587ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a51d2b-5b6d-4a71-9352-8077991fc24a", "tag": "59a421c6-093f-49ff-8651-dd75acf22037"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:50.381814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-63b9666d-5e15-45cc-879c-3b295718d094 req-fff81d73-6058-4467-8169-161b02587ff7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:50.382305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-63b9666d-5e15-45cc-879c-3b295718d094 req-fff81d73-6058-4467-8169-161b02587ff7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:50.382730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-63b9666d-5e15-45cc-879c-3b295718d094 req-fff81d73-6058-4467-8169-161b02587ff7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:50.433950 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-63b9666d-5e15-45cc-879c-3b295718d094 req-fff81d73-6058-4467-8169-161b02587ff7 service nova] Creating event network-changed:59a421c6-093f-49ff-8651-dd75acf22037 for instance 32a51d2b-5b6d-4a71-9352-8077991fc24a on n-h1-858383-10 Oct 12 08:51:50.440649 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-63b9666d-5e15-45cc-879c-3b295718d094 req-fff81d73-6058-4467-8169-161b02587ff7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122163 Oct 12 08:51:50.441943 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 969/2081] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:50.447847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:50.448816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:50.497077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:50.497927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:50.498575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:50.499486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:50.500100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:50.500685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:50.975027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-7a43a00b-0569-4815-bb3e-04c2e6a1fca0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 in use.", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:51:50.976893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7a43a00b-0569-4815-bb3e-04c2e6a1fca0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security Group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 in use. Oct 12 08:51:50.976893 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-ae9303e8-ab9d-496b-a07b-a26abf1b22c4'] Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a43a00b-0569-4815-bb3e-04c2e6a1fca0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-security-groups/9401d3e1-b2da-4ccd-87d2-733db5450ec8 HTTP/1.1 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: exception: Security Group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 in use. Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-ae9303e8-ab9d-496b-a07b-a26abf1b22c4'] Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '9401d3e1-b2da-4ccd-87d2-733db5450ec8'} Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:51:50.980091 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 in use. Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae9303e8-ab9d-496b-a07b-a26abf1b22c4'] Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 in use. Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae9303e8-ab9d-496b-a07b-a26abf1b22c4'] Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 in use. Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae9303e8-ab9d-496b-a07b-a26abf1b22c4'] Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 in use. Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae9303e8-ab9d-496b-a07b-a26abf1b22c4'] Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a43a00b-0569-4815-bb3e-04c2e6a1fca0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 400 to user: Security Group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 in use. Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-ae9303e8-ab9d-496b-a07b-a26abf1b22c4'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7a43a00b-0569-4815-bb3e-04c2e6a1fca0 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9401d3e1-b2da-4ccd-87d2-733db5450ec8" status: 400 len: 185 microversion: 2.1 time: 0.933382 Oct 12 08:51:50.985018 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1113/2082] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:51:50 2022] DELETE /compute/v2.1/os-security-groups/9401d3e1-b2da-4ccd-87d2-733db5450ec8 => generated 185 bytes in 935 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:51:50.996171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:50.996859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:51.019246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.021949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.022769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.023596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.024909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.026291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.180598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:51.195552 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b4dc723-61d4-44dd-aa72-7d411efdd9c2 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.748581 Oct 12 08:51:51.217043 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 970/2083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:50 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:51.241383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5ebeaf0b-fb5c-463d-807d-d924b55d27e4 req-1493d539-86be-4037-9e96-250ccde5eb8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:51.269955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ebeaf0b-fb5c-463d-807d-d924b55d27e4 req-1493d539-86be-4037-9e96-250ccde5eb8b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.272970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ebeaf0b-fb5c-463d-807d-d924b55d27e4 req-1493d539-86be-4037-9e96-250ccde5eb8b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.274377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ebeaf0b-fb5c-463d-807d-d924b55d27e4 req-1493d539-86be-4037-9e96-250ccde5eb8b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.291161 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5ebeaf0b-fb5c-463d-807d-d924b55d27e4 req-1493d539-86be-4037-9e96-250ccde5eb8b service nova] Creating event network-changed:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:51:51.297154 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5ebeaf0b-fb5c-463d-807d-d924b55d27e4 req-1493d539-86be-4037-9e96-250ccde5eb8b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078359 Oct 12 08:51:51.299034 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 971/2084] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:51.307651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-284de0d0-05c5-4dc2-89a6-f14ce150854d req-a6f693fe-4a4e-4f61-852b-0e93a98f0564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "name": "network-vif-plugged", "status": "completed", "tag": "e045665c-7028-4af9-b920-60841faf44eb"}, {"server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "name": "network-vif-plugged", "status": "completed", "tag": "56a53eb6-be28-4a3c-8084-f457f6be5c2b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:51.320610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-284de0d0-05c5-4dc2-89a6-f14ce150854d req-a6f693fe-4a4e-4f61-852b-0e93a98f0564 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.321486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-284de0d0-05c5-4dc2-89a6-f14ce150854d req-a6f693fe-4a4e-4f61-852b-0e93a98f0564 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.322105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-284de0d0-05c5-4dc2-89a6-f14ce150854d req-a6f693fe-4a4e-4f61-852b-0e93a98f0564 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.347145 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-284de0d0-05c5-4dc2-89a6-f14ce150854d req-a6f693fe-4a4e-4f61-852b-0e93a98f0564 service nova] Creating event network-vif-plugged:e045665c-7028-4af9-b920-60841faf44eb for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:51:51.347997 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-284de0d0-05c5-4dc2-89a6-f14ce150854d req-a6f693fe-4a4e-4f61-852b-0e93a98f0564 service nova] Creating event network-vif-plugged:56a53eb6-be28-4a3c-8084-f457f6be5c2b for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:51:51.370449 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-284de0d0-05c5-4dc2-89a6-f14ce150854d req-a6f693fe-4a4e-4f61-852b-0e93a98f0564 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068936 Oct 12 08:51:51.373242 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 972/2085] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:51.383906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:51.389526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:51.407839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.408341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.408776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.409506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.414209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.415208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.472650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:51.604121 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-672bce82-7306-4ecf-98a3-9496d66d4565 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 204 len: 0 microversion: 2.1 time: 0.227985 Oct 12 08:51:51.604778 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 973/2086] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:51:51 2022] DELETE /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:51.616425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:51.617143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:51.629272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.631495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.636114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.637036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.637761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.638212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.812696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:51.822356 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-00f18ee1-69bc-4664-bdb9-42af2ddd1ee1 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 0.838972 Oct 12 08:51:51.828636 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1114/2087] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:50 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:51.841806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:51.849798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:51.872820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.873654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.878526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.881962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.884012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.885127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.954671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:51.963752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:51.965588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:51.966981 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dee461eb-752f-40b6-9f47-61f5f5369b50 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1476 microversion: 2.25 time: 0.357842 Oct 12 08:51:51.968379 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 974/2088] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:51 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:51.973423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:51.974332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:51.981208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.982012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.982616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:51.983526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:51.984135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:51.984720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:52.014809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:52.186493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:52.199918 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e9b05ad5-4e49-47b6-80c1-7eb14aa8cd1a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1647 microversion: 2.1 time: 0.230198 Oct 12 08:51:52.217826 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 975/2089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:51 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1647 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:52.228152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0d8fe128-7ad2-46ef-86f0-87c374f4ca59 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '.version_select at 0x7f9848a548b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:52.236964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d8fe128-7ad2-46ef-86f0-87c374f4ca59 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:52.240145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d8fe128-7ad2-46ef-86f0-87c374f4ca59 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:52.242295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d8fe128-7ad2-46ef-86f0-87c374f4ca59 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:52.254151 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0d8fe128-7ad2-46ef-86f0-87c374f4ca59 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.033310 Oct 12 08:51:52.255897 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 976/2090] 10.222.0.40 () {60 vars in 1184 bytes} [Wed Oct 12 08:51:52 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:52.261911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:52.263502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:52.272103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:52.272948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:52.273704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:52.274669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:52.275499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:52.276144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:52.519600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:52.531611 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b0609781-46a5-4d5e-9068-7265977311a3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.274353 Oct 12 08:51:52.534931 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 977/2091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:52 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:52.551334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:52.552314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:52.561210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:52.561824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:52.562326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:52.563094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:52.564208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:52.564735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:52.765593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] Lazy-loading 'services' on Instance uuid 88f1fe07-9eb6-4da6-8b88-0c4df059868e {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:51:52.784576 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-56007197-1d7d-45a2-b24b-50c9a4fd5974 tempest-LiveAutoBlockMigrationV225Test-1585973686 tempest-LiveAutoBlockMigrationV225Test-1585973686-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1970 microversion: 2.25 time: 0.248535 Oct 12 08:51:52.785914 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 978/2092] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:52 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1970 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:52.826663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:52.827156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:52.834159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:52.834652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:52.835095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:52.835808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:52.836252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:52.836670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:52.879632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:53.030664 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-52a1e1ea-e47f-4dfd-aa07-0085a5dafddb tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 204 len: 0 microversion: 2.25 time: 0.201047 Oct 12 08:51:53.033954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:53.038818 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 979/2093] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:51:52 2022] DELETE /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:51:53.048622 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c4a49d0-853a-491f-bc56-9d42936de889 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1363 microversion: 2.1 time: 1.209320 Oct 12 08:51:53.049903 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1115/2094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:51 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1363 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:53.058080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:53.068036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:53.068580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:53.069930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:53.084496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:53.085136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:53.085794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:53.086239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:53.086969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:53.087435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:53.087861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:53.094778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:53.095242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:53.096009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:53.100860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:53.101515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:53.618272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:53.633148 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c85a8d39-468a-4373-8baa-6794110d6c2b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 0.592185 Oct 12 08:51:53.653104 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 980/2095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:53 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:53.664842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:53.665842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:53.674450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:53.675160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:53.675759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:53.676689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:53.677295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:53.677917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:53.937053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:53.961413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:53.964901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:53.968002 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-62c968e2-9f03-4c2a-bbe4-18fd141a399a tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1482 microversion: 2.25 time: 0.916835 Oct 12 08:51:53.968779 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1116/2096] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:53 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1482 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:53.978508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:53.981720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:53.997427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:53.999769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:54.000984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:54.002538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:54.004912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:54.006384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:54.018935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:54.815130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:54.828157 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d0a4d81-5da6-4616-b19d-fea9b11d4a8c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1354 microversion: 2.1 time: 0.855288 Oct 12 08:51:54.829198 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1117/2097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:53 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1354 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:54.840564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:54.855083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:54.858400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:54.876047 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a2c4237e-d87a-4198-aef8-74f013729c38 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1647 microversion: 2.1 time: 1.221414 Oct 12 08:51:54.880695 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 981/2098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:53 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1647 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:54.886459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:54.887602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:54.888330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:54.890434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:54.891680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:54.892951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:54.911990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8597e016-91d4-450e-acb6-f061ab8aa4dd req-2ed61b36-ef81-4642-b74c-b6c820163f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8218a41-0ecf-4507-b952-72ce43512a26", "tag": "b568ccd8-ebeb-4834-84f8-4a93f97ac613"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:54.940140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8597e016-91d4-450e-acb6-f061ab8aa4dd req-2ed61b36-ef81-4642-b74c-b6c820163f4a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:54.940959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8597e016-91d4-450e-acb6-f061ab8aa4dd req-2ed61b36-ef81-4642-b74c-b6c820163f4a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:54.941590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8597e016-91d4-450e-acb6-f061ab8aa4dd req-2ed61b36-ef81-4642-b74c-b6c820163f4a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:54.977814 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8597e016-91d4-450e-acb6-f061ab8aa4dd req-2ed61b36-ef81-4642-b74c-b6c820163f4a service nova] Creating event network-changed:b568ccd8-ebeb-4834-84f8-4a93f97ac613 for instance c8218a41-0ecf-4507-b952-72ce43512a26 on n-h2-858383-10 Oct 12 08:51:54.988158 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8597e016-91d4-450e-acb6-f061ab8aa4dd req-2ed61b36-ef81-4642-b74c-b6c820163f4a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091139 Oct 12 08:51:54.992026 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 982/2099] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:55.002127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:55.003085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:55.012730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:55.013640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:55.014328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:55.015786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:55.016470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:55.016754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:55.292881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:55.302765 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79a41b85-056f-45d3-b976-9fe3d808e44c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1363 microversion: 2.1 time: 0.472182 Oct 12 08:51:55.308868 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1118/2100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:54 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:55.329825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:55.331107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:55.338161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:55.338859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:55.339777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:55.340690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:55.341312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:55.341931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:55.595459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:55.603492 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4b501ca7-d977-452b-802d-4ab3421487f5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 0.609980 Oct 12 08:51:55.609620 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 983/2101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:54 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:55.661114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:55.691609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:55.697885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:55.701360 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e434c172-21e7-4b62-a49f-c76640ff1dac tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1482 microversion: 2.25 time: 0.374923 Oct 12 08:51:55.704079 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1119/2102] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:55 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1482 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:55.852127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:55.852742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:55.878937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:55.881595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:55.882283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:55.882911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:55.883794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:55.884588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:55.885205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:55.907851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:55.909145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:55.925739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:55.926580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:55.927213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:55.928306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:55.929053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:55.929835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.252437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:56.270448 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b1ca698-872f-4e49-9a31-0a6e75b4cf02 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 200 len: 1468 microversion: 2.1 time: 0.364686 Oct 12 08:51:56.288610 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1120/2103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:55 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 1468 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:51:56.309252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7b49eee5-f67b-4e54-b0cf-e4504a14873f req-cfbe2f5e-dc11-43c1-a886-a2c4f5efa822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a51d2b-5b6d-4a71-9352-8077991fc24a", "name": "network-vif-deleted", "tag": "59a421c6-093f-49ff-8651-dd75acf22037"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:56.338878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7b49eee5-f67b-4e54-b0cf-e4504a14873f req-cfbe2f5e-dc11-43c1-a886-a2c4f5efa822 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.339592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7b49eee5-f67b-4e54-b0cf-e4504a14873f req-cfbe2f5e-dc11-43c1-a886-a2c4f5efa822 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.341278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7b49eee5-f67b-4e54-b0cf-e4504a14873f req-cfbe2f5e-dc11-43c1-a886-a2c4f5efa822 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.383382 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7b49eee5-f67b-4e54-b0cf-e4504a14873f req-cfbe2f5e-dc11-43c1-a886-a2c4f5efa822 service nova] Creating event network-vif-deleted:59a421c6-093f-49ff-8651-dd75acf22037 for instance 32a51d2b-5b6d-4a71-9352-8077991fc24a on n-h1-858383-10 Oct 12 08:51:56.390660 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7b49eee5-f67b-4e54-b0cf-e4504a14873f req-cfbe2f5e-dc11-43c1-a886-a2c4f5efa822 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099285 Oct 12 08:51:56.391632 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1121/2104] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:56.398919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:56.399902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:56.408589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.409510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.410144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.411136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.412290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.412892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.466998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:56.480965 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-487ea2a8-be91-4c32-8090-632d616623c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1802 microversion: 2.1 time: 0.632663 Oct 12 08:51:56.512557 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 984/2105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:55 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1802 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:56.583927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:56.590062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:56.599100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.602881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.603447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.604199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.604834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.605120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.656150 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d1c6868a-2ab5-4d1c-8737-64632e6dee6f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea/ips" status: 200 len: 216 microversion: 2.1 time: 0.141946 Oct 12 08:51:56.665771 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 985/2106] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 08:51:56 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea/ips => generated 216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:56.677431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:56.678056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:56.699298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.699792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.706259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.707305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.708067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.708669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.924820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:56.951341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc05c2a3-be1e-4689-98e2-68113a3d1eb7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1363 microversion: 2.1 time: 0.557609 Oct 12 08:51:56.953501 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1122/2107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:56 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:56.963901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:56.966519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:56.980846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.986458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.987828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:56.990092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:56.991249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:56.992620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:57.011936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:57.025316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:51:57.028491 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f888f850-fa8a-4535-9042-d1273095b1ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 0.354742 Oct 12 08:51:57.032596 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 986/2108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:56 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:57.038965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:51:57.067232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:57.067767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:57.079376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:57.080063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:57.082163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:57.083154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:57.084418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:57.086365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:57.258349 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b162fa1-b68e-4157-884e-1f6e4dcea0c0 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "DELETE /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 204 len: 0 microversion: 2.1 time: 0.299478 Oct 12 08:51:57.260297 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1123/2109] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:51:56 2022] DELETE /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:51:57.260824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:57.272421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:57.274424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:57.283331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:57.284078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:57.285055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:57.285800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:57.286890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:57.287595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:57.288386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:57.300000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:57.301295 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa84da46-3681-4174-9049-6759c4911a5e tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1440 microversion: 2.25 time: 0.253767 Oct 12 08:51:57.314154 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 987/2110] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:57 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1440 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:57.327126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:57.328554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:57.336271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:57.337045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:57.338360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:57.339469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:57.341946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:57.342586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:57.364107 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a HTTP/1.1 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '32a51d2b-5b6d-4a71-9352-8077991fc24a'} Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:51:57.366726 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:57.373127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:51:57.373127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:51:57.373127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:51:57.373127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:51:57.373127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:51:57.373127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:51:57.373127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:51:57.374983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:51:57.376193 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-88a8d580-b8c1-4a11-a52c-7650af641f4e tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 404 len: 111 microversion: 2.1 time: 0.060512 Oct 12 08:51:57.377088 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 988/2111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:57 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:51:57.386048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86d0693f-61bc-40d7-b285-08cd3a0cb408 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848ca71f0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:57.693975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:57.705706 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7a0cbc81-fb1b-4103-8678-42e24f7b3b9e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1808 microversion: 2.1 time: 0.440683 Oct 12 08:51:57.707032 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1124/2112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:57 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1808 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:51:57.835646 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86d0693f-61bc-40d7-b285-08cd3a0cb408 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f7d1fbf5-7cef-4428-9822-fd1978d54dd5" status: 202 len: 0 microversion: 2.1 time: 0.453693 Oct 12 08:51:57.837098 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 989/2113] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:51:57 2022] DELETE /compute/v2.1/os-security-groups/f7d1fbf5-7cef-4428-9822-fd1978d54dd5 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:51:57.849469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a171303-08e9-483f-9083-66b259345ce5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f984cc00dc0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:57.981042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:57.981688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:57.996160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:57.996651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:57.997096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:57.997896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:57.998507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:57.998919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:58.349770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:58.364566 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02ce87b9-ec4a-4a06-ab7c-5e8a65aff6d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1363 microversion: 2.1 time: 0.388648 Oct 12 08:51:58.367872 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 990/2114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:57 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:58.392066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:58.398573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:58.412745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:58.421023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:58.421982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:58.422944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:58.423576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:58.424857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:58.686310 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a171303-08e9-483f-9083-66b259345ce5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9401d3e1-b2da-4ccd-87d2-733db5450ec8" status: 202 len: 0 microversion: 2.1 time: 0.844570 Oct 12 08:51:58.687525 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1125/2115] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:51:57 2022] DELETE /compute/v2.1/os-security-groups/9401d3e1-b2da-4ccd-87d2-733db5450ec8 => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:51:58.693278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:58.694174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:58.711149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:58.711932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:58.712571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:58.715113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:58.715754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:58.720159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:58.744606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:58.754621 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e899730-698e-43ec-97c2-cb6f2609098f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 0.366245 Oct 12 08:51:58.758446 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 991/2116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:58 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:58.763229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-02415998-5f44-492e-84b2-a9020231fda8 req-478f5787-c480-42d9-9a0c-1da5ba6176a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "name": "network-vif-plugged", "status": "completed", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:58.808931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-02415998-5f44-492e-84b2-a9020231fda8 req-478f5787-c480-42d9-9a0c-1da5ba6176a0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:58.812628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-02415998-5f44-492e-84b2-a9020231fda8 req-478f5787-c480-42d9-9a0c-1da5ba6176a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:58.817594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-02415998-5f44-492e-84b2-a9020231fda8 req-478f5787-c480-42d9-9a0c-1da5ba6176a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:58.877186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-02415998-5f44-492e-84b2-a9020231fda8 req-478f5787-c480-42d9-9a0c-1da5ba6176a0 service nova] Creating event network-vif-plugged:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:51:58.889732 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-02415998-5f44-492e-84b2-a9020231fda8 req-478f5787-c480-42d9-9a0c-1da5ba6176a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129298 Oct 12 08:51:58.891007 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 992/2117] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:58.899045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-fc2b76c7-a19b-45b5-8b8c-cb5992ca3090 req-812c061c-56c6-4f8f-a73a-3577cbcc8938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f1fe07-9eb6-4da6-8b88-0c4df059868e", "name": "network-vif-deleted", "tag": "163ca692-7dfb-4edc-81ef-916821ba1cbc"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:58.915630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fc2b76c7-a19b-45b5-8b8c-cb5992ca3090 req-812c061c-56c6-4f8f-a73a-3577cbcc8938 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:58.916365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fc2b76c7-a19b-45b5-8b8c-cb5992ca3090 req-812c061c-56c6-4f8f-a73a-3577cbcc8938 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:58.917610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fc2b76c7-a19b-45b5-8b8c-cb5992ca3090 req-812c061c-56c6-4f8f-a73a-3577cbcc8938 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:58.930164 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-fc2b76c7-a19b-45b5-8b8c-cb5992ca3090 req-812c061c-56c6-4f8f-a73a-3577cbcc8938 service nova] Creating event network-vif-deleted:163ca692-7dfb-4edc-81ef-916821ba1cbc for instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e on n-h2-858383-10 Oct 12 08:51:58.936681 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-fc2b76c7-a19b-45b5-8b8c-cb5992ca3090 req-812c061c-56c6-4f8f-a73a-3577cbcc8938 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043621 Oct 12 08:51:58.938068 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 993/2118] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:51:58.945921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d3adb02-7924-4cea-8bf5-bfe75713fc98 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'create', calling method: .version_select at 0x7f98488575e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2125470477", "description": "tempest-description-417377580"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:51:59.012087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:59.022530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:59.030160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:59.034714 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f830c25c-ee8e-4686-9b54-9bc367a54cf7 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1265 microversion: 2.25 time: 0.345985 Oct 12 08:51:59.038140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1126/2119] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:51:58 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:51:59.051898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:59.070657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:59.090635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:59.091892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:59.092504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:59.093647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:59.094367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:59.096523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:59.689683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:51:59.699723 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ebbf7874-4557-497d-9f74-7431bfe3a1f3 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1808 microversion: 2.1 time: 0.659437 Oct 12 08:51:59.706618 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1127/2120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:59 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1808 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:51:59.717654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:51:59.719604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:51:59.742391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:59.744240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:59.746818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:51:59.747875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:51:59.751227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:51:59.754420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:00.144369 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1d3adb02-7924-4cea-8bf5-bfe75713fc98 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.204860 Oct 12 08:52:00.145024 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 994/2121] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 08:51:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:00.156154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:00.160557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:00.206696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:00.209548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:00.211877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:00.213258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:00.216082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:00.217797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:00.819029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:00.822648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:00.843171 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f49e5265-0a64-4228-95b1-176d260643e6 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 0.693252 Oct 12 08:52:00.844279 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 995/2122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:00 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:00.894685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:00.895565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:00.914568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:00.915295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:00.916420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:00.920782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:00.921426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:00.922005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:01.066956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:01.084184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:01.086236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:01.099388 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0d6fb5d9-901d-43a1-9419-98d54052951b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1265 microversion: 2.25 time: 0.231538 Oct 12 08:52:01.100178 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 996/2123] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:00 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:01.128405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-03c357f5-ba0e-4a77-8780-0fe73d088f9f tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Action: 'update', calling method: .version_select at 0x7f9848ca7c10>, body: {"security_group": {"name": "tempest-sg-hth-934591925", "description": "tempest-description-hth-990126844"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:01.290735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:01.299568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e852e6d-cca8-4962-8e2c-efd46e760091 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1363 microversion: 2.1 time: 1.591144 Oct 12 08:52:01.309773 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1128/2124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:51:59 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1363 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:01.320770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:01.325724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:01.344574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:01.345491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:01.346197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:01.356972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:01.357961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:01.358836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:01.769752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:01.789636 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5aeacbeb-3c87-4a5a-94e6-e97f02cdd37f tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1808 microversion: 2.1 time: 0.481259 Oct 12 08:52:01.790397 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1129/2125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:01 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1808 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:01.869904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:01.870678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:01.886950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:01.889653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:01.890235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:01.891963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:01.895613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:01.897278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:02.820054 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-03c357f5-ba0e-4a77-8780-0fe73d088f9f tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/8ce4132d-0ac9-4305-a490-481ee4fd24d1" status: 200 len: 216 microversion: 2.1 time: 1.698810 Oct 12 08:52:02.820578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:02.828557 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 997/2126] 10.222.0.40 () {60 vars in 1290 bytes} [Wed Oct 12 08:52:01 2022] PUT /compute/v2.1/os-security-groups/8ce4132d-0ac9-4305-a490-481ee4fd24d1 => generated 216 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:02.834866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:02.835481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:02.838148 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df822fd1-1bd3-46e8-960c-b5d1daabe8d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 0.970556 Oct 12 08:52:02.839144 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1130/2127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:01 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:02.860564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-68f98d99-e0f0-40c6-92b9-32f22b5f1cb5 req-d5fce150-bb13-4b12-b67d-c90f6b2fae39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "name": "network-vif-deleted", "tag": "56a53eb6-be28-4a3c-8084-f457f6be5c2b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:02.872050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:02.873008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:02.873008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:02.873884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:02.877132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:02.878171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:02.915799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-68f98d99-e0f0-40c6-92b9-32f22b5f1cb5 req-d5fce150-bb13-4b12-b67d-c90f6b2fae39 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:02.918777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-68f98d99-e0f0-40c6-92b9-32f22b5f1cb5 req-d5fce150-bb13-4b12-b67d-c90f6b2fae39 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:02.923425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-68f98d99-e0f0-40c6-92b9-32f22b5f1cb5 req-d5fce150-bb13-4b12-b67d-c90f6b2fae39 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:02.968375 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-68f98d99-e0f0-40c6-92b9-32f22b5f1cb5 req-d5fce150-bb13-4b12-b67d-c90f6b2fae39 service nova] Creating event network-vif-deleted:56a53eb6-be28-4a3c-8084-f457f6be5c2b for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:52:02.997255 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-68f98d99-e0f0-40c6-92b9-32f22b5f1cb5 req-d5fce150-bb13-4b12-b67d-c90f6b2fae39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150427 Oct 12 08:52:03.006973 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1131/2128] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:03.038576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:03.041366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:03.070796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:03.076924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:03.077773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:03.084112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:03.084112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:03.084112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:03.149710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:03.169277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:03.171575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:03.175122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a2c87a5-502b-44dc-955f-86d0e2acbd90 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1265 microversion: 2.25 time: 0.345468 Oct 12 08:52:03.193463 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 998/2129] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:02 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:03.204911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:03.205606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:03.221404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:03.222254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:03.222954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:03.224227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:03.224861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:03.225532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:04.034217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:04.046936 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-32866275-970c-4b92-8397-75587584beb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1551 microversion: 2.1 time: 1.023266 Oct 12 08:52:04.047979 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1132/2130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:03 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1551 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:04.065744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8bd41da4-c0ca-4c14-be62-65bdfd072591 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848032c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:04.136168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:04.153761 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cb410f33-8cd3-4717-8384-4abbfb60e499 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1673 microversion: 2.1 time: 0.969277 Oct 12 08:52:04.159204 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 999/2131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:03 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1673 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:04.185990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0f0ecb73-9137-4f53-ad32-055afbd4bac0 req-46e2b42f-ee82-454b-b042-b2ad29921400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8218a41-0ecf-4507-b952-72ce43512a26", "name": "network-vif-plugged", "status": "completed", "tag": "b568ccd8-ebeb-4834-84f8-4a93f97ac613"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:04.242634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0f0ecb73-9137-4f53-ad32-055afbd4bac0 req-46e2b42f-ee82-454b-b042-b2ad29921400 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:04.243803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0f0ecb73-9137-4f53-ad32-055afbd4bac0 req-46e2b42f-ee82-454b-b042-b2ad29921400 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:04.244231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0f0ecb73-9137-4f53-ad32-055afbd4bac0 req-46e2b42f-ee82-454b-b042-b2ad29921400 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:04.301975 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8bd41da4-c0ca-4c14-be62-65bdfd072591 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/8ce4132d-0ac9-4305-a490-481ee4fd24d1" status: 200 len: 216 microversion: 2.1 time: 0.251465 Oct 12 08:52:04.302861 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1133/2132] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:52:04 2022] GET /compute/v2.1/os-security-groups/8ce4132d-0ac9-4305-a490-481ee4fd24d1 => generated 216 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:04.315680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:04.316720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:04.318020 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0f0ecb73-9137-4f53-ad32-055afbd4bac0 req-46e2b42f-ee82-454b-b042-b2ad29921400 service nova] Creating event network-vif-plugged:b568ccd8-ebeb-4834-84f8-4a93f97ac613 for instance c8218a41-0ecf-4507-b952-72ce43512a26 on n-h2-858383-10 Oct 12 08:52:04.331656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:04.332812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:04.338382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:04.340419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0f0ecb73-9137-4f53-ad32-055afbd4bac0 req-46e2b42f-ee82-454b-b042-b2ad29921400 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165167 Oct 12 08:52:04.341169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:04.342181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:04.344600 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1000/2133] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:04.344983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:04.368184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:04.372502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:04.409455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:04.410883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:04.415224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:04.420012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:04.422457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:04.426805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:04.795247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:04.807589 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ba494f22-1409-4736-ba28-0da7c2a1c145 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 0.503036 Oct 12 08:52:04.810835 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1134/2134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:04 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:04.815969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:04.818113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:04.836462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:04.837379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:04.838586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:04.840923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:04.842004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:04.852441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:04.960695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:04.970727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:04.975016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:04.978204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a189019-9ff9-427f-bd14-1d8cf6c11901 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1265 microversion: 2.25 time: 0.166059 Oct 12 08:52:04.980061 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1135/2135] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:04 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:04.990689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c850b1f1-b76c-4dd2-99c2-6ded52f86717 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f98490db040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:05.167597 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7ddd2ed9-50ff-432d-a3ad-f7aa094b2ee3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.821660 Oct 12 08:52:05.177734 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1001/2136] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 08:52:04 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/os-interface => generated 285 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:05.184105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-17d5cf28-4b47-4c82-901a-5e70e06d75e7 req-eebebbec-c39b-419c-9730-a8402d8a3627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "name": "network-vif-deleted", "tag": "e045665c-7028-4af9-b920-60841faf44eb"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:05.220218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-17d5cf28-4b47-4c82-901a-5e70e06d75e7 req-eebebbec-c39b-419c-9730-a8402d8a3627 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.226508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-17d5cf28-4b47-4c82-901a-5e70e06d75e7 req-eebebbec-c39b-419c-9730-a8402d8a3627 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.230166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-17d5cf28-4b47-4c82-901a-5e70e06d75e7 req-eebebbec-c39b-419c-9730-a8402d8a3627 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:05.283784 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-17d5cf28-4b47-4c82-901a-5e70e06d75e7 req-eebebbec-c39b-419c-9730-a8402d8a3627 service nova] Creating event network-vif-deleted:e045665c-7028-4af9-b920-60841faf44eb for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:52:05.314157 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-17d5cf28-4b47-4c82-901a-5e70e06d75e7 req-eebebbec-c39b-419c-9730-a8402d8a3627 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128973 Oct 12 08:52:05.332201 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1002/2137] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:05.362085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:05.366779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:05.399579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.400484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.404418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:05.408196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.408875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.411995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:05.615459 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c850b1f1-b76c-4dd2-99c2-6ded52f86717 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/8ce4132d-0ac9-4305-a490-481ee4fd24d1" status: 202 len: 0 microversion: 2.1 time: 0.633028 Oct 12 08:52:05.617080 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1136/2138] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:04 2022] DELETE /compute/v2.1/os-security-groups/8ce4132d-0ac9-4305-a490-481ee4fd24d1 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:52:05.625338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:05.627132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:05.640801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.654699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.657949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:05.661596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.663405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.664096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:05.703829 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a HTTP/1.1 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '32a51d2b-5b6d-4a71-9352-8077991fc24a'} Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:05.707902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.713384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.718834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:05.720037 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dfecf715-dcf9-47a3-858f-1ba41ca80a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 404 len: 111 microversion: 2.1 time: 0.098692 Oct 12 08:52:05.721151 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1137/2139] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:05 2022] DELETE /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:52:05.736684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:05.737350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 32a51d2b-5b6d-4a71-9352-8077991fc24a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:05.753946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.753946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.753946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:05.753946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.754334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.754748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:05.795563 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a HTTP/1.1 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '32a51d2b-5b6d-4a71-9352-8077991fc24a'} Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:05.797311 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.802967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.802967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:05.802967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:05.802967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:05.802967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:05.802967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. Oct 12 08:52:05.802967 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.804300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Instance 32a51d2b-5b6d-4a71-9352-8077991fc24a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:05.805364 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6500c901-aa96-4bbe-ac34-63db5a217a82 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a" status: 404 len: 111 microversion: 2.1 time: 0.079107 Oct 12 08:52:05.806459 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1138/2140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:05 2022] GET /compute/v2.1/servers/32a51d2b-5b6d-4a71-9352-8077991fc24a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:05.818121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a7036aa-c031-419e-9109-e750328db011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f98490db3a0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:05.915425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-2a7036aa-c031-419e-9109-e750328db011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:52:05.916276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-2a7036aa-c031-419e-9109-e750328db011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:52:05.917003 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-2a7036aa-c031-419e-9109-e750328db011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 does not exist Oct 12 08:52:05.917003 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-c6cb627b-7148-4509-a999-6b15b05f6907'] Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a7036aa-c031-419e-9109-e750328db011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-security-groups/9401d3e1-b2da-4ccd-87d2-733db5450ec8 HTTP/1.1 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 does not exist Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-c6cb627b-7148-4509-a999-6b15b05f6907'] Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '9401d3e1-b2da-4ccd-87d2-733db5450ec8'} Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:52:05.919461 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 does not exist Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6cb627b-7148-4509-a999-6b15b05f6907'] Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 does not exist Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6cb627b-7148-4509-a999-6b15b05f6907'] Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 does not exist Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6cb627b-7148-4509-a999-6b15b05f6907'] Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 does not exist Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6cb627b-7148-4509-a999-6b15b05f6907'] Oct 12 08:52:05.924498 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:05.929271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a7036aa-c031-419e-9109-e750328db011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group 9401d3e1-b2da-4ccd-87d2-733db5450ec8 does not exist Oct 12 08:52:05.929271 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-c6cb627b-7148-4509-a999-6b15b05f6907'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:05.930437 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a7036aa-c031-419e-9109-e750328db011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9401d3e1-b2da-4ccd-87d2-733db5450ec8" status: 404 len: 194 microversion: 2.1 time: 0.119636 Oct 12 08:52:05.931511 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1139/2141] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:05 2022] DELETE /compute/v2.1/os-security-groups/9401d3e1-b2da-4ccd-87d2-733db5450ec8 => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:52:05.936753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:05.943031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:05.972588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.973502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.974114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:05.975238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:05.975855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:05.976474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:06.437618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:06.447605 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c101599-c312-4d8e-b09e-57fc2f49b4c8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1494 microversion: 2.1 time: 1.111135 Oct 12 08:52:06.451731 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1003/2142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:05 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1494 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:06.466717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0dba10a-3b95-4bba-afd8-a17d5d35b731 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848c1c940>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:06.600446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-a0dba10a-3b95-4bba-afd8-a17d5d35b731 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 does not exist", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:52:06.601333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.security_group_api [None req-a0dba10a-3b95-4bba-afd8-a17d5d35b731 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 not found {{(pid=127007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:52:06.602349 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a0dba10a-3b95-4bba-afd8-a17d5d35b731 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 does not exist Oct 12 08:52:06.602349 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-e1a536d3-c1b2-4ee5-97dd-382e6f31955a'] Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0dba10a-3b95-4bba-afd8-a17d5d35b731 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-security-groups/f7d1fbf5-7cef-4428-9822-fd1978d54dd5 HTTP/1.1 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: exception: Security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 does not exist Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-e1a536d3-c1b2-4ee5-97dd-382e6f31955a'] Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f7d1fbf5-7cef-4428-9822-fd1978d54dd5'} Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:52:06.604678 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 does not exist Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1a536d3-c1b2-4ee5-97dd-382e6f31955a'] Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 does not exist Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1a536d3-c1b2-4ee5-97dd-382e6f31955a'] Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 does not exist Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1a536d3-c1b2-4ee5-97dd-382e6f31955a'] Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 does not exist Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1a536d3-c1b2-4ee5-97dd-382e6f31955a'] Oct 12 08:52:06.609059 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:06.617111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0dba10a-3b95-4bba-afd8-a17d5d35b731 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group f7d1fbf5-7cef-4428-9822-fd1978d54dd5 does not exist Oct 12 08:52:06.617111 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-e1a536d3-c1b2-4ee5-97dd-382e6f31955a'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:06.618450 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0dba10a-3b95-4bba-afd8-a17d5d35b731 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f7d1fbf5-7cef-4428-9822-fd1978d54dd5" status: 404 len: 194 microversion: 2.1 time: 0.165160 Oct 12 08:52:06.622521 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1004/2143] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:06 2022] DELETE /compute/v2.1/os-security-groups/f7d1fbf5-7cef-4428-9822-fd1978d54dd5 => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:06.631395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:06.636368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:06.658366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:06.666058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:06.667427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:06.668615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:06.669326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:06.674270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:06.884132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:06.894991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:06.899192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:06.900703 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e231f496-3005-4cd1-b57a-e446b09131d8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1265 microversion: 2.25 time: 0.276848 Oct 12 08:52:06.936341 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1005/2144] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:06 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:06.955503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bb2ae09-3eb1-4621-86e3-e079244a4c57 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848c1ca60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:07.051532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:07.066215 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4d66616e-0f2f-43d6-8d45-62c40bfe00a9 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1316 microversion: 2.1 time: 1.133401 Oct 12 08:52:07.067532 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1140/2145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:05 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1316 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:07.074611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f08ee580-adc0-47d1-a85a-89cde3d344c0 req-439b2813-ef32-429e-b8fc-f9461d4e505a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "name": "network-vif-unplugged", "status": "completed", "tag": "5bced808-04d2-43fa-ad61-7f1b95feac13"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:07.093672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f08ee580-adc0-47d1-a85a-89cde3d344c0 req-439b2813-ef32-429e-b8fc-f9461d4e505a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:07.100777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f08ee580-adc0-47d1-a85a-89cde3d344c0 req-439b2813-ef32-429e-b8fc-f9461d4e505a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:07.102700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f08ee580-adc0-47d1-a85a-89cde3d344c0 req-439b2813-ef32-429e-b8fc-f9461d4e505a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:07.142460 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f08ee580-adc0-47d1-a85a-89cde3d344c0 req-439b2813-ef32-429e-b8fc-f9461d4e505a service nova] Creating event network-vif-unplugged:5bced808-04d2-43fa-ad61-7f1b95feac13 for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:52:07.154662 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f08ee580-adc0-47d1-a85a-89cde3d344c0 req-439b2813-ef32-429e-b8fc-f9461d4e505a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085486 Oct 12 08:52:07.160529 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1141/2146] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:07.382330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-5bb2ae09-3eb1-4621-86e3-e079244a4c57 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:52:07.383627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.security_group_api [None req-5bb2ae09-3eb1-4621-86e3-e079244a4c57 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group f33f7e82-134d-4827-8310-d13725704b2b not found {{(pid=127007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:52:07.384982 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5bb2ae09-3eb1-4621-86e3-e079244a4c57 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:52:07.384982 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-911ffdb1-e04e-4466-9d81-0fca276dd0a8'] Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bb2ae09-3eb1-4621-86e3-e079244a4c57 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-security-groups/f33f7e82-134d-4827-8310-d13725704b2b HTTP/1.1 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: exception: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-911ffdb1-e04e-4466-9d81-0fca276dd0a8'] Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f33f7e82-134d-4827-8310-d13725704b2b'} Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:52:07.387520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-911ffdb1-e04e-4466-9d81-0fca276dd0a8'] Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-911ffdb1-e04e-4466-9d81-0fca276dd0a8'] Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-911ffdb1-e04e-4466-9d81-0fca276dd0a8'] Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-911ffdb1-e04e-4466-9d81-0fca276dd0a8'] Oct 12 08:52:07.394247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:07.400014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bb2ae09-3eb1-4621-86e3-e079244a4c57 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group f33f7e82-134d-4827-8310-d13725704b2b does not exist Oct 12 08:52:07.400014 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-911ffdb1-e04e-4466-9d81-0fca276dd0a8'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:07.401494 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5bb2ae09-3eb1-4621-86e3-e079244a4c57 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f33f7e82-134d-4827-8310-d13725704b2b" status: 404 len: 194 microversion: 2.1 time: 0.463786 Oct 12 08:52:07.402600 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1006/2147] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:06 2022] DELETE /compute/v2.1/os-security-groups/f33f7e82-134d-4827-8310-d13725704b2b => generated 194 bytes in 465 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:07.412357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e63ca777-1dfb-4564-898d-ade0a3a43eaa tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848ee0e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:07.479644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:07.481127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:07.495907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:07.496899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:07.497600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:07.498526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:07.503729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:07.507090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:08.386895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:08.407977 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c74b7ef3-1e46-4999-be64-62756284c243 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1452 microversion: 2.1 time: 0.929173 Oct 12 08:52:08.413337 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1007/2148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:07 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1452 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:08.438431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:08.441531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:08.456003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:08.461583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:08.462405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:08.464428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:08.467285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:08.469114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:08.470631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:08.537212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-e63ca777-1dfb-4564-898d-ade0a3a43eaa tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:52:08.537933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-e63ca777-1dfb-4564-898d-ade0a3a43eaa tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group 52365071-5dad-4d16-a251-965fa07c0075 not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:52:08.538803 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-e63ca777-1dfb-4564-898d-ade0a3a43eaa tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:52:08.538803 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-dac30063-3cbb-4098-9175-e68bf5ebca05'] Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e63ca777-1dfb-4564-898d-ade0a3a43eaa tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-security-groups/52365071-5dad-4d16-a251-965fa07c0075 HTTP/1.1 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-dac30063-3cbb-4098-9175-e68bf5ebca05'] Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '52365071-5dad-4d16-a251-965fa07c0075'} Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:52:08.541175 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dac30063-3cbb-4098-9175-e68bf5ebca05'] Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dac30063-3cbb-4098-9175-e68bf5ebca05'] Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dac30063-3cbb-4098-9175-e68bf5ebca05'] Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dac30063-3cbb-4098-9175-e68bf5ebca05'] Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e63ca777-1dfb-4564-898d-ade0a3a43eaa tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group 52365071-5dad-4d16-a251-965fa07c0075 does not exist Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-dac30063-3cbb-4098-9175-e68bf5ebca05'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e63ca777-1dfb-4564-898d-ade0a3a43eaa tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/52365071-5dad-4d16-a251-965fa07c0075" status: 404 len: 194 microversion: 2.1 time: 1.136035 Oct 12 08:52:08.546812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1142/2149] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:07 2022] DELETE /compute/v2.1/os-security-groups/52365071-5dad-4d16-a251-965fa07c0075 => generated 194 bytes in 1141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:08.561591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:08.562367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:08.582843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:08.618246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:08.621793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:08.622486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:08.631227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:08.633924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:08.638804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:09.136929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:09.146194 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c8f0d330-e6c1-4e73-9f4a-a2618e8a1936 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1466 microversion: 2.1 time: 0.598502 Oct 12 08:52:09.152004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1143/2150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:08 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1466 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:09.168354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-656ff275-f88b-4c0f-8d21-f9e1d684fd7e req-161745a6-b0b6-40c0-9f44-3cbb02d5aeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "270ccda0-0058-4f07-9852-1a30012c5aea", "name": "network-vif-deleted", "tag": "5bced808-04d2-43fa-ad61-7f1b95feac13"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:09.193839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-656ff275-f88b-4c0f-8d21-f9e1d684fd7e req-161745a6-b0b6-40c0-9f44-3cbb02d5aeac service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:09.196521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-656ff275-f88b-4c0f-8d21-f9e1d684fd7e req-161745a6-b0b6-40c0-9f44-3cbb02d5aeac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:09.202325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-656ff275-f88b-4c0f-8d21-f9e1d684fd7e req-161745a6-b0b6-40c0-9f44-3cbb02d5aeac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:09.235476 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-656ff275-f88b-4c0f-8d21-f9e1d684fd7e req-161745a6-b0b6-40c0-9f44-3cbb02d5aeac service nova] Creating event network-vif-deleted:5bced808-04d2-43fa-ad61-7f1b95feac13 for instance 270ccda0-0058-4f07-9852-1a30012c5aea on n-h2-858383-10 Oct 12 08:52:09.247377 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-656ff275-f88b-4c0f-8d21-f9e1d684fd7e req-161745a6-b0b6-40c0-9f44-3cbb02d5aeac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092183 Oct 12 08:52:09.249980 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1144/2151] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:09.260234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a888c96-1512-486b-9d94-3bf67f84d8b2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f984880caf0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:09.318124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-4a888c96-1512-486b-9d94-3bf67f84d8b2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:52:09.319055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-4a888c96-1512-486b-9d94-3bf67f84d8b2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group 52691548-8860-4de5-822b-b4724a04ecdd not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:52:09.320052 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4a888c96-1512-486b-9d94-3bf67f84d8b2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:52:09.320052 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-d81ff1c2-bc5b-4378-9e34-3ae6f743bdbd'] Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a888c96-1512-486b-9d94-3bf67f84d8b2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-security-groups/52691548-8860-4de5-822b-b4724a04ecdd HTTP/1.1 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-d81ff1c2-bc5b-4378-9e34-3ae6f743bdbd'] Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '52691548-8860-4de5-822b-b4724a04ecdd'} Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:52:09.322471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d81ff1c2-bc5b-4378-9e34-3ae6f743bdbd'] Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d81ff1c2-bc5b-4378-9e34-3ae6f743bdbd'] Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d81ff1c2-bc5b-4378-9e34-3ae6f743bdbd'] Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d81ff1c2-bc5b-4378-9e34-3ae6f743bdbd'] Oct 12 08:52:09.326750 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:09.334082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a888c96-1512-486b-9d94-3bf67f84d8b2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group 52691548-8860-4de5-822b-b4724a04ecdd does not exist Oct 12 08:52:09.334082 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-d81ff1c2-bc5b-4378-9e34-3ae6f743bdbd'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:09.335390 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a888c96-1512-486b-9d94-3bf67f84d8b2 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/52691548-8860-4de5-822b-b4724a04ecdd" status: 404 len: 194 microversion: 2.1 time: 0.082775 Oct 12 08:52:09.336524 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1145/2152] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:09 2022] DELETE /compute/v2.1/os-security-groups/52691548-8860-4de5-822b-b4724a04ecdd => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:09.344396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:09.345411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:09.359392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:09.360305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:09.360974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:09.361996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:09.362707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:09.363421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:09.928559 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3479617e-e00f-446c-9bf7-25ca3d46f7be tempest-ServersOnMultiNodesTest-1742738051 tempest-ServersOnMultiNodesTest-1742738051-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1619 microversion: 2.1 time: 0.587696 Oct 12 08:52:09.929297 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1146/2153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:09 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1619 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:09.942746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42e4742d-8b94-4d8c-8d5a-5e5ab2bfe011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f984923faf0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:09.944181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:09.963383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:09.970753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:09.972162 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a2a3b37f-b9e4-4357-94a8-2f2938023261 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1265 microversion: 2.25 time: 1.557518 Oct 12 08:52:09.973032 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1008/2154] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:08 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1265 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:10.005024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:10.011551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:10.026886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.027563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.028112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.028959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.029562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.030094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.066584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-42e4742d-8b94-4d8c-8d5a-5e5ab2bfe011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:52:10.067540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-42e4742d-8b94-4d8c-8d5a-5e5ab2bfe011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Neutron security group f0cab814-b4d8-40e8-ac64-f9daeb2516da not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:52:10.068421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-42e4742d-8b94-4d8c-8d5a-5e5ab2bfe011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:52:10.068421 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-d02cab18-99a6-4756-8e5d-6d1214ae7bfd'] Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42e4742d-8b94-4d8c-8d5a-5e5ab2bfe011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da HTTP/1.1 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-d02cab18-99a6-4756-8e5d-6d1214ae7bfd'] Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'f0cab814-b4d8-40e8-ac64-f9daeb2516da'} Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:52:10.073880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d02cab18-99a6-4756-8e5d-6d1214ae7bfd'] Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d02cab18-99a6-4756-8e5d-6d1214ae7bfd'] Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d02cab18-99a6-4756-8e5d-6d1214ae7bfd'] Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d02cab18-99a6-4756-8e5d-6d1214ae7bfd'] Oct 12 08:52:10.078478 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:10.085714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42e4742d-8b94-4d8c-8d5a-5e5ab2bfe011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Security group f0cab814-b4d8-40e8-ac64-f9daeb2516da does not exist Oct 12 08:52:10.085714 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-d02cab18-99a6-4756-8e5d-6d1214ae7bfd'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:10.088840 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42e4742d-8b94-4d8c-8d5a-5e5ab2bfe011 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da" status: 404 len: 194 microversion: 2.1 time: 0.158229 Oct 12 08:52:10.092810 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1147/2155] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:09 2022] DELETE /compute/v2.1/os-security-groups/f0cab814-b4d8-40e8-ac64-f9daeb2516da => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:10.115398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:10.115958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:10.134157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.134650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.144728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.146351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.150261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.151051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.159055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.160449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.161464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.162351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lazy-loading 'fault' on Instance uuid 270ccda0-0058-4f07-9852-1a30012c5aea {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:10.221425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:10.231860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:10.356204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:10.379174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8233896f-7254-4f64-bdf8-2d06fe7e3326 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 200 len: 1302 microversion: 2.1 time: 0.392162 Oct 12 08:52:10.380016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1009/2156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:09 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 1302 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:10.389404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:10.390469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:10.407676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.408169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.408605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.411969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.414044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.415877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.505815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:10.507658 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-91bafc12-b6b9-4695-8b85-ff228e79e60b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 204 len: 0 microversion: 2.1 time: 0.407919 Oct 12 08:52:10.516757 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1148/2157] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:10 2022] DELETE /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:10.540088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:10.544530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:10.570333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.576265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.579527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.580746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.584798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.592167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.757211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b2d8d48-4037-4d57-9134-ca9143446fe5 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 204 len: 0 microversion: 2.1 time: 0.375461 Oct 12 08:52:10.765139 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1010/2158] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:10 2022] DELETE /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:10.779409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:10.787269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:10.802528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.803297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.803889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:10.804758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:10.805398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:10.806021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:11.181079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:11.194735 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-afb28f57-f450-4d0f-88f5-2e7bef20fa74 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1472 microversion: 2.1 time: 0.671083 Oct 12 08:52:11.213068 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1149/2159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:10 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1472 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:11.221635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:11.222239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:11.261137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:11.261566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:11.262003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:11.262715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:11.263170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:11.263593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:11.351485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:11.351978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:11.352409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:11.352865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lazy-loading 'fault' on Instance uuid 88f1fe07-9eb6-4da6-8b88-0c4df059868e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:11.380809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:11.395005 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9bbef09a-91e5-47e7-93e0-4f63b7183bad tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1646 microversion: 2.1 time: 0.619694 Oct 12 08:52:11.403993 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1011/2160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:10 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1646 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:11.420830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:11.431647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:11.460069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:11.467808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:11.472586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:11.476562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:11.482705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:11.486325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:11.495057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:11.511677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:11.513322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:11.514727 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1ed16bc1-2a1e-4195-af1a-b199f9cab36b tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 200 len: 1270 microversion: 2.25 time: 0.299940 Oct 12 08:52:11.515893 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1150/2161] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:11 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 1270 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:11.565003 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] HTTP exception thrown: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Request method failure captured: Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea HTTP/1.1 Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn_nKhyUHoOcQ_w-32X6cWNcP5s06loXXRiHXPkQdeb7a_FC3ivmJCapuvxkFGFbthg7KGvjV1iDnP4dIWlrdZ75g1JPrZB0tNpBnAioGHEqSzPT037ClfBSkdsSljglsODIK0rmXtOzi6uHIbA63uC7jpnuthMqXEIqldhiphZpFPM Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}] Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestMultiNic-2060105725 Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 9a533e9e2ed84f6eb570e389be2f2feb Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '270ccda0-0058-4f07-9852-1a30012c5aea'} Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:11.566761 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Returning 404 to user: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:11.572169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e96e873a-41f6-4616-af98-b242821cc26c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 404 len: 111 microversion: 2.1 time: 0.162684 Oct 12 08:52:11.607502 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1012/2162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:11 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:11.990618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8394fbb3-5af7-4ffa-aa4d-3cf8829b22e5 req-1424a399-6f38-4fd1-8928-92bdf879a587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:12.004796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8394fbb3-5af7-4ffa-aa4d-3cf8829b22e5 req-1424a399-6f38-4fd1-8928-92bdf879a587 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:12.005277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8394fbb3-5af7-4ffa-aa4d-3cf8829b22e5 req-1424a399-6f38-4fd1-8928-92bdf879a587 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:12.007723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8394fbb3-5af7-4ffa-aa4d-3cf8829b22e5 req-1424a399-6f38-4fd1-8928-92bdf879a587 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:12.044154 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8394fbb3-5af7-4ffa-aa4d-3cf8829b22e5 req-1424a399-6f38-4fd1-8928-92bdf879a587 service nova] Creating event network-changed:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:52:12.077461 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8394fbb3-5af7-4ffa-aa4d-3cf8829b22e5 req-1424a399-6f38-4fd1-8928-92bdf879a587 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081306 Oct 12 08:52:12.078652 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1151/2163] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:12.220330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:12.220964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:12.234725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:12.235226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:12.235679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:12.245505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:12.247932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:12.251788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:12.432261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:12.433789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:12.487217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:12.499824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:12.500335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:12.505371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:12.508437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:12.513412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:13.030838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:13.039369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f8903f88-4e6e-40db-9f07-032002623cac tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1646 microversion: 2.1 time: 0.611937 Oct 12 08:52:13.050459 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1152/2164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:12 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1646 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:13.079976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:13.083504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 88f1fe07-9eb6-4da6-8b88-0c4df059868e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:13.105803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:13.111954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:13.115489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:13.116152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:13.121888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:13.123829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:13.189210 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] HTTP exception thrown: Instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e could not be found. Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Request method failure captured: Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e HTTP/1.1 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6Ts-eSTmrL5eQiSTwTnp3yx3lZShQiCDtw09IZUqrYBKgZEsDt6cjApr7jFWv4P4uMtoSmv0DyTWoGhqYlcFK2dcmFGFzjY0KQXGH--pkeFwin3yJp9wo9cdbYkPw4Z4sL3rNxX_f2pZZD6XSS_PNAXhUPZa64c3yJAm4Nh774mCc Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e9dc112ec885461eae39dbe7d1abfe7d Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9dc112ec885461eae39dbe7d1abfe7d"}]}] Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e9dc112ec885461eae39dbe7d1abfe7d Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-LiveAutoBlockMigrationV225Test-866295006-project Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 008f3287ba094f53971db283b5f303c5 Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-866295006-project Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e could not be found. Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '88f1fe07-9eb6-4da6-8b88-0c4df059868e'} Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e could not be found. Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e could not be found. Oct 12 08:52:13.199083 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e could not be found. Oct 12 08:52:13.204508 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:13.206438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Returning 404 to user: Instance 88f1fe07-9eb6-4da6-8b88-0c4df059868e could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:13.210101 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c86d556c-8827-4970-a1d4-f342e84a136f tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e" status: 404 len: 111 microversion: 2.25 time: 0.158306 Oct 12 08:52:13.215528 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1153/2165] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:13 2022] GET /compute/v2.1/servers/88f1fe07-9eb6-4da6-8b88-0c4df059868e => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:52:13.540450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1901582627", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5694562d-e360-435c-86bf-39f253be6d82"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:13.620099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] validate_networks() for [('5694562d-e360-435c-86bf-39f253be6d82', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:52:14.100243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:14.119778 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-697a5449-bde3-431c-b887-f78ed3e5791d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1472 microversion: 2.1 time: 1.899067 Oct 12 08:52:14.149507 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1013/2166] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:12 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1472 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:14.160466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:14.166571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:14.181263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:14.182241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:14.182858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:14.190876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:14.196478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:14.197849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:14.625479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:52:14.626797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:52:14.627484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:52:14.628071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:52:14.628740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:52:14.662595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:14.663110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:14.663641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:14.666842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:14.667319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:14.670913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:14.737769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:52:14.747829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:52:14.776872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:52:14.784065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:52:14.911240 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bafffcf7-f054-4c34-a747-d76e47e6e27b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.685744 Oct 12 08:52:14.918580 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1154/2167] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:52:14.930637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23d24cce-2233-4b29-bca9-1aa10e35e132 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:14.931846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-23d24cce-2233-4b29-bca9-1aa10e35e132 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:15.102046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-23d24cce-2233-4b29-bca9-1aa10e35e132 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:15.109568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-23d24cce-2233-4b29-bca9-1aa10e35e132 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1193 microversion: 2.1 time: 0.189398 Oct 12 08:52:15.110169 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1155/2168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:14 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1193 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:15.146901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:15.159561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:15.187567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:15.190341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:15.196278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:15.196941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:15.203874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:15.207058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:15.364401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:15.385474 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5accab49-469d-4162-8eb9-ded7b4a47e90 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1430 microversion: 2.1 time: 0.242480 Oct 12 08:52:15.414055 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1156/2169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:15 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1430 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:15.826175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-64a40ebf-306b-46cb-808c-4ad291962ccc req-ffc8fc8e-8fba-44f3-b703-8b461340a129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8218a41-0ecf-4507-b952-72ce43512a26", "name": "network-vif-deleted", "tag": "b568ccd8-ebeb-4834-84f8-4a93f97ac613"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:15.887674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-64a40ebf-306b-46cb-808c-4ad291962ccc req-ffc8fc8e-8fba-44f3-b703-8b461340a129 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:15.888097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-64a40ebf-306b-46cb-808c-4ad291962ccc req-ffc8fc8e-8fba-44f3-b703-8b461340a129 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:15.888563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-64a40ebf-306b-46cb-808c-4ad291962ccc req-ffc8fc8e-8fba-44f3-b703-8b461340a129 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:15.967088 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-64a40ebf-306b-46cb-808c-4ad291962ccc req-ffc8fc8e-8fba-44f3-b703-8b461340a129 service nova] Creating event network-vif-deleted:b568ccd8-ebeb-4834-84f8-4a93f97ac613 for instance c8218a41-0ecf-4507-b952-72ce43512a26 on n-h2-858383-10 Oct 12 08:52:15.991110 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-64a40ebf-306b-46cb-808c-4ad291962ccc req-ffc8fc8e-8fba-44f3-b703-8b461340a129 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175293 Oct 12 08:52:15.997701 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1157/2170] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:16.133165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52d3e6af-dc23-43b3-9006-f34374db5c87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:16.133901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-52d3e6af-dc23-43b3-9006-f34374db5c87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:16.761406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-52d3e6af-dc23-43b3-9006-f34374db5c87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:16.770531 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-52d3e6af-dc23-43b3-9006-f34374db5c87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1193 microversion: 2.1 time: 0.641900 Oct 12 08:52:16.774508 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1158/2171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:16 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1193 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:16.790305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:16.791225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:16.812143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:16.813366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:16.816519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:16.817659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:16.820083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:16.823737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:17.060407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:17.062128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:17.065756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:17.075436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lazy-loading 'fault' on Instance uuid c8218a41-0ecf-4507-b952-72ce43512a26 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:17.420137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:17.430251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bd1a39e2-6816-4f33-acdb-c6e8fdc7d8cc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 200 len: 1306 microversion: 2.1 time: 0.654412 Oct 12 08:52:17.435365 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1159/2172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:16 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 1306 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:17.562204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:17.573806 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad5ee981-f8ff-48f7-a937-ecf92698e7ca tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1646 microversion: 2.1 time: 3.419446 Oct 12 08:52:17.575071 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1014/2173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:14 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1646 bytes in 3425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:17.801120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:17.802055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:17.817871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:17.823345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:17.824075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:17.829584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:17.830615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:17.831330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:18.140161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:18.156341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-406b1db5-96ae-47f1-a658-8ba505146587 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1245 microversion: 2.1 time: 0.353686 Oct 12 08:52:18.163288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1160/2174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:17 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1245 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:18.454812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:18.455424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: c8218a41-0ecf-4507-b952-72ce43512a26] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:18.468010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:18.468497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:18.468925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:18.477767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:18.482850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:18.489474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:18.559333 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] HTTP exception thrown: Instance c8218a41-0ecf-4507-b952-72ce43512a26 could not be found. Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Request method failure captured: Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 HTTP/1.1 Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9pUbLPSQP9ujkvj-N7eTzJXA__5QGTAEo3oGEeuzDMj0bCMZerwN_QqYqNyBKloDZ3Ftf4NU7T-k-Sc4hLLttKngr-NGbJU2cR79jWVjP9Kw8DuK8afmyNfU7BemUfNSFad3n6SghgzRlKZGCO5WKTU7--yWH_HHySAguTq0HUndU Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}] Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 42733726966a4ab9ba5e9e160415358d Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance c8218a41-0ecf-4507-b952-72ce43512a26 could not be found. Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'c8218a41-0ecf-4507-b952-72ce43512a26'} Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8218a41-0ecf-4507-b952-72ce43512a26 could not be found. Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8218a41-0ecf-4507-b952-72ce43512a26 could not be found. Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:18.570808 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:18.577086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:18.577086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:18.577086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:18.577086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:18.577086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:18.577086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8218a41-0ecf-4507-b952-72ce43512a26 could not be found. Oct 12 08:52:18.577086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:18.580627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Returning 404 to user: Instance c8218a41-0ecf-4507-b952-72ce43512a26 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:18.583164 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-776394a9-baac-4256-8c07-39231323b17d tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26" status: 404 len: 111 microversion: 2.1 time: 0.132002 Oct 12 08:52:18.592214 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1015/2175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:18 2022] GET /compute/v2.1/servers/c8218a41-0ecf-4507-b952-72ce43512a26 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:18.601971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:18.602537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:18.612409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:18.614132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:18.614962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:18.616805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:18.617387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:18.618335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:18.620716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:18.621394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:18.631542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:18.633859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:18.634480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:18.638255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:18.638923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:18.639517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:18.687991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:18.736632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:18.987902 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-41eb7e0e-2a3b-4e28-8cd9-f19040e75c12 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 204 len: 0 microversion: 2.1 time: 0.395788 Oct 12 08:52:18.988740 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1161/2176] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:18 2022] DELETE /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:19.005121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:19.006211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:19.030798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:19.039930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:19.040704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:19.041836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:19.042479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:19.043300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:19.498686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:19.507615 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-854a421f-f882-45d4-af0e-5fdd36f9f68d tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1467 microversion: 2.1 time: 0.908928 Oct 12 08:52:19.514387 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1016/2177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:18 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1467 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:19.532609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:19.535353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:19.560418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:19.562052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:19.566946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:19.567964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:19.569988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:19.575278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:19.575913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:19.576526 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47c9ca48-a306-4289-ad19-02b2a16fa26e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1472 microversion: 2.1 time: 0.575335 Oct 12 08:52:19.577202 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1162/2178] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:18 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1472 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:20.076453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d213410a-4ed4-4bd5-9693-91c8abff7413 req-ccea0edb-2676-43f8-bbf8-df0572fef44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad3031b-2e27-424a-9ec0-6d590834783f", "name": "network-vif-deleted", "tag": "ce2057b4-bb08-4477-8c3a-c2784285043a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:20.100942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d213410a-4ed4-4bd5-9693-91c8abff7413 req-ccea0edb-2676-43f8-bbf8-df0572fef44b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:20.101465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d213410a-4ed4-4bd5-9693-91c8abff7413 req-ccea0edb-2676-43f8-bbf8-df0572fef44b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:20.101913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d213410a-4ed4-4bd5-9693-91c8abff7413 req-ccea0edb-2676-43f8-bbf8-df0572fef44b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:20.132384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:20.152720 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bcdcd76b-a91a-47d5-acba-62f9fd27a5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1251 microversion: 2.1 time: 0.637051 Oct 12 08:52:20.158296 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d213410a-4ed4-4bd5-9693-91c8abff7413 req-ccea0edb-2676-43f8-bbf8-df0572fef44b service nova] Creating event network-vif-deleted:ce2057b4-bb08-4477-8c3a-c2784285043a for instance 8ad3031b-2e27-424a-9ec0-6d590834783f on n-h1-858383-10 Oct 12 08:52:20.161841 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1017/2179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:19 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1251 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:20.183861 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d213410a-4ed4-4bd5-9693-91c8abff7413 req-ccea0edb-2676-43f8-bbf8-df0572fef44b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097985 Oct 12 08:52:20.185874 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1163/2180] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:20.540526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:20.541963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:20.557144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:20.558146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:20.558845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:20.564748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:20.565657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:20.566411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:20.607989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:20.608815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:20.624493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:20.627733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:20.630429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:20.631227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:20.634393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:20.635004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:20.702280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:20.708948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:20.710150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:20.711047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lazy-loading 'fault' on Instance uuid 8ad3031b-2e27-424a-9ec0-6d590834783f {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:21.023053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c765279afc5a4682b5e525416c13db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835727d058524514b4fc66d4c8e8dedc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:21.031930 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-691695bf-bf54-4ba7-824c-af9979fadb6c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 200 len: 1305 microversion: 2.1 time: 0.495680 Oct 12 08:52:21.037686 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1018/2181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:20 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 1305 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:21.180791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:21.183385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:21.211982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:21.215315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:21.215779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:21.216537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:21.216995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:21.217452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:21.672356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:21.691611 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-49e90e62-0ced-4e07-a696-867e982fd199 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1251 microversion: 2.1 time: 0.515091 Oct 12 08:52:21.694541 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1019/2182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:21 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1251 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:21.848967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:21.873108 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e2904147-91e8-4942-8649-529849dcc1ac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1472 microversion: 2.1 time: 1.271538 Oct 12 08:52:21.875707 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1164/2183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:20 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1472 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:22.114096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:22.119698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] [instance: 8ad3031b-2e27-424a-9ec0-6d590834783f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:22.167722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:22.169812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:22.174144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:22.175213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:22.175912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:22.179919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:22.235321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] HTTP exception thrown: Instance 8ad3031b-2e27-424a-9ec0-6d590834783f could not be found. Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Request method failure captured: Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f HTTP/1.1 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn-5835h59NJtekA29Lc1ghcN2GSeia1FRjTCUygE17-Q2EdbNHZ6H1Ine7oexx-zZ5d_cIwAqDVclm_sDxxn8QEQpUHBqWedJTN1qKMj41dU8NkPxnI9JXXVblwC06k10cWRLoBfngUq2Uml69rfF5pFZCKkACpYbk1PKenlb9pm68 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_835727d058524514b4fc66d4c8e8dedc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/835727d058524514b4fc66d4c8e8dedc"}]}] Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 835727d058524514b4fc66d4c8e8dedc Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-331182072 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c765279afc5a4682b5e525416c13db87 Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsTestJSON-331182072-project Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 8ad3031b-2e27-424a-9ec0-6d590834783f could not be found. Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '8ad3031b-2e27-424a-9ec0-6d590834783f'} Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad3031b-2e27-424a-9ec0-6d590834783f could not be found. Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad3031b-2e27-424a-9ec0-6d590834783f could not be found. Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:22.236894 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:22.243763 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:22.243763 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:22.243763 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:22.243763 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:22.243763 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:22.243763 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad3031b-2e27-424a-9ec0-6d590834783f could not be found. Oct 12 08:52:22.243763 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:22.260706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Returning 404 to user: Instance 8ad3031b-2e27-424a-9ec0-6d590834783f could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:22.262052 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8bf40615-fd21-4f3c-9327-cd98e8c4b66a tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f" status: 404 len: 111 microversion: 2.1 time: 0.205132 Oct 12 08:52:22.266269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1020/2184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:22 2022] GET /compute/v2.1/servers/8ad3031b-2e27-424a-9ec0-6d590834783f => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:22.271771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4877494-302e-409b-89f4-f7f98c89f42c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848c250d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:22.695645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:22.696149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:22.713739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:22.714255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:22.715566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:22.717070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:22.717760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:22.718812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:22.800251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:23.045684 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b34a9394-b05f-4d7a-9f8d-f14dc026f3f4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 204 len: 0 microversion: 2.25 time: 0.353584 Oct 12 08:52:23.046804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1021/2185] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:52:22 2022] DELETE /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:52:23.052496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:23.053762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:23.081769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:23.082748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:23.083443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:23.085532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:23.086229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:23.087924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:23.527281 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4877494-302e-409b-89f4-f7f98c89f42c tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f7b5f0a5-99d1-4793-a0c7-092d6de6abd6" status: 202 len: 0 microversion: 2.1 time: 1.259206 Oct 12 08:52:23.528356 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1165/2186] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:22 2022] DELETE /compute/v2.1/os-security-groups/f7b5f0a5-99d1-4793-a0c7-092d6de6abd6 => generated 0 bytes in 1261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:52:23.534350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:23.535168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:23.561265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:23.561812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:23.562253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:23.562979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:23.574579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:23.575060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:23.796390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:23.816456 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-850b0b49-050c-45a8-bee5-656f02ca135d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.759808 Oct 12 08:52:23.819912 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1022/2187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:23 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:23.828887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:23.831878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:23.881753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:23.881873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:23.889889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:23.893299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:23.895037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:23.895553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:24.011021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:24.025399 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5aa55ae4-4dd2-40e4-b823-1c3b1b0df069 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 200 len: 1430 microversion: 2.1 time: 0.495552 Oct 12 08:52:24.026154 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1166/2188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:23 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 1430 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:24.075237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ff37be07-0ee6-4bb2-99f4-7daa2f545ae3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] Calling method '.version_select at 0x7f9848e5ddc0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:24.707372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:25.041727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:25.055673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:25.057787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:25.059199 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-56cfbe33-a4b4-485f-95b4-d0e596c72230 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1730 microversion: 2.25 time: 1.238039 Oct 12 08:52:25.060651 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1023/2189] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:23 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1730 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:25.066063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a858b61a-7a50-4925-aaa8-e5298fa82119 req-e0fa8e2b-129c-4108-baba-bc32cff78308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefe319f-8432-4c1e-991c-0ae636dc43fa", "name": "network-vif-deleted", "tag": "633af6c6-0c7b-4c06-ad95-d9e78e945be0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:25.078721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a858b61a-7a50-4925-aaa8-e5298fa82119 req-e0fa8e2b-129c-4108-baba-bc32cff78308 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:25.079404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a858b61a-7a50-4925-aaa8-e5298fa82119 req-e0fa8e2b-129c-4108-baba-bc32cff78308 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:25.079993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a858b61a-7a50-4925-aaa8-e5298fa82119 req-e0fa8e2b-129c-4108-baba-bc32cff78308 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:25.099914 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a858b61a-7a50-4925-aaa8-e5298fa82119 req-e0fa8e2b-129c-4108-baba-bc32cff78308 service nova] Creating event network-vif-deleted:633af6c6-0c7b-4c06-ad95-d9e78e945be0 for instance cefe319f-8432-4c1e-991c-0ae636dc43fa on n-h1-858383-10 Oct 12 08:52:25.121775 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a858b61a-7a50-4925-aaa8-e5298fa82119 req-e0fa8e2b-129c-4108-baba-bc32cff78308 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045333 Oct 12 08:52:25.123537 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1024/2190] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:25.292794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9affce1d-f00c-408a-ab20-d2d997a5e29e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Action: 'create', calling method: .version_select at 0x7f9848e1fc10>, body: {"keypair": {"name": "tempest-keypair-1493624682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+c0/TZj0aZLpnDz1eygOlHp77uypM6er4Edwd4z0tLhJRRpkcEE+v9zneM9nQfoP+8mFFljxCOuR6TuuhQY/Y3DbV11wF2msro58hUzuOrS3uYpIHYk+D+cKf6Z/3qEQ=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:25.320453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9affce1d-f00c-408a-ab20-d2d997a5e29e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Getting quotas for project 53ff14b2964549dabef982ff05657230. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:52:25.326293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9affce1d-f00c-408a-ab20-d2d997a5e29e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Getting quotas for user 2ddcb6fa0027468bae2b3d917c4a7fcc and project 53ff14b2964549dabef982ff05657230. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:52:25.378052 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9affce1d-f00c-408a-ab20-d2d997a5e29e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.253891 Oct 12 08:52:25.385188 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1025/2191] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:52:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:25.390739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:25.391894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:25.399599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:25.400329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:25.401049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:25.401981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:25.402603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:25.403196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:25.588151 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ff37be07-0ee6-4bb2-99f4-7daa2f545ae3 tempest-SecurityGroupsTestJSON-331182072 tempest-SecurityGroupsTestJSON-331182072-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9247390a-1fb4-4fd3-921d-830565eee933" status: 202 len: 0 microversion: 2.1 time: 1.547775 Oct 12 08:52:25.588832 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1167/2192] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:24 2022] DELETE /compute/v2.1/os-security-groups/9247390a-1fb4-4fd3-921d-830565eee933 => generated 0 bytes in 1562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:52:25.594436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:25.595127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: cefe319f-8432-4c1e-991c-0ae636dc43fa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:25.624097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:25.624552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:25.624998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:25.625770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:25.626225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:25.632285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:25.676923 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] HTTP exception thrown: Instance cefe319f-8432-4c1e-991c-0ae636dc43fa could not be found. Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Request method failure captured: Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa HTTP/1.1 Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9pUbLPSQP9ujkvj-N7eTzJXA__5QGTAEo3oGEeuzDMj0bCMZerwN_QqYqNyBKloDZ3Ftf4NU7T-k-Sc4hLLttKngr-NGbJU2cR79jWVjP9Kw8DuK8afmyNfU7BemUfNSFad3n6SghgzRlKZGCO5WKTU7--yWH_HHySAguTq0HUndU Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}] Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 42733726966a4ab9ba5e9e160415358d Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance cefe319f-8432-4c1e-991c-0ae636dc43fa could not be found. Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'cefe319f-8432-4c1e-991c-0ae636dc43fa'} Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cefe319f-8432-4c1e-991c-0ae636dc43fa could not be found. Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cefe319f-8432-4c1e-991c-0ae636dc43fa could not be found. Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:25.680476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:25.686432 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:25.686432 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:25.686432 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:25.686432 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:25.686432 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:25.686432 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cefe319f-8432-4c1e-991c-0ae636dc43fa could not be found. Oct 12 08:52:25.686432 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:25.690617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Returning 404 to user: Instance cefe319f-8432-4c1e-991c-0ae636dc43fa could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:25.691729 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9cb41294-8a05-4c4b-afe0-150f1ee310c2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa" status: 404 len: 111 microversion: 2.1 time: 0.101972 Oct 12 08:52:25.696550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1168/2193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:25 2022] GET /compute/v2.1/servers/cefe319f-8432-4c1e-991c-0ae636dc43fa => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:25.702451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:25.703211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:25.710631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:25.712121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:25.712725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:25.713668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:25.714282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:25.714909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:25.746524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:25.784734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:25.988730 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4bf347dd-0088-44e0-a1cb-2e36e88b76bc tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 204 len: 0 microversion: 2.1 time: 0.288862 Oct 12 08:52:25.990853 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1169/2194] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:25 2022] DELETE /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:26.008420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:26.010732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:26.023509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:26.024459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:26.025218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:26.026327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:26.027669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:26.028265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:26.277953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:26.291638 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-de77e5c5-85e9-4623-932f-3edf5866f5b6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.904778 Oct 12 08:52:26.292237 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1026/2195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:25 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:26.301505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:26.308422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:26.326075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:26.326813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:26.336239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:26.336607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:26.337088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:26.337549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:26.406915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:26.411020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:26.411505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:26.412008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lazy-loading 'fault' on Instance uuid 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:26.730871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:26.741830 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2bbe9a56-7ebd-4e3e-be1e-946cdd2ae21f tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1473 microversion: 2.1 time: 0.746184 Oct 12 08:52:26.750398 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1170/2196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:25 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1473 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:26.907433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:26.923512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:26.927991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:26.932803 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-be991c27-c92b-4832-bd65-a10898b3c5b8 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 200 len: 1375 microversion: 2.25 time: 0.635684 Oct 12 08:52:26.935135 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1027/2197] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:26 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 1375 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:27.165579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-14e4a4fe-7a36-4b52-aa60-dfc8d1aa9739 req-cf1086b9-69b3-4c31-b4ef-9088144bc7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21", "name": "network-vif-deleted", "tag": "f197b63f-1a58-4a19-b284-61862fdfca13"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:27.171354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=10 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:27.197786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14e4a4fe-7a36-4b52-aa60-dfc8d1aa9739 req-cf1086b9-69b3-4c31-b4ef-9088144bc7a0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:27.198288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14e4a4fe-7a36-4b52-aa60-dfc8d1aa9739 req-cf1086b9-69b3-4c31-b4ef-9088144bc7a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:27.198962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14e4a4fe-7a36-4b52-aa60-dfc8d1aa9739 req-cf1086b9-69b3-4c31-b4ef-9088144bc7a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:27.224175 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-14e4a4fe-7a36-4b52-aa60-dfc8d1aa9739 req-cf1086b9-69b3-4c31-b4ef-9088144bc7a0 service nova] Creating event network-vif-deleted:f197b63f-1a58-4a19-b284-61862fdfca13 for instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 on n-h2-858383-10 Oct 12 08:52:27.231537 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-14e4a4fe-7a36-4b52-aa60-dfc8d1aa9739 req-cf1086b9-69b3-4c31-b4ef-9088144bc7a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073428 Oct 12 08:52:27.232390 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1171/2198] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:52:27.276123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3126db8d-ef5a-407b-aacb-169acac8dea8 req-50ae0f62-6501-431f-958a-81f5b3c1c903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b2b899b-d791-4d6e-b96d-bb4abd3f6959", "tag": "edb66832-c169-4cc5-ba21-6fa1b454376c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:27.291735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3126db8d-ef5a-407b-aacb-169acac8dea8 req-50ae0f62-6501-431f-958a-81f5b3c1c903 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:27.294395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3126db8d-ef5a-407b-aacb-169acac8dea8 req-50ae0f62-6501-431f-958a-81f5b3c1c903 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:27.296613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3126db8d-ef5a-407b-aacb-169acac8dea8 req-50ae0f62-6501-431f-958a-81f5b3c1c903 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:27.332143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:27.336090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:27.337550 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3126db8d-ef5a-407b-aacb-169acac8dea8 req-50ae0f62-6501-431f-958a-81f5b3c1c903 service nova] Creating event network-changed:edb66832-c169-4cc5-ba21-6fa1b454376c for instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 on n-h1-858383-10 Oct 12 08:52:27.347352 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3126db8d-ef5a-407b-aacb-169acac8dea8 req-50ae0f62-6501-431f-958a-81f5b3c1c903 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076619 Oct 12 08:52:27.348360 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1028/2199] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:27.350751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:27.352844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:27.353587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:27.354839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:27.356254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:27.356904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:27.777142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:27.785404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:27.794677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:27.795513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:27.796140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:27.797540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:27.799014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:27.802339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:28.048101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:28.064544 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c53026e-857e-48f7-9df8-0fe7fa412e2e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.750469 Oct 12 08:52:28.065145 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1172/2200] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:27 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:28.079748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:28.082249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:28.102810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:28.103461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:28.103910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:28.104714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:28.105111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:28.105763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:28.146799 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] HTTP exception thrown: Instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 could not be found. Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Request method failure captured: Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 HTTP/1.1 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6Ts-eSTmrL5eQiSTwTnp3yx3lZShQiCDtw09IZUqrYBKgZEsDt6cjApr7jFWv4P4uMtoSmv0DyTWoGhqYlcFK2dcmFGFzjY0KQXGH--pkeFwin3yJp9wo9cdbYkPw4Z4sL3rNxX_f2pZZD6XSS_PNAXhUPZa64c3yJAm4Nh774mCc Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e9dc112ec885461eae39dbe7d1abfe7d Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9dc112ec885461eae39dbe7d1abfe7d"}]}] Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e9dc112ec885461eae39dbe7d1abfe7d Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-LiveAutoBlockMigrationV225Test-866295006-project Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 008f3287ba094f53971db283b5f303c5 Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-866295006-project Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 could not be found. Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21'} Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 could not be found. Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 could not be found. Oct 12 08:52:28.148562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 could not be found. Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Returning 404 to user: Instance 5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:28.153999 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-520cc648-04ef-4d66-b0dc-aeaae3a7ceec tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21" status: 404 len: 111 microversion: 2.25 time: 0.083652 Oct 12 08:52:28.157819 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1173/2201] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:28 2022] GET /compute/v2.1/servers/5c13629a-15ee-4c6d-a8fa-b5c1b2c72d21 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:52:28.163650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf2b375e-1ee0-42f1-a04f-883c154b7662 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '.version_select at 0x7f98490c19d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:28.205991 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf2b375e-1ee0-42f1-a04f-883c154b7662 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758790530" status: 204 len: 0 microversion: 2.25 time: 0.046802 Oct 12 08:52:28.207954 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1174/2202] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 08:52:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758790530 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:52:28.435194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:28.449248 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3cb9f6c-e7c9-41e8-be49-fae62843d7e2 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1473 microversion: 2.1 time: 0.677500 Oct 12 08:52:28.450360 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1029/2203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:27 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1473 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:29.095944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:29.096921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:29.106006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:29.106912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:29.107616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:29.108635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:29.109331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:29.110072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:29.285157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b2bcc248-4bd3-4288-829d-f04b387a71ef req-1f0d8ee9-13af-43ac-84d1-fc4f8ea9552d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68d4300-929d-46de-bb5e-4010c2d60be3", "name": "network-vif-deleted", "tag": "d04f2e52-f07c-4667-82e2-c9b8d1f82d6a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:29.313375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b2bcc248-4bd3-4288-829d-f04b387a71ef req-1f0d8ee9-13af-43ac-84d1-fc4f8ea9552d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:29.314161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b2bcc248-4bd3-4288-829d-f04b387a71ef req-1f0d8ee9-13af-43ac-84d1-fc4f8ea9552d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:29.314751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b2bcc248-4bd3-4288-829d-f04b387a71ef req-1f0d8ee9-13af-43ac-84d1-fc4f8ea9552d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:29.334344 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b2bcc248-4bd3-4288-829d-f04b387a71ef req-1f0d8ee9-13af-43ac-84d1-fc4f8ea9552d service nova] Creating event network-vif-deleted:d04f2e52-f07c-4667-82e2-c9b8d1f82d6a for instance f68d4300-929d-46de-bb5e-4010c2d60be3 on n-h1-858383-10 Oct 12 08:52:29.344175 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b2bcc248-4bd3-4288-829d-f04b387a71ef req-1f0d8ee9-13af-43ac-84d1-fc4f8ea9552d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062767 Oct 12 08:52:29.345910 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1030/2204] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:52:29.475667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:29.476364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:29.506165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:29.506731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:29.509792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:29.520653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:29.521716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:29.525091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:29.655290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:29.655773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:29.656279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:29.656758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lazy-loading 'fault' on Instance uuid f68d4300-929d-46de-bb5e-4010c2d60be3 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:29.770738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:29.787008 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-156e7a5c-9bf1-4782-b64a-149664aeedde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.698308 Oct 12 08:52:29.788444 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1175/2205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:29 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:29.912147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:29.923423 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dde6dc87-2592-4d2c-8114-1399cd4a28c3 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 200 len: 1307 microversion: 2.1 time: 0.452003 Oct 12 08:52:29.926304 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1031/2206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:29 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 1307 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:30.308542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-129714143", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "9dec72d8-fddb-4ba2-a0a2-ff87a51f71c6"}, {"uuid": "072e75f9-e9a4-497d-856f-403fd242514a"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:30.336356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:30.379435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] validate_networks() for [('9dec72d8-fddb-4ba2-a0a2-ff87a51f71c6', None, None, None, None, None), ('072e75f9-e9a4-497d-856f-403fd242514a', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:52:30.814867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:30.816230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:30.823415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:30.824175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:30.824967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:30.825882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:30.826536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:30.827129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.287699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:31.301977 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6dd522b4-46f2-4c64-8490-d9cc4a53d456 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.490040 Oct 12 08:52:31.303364 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1032/2207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:30 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:31.309172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:31.311331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: f68d4300-929d-46de-bb5e-4010c2d60be3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:31.320424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.321334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.322418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.323458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.324513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.325297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.344637 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] HTTP exception thrown: Instance f68d4300-929d-46de-bb5e-4010c2d60be3 could not be found. Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Request method failure captured: Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 HTTP/1.1 Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9pUbLPSQP9ujkvj-N7eTzJXA__5QGTAEo3oGEeuzDMj0bCMZerwN_QqYqNyBKloDZ3Ftf4NU7T-k-Sc4hLLttKngr-NGbJU2cR79jWVjP9Kw8DuK8afmyNfU7BemUfNSFad3n6SghgzRlKZGCO5WKTU7--yWH_HHySAguTq0HUndU Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}] Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 42733726966a4ab9ba5e9e160415358d Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance f68d4300-929d-46de-bb5e-4010c2d60be3 could not be found. Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f68d4300-929d-46de-bb5e-4010c2d60be3'} Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68d4300-929d-46de-bb5e-4010c2d60be3 could not be found. Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68d4300-929d-46de-bb5e-4010c2d60be3 could not be found. Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:31.349407 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:31.355939 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:31.355939 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:31.355939 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:31.355939 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:31.355939 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:31.355939 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68d4300-929d-46de-bb5e-4010c2d60be3 could not be found. Oct 12 08:52:31.355939 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:31.355939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Returning 404 to user: Instance f68d4300-929d-46de-bb5e-4010c2d60be3 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:31.357496 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a72530ad-0e42-4200-b8d1-fa1995de3a6e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3" status: 404 len: 111 microversion: 2.1 time: 0.052066 Oct 12 08:52:31.362456 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1033/2208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:31 2022] GET /compute/v2.1/servers/f68d4300-929d-46de-bb5e-4010c2d60be3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:31.368290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:31.368933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:31.375745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.376524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.377215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.378438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.379119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.379766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.408899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:31.415558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:31.519506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9fb1cb57-ce6a-41d2-ae59-ce8b112c4084 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32" status: 204 len: 0 microversion: 2.1 time: 0.155344 Oct 12 08:52:31.524571 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1034/2209] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:31 2022] DELETE /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:31.541286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:31.542948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:31.560511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.561744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.562641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.564436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.565111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.565807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.613967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:31.746700 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-84d00b7e-0e39-4b82-b11f-244d7567fe04 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 204 len: 0 microversion: 2.1 time: 0.218275 Oct 12 08:52:31.750733 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1035/2210] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:31 2022] DELETE /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:31.759923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:31.760804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:31.769163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.770404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.771020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.772466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.773111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.774405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.852160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:52:31.852660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:52:31.853213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:52:31.853892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:52:31.854343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:52:31.904387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.907370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.908019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.910316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:31.919327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:31.920055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:31.991876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Getting quotas for project a52c8325195f4024b1a917f2a1f0ca7e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:52:32.006694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Getting quotas for user 9a533e9e2ed84f6eb570e389be2f2feb and project a52c8325195f4024b1a917f2a1f0ca7e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:52:32.052285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:52:32.058646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:52:32.229189 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7400091-7374-4ec0-984f-50275adb5fd6 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.920710 Oct 12 08:52:32.229189 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1176/2211] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:52:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:52:32.230880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:32.231638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:32.238580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:32.239317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:32.239967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:32.240865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:32.241544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:32.257845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:32.364025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:32.391230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:32.400853 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-99eaff45-e12d-4c50-818d-35db1d946f51 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32" status: 200 len: 1475 microversion: 2.1 time: 0.647045 Oct 12 08:52:32.411419 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1036/2212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:31 2022] GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 => generated 1475 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:32.416877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1927146831", "imageRef": "19c9ee16-8af5-40d1-bf1a-0b8797b8ecae", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "aa8137e9-ba4c-489e-b588-21ef7a2f827d"}], "security_groups": [{"name": "tempest-securitygroup--1036141391"}], "key_name": "tempest-keypair-1493624682", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:32.444081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:32.599821 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c41c1f2-25f0-456a-a4e1-ea5a5a74d697 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 204 len: 0 microversion: 2.25 time: 0.372928 Oct 12 08:52:32.604023 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1177/2213] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:52:32 2022] DELETE /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:52:32.638668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] validate_networks() for [('aa8137e9-ba4c-489e-b588-21ef7a2f827d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:52:32.916051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c997beb1-686b-47f2-a8c9-8c3741e86d56 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Action: 'create', calling method: .version_select at 0x7f984cbf1430>, body: {"keypair": {"name": "tempest-keypair-1657414392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHUShEda6YuEi6FMtwO0vR+BjySXaxqLzgQ5lm3g02SnajZh9T5HcyvVuWOFdbWcl/esFYgLfoeLiMhh0GT3I+pFzSPaQIhjB4G+gZckQgewizfEC5mpnpF/2VLgInWw=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:32.966618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c997beb1-686b-47f2-a8c9-8c3741e86d56 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Getting quotas for project ecfcb084646547968793714916aa6e91. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:52:32.999315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c997beb1-686b-47f2-a8c9-8c3741e86d56 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Getting quotas for user 87645feeea9f4f0b93b3dddae933d343 and project ecfcb084646547968793714916aa6e91. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:52:33.036378 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c997beb1-686b-47f2-a8c9-8c3741e86d56 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.430933 Oct 12 08:52:33.039345 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1178/2214] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:52:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:33.051542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cfc3be1c-dfc1-4745-a656-632d6a04925c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:33.056501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cfc3be1c-dfc1-4745-a656-632d6a04925c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:33.206979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cfc3be1c-dfc1-4745-a656-632d6a04925c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:33.216073 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cfc3be1c-dfc1-4745-a656-632d6a04925c tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1212 microversion: 2.1 time: 0.175433 Oct 12 08:52:33.227951 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1179/2215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:33 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:33.256514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:33.257342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:33.277170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:33.278599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:33.279214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:33.280128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:33.280756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:33.281378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:33.575413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:33.584131 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf9f5884-94ca-43c8-84f3-f87c63b66380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.337126 Oct 12 08:52:33.594313 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1180/2216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:33 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:33.604103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:33.614335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:33.638198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:33.640701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:33.641224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:33.642175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:33.642762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:33.645597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:33.961487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:33.971799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:33.974531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:33.976063 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-20b56ba5-58e1-401e-84b8-45c1c4597bc1 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1549 microversion: 2.25 time: 0.380291 Oct 12 08:52:33.989977 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1181/2217] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:33 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1549 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:34.001603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:34.002742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:34.009843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:34.010690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:34.011367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:34.012356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:34.013246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:34.014098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:34.232595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:52:34.234085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:52:34.234911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:52:34.235333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:52:34.235750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:52:34.254455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:34.256016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:34.256476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:34.257268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:34.257764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:34.258199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:34.313581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Getting quotas for project 53ff14b2964549dabef982ff05657230. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:52:34.328039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Getting quotas for user 2ddcb6fa0027468bae2b3d917c4a7fcc and project 53ff14b2964549dabef982ff05657230. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:52:34.382227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:52:34.392443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19c9ee16-8af5-40d1-bf1a-0b8797b8ecae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:52:34.499666 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e2aab76e-8664-490b-b9e2-21c0e40d54b5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.086638 Oct 12 08:52:34.501110 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1037/2218] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:52:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:52:34.507299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:34.508272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:34.517737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:34.518811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:34.519477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:34.521364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:34.522168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:34.523101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:34.830831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:34.840280 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b12f6f89-98e8-484b-a1dd-7e9b1c15f591 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32" status: 200 len: 1475 microversion: 2.1 time: 0.848783 Oct 12 08:52:34.853492 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1182/2219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:33 2022] GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 => generated 1475 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:34.871704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3abb7d81-3f27-47c7-ae5c-ddf08b569604 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:34.872320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3abb7d81-3f27-47c7-ae5c-ddf08b569604 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:34.952076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:34.962151 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c6eaa07-af25-40c8-a603-115d9436e647 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1282 microversion: 2.1 time: 0.459591 Oct 12 08:52:34.962799 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1038/2220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:34 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1282 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:34.993481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:34.994178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:35.013587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:35.014145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:35.014618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:35.015378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:35.015826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:35.016271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:35.091912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3abb7d81-3f27-47c7-ae5c-ddf08b569604 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:35.102619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3abb7d81-3f27-47c7-ae5c-ddf08b569604 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1246 microversion: 2.1 time: 0.241591 Oct 12 08:52:35.104831 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1183/2221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:34 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1246 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:35.121107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:35.127041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:35.166837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:35.175162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:35.177031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:35.178699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:35.179407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:35.180029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:35.790241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:35.817749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:35.822088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:35.834164 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a9e04fe7-d75e-469a-a6e2-25ad3cd216d5 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1549 microversion: 2.25 time: 0.719944 Oct 12 08:52:35.837454 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1184/2222] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:35 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1549 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:35.868078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:35.872184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:35.894474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:35.895333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:35.896034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:35.898359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:35.902527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:35.903198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:35.972190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:35.982918 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c8dda52-1d30-4c72-8f7d-d087c537b9b3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.993885 Oct 12 08:52:35.992963 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1039/2223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:34 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:36.007080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:36.016167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:36.034229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:36.035463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:36.036224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:36.037228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:36.037996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:36.038681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:36.172791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:36.186646 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-79921e50-6b70-4e36-b669-367e3a7824b4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1270 microversion: 2.1 time: 0.183477 Oct 12 08:52:36.187402 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1040/2224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:35 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:36.192379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:36.203486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:36.239011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:36.241636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:36.242215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:36.243612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:36.248204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:36.249595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:36.477042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:36.503186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-09786a11-be9f-4add-a632-0ecd01670555 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1298 microversion: 2.1 time: 0.314325 Oct 12 08:52:36.506116 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1041/2225] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:36 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1298 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:36.588208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b1ace80e-5d68-4b87-91cb-cc52e6db5ba9 req-b713e9f9-720b-4f07-b809-f2a5da5d6b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87afdca0-7aca-4b7d-8a37-b4d9c2a8af32", "name": "network-vif-deleted", "tag": "25f4d920-1f22-4b73-b152-a386262bd173"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:36.607237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b1ace80e-5d68-4b87-91cb-cc52e6db5ba9 req-b713e9f9-720b-4f07-b809-f2a5da5d6b37 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:36.613897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b1ace80e-5d68-4b87-91cb-cc52e6db5ba9 req-b713e9f9-720b-4f07-b809-f2a5da5d6b37 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:36.614906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b1ace80e-5d68-4b87-91cb-cc52e6db5ba9 req-b713e9f9-720b-4f07-b809-f2a5da5d6b37 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:36.640262 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b1ace80e-5d68-4b87-91cb-cc52e6db5ba9 req-b713e9f9-720b-4f07-b809-f2a5da5d6b37 service nova] Creating event network-vif-deleted:25f4d920-1f22-4b73-b152-a386262bd173 for instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 on n-h1-858383-10 Oct 12 08:52:36.655344 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b1ace80e-5d68-4b87-91cb-cc52e6db5ba9 req-b713e9f9-720b-4f07-b809-f2a5da5d6b37 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074535 Oct 12 08:52:36.659151 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1042/2226] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:52:36.871506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:36.877898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:36.901458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:36.909618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:36.911453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:36.922543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:36.930251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:36.930869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:37.027781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:37.031071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:37.033753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:37.034546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:37.037719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lazy-loading 'fault' on Instance uuid 6737ba52-cb8a-4710-85dd-f0a1aa841a5e {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:37.056826 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53a3d5db-6d49-4303-a83c-4ccaf495d8df tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32" status: 200 len: 1475 microversion: 2.1 time: 1.196943 Oct 12 08:52:37.058912 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1185/2227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:35 2022] GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 => generated 1475 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:37.083480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:37.084089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:37.127076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:37.127592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:37.129633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:37.131631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:37.132119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:37.132553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:37.833800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:37.846379 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f55351f6-4546-4a5f-8e82-edbc5b8f20ac tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.784881 Oct 12 08:52:37.861468 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1186/2228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:37 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:37.861468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:37.861468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:37.874955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:37.876463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:37.878117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:37.880314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:37.881199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:37.882191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.046828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:38.056048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:38.061092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:38.067184 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f7a8200-fea2-42c7-a695-3686123cf298 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 200 len: 1352 microversion: 2.25 time: 1.203672 Oct 12 08:52:38.067984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1043/2229] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:36 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 1352 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:38.080039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:38.081067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:38.100437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.101408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.102414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.104375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.105031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.105655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.254227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:38.267490 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a2de123a-820e-44b3-9386-3d4cbf80b609 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1304 microversion: 2.1 time: 0.195426 Oct 12 08:52:38.268124 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1044/2230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:38 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:38.277227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-45d45a76-08ad-4c82-b9c8-614be5cca8aa req-7839c6c4-af9a-47f7-bf60-1bade067dbdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2b899b-d791-4d6e-b96d-bb4abd3f6959", "name": "network-vif-plugged", "status": "completed", "tag": "edb66832-c169-4cc5-ba21-6fa1b454376c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:38.304665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45d45a76-08ad-4c82-b9c8-614be5cca8aa req-7839c6c4-af9a-47f7-bf60-1bade067dbdd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.305369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45d45a76-08ad-4c82-b9c8-614be5cca8aa req-7839c6c4-af9a-47f7-bf60-1bade067dbdd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.306509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45d45a76-08ad-4c82-b9c8-614be5cca8aa req-7839c6c4-af9a-47f7-bf60-1bade067dbdd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.327623 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-45d45a76-08ad-4c82-b9c8-614be5cca8aa req-7839c6c4-af9a-47f7-bf60-1bade067dbdd service nova] Creating event network-vif-plugged:edb66832-c169-4cc5-ba21-6fa1b454376c for instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 on n-h1-858383-10 Oct 12 08:52:38.344794 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-45d45a76-08ad-4c82-b9c8-614be5cca8aa req-7839c6c4-af9a-47f7-bf60-1bade067dbdd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064587 Oct 12 08:52:38.346003 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1045/2231] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:38.355218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:38.355971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:38.367869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.368378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.368894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.369975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.371278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.372060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.391506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] HTTP exception thrown: Instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 could not be found. Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Request method failure captured: Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 HTTP/1.1 Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9pUbLPSQP9ujkvj-N7eTzJXA__5QGTAEo3oGEeuzDMj0bCMZerwN_QqYqNyBKloDZ3Ftf4NU7T-k-Sc4hLLttKngr-NGbJU2cR79jWVjP9Kw8DuK8afmyNfU7BemUfNSFad3n6SghgzRlKZGCO5WKTU7--yWH_HHySAguTq0HUndU Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}] Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 42733726966a4ab9ba5e9e160415358d Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 could not be found. Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '87afdca0-7aca-4b7d-8a37-b4d9c2a8af32'} Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 could not be found. Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 could not be found. Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:38.394176 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:38.399269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:38.399269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:38.399269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:38.399269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:38.399269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:38.399269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 could not be found. Oct 12 08:52:38.399269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:38.403071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Returning 404 to user: Instance 87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:38.404467 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-88979160-1c72-4fd9-8ca7-7e02c679625e tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32" status: 404 len: 111 microversion: 2.1 time: 0.055736 Oct 12 08:52:38.405789 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1046/2232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:38 2022] GET /compute/v2.1/servers/87afdca0-7aca-4b7d-8a37-b4d9c2a8af32 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:38.415391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:38.417660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:38.425779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.426547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.427321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.428211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.428903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.429594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.469954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.472567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.473935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.476416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lazy-loading 'fault' on Instance uuid 979a8fd2-1874-4df7-b407-c21f06a8ef93 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:38.626319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:38.639676 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c4dda99-5600-4fad-aa43-3528d48f1cc5 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 200 len: 1309 microversion: 2.1 time: 0.227921 Oct 12 08:52:38.641062 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1047/2233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:38 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 1309 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:38.802327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-29853f69-e8f3-494b-94a5-67e0a3de5305 req-a37d78e4-5932-4181-9e63-b223f2ee9616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6737ba52-cb8a-4710-85dd-f0a1aa841a5e", "name": "network-vif-deleted", "tag": "37c8ed16-2d1b-4bef-8a90-962fed6302ce"}, {"server_uuid": "979a8fd2-1874-4df7-b407-c21f06a8ef93", "name": "network-vif-deleted", "tag": "6dfcbb58-e844-4b48-bf45-ede1a949604b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:38.826265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-29853f69-e8f3-494b-94a5-67e0a3de5305 req-a37d78e4-5932-4181-9e63-b223f2ee9616 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.840389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-29853f69-e8f3-494b-94a5-67e0a3de5305 req-a37d78e4-5932-4181-9e63-b223f2ee9616 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.841225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-29853f69-e8f3-494b-94a5-67e0a3de5305 req-a37d78e4-5932-4181-9e63-b223f2ee9616 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.880103 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-29853f69-e8f3-494b-94a5-67e0a3de5305 req-a37d78e4-5932-4181-9e63-b223f2ee9616 service nova] Creating event network-vif-deleted:37c8ed16-2d1b-4bef-8a90-962fed6302ce for instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e on n-h2-858383-10 Oct 12 08:52:38.884400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-29853f69-e8f3-494b-94a5-67e0a3de5305 req-a37d78e4-5932-4181-9e63-b223f2ee9616 service nova] Creating event network-vif-deleted:6dfcbb58-e844-4b48-bf45-ede1a949604b for instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 on n-h2-858383-10 Oct 12 08:52:38.900140 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-29853f69-e8f3-494b-94a5-67e0a3de5305 req-a37d78e4-5932-4181-9e63-b223f2ee9616 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101858 Oct 12 08:52:38.910172 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1048/2234] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:52:38.916683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:38.921305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:38.935114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.937676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.945996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:38.948703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:38.952359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:38.953086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.098542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:39.111991 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2ff5c0b0-5ade-48c8-bbdd-9ee93c1c6daa tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1312 microversion: 2.1 time: 1.256258 Oct 12 08:52:39.117402 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1187/2235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:37 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1312 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:39.129369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:39.131788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 6737ba52-cb8a-4710-85dd-f0a1aa841a5e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:39.163459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.164753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.165560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.168457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.169053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.182018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.238996 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] HTTP exception thrown: Instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e could not be found. Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Request method failure captured: Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e HTTP/1.1 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6Ts-eSTmrL5eQiSTwTnp3yx3lZShQiCDtw09IZUqrYBKgZEsDt6cjApr7jFWv4P4uMtoSmv0DyTWoGhqYlcFK2dcmFGFzjY0KQXGH--pkeFwin3yJp9wo9cdbYkPw4Z4sL3rNxX_f2pZZD6XSS_PNAXhUPZa64c3yJAm4Nh774mCc Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e9dc112ec885461eae39dbe7d1abfe7d Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9dc112ec885461eae39dbe7d1abfe7d"}]}] Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e9dc112ec885461eae39dbe7d1abfe7d Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-LiveAutoBlockMigrationV225Test-866295006-project Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 008f3287ba094f53971db283b5f303c5 Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-866295006-project Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e could not be found. Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '6737ba52-cb8a-4710-85dd-f0a1aa841a5e'} Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e could not be found. Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e could not be found. Oct 12 08:52:39.241964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e could not be found. Oct 12 08:52:39.247207 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.267172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Returning 404 to user: Instance 6737ba52-cb8a-4710-85dd-f0a1aa841a5e could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:39.273413 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d1ab04c0-a610-4821-8bad-3e0f30d390c4 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e" status: 404 len: 111 microversion: 2.25 time: 0.149129 Oct 12 08:52:39.274082 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1188/2236] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:39 2022] GET /compute/v2.1/servers/6737ba52-cb8a-4710-85dd-f0a1aa841a5e => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:52:39.278395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:39.282465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:39.282998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:39.287157 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71206845-2e0e-411f-bfeb-9b08d5351547 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.375537 Oct 12 08:52:39.295849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.296733 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1049/2237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:38 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:39.310691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:39.310948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.311683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.314878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.315937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:39.316794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.317576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.331606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.335050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.340553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.341560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.346256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.346959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.348597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:39.360944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:39.476761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:39.483831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:39.491778 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ca9d5e67-f4ca-4d8d-888e-43985a4a5169 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1304 microversion: 2.1 time: 0.193212 Oct 12 08:52:39.492685 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1050/2238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:39 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1304 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:39.536209 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6b6d177c-8b57-4d91-b43b-f2aa7811bff2 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 204 len: 0 microversion: 2.25 time: 0.257018 Oct 12 08:52:39.549309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:39.550578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:39.555183 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1189/2239] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:52:39 2022] DELETE /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 08:52:39.560520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.561402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.562140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.564197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.564914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.565622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.669671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:39.670796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 979a8fd2-1874-4df7-b407-c21f06a8ef93] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:39.677906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.678774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.679462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.680405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.681081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.682294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.712817 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] HTTP exception thrown: Instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 could not be found. Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Request method failure captured: Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 HTTP/1.1 Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9pUbLPSQP9ujkvj-N7eTzJXA__5QGTAEo3oGEeuzDMj0bCMZerwN_QqYqNyBKloDZ3Ftf4NU7T-k-Sc4hLLttKngr-NGbJU2cR79jWVjP9Kw8DuK8afmyNfU7BemUfNSFad3n6SghgzRlKZGCO5WKTU7--yWH_HHySAguTq0HUndU Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}] Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 42733726966a4ab9ba5e9e160415358d Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 could not be found. Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '979a8fd2-1874-4df7-b407-c21f06a8ef93'} Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 could not be found. Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 could not be found. Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:39.719571 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.724255 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:39.724255 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:39.724255 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:39.724255 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:39.724255 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:39.724255 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 could not be found. Oct 12 08:52:39.724255 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:39.729289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Returning 404 to user: Instance 979a8fd2-1874-4df7-b407-c21f06a8ef93 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:39.731660 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e32f4117-60e1-4c53-b914-f3dc261be16c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93" status: 404 len: 111 microversion: 2.1 time: 0.066028 Oct 12 08:52:39.733622 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1190/2240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:39 2022] GET /compute/v2.1/servers/979a8fd2-1874-4df7-b407-c21f06a8ef93 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:39.747234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5cbc499d-0bc8-4d10-87f2-e89cf1e6544b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:39.826538 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5cbc499d-0bc8-4d10-87f2-e89cf1e6544b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/45536584-24a8-4542-bd40-163f2a9facbc" status: 204 len: 0 microversion: 2.1 time: 0.087824 Oct 12 08:52:39.828416 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1191/2241] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 08:52:39 2022] DELETE /compute/v2.1/os-server-groups/45536584-24a8-4542-bd40-163f2a9facbc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:52:39.845866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:39.847860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:39.872252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.875226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.880980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.882829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:39.886423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:39.887624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:39.973532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:40.121312 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86b0bf55-8578-405d-a70c-620c12759187 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 204 len: 0 microversion: 2.1 time: 0.287067 Oct 12 08:52:40.124009 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1192/2242] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:39 2022] DELETE /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:52:40.140797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:40.143303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:40.154496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:40.155295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:40.155978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:40.157005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:40.157713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:40.158368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:40.189825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:40.335385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:40.350837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:40.353263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:40.355041 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cd562506-c78a-4aca-b62b-db3bf5af5de6 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1562 microversion: 2.25 time: 0.811519 Oct 12 08:52:40.372671 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1051/2243] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:39 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1562 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:40.385165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:40.388128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:40.394010 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c33cb1c2-6441-4490-9ec5-b70053bde2b8 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 204 len: 0 microversion: 2.1 time: 0.264644 Oct 12 08:52:40.394803 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1193/2244] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:40 2022] DELETE /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:40.404961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:40.406680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:40.407354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:40.407950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:40.408859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:40.409776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:40.410426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:40.414183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:40.421521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:40.429145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:40.436071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:40.437071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:40.437726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:40.438319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:41.024370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:41.039513 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20fba859-b5b1-455b-8085-9eddf67a2826 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.665099 Oct 12 08:52:41.053079 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1052/2245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:40 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:41.068218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:41.069171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:41.085213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:41.086160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:41.086945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:41.088964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:41.090153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:41.091569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:41.306897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:41.320702 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bbea0755-f13e-46c6-bcb9-c46728305ece tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1293 microversion: 2.1 time: 0.919145 Oct 12 08:52:41.333870 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1194/2246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:40 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1293 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:41.333870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:41.333870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:41.344584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:41.345545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:41.346239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:41.347370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:41.347915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:41.348582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:41.547611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:41.557866 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f55bc373-62bd-4a6d-986b-168d6aff61da tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 200 len: 1473 microversion: 2.1 time: 0.502924 Oct 12 08:52:41.575485 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1053/2247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:41 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 1473 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:41.582975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:41.584619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:41.593315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:41.593916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:41.594633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:41.595808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:41.596418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:41.596950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:41.678397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:41.690315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:41.692302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '008f3287ba094f53971db283b5f303c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9dc112ec885461eae39dbe7d1abfe7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:41.693764 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0a8ff13f-8279-4754-85c0-4d60a786ad34 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 200 len: 1346 microversion: 2.25 time: 0.116344 Oct 12 08:52:41.694526 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1054/2248] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:41 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 1346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:52:41.699807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-71193b28-cc31-439f-8fe1-b4aa53f48970 req-bead71b9-38f3-4d73-b49d-0d77e8c1aaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7d54d7-366a-49f9-bd42-d252f7868e2d", "name": "network-vif-deleted", "tag": "ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:41.710955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-71193b28-cc31-439f-8fe1-b4aa53f48970 req-bead71b9-38f3-4d73-b49d-0d77e8c1aaaa service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:41.711841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-71193b28-cc31-439f-8fe1-b4aa53f48970 req-bead71b9-38f3-4d73-b49d-0d77e8c1aaaa service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:41.712728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-71193b28-cc31-439f-8fe1-b4aa53f48970 req-bead71b9-38f3-4d73-b49d-0d77e8c1aaaa service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:41.729792 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-71193b28-cc31-439f-8fe1-b4aa53f48970 req-bead71b9-38f3-4d73-b49d-0d77e8c1aaaa service nova] Creating event network-vif-deleted:ebfa7b3b-5a1b-4d11-af1e-0ee8afdd15e7 for instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d on n-h2-858383-10 Oct 12 08:52:41.735062 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-71193b28-cc31-439f-8fe1-b4aa53f48970 req-bead71b9-38f3-4d73-b49d-0d77e8c1aaaa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038847 Oct 12 08:52:41.735885 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1055/2249] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:41.945885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:41.948981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:41.961359 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c29064f4-31d1-4226-bf5b-938116577078 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.636893 Oct 12 08:52:41.962669 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1195/2250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:41 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:42.069988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:42.070958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:42.078146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.078991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.079608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.081225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.081904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.082493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.296074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:42.316416 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-755f0ce9-1fed-4599-8076-21d05b134c13 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.251837 Oct 12 08:52:42.317478 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1056/2251] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:42 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:42.350337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:42.351875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:42.360689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.361944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.363190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.364507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.366047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.367057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.582885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:42.586119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:42.595119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.595922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.596477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.597277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.601705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.602230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.736324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:42.751062 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2fe8c603-4d92-4228-aaa9-dd18f68dc573 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1474 microversion: 2.1 time: 0.406259 Oct 12 08:52:42.764545 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1196/2252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:42 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1474 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:42.764545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:42.764545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] [instance: 5f7d54d7-366a-49f9-bd42-d252f7868e2d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:42.764545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:42.780845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.785922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.786975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.791494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.791995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.792432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.834179 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] HTTP exception thrown: Instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d could not be found. Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Request method failure captured: Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d HTTP/1.1 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn6Ts-eSTmrL5eQiSTwTnp3yx3lZShQiCDtw09IZUqrYBKgZEsDt6cjApr7jFWv4P4uMtoSmv0DyTWoGhqYlcFK2dcmFGFzjY0KQXGH--pkeFwin3yJp9wo9cdbYkPw4Z4sL3rNxX_f2pZZD6XSS_PNAXhUPZa64c3yJAm4Nh774mCc Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.25 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e9dc112ec885461eae39dbe7d1abfe7d Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e9dc112ec885461eae39dbe7d1abfe7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9dc112ec885461eae39dbe7d1abfe7d"}]}] Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e9dc112ec885461eae39dbe7d1abfe7d Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-866295006 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-LiveAutoBlockMigrationV225Test-866295006-project Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 008f3287ba094f53971db283b5f303c5 Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-866295006-project Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d could not be found. Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5f7d54d7-366a-49f9-bd42-d252f7868e2d'} Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d could not be found. Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d could not be found. Oct 12 08:52:42.840598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d could not be found. Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] Returning 404 to user: Instance 5f7d54d7-366a-49f9-bd42-d252f7868e2d could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:42.847324 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ce8a75e-f4c1-4b52-8a50-42964f965d01 tempest-LiveAutoBlockMigrationV225Test-866295006 tempest-LiveAutoBlockMigrationV225Test-866295006-project] 10.222.0.40 "GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d" status: 404 len: 111 microversion: 2.25 time: 0.089693 Oct 12 08:52:42.850357 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1197/2253] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:52:42 2022] GET /compute/v2.1/servers/5f7d54d7-366a-49f9-bd42-d252f7868e2d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:52:42.861351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:42.863933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:42.884714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.885663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.886446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.887591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:42.889800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:42.890976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:42.960084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:43.019099 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-87865bc7-d90d-4be9-9021-19fad704ceac tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 200 len: 1473 microversion: 2.1 time: 0.440625 Oct 12 08:52:43.030908 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1057/2254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:42 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 1473 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:43.056619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-188062092", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "4f532d19-5c86-4e02-8797-d99cfa48fa40"}], "security_groups": [{"name": "tempest-securitygroup--1460524035"}], "key_name": "tempest-keypair-1657414392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:43.437003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:43.450367 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-332bdb1d-e9dc-4c93-b49a-bcb018ab0d0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.598866 Oct 12 08:52:43.455339 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1198/2255] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:42 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:43.466511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:43.469137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:43.484960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:43.487882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:43.488681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:43.493221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:43.494174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:43.495275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:43.567884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] validate_networks() for [('4f532d19-5c86-4e02-8797-d99cfa48fa40', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:52:43.771137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:43.779696 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-856876c5-b263-4354-832a-bd922032e40f tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.322746 Oct 12 08:52:43.780383 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1199/2256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:43 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:43.789586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1067946146", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:43.855965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] validate_networks() for [('5694562d-e360-435c-86bf-39f253be6d82', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:52:44.278468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:44.346147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:44.782250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:52:44.782692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:52:44.783200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:52:44.783604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:52:44.784068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:52:44.810193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:44.810692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:44.811126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:44.811879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:44.818190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:44.818837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:44.859962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Getting quotas for project ecfcb084646547968793714916aa6e91. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:52:44.865824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Getting quotas for user 87645feeea9f4f0b93b3dddae933d343 and project ecfcb084646547968793714916aa6e91. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:52:44.899001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:52:44.901326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:52:44.983794 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-479f52e4-c78c-42ae-9987-e77937e164bc tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.949509 Oct 12 08:52:44.985959 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1058/2257] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:52:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:52:45.001173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:52:45.001627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:52:45.002547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:52:45.003018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:52:45.003366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:52:45.004231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:45.005918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:45.024163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.025387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.029410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.029778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.029932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.030362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.031849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.032648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.033875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.040616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.042857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.043320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.087227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:52:45.094310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:52:45.114172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:52:45.117608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 66594999-2298-414d-8cd7-bfa6b4fa00b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:52:45.207754 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5a3c80f1-cc9c-4368-97fa-8fe8f14684d9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426289 Oct 12 08:52:45.208429 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1200/2258] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:52:45.228625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:45.229269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:45.272901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.273417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.273896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.274648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.275111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.275536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.869877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:45.880367 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0fe31a9e-75f6-45da-ab74-4398eb8d5d01 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.887846 Oct 12 08:52:45.882933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:45.888068 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1059/2259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:44 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:45.906483 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f08bb1d3-d306-43a2-8a6e-50087c934695 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.691818 Oct 12 08:52:45.921583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5f862ec1-565d-422e-9805-a67e8f0bd735 req-22a547ba-8f54-44e3-b02c-3820bc8118a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35be6073-b817-4b7d-90f5-1b9ecf1f92a9", "tag": "3eed2960-1011-403a-8e37-0354fe877f8e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:45.922929 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1201/2260] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:45 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:45.932269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:45.933708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:45.942086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.942618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5f862ec1-565d-422e-9805-a67e8f0bd735 req-22a547ba-8f54-44e3-b02c-3820bc8118a8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.943135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5f862ec1-565d-422e-9805-a67e8f0bd735 req-22a547ba-8f54-44e3-b02c-3820bc8118a8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.943581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5f862ec1-565d-422e-9805-a67e8f0bd735 req-22a547ba-8f54-44e3-b02c-3820bc8118a8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.943761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.944366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.945404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:45.946106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:45.946822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:45.984328 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5f862ec1-565d-422e-9805-a67e8f0bd735 req-22a547ba-8f54-44e3-b02c-3820bc8118a8 service nova] Creating event network-changed:3eed2960-1011-403a-8e37-0354fe877f8e for instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 on n-h2-858383-10 Oct 12 08:52:46.005146 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5f862ec1-565d-422e-9805-a67e8f0bd735 req-22a547ba-8f54-44e3-b02c-3820bc8118a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113853 Oct 12 08:52:46.009528 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1060/2261] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:46.037080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:46.037884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:46.055240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:46.056053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:46.057940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:46.062365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:46.063834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:46.065427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:46.253410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:46.264545 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8909502f-1fa2-4b6a-8872-cffa7a9da5e7 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 200 len: 1473 microversion: 2.1 time: 0.340163 Oct 12 08:52:46.268291 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1202/2262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:45 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 1473 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:46.279277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:46.280078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:46.296167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:46.299654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:46.300115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:46.301156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:46.305303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:46.306022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:46.534158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:46.543990 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80efe8e4-b82b-4517-a751-79917602533a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1245 microversion: 2.1 time: 0.274469 Oct 12 08:52:46.547344 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1203/2263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:46 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1245 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:46.561997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:46.568799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 66594999-2298-414d-8cd7-bfa6b4fa00b8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:46.590893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:46.594166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:46.594817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:46.602591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:46.603355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:46.603952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:46.674358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:46.757073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 66594999-2298-414d-8cd7-bfa6b4fa00b8] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:46.779582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:46.780427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:46.781421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:46.824077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'flavor' on Instance uuid 66594999-2298-414d-8cd7-bfa6b4fa00b8 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:46.849112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'system_metadata' on Instance uuid 66594999-2298-414d-8cd7-bfa6b4fa00b8 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:46.972488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'metadata' on Instance uuid 66594999-2298-414d-8cd7-bfa6b4fa00b8 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:47.650317 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.scheduler.client.report [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Deleted allocations for instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 Oct 12 08:52:47.707407 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bcbdfcc9-d667-4c03-9e8e-2d2007996d0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8" status: 204 len: 0 microversion: 2.1 time: 1.153233 Oct 12 08:52:47.711551 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1204/2264] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:46 2022] DELETE /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8 => generated 0 bytes in 1160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:47.751009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-998cf1f8-a2be-40c5-940f-8fd45efe048e req-a6fd2616-48be-49a5-b620-64bf8a459085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f7b507-2869-4d3b-a35a-904ac94e199c", "tag": "cf5877da-a042-42a4-b1bc-c9afc1cd1bab"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:47.789662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-998cf1f8-a2be-40c5-940f-8fd45efe048e req-a6fd2616-48be-49a5-b620-64bf8a459085 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:47.795498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-998cf1f8-a2be-40c5-940f-8fd45efe048e req-a6fd2616-48be-49a5-b620-64bf8a459085 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:47.798979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-998cf1f8-a2be-40c5-940f-8fd45efe048e req-a6fd2616-48be-49a5-b620-64bf8a459085 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:47.838752 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-998cf1f8-a2be-40c5-940f-8fd45efe048e req-a6fd2616-48be-49a5-b620-64bf8a459085 service nova] Creating event network-changed:cf5877da-a042-42a4-b1bc-c9afc1cd1bab for instance 68f7b507-2869-4d3b-a35a-904ac94e199c on n-h1-858383-10 Oct 12 08:52:47.859366 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-998cf1f8-a2be-40c5-940f-8fd45efe048e req-a6fd2616-48be-49a5-b620-64bf8a459085 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149810 Oct 12 08:52:47.868828 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1205/2265] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:47.888600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:47.902257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:47.919396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:47.919890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:47.920418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:47.930174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:47.930820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:47.931837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:48.981064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:48.990547 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e171cd91-c504-4d5f-ae9c-94776f9c33a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 1.120192 Oct 12 08:52:48.991471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1206/2266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:47 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:48.996972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8dfed212-b7c1-4adb-9e26-e50ae07c2370 req-6f74a9f6-ecb8-476f-bd46-a7cf03138211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7753b798-4301-4a65-9412-154b59047db2", "name": "network-vif-unplugged", "status": "completed", "tag": "b9bacb15-a33b-497e-b135-06e1f7ade2c1"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:49.012016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8dfed212-b7c1-4adb-9e26-e50ae07c2370 req-6f74a9f6-ecb8-476f-bd46-a7cf03138211 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:49.012689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8dfed212-b7c1-4adb-9e26-e50ae07c2370 req-6f74a9f6-ecb8-476f-bd46-a7cf03138211 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:49.013473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8dfed212-b7c1-4adb-9e26-e50ae07c2370 req-6f74a9f6-ecb8-476f-bd46-a7cf03138211 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:49.042121 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8dfed212-b7c1-4adb-9e26-e50ae07c2370 req-6f74a9f6-ecb8-476f-bd46-a7cf03138211 service nova] Creating event network-vif-unplugged:b9bacb15-a33b-497e-b135-06e1f7ade2c1 for instance 7753b798-4301-4a65-9412-154b59047db2 on n-h1-858383-10 Oct 12 08:52:49.060392 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8dfed212-b7c1-4adb-9e26-e50ae07c2370 req-6f74a9f6-ecb8-476f-bd46-a7cf03138211 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057891 Oct 12 08:52:49.071810 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1207/2267] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:49.093960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:49.125642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:49.161794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:49.162374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:49.167291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:49.171050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:49.173676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:49.174182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:49.838192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:49.875087 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8682a888-deda-4c8b-837e-cb34ba1f4917 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 3.848659 Oct 12 08:52:49.880417 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1061/2268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:46 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 3856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:49.901635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:49.912170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:49.931301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:49.934905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:49.942129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:49.944128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:49.953070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:49.954102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:50.190191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:50.209134 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-406b6ffb-6130-49ed-b6b7-cc884e58cb3b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 200 len: 1431 microversion: 2.1 time: 0.326304 Oct 12 08:52:50.233474 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1062/2269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:49 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 1431 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:50.233474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:50.233474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:50.256657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:50.257220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:50.258622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:50.259165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:50.259625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:50.260054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:50.473829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:50.510495 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ef96710-a391-400e-ac6e-0794090dd263 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1299 microversion: 2.1 time: 0.289527 Oct 12 08:52:50.512823 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1063/2270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:50 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1299 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:50.578731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:50.583317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 66594999-2298-414d-8cd7-bfa6b4fa00b8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:50.639483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:50.640472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:50.642216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:50.646572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:50.651710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:50.654344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:50.723334 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8 HTTP/1.1 Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '66594999-2298-414d-8cd7-bfa6b4fa00b8'} Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:50.728971 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:50.733163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:50.733163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:50.733163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:50.733163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:50.733163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:52:50.733163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:50.736684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:50.738838 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8fb9d355-6eeb-4379-8414-e665e0bbfa18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8" status: 404 len: 111 microversion: 2.1 time: 0.210194 Oct 12 08:52:50.741821 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1064/2271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:50 2022] GET /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8 => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:50.757719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:50.765356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-39b7098c-1df5-4294-b2f9-fe559f186a6a req-14dbc09a-1d58-4e23-97a6-4e3058565a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35be6073-b817-4b7d-90f5-1b9ecf1f92a9", "tag": "126044bb-c93e-4ac0-8869-0ac335709ac4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:50.772203 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c4c47c7a-2676-42a0-9c32-947603108928 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 1.696043 Oct 12 08:52:50.779173 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1208/2272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:49 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:50.799244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1069583152"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:50.810981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:50.821990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-39b7098c-1df5-4294-b2f9-fe559f186a6a req-14dbc09a-1d58-4e23-97a6-4e3058565a94 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:50.829130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-39b7098c-1df5-4294-b2f9-fe559f186a6a req-14dbc09a-1d58-4e23-97a6-4e3058565a94 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:50.836981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-39b7098c-1df5-4294-b2f9-fe559f186a6a req-14dbc09a-1d58-4e23-97a6-4e3058565a94 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:50.838150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:50.839564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:50.844016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:50.846358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:50.849214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:50.851352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:50.892628 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-39b7098c-1df5-4294-b2f9-fe559f186a6a req-14dbc09a-1d58-4e23-97a6-4e3058565a94 service nova] Creating event network-changed:126044bb-c93e-4ac0-8869-0ac335709ac4 for instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 on n-h2-858383-10 Oct 12 08:52:50.925185 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-39b7098c-1df5-4294-b2f9-fe559f186a6a req-14dbc09a-1d58-4e23-97a6-4e3058565a94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172192 Oct 12 08:52:50.930991 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1065/2273] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:50.948156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-eda1ff7b-4354-4cf8-8f51-77e7e9401a1f req-128f322f-84dd-4801-886e-c3a20c41a5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b3b9cb-de6c-4762-bb16-bab9cbde5277", "name": "network-vif-deleted", "tag": "a02a1787-8fb6-4ba8-a91a-f6851ccecdf8"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:51.005531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-eda1ff7b-4354-4cf8-8f51-77e7e9401a1f req-128f322f-84dd-4801-886e-c3a20c41a5a4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:51.010023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-eda1ff7b-4354-4cf8-8f51-77e7e9401a1f req-128f322f-84dd-4801-886e-c3a20c41a5a4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:51.010534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-eda1ff7b-4354-4cf8-8f51-77e7e9401a1f req-128f322f-84dd-4801-886e-c3a20c41a5a4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:51.117982 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-eda1ff7b-4354-4cf8-8f51-77e7e9401a1f req-128f322f-84dd-4801-886e-c3a20c41a5a4 service nova] Creating event network-vif-deleted:a02a1787-8fb6-4ba8-a91a-f6851ccecdf8 for instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 on n-h1-858383-10 Oct 12 08:52:51.160400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-eda1ff7b-4354-4cf8-8f51-77e7e9401a1f req-128f322f-84dd-4801-886e-c3a20c41a5a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223503 Oct 12 08:52:51.167455 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1066/2274] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:51.210570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:51.215054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:51.270610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:51.273906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:51.275130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:51.279333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:51.280039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:51.280703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:51.483656 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e15ff8b5-1885-4aef-aeb0-3b99793ccf61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.702290 Oct 12 08:52:51.485215 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1209/2275] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:52:50 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 08:52:51.493693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-918987530", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "5694562d-e360-435c-86bf-39f253be6d82"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:51.637113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] validate_networks() for [('5694562d-e360-435c-86bf-39f253be6d82', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:52:51.980240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:51.988926 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e5c1b9b3-706d-46df-8f54-4b67f231506e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.820107 Oct 12 08:52:51.992870 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1067/2276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:51 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:52.005101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:52.006380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:52.029509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:52.030354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:52.038149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:52.039279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:52.039957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:52.040664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:52.154781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:52.166094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:52.166723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:52.167500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:52.168161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lazy-loading 'fault' on Instance uuid 94b3b9cb-de6c-4762-bb16-bab9cbde5277 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:52:52.419897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:52.455023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37d64980-88ac-4042-a5c8-5b7164077f87 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 200 len: 1308 microversion: 2.1 time: 0.460459 Oct 12 08:52:52.476486 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1068/2277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:51 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:52.486330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-30b0f1ef-6367-4576-b0de-0b78f98b9e06 req-4065facb-5960-4dba-85a6-52e365332e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b3b9cb-de6c-4762-bb16-bab9cbde5277", "name": "network-vif-unplugged", "status": "completed", "tag": "a02a1787-8fb6-4ba8-a91a-f6851ccecdf8"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:52.501114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-30b0f1ef-6367-4576-b0de-0b78f98b9e06 req-4065facb-5960-4dba-85a6-52e365332e95 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:52.501876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-30b0f1ef-6367-4576-b0de-0b78f98b9e06 req-4065facb-5960-4dba-85a6-52e365332e95 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:52.502590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-30b0f1ef-6367-4576-b0de-0b78f98b9e06 req-4065facb-5960-4dba-85a6-52e365332e95 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:52.530673 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-30b0f1ef-6367-4576-b0de-0b78f98b9e06 req-4065facb-5960-4dba-85a6-52e365332e95 service nova] Creating event network-vif-unplugged:a02a1787-8fb6-4ba8-a91a-f6851ccecdf8 for instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 on n-h1-858383-10 Oct 12 08:52:52.549105 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-30b0f1ef-6367-4576-b0de-0b78f98b9e06 req-4065facb-5960-4dba-85a6-52e365332e95 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070291 Oct 12 08:52:52.550012 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1069/2278] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:52.556053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:52.556946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:52.570206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:52.570836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:52.571320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:52.572479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:52.573085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:52.576129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:53.206469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:52:53.207165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:52:53.207755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:52:53.208265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:52:53.208907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:52:53.252248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:53.254215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:53.263611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:53.264825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:53.265471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:53.268586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:53.315918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:52:53.322066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:52:53.351016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:52:53.354769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:52:53.479078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:53.486576 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14002062-50f8-4d2e-9c6f-2cf0221b4b9d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.999252 Oct 12 08:52:53.487902 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1210/2279] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:52:53.500042 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b81728a2-5419-4766-80e0-918ea3540a32 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 0.948763 Oct 12 08:52:53.505053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:53.505874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:53.512380 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1070/2280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:52 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:53.517725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:53.518789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:53.519542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:53.520504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:53.520967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-28ea604e-deaa-4edb-a296-4aa6a8f3b6f1 req-0bafac94-ff5f-4d63-a07c-f6b94589a808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7753b798-4301-4a65-9412-154b59047db2", "name": "network-vif-deleted", "tag": "b9bacb15-a33b-497e-b135-06e1f7ade2c1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:53.521453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:53.522068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:53.545815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-28ea604e-deaa-4edb-a296-4aa6a8f3b6f1 req-0bafac94-ff5f-4d63-a07c-f6b94589a808 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:53.546578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-28ea604e-deaa-4edb-a296-4aa6a8f3b6f1 req-0bafac94-ff5f-4d63-a07c-f6b94589a808 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:53.547277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-28ea604e-deaa-4edb-a296-4aa6a8f3b6f1 req-0bafac94-ff5f-4d63-a07c-f6b94589a808 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:53.572815 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-28ea604e-deaa-4edb-a296-4aa6a8f3b6f1 req-0bafac94-ff5f-4d63-a07c-f6b94589a808 service nova] Creating event network-vif-deleted:b9bacb15-a33b-497e-b135-06e1f7ade2c1 for instance 7753b798-4301-4a65-9412-154b59047db2 on n-h1-858383-10 Oct 12 08:52:53.579640 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-28ea604e-deaa-4edb-a296-4aa6a8f3b6f1 req-0bafac94-ff5f-4d63-a07c-f6b94589a808 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065627 Oct 12 08:52:53.580919 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1071/2281] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:53.588982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:53.590442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:53.607764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:53.608604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:53.609238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:53.610780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:53.611405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:53.612125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:53.647805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:54.305412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:54.347931 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c69d2fc9-4111-4f81-8dd4-ea6d21d41635 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.762676 Oct 12 08:52:54.349474 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1072/2282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:53 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:54.383346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:54.387802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 94b3b9cb-de6c-4762-bb16-bab9cbde5277] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:54.472874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.474046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.476032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.483174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.485342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.487598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.520829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:54.535131 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-32cc8496-489c-4776-a601-a2b1017f2c23 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 1.045954 Oct 12 08:52:54.535818 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1211/2283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:53 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:54.548133 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] HTTP exception thrown: Instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 could not be found. Oct 12 08:52:54.551030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:54.553339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Request method failure captured: Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 HTTP/1.1 Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9pUbLPSQP9ujkvj-N7eTzJXA__5QGTAEo3oGEeuzDMj0bCMZerwN_QqYqNyBKloDZ3Ftf4NU7T-k-Sc4hLLttKngr-NGbJU2cR79jWVjP9Kw8DuK8afmyNfU7BemUfNSFad3n6SghgzRlKZGCO5WKTU7--yWH_HHySAguTq0HUndU Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}] Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 42733726966a4ab9ba5e9e160415358d Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 could not be found. Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '94b3b9cb-de6c-4762-bb16-bab9cbde5277'} Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 could not be found. Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 could not be found. Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:54.557559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 could not be found. Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Returning 404 to user: Instance 94b3b9cb-de6c-4762-bb16-bab9cbde5277 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:54.561066 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b2fb800-904b-4636-beb8-91446e0df29b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277" status: 404 len: 111 microversion: 2.1 time: 0.210104 Oct 12 08:52:54.568061 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1073/2284] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:54 2022] GET /compute/v2.1/servers/94b3b9cb-de6c-4762-bb16-bab9cbde5277 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:54.576395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.578194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.580772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:54.581631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.583209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.583494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:54.587020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.587735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.621781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.625791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.627645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.628420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.632512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.633930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.710408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:54.723092 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68393bcb-0d4e-40f5-a1fc-7551d89faec9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1216 microversion: 2.1 time: 0.186154 Oct 12 08:52:54.726878 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1212/2285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:54 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1216 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:54.740104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:54.742171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 7753b798-4301-4a65-9412-154b59047db2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:54.752370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.752861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.753299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.754197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.754651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.755075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.800111 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] HTTP exception thrown: Instance 7753b798-4301-4a65-9412-154b59047db2 could not be found. Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Request method failure captured: Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 HTTP/1.1 Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRn9pUbLPSQP9ujkvj-N7eTzJXA__5QGTAEo3oGEeuzDMj0bCMZerwN_QqYqNyBKloDZ3Ftf4NU7T-k-Sc4hLLttKngr-NGbJU2cR79jWVjP9Kw8DuK8afmyNfU7BemUfNSFad3n6SghgzRlKZGCO5WKTU7--yWH_HHySAguTq0HUndU Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}] Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 42733726966a4ab9ba5e9e160415358d Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7753b798-4301-4a65-9412-154b59047db2 could not be found. Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7753b798-4301-4a65-9412-154b59047db2'} Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7753b798-4301-4a65-9412-154b59047db2 could not be found. Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7753b798-4301-4a65-9412-154b59047db2 could not be found. Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:54.802626 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.806093 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:54.806093 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:54.806093 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:54.806093 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:54.806093 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:54.806093 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7753b798-4301-4a65-9412-154b59047db2 could not be found. Oct 12 08:52:54.806093 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:54.806093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Returning 404 to user: Instance 7753b798-4301-4a65-9412-154b59047db2 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:54.823500 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4928a4b7-e2b8-4f82-acd2-4bbe6e927d31 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2" status: 404 len: 111 microversion: 2.1 time: 0.092258 Oct 12 08:52:54.824172 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1213/2286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:54 2022] GET /compute/v2.1/servers/7753b798-4301-4a65-9412-154b59047db2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:54.834701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:54.866039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ced4b5a6-9b4a-4e77-9a09-774c56db52fd tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:54.892742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:54.920383 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ced4b5a6-9b4a-4e77-9a09-774c56db52fd tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/689d6444-84a2-4ed0-90bf-1e80435622af" status: 204 len: 0 microversion: 2.1 time: 0.090826 Oct 12 08:52:54.924509 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1214/2287] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 08:52:54 2022] DELETE /compute/v2.1/os-server-groups/689d6444-84a2-4ed0-90bf-1e80435622af => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:52:54.941216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:54.944801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:54.961739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.964985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.965532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:54.968131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:54.968623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:54.969063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:55.050676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:52:55.204662 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24550933-69db-4bb2-8d49-4c9b6080b353 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 204 len: 0 microversion: 2.1 time: 0.275846 Oct 12 08:52:55.205544 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1215/2288] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:52:54 2022] DELETE /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:52:55.214983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:55.216027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:55.234502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:55.235338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:55.236317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:55.237817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:55.238522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:55.239187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:55.326259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:55.336991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-399a8623-23a8-4532-bfba-16620ad5e6ba tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 0.770376 Oct 12 08:52:55.337788 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1074/2289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:54 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:55.377425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:55.378478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:55.390614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:55.391189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:55.392573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:55.393718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:55.394085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:55.394734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:55.484833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:55.497896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dfb1bda4-9324-48bf-b09c-0a408ab7476b tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1473 microversion: 2.1 time: 0.287296 Oct 12 08:52:55.501296 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1216/2290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:55 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1473 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:55.562623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:55.563410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:55.586210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:55.596906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:55.597488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:55.598528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:55.606110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:55.606428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:55.630769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:55.939741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:55.954893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9c9a0054-5175-473d-9a8c-4d8b59addb19 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.399646 Oct 12 08:52:55.959782 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1217/2291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:55 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:55.972073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:55.972935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:55.985559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:55.986218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:55.986704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:55.988218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:55.988687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:55.989165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:56.180588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:56.201473 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aac7b30b-42a1-4807-9a91-126687863c29 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1278 microversion: 2.1 time: 0.240164 Oct 12 08:52:56.202765 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1218/2292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:55 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:56.213844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:56.224822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a43a1935-575b-4d7c-b677-0223a39387e4 req-ecbd553f-5a9a-47a4-8b34-0dee1fc97f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814", "tag": "e94727c5-ffb3-4193-ac33-68322d68eea9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:56.235707 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-acb80e4f-3272-4843-98da-0c83772eef03 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.863878 Oct 12 08:52:56.237958 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1075/2293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:55 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:56.239245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a43a1935-575b-4d7c-b677-0223a39387e4 req-ecbd553f-5a9a-47a4-8b34-0dee1fc97f14 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:56.240024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a43a1935-575b-4d7c-b677-0223a39387e4 req-ecbd553f-5a9a-47a4-8b34-0dee1fc97f14 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:56.240596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a43a1935-575b-4d7c-b677-0223a39387e4 req-ecbd553f-5a9a-47a4-8b34-0dee1fc97f14 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:56.258076 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a43a1935-575b-4d7c-b677-0223a39387e4 req-ecbd553f-5a9a-47a4-8b34-0dee1fc97f14 service nova] Creating event network-changed:e94727c5-ffb3-4193-ac33-68322d68eea9 for instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 on n-h2-858383-10 Oct 12 08:52:56.263424 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a43a1935-575b-4d7c-b677-0223a39387e4 req-ecbd553f-5a9a-47a4-8b34-0dee1fc97f14 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043430 Oct 12 08:52:56.264576 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1219/2294] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:56.363600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:56.365830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:56.392595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:56.393893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:56.394512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:56.395584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:56.397419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:56.399607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:56.529704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:56.530918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:56.543280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:56.544396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:56.545338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:56.546105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:56.546567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:56.546997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:56.818364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:56.830757 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b6c1a51-f03a-463d-8779-e6194499b337 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 0.471802 Oct 12 08:52:56.831506 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1076/2295] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:56 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:56.965512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:56.981756 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3732ba7d-cd26-4f79-916e-c983dbb6f453 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1473 microversion: 2.1 time: 0.457894 Oct 12 08:52:56.982751 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1220/2296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:56 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1473 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:52:56.983436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:56.984069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:57.002725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:57.003546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:57.004863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:57.005887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:57.006560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:57.007272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:57.229099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:57.230856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:57.243907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:57.244749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:57.245392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:57.246499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:57.247171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:57.247789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:57.348166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:57.360128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b039c124-e336-422b-b8ad-7263ebd634eb tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.381523 Oct 12 08:52:57.362880 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1077/2297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:56 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:57.371814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:57.372434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:57.390123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:57.390655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:57.391264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:57.392177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:57.395217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:57.395878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:57.588357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:57.618124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0db78a00-5fa5-4bbe-96f1-73bd53c64297 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1320 microversion: 2.1 time: 0.396549 Oct 12 08:52:57.635984 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1221/2298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:57 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1320 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:57.700103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:57.709232 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b12fbbf5-8556-45d8-afaf-db02feda2991 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.342866 Oct 12 08:52:57.710349 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1078/2299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:57 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:57.866752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:57.867613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:57.876755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:57.886398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:57.889622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:57.890792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:57.892613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:57.897305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:58.162831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36c9d5f2-c2fd-4fcb-a87f-fbaecd1a2b70 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Calling method '.version_select at 0x7f9848c12ee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:58.279677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-36c9d5f2-c2fd-4fcb-a87f-fbaecd1a2b70 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:52:58.280623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-36c9d5f2-c2fd-4fcb-a87f-fbaecd1a2b70 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Neutron security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:52:58.281267 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-36c9d5f2-c2fd-4fcb-a87f-fbaecd1a2b70 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] HTTP exception thrown: Security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a does not exist Oct 12 08:52:58.281267 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-79886beb-3813-4f15-a1a0-0e96e05b7d39'] Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36c9d5f2-c2fd-4fcb-a87f-fbaecd1a2b70 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Request method failure captured: Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-security-groups/3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a HTTP/1.1 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoBpNYV_eshDIHXyRNsFGUn6vD00FxpVUWAbHnvx0Wu0ke0aZDS57jdCKJRhJb37D9ZY7yBrmEa6FQAFWhVb_IH6gRnYU921JdP7Al1iYo0rSZmPiJaAIkIQ7q9YAIuLrJFz6fOL1LWKOeqEsJzz3cPmpb3pOgYF5LVxdd3SVuSEE8Y Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 3cb7b28d39554be490f6993da6373bcf Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3cb7b28d39554be490f6993da6373bcf"}]}] Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 3cb7b28d39554be490f6993da6373bcf Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsNegativeTestJSON-1134138970-project Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: fc465c6b49d44880bed3be7b5bc99c80 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970-project Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a does not exist Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-79886beb-3813-4f15-a1a0-0e96e05b7d39'] Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a'} Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:52:58.283746 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a does not exist Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79886beb-3813-4f15-a1a0-0e96e05b7d39'] Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a does not exist Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79886beb-3813-4f15-a1a0-0e96e05b7d39'] Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a does not exist Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79886beb-3813-4f15-a1a0-0e96e05b7d39'] Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a does not exist Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79886beb-3813-4f15-a1a0-0e96e05b7d39'] Oct 12 08:52:58.287143 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:52:58.290668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36c9d5f2-c2fd-4fcb-a87f-fbaecd1a2b70 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Returning 404 to user: Security group 3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a does not exist Oct 12 08:52:58.290668 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-79886beb-3813-4f15-a1a0-0e96e05b7d39'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:52:58.291692 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-36c9d5f2-c2fd-4fcb-a87f-fbaecd1a2b70 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a" status: 404 len: 194 microversion: 2.1 time: 0.538909 Oct 12 08:52:58.292484 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1222/2300] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:52:57 2022] DELETE /compute/v2.1/os-security-groups/3b90fe4e-5eb1-497c-99a7-8d4930bb0b9a => generated 194 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:52:58.307030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:58.311004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:58.318947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:52:58.322315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:58.323110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:58.323888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:58.324820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:58.325500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:58.326113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:58.772512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:58.787504 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7dd07907-8de5-4fd1-9077-0136666271ce tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1473 microversion: 2.1 time: 0.486382 Oct 12 08:52:58.795459 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1223/2301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:58 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1473 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:58.808617 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-49d072e8-3f4d-4319-ab2c-9c5940489be5 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006233 Oct 12 08:52:58.810908 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1224/2302] 10.222.0.40 () {58 vars in 1164 bytes} [Wed Oct 12 08:52:58 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 08:52:58.823661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:58.826206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:58.868989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:58.869565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:58.870007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:58.870743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:58.871217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:58.871641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:59.170871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:59.181211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-644244cb-8b26-4ef6-9aa7-db2a2daa5f9f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 1.330986 Oct 12 08:52:59.193543 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1079/2303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:57 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:59.204911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:59.206077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:59.229860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:59.231382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:59.233225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:59.234262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:59.234949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:59.235565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:59.701643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:52:59.721894 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f06f02f-4640-4e96-9696-f31b8ae0ca70 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.907205 Oct 12 08:52:59.722529 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1225/2304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:58 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:52:59.739529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f0367705-2a1e-46cd-8a18-dd4a62fe39a0 req-212fbfa3-0431-4361-a953-05248d365f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "name": "network-vif-plugged", "status": "completed", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:52:59.775774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f0367705-2a1e-46cd-8a18-dd4a62fe39a0 req-212fbfa3-0431-4361-a953-05248d365f86 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:59.777239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f0367705-2a1e-46cd-8a18-dd4a62fe39a0 req-212fbfa3-0431-4361-a953-05248d365f86 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:59.778585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f0367705-2a1e-46cd-8a18-dd4a62fe39a0 req-212fbfa3-0431-4361-a953-05248d365f86 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:59.803875 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f0367705-2a1e-46cd-8a18-dd4a62fe39a0 req-212fbfa3-0431-4361-a953-05248d365f86 service nova] Creating event network-vif-plugged:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:52:59.810447 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f0367705-2a1e-46cd-8a18-dd4a62fe39a0 req-212fbfa3-0431-4361-a953-05248d365f86 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086691 Oct 12 08:52:59.811838 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1226/2305] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:52:59.819833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:52:59.820533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:52:59.827854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:59.828435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:59.829540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:52:59.830672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:52:59.831270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:52:59.832103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:00.124834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:00.136131 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3a368ed5-0922-418c-9af8-fe5c38dd8558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1320 microversion: 2.1 time: 0.940955 Oct 12 08:53:00.139964 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1080/2306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:59 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1320 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:00.146385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf1345fe-7ba3-45f3-9391-aadba422efc2 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Calling method '.version_select at 0x7f98489b9820>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:00.549281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:00.561623 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-83627130-9645-42af-9163-578510619599 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.747496 Oct 12 08:53:00.573486 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1227/2307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:52:59 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:00.573486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:00.573486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:00.587345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:00.588124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:00.588770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:00.589730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:00.590414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:00.591045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:00.660655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:00.663586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:00.666211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:00.666896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lazy-loading 'fault' on Instance uuid 8519af08-ba91-4304-a23c-97cdf484974c {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:53:00.954197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42733726966a4ab9ba5e9e160415358d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7002508409ec4f61b4d66eccdcd9f2ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:00.962621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d44bda95-fdb4-4a67-9a73-12de18c504d4 tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 200 len: 1307 microversion: 2.1 time: 0.398015 Oct 12 08:53:00.968905 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1228/2308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:00 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:00.980079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:00.980765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:00.996436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:00.997021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:00.997581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:00.998254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:00.998723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:00.999143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:01.020566 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf1345fe-7ba3-45f3-9391-aadba422efc2 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.877915 Oct 12 08:53:01.022079 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1081/2309] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 08:53:00 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:01.045935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-11f74986-2fad-4c6d-83a3-def1dddf56f0 req-903113cf-b2d2-4e5d-9919-65011aaa212a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8519af08-ba91-4304-a23c-97cdf484974c", "name": "network-vif-deleted", "tag": "9071c962-6516-4840-bb06-bba569196928"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:01.079439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-11f74986-2fad-4c6d-83a3-def1dddf56f0 req-903113cf-b2d2-4e5d-9919-65011aaa212a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:01.080169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-11f74986-2fad-4c6d-83a3-def1dddf56f0 req-903113cf-b2d2-4e5d-9919-65011aaa212a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:01.083347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-11f74986-2fad-4c6d-83a3-def1dddf56f0 req-903113cf-b2d2-4e5d-9919-65011aaa212a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:01.119729 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-11f74986-2fad-4c6d-83a3-def1dddf56f0 req-903113cf-b2d2-4e5d-9919-65011aaa212a service nova] Creating event network-vif-deleted:9071c962-6516-4840-bb06-bba569196928 for instance 8519af08-ba91-4304-a23c-97cdf484974c on n-h2-858383-10 Oct 12 08:53:01.136260 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-11f74986-2fad-4c6d-83a3-def1dddf56f0 req-903113cf-b2d2-4e5d-9919-65011aaa212a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106430 Oct 12 08:53:01.141839 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1082/2310] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:01.154198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:01.158468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:01.171674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:01.174523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:01.176004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:01.178706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:01.180277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:01.182301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:01.642081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:01.650401 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7b1aa24e-5f73-444a-93b7-0f5c54efeb04 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.506570 Oct 12 08:53:01.654610 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1083/2311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:01 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:01.673693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50bc4d4b-e2ec-407d-b76e-9fa1459244b1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Calling method '.version_select at 0x7f9848e1fe50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:01.749292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:01.761989 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2b6f992b-a0de-4db3-88b6-649588a3d915 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 0.791800 Oct 12 08:53:01.777473 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1229/2312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:00 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:01.777473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:01.777473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:01.792036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:01.792530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:01.792964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:01.794382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:01.794839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:01.795263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.134871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-50bc4d4b-e2ec-407d-b76e-9fa1459244b1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:53:02.136102 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-50bc4d4b-e2ec-407d-b76e-9fa1459244b1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 12 08:53:02.136102 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-1b8790c4-0d8f-48df-a14c-dda3463a3605'] Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50bc4d4b-e2ec-407d-b76e-9fa1459244b1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Request method failure captured: Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-security-groups/607596d7-c533-4e6d-a4f1-e693ffd02a21 HTTP/1.1 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoBpNYV_eshDIHXyRNsFGUn6vD00FxpVUWAbHnvx0Wu0ke0aZDS57jdCKJRhJb37D9ZY7yBrmEa6FQAFWhVb_IH6gRnYU921JdP7Al1iYo0rSZmPiJaAIkIQ7q9YAIuLrJFz6fOL1LWKOeqEsJzz3cPmpb3pOgYF5LVxdd3SVuSEE8Y Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 3cb7b28d39554be490f6993da6373bcf Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3cb7b28d39554be490f6993da6373bcf"}]}] Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 3cb7b28d39554be490f6993da6373bcf Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsNegativeTestJSON-1134138970-project Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: fc465c6b49d44880bed3be7b5bc99c80 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970-project Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: exception: Insufficient rights for removing default security group. Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-1b8790c4-0d8f-48df-a14c-dda3463a3605'] Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '607596d7-c533-4e6d-a4f1-e693ffd02a21'} Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:53:02.138367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b8790c4-0d8f-48df-a14c-dda3463a3605'] Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b8790c4-0d8f-48df-a14c-dda3463a3605'] Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b8790c4-0d8f-48df-a14c-dda3463a3605'] Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b8790c4-0d8f-48df-a14c-dda3463a3605'] Oct 12 08:53:02.142754 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.151607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50bc4d4b-e2ec-407d-b76e-9fa1459244b1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 12 08:53:02.151607 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-1b8790c4-0d8f-48df-a14c-dda3463a3605'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:02.153073 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-50bc4d4b-e2ec-407d-b76e-9fa1459244b1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/607596d7-c533-4e6d-a4f1-e693ffd02a21" status: 400 len: 182 microversion: 2.1 time: 0.496704 Oct 12 08:53:02.154190 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1084/2313] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:53:01 2022] DELETE /compute/v2.1/os-security-groups/607596d7-c533-4e6d-a4f1-e693ffd02a21 => generated 182 bytes in 499 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:53:02.159102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:02.159961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:02.170238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.171224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.171879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.173852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.175124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.175798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.360848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:02.372285 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be43ceac-3b00-49a8-b126-3a0439ef244b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1320 microversion: 2.1 time: 0.606174 Oct 12 08:53:02.377148 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1230/2314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:01 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1320 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:02.394666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:02.399187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5819d151-3db8-4a7e-8dae-534feac7f659 req-1f262824-152f-419c-a97b-b5ba222f0839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b507-2869-4d3b-a35a-904ac94e199c", "name": "network-vif-plugged", "status": "completed", "tag": "cf5877da-a042-42a4-b1bc-c9afc1cd1bab"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:02.414336 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-847c4880-8abf-4697-95fc-6c9553e5e802 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.258808 Oct 12 08:53:02.425502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5819d151-3db8-4a7e-8dae-534feac7f659 req-1f262824-152f-419c-a97b-b5ba222f0839 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.425502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5819d151-3db8-4a7e-8dae-534feac7f659 req-1f262824-152f-419c-a97b-b5ba222f0839 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.425502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5819d151-3db8-4a7e-8dae-534feac7f659 req-1f262824-152f-419c-a97b-b5ba222f0839 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.425888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1085/2315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:02 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:02.436855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:02.437869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] [instance: 8519af08-ba91-4304-a23c-97cdf484974c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:02.444277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.445081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.445949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.446879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.447561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.447666 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5819d151-3db8-4a7e-8dae-534feac7f659 req-1f262824-152f-419c-a97b-b5ba222f0839 service nova] Creating event network-vif-plugged:cf5877da-a042-42a4-b1bc-c9afc1cd1bab for instance 68f7b507-2869-4d3b-a35a-904ac94e199c on n-h1-858383-10 Oct 12 08:53:02.448283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.459649 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5819d151-3db8-4a7e-8dae-534feac7f659 req-1f262824-152f-419c-a97b-b5ba222f0839 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068695 Oct 12 08:53:02.460493 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1231/2316] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:02.464624 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] HTTP exception thrown: Instance 8519af08-ba91-4304-a23c-97cdf484974c could not be found. Oct 12 08:53:02.465607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e2fa94b-79fb-43e4-bb2d-72da016dd042 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Calling method '.version_select at 0x7f9848896e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Request method failure captured: Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c HTTP/1.1 Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn9pUbLPSQP9ujkvj-N7eTzJXA__5QGTAEo3oGEeuzDMj0bCMZerwN_QqYqNyBKloDZ3Ftf4NU7T-k-Sc4hLLttKngr-NGbJU2cR79jWVjP9Kw8DuK8afmyNfU7BemUfNSFad3n6SghgzRlKZGCO5WKTU7--yWH_HHySAguTq0HUndU Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7002508409ec4f61b4d66eccdcd9f2ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7002508409ec4f61b4d66eccdcd9f2ab"}]}] Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7002508409ec4f61b4d66eccdcd9f2ab Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2091090501 Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 42733726966a4ab9ba5e9e160415358d Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersOnMultiNodesTest-2091090501-project Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 8519af08-ba91-4304-a23c-97cdf484974c could not be found. Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '8519af08-ba91-4304-a23c-97cdf484974c'} Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8519af08-ba91-4304-a23c-97cdf484974c could not be found. Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8519af08-ba91-4304-a23c-97cdf484974c could not be found. Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.466914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.470591 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.470591 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:02.470591 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:02.470591 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:02.470591 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:02.470591 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8519af08-ba91-4304-a23c-97cdf484974c could not be found. Oct 12 08:53:02.470591 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.473393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] Returning 404 to user: Instance 8519af08-ba91-4304-a23c-97cdf484974c could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:02.474656 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac00b9d1-a385-4b4b-b11b-a0b00ee5331c tempest-ServersOnMultiNodesTest-2091090501 tempest-ServersOnMultiNodesTest-2091090501-project] 10.222.0.40 "GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c" status: 404 len: 111 microversion: 2.1 time: 0.047244 Oct 12 08:53:02.475728 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1086/2317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:02 2022] GET /compute/v2.1/servers/8519af08-ba91-4304-a23c-97cdf484974c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:02.608827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-7e2fa94b-79fb-43e4-bb2d-72da016dd042 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:53:02.609708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-7e2fa94b-79fb-43e4-bb2d-72da016dd042 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Neutron security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:53:02.610459 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7e2fa94b-79fb-43e4-bb2d-72da016dd042 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] HTTP exception thrown: Security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 does not exist Oct 12 08:53:02.610459 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-7b667429-482c-4c81-9252-2d80212cc209'] Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e2fa94b-79fb-43e4-bb2d-72da016dd042 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Request method failure captured: Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-security-groups/ddd230da-07b0-4add-b1e5-3adb5e0796d2 HTTP/1.1 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoBpNYV_eshDIHXyRNsFGUn6vD00FxpVUWAbHnvx0Wu0ke0aZDS57jdCKJRhJb37D9ZY7yBrmEa6FQAFWhVb_IH6gRnYU921JdP7Al1iYo0rSZmPiJaAIkIQ7q9YAIuLrJFz6fOL1LWKOeqEsJzz3cPmpb3pOgYF5LVxdd3SVuSEE8Y Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 3cb7b28d39554be490f6993da6373bcf Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3cb7b28d39554be490f6993da6373bcf"}]}] Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 3cb7b28d39554be490f6993da6373bcf Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupsNegativeTestJSON-1134138970-project Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: fc465c6b49d44880bed3be7b5bc99c80 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970-project Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 does not exist Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-7b667429-482c-4c81-9252-2d80212cc209'] Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'ddd230da-07b0-4add-b1e5-3adb5e0796d2'} Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:53:02.612866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 does not exist Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b667429-482c-4c81-9252-2d80212cc209'] Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 does not exist Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b667429-482c-4c81-9252-2d80212cc209'] Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 does not exist Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b667429-482c-4c81-9252-2d80212cc209'] Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 does not exist Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b667429-482c-4c81-9252-2d80212cc209'] Oct 12 08:53:02.616306 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.619674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e2fa94b-79fb-43e4-bb2d-72da016dd042 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Returning 404 to user: Security group ddd230da-07b0-4add-b1e5-3adb5e0796d2 does not exist Oct 12 08:53:02.619674 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-7b667429-482c-4c81-9252-2d80212cc209'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:02.620797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e2fa94b-79fb-43e4-bb2d-72da016dd042 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/ddd230da-07b0-4add-b1e5-3adb5e0796d2" status: 404 len: 194 microversion: 2.1 time: 0.159322 Oct 12 08:53:02.621977 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1232/2318] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 08:53:02 2022] GET /compute/v2.1/os-security-groups/ddd230da-07b0-4add-b1e5-3adb5e0796d2 => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:02.631717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17545a52-3cd3-4468-8dbd-3ff2d08623a1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Action: 'update', calling method: .version_select at 0x7f9848e1fe50>, body: {"security_group": {"name": "tempest-sg-1875433151", "description": "tempest-description-824901211"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:02.677854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:02.679202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:02.681820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-17545a52-3cd3-4468-8dbd-3ff2d08623a1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f does not exist", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:53:02.682788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.security_group_api [None req-17545a52-3cd3-4468-8dbd-3ff2d08623a1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Neutron security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f not found {{(pid=127007) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 08:53:02.685660 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-17545a52-3cd3-4468-8dbd-3ff2d08623a1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] HTTP exception thrown: Security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f does not exist Oct 12 08:53:02.685660 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-31dd2a13-455f-400d-98e4-86eaf67654eb'] Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17545a52-3cd3-4468-8dbd-3ff2d08623a1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Request method failure captured: Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/os-security-groups/98d659d6-7f56-4e06-b0b7-5f8f79f7212f HTTP/1.1 Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 101 Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoBpNYV_eshDIHXyRNsFGUn6vD00FxpVUWAbHnvx0Wu0ke0aZDS57jdCKJRhJb37D9ZY7yBrmEa6FQAFWhVb_IH6gRnYU921JdP7Al1iYo0rSZmPiJaAIkIQ7q9YAIuLrJFz6fOL1LWKOeqEsJzz3cPmpb3pOgYF5LVxdd3SVuSEE8Y Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 3cb7b28d39554be490f6993da6373bcf Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3cb7b28d39554be490f6993da6373bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3cb7b28d39554be490f6993da6373bcf"}]}] Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 3cb7b28d39554be490f6993da6373bcf Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970 Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupsNegativeTestJSON-1134138970-project Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: fc465c6b49d44880bed3be7b5bc99c80 Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1134138970-project Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: {"security_group": {"name": "tempest-sg-1875433151", "description": "tempest-description-824901211"}} Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: exception: Security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f does not exist Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-31dd2a13-455f-400d-98e4-86eaf67654eb'] Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '98d659d6-7f56-4e06-b0b7-5f8f79f7212f', 'body': {'security_group': {'name': 'tempest-sg-1875433151', 'description': 'tempest-description-824901211'}}} Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:53:02.687545 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f does not exist Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31dd2a13-455f-400d-98e4-86eaf67654eb'] Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f does not exist Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31dd2a13-455f-400d-98e4-86eaf67654eb'] Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f does not exist Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31dd2a13-455f-400d-98e4-86eaf67654eb'] Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f does not exist Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31dd2a13-455f-400d-98e4-86eaf67654eb'] Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17545a52-3cd3-4468-8dbd-3ff2d08623a1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] Returning 404 to user: Security group 98d659d6-7f56-4e06-b0b7-5f8f79f7212f does not exist Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: Neutron server returns request_ids: ['req-31dd2a13-455f-400d-98e4-86eaf67654eb'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:02.691523 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-17545a52-3cd3-4468-8dbd-3ff2d08623a1 tempest-SecurityGroupsNegativeTestJSON-1134138970 tempest-SecurityGroupsNegativeTestJSON-1134138970-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/98d659d6-7f56-4e06-b0b7-5f8f79f7212f" status: 404 len: 194 microversion: 2.1 time: 0.061792 Oct 12 08:53:02.700934 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1087/2319] 10.222.0.40 () {60 vars in 1290 bytes} [Wed Oct 12 08:53:02 2022] PUT /compute/v2.1/os-security-groups/98d659d6-7f56-4e06-b0b7-5f8f79f7212f => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:02.707084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.707992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.708446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.709212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.709718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.711609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.791373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:02.793063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:02.806959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.807447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.807892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:02.808610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:02.813903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:02.814583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:03.041155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:03.053260 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b76b247-a9e3-4aaa-ab96-c03c988d38c5 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.380117 Oct 12 08:53:03.058777 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1233/2320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:02 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:03.093352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:03.169375 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-335f4063-f909-4997-b443-d0da9c64f8be tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 0.381815 Oct 12 08:53:03.180673 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1088/2321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:02 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:03.193777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e5a6cc71-6d47-4b43-b77f-04fbb26626b8 req-25d6560d-57e7-4af4-b8db-574537d5075b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf2a520-252a-4a78-bca0-1e719a4d1c4a", "tag": "5689fee7-af4e-4b17-80b4-7f85a5866e27"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:03.206043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e5a6cc71-6d47-4b43-b77f-04fbb26626b8 req-25d6560d-57e7-4af4-b8db-574537d5075b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:03.206857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e5a6cc71-6d47-4b43-b77f-04fbb26626b8 req-25d6560d-57e7-4af4-b8db-574537d5075b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:03.207605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e5a6cc71-6d47-4b43-b77f-04fbb26626b8 req-25d6560d-57e7-4af4-b8db-574537d5075b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:03.221643 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e5a6cc71-6d47-4b43-b77f-04fbb26626b8 req-25d6560d-57e7-4af4-b8db-574537d5075b service nova] Creating event network-changed:5689fee7-af4e-4b17-80b4-7f85a5866e27 for instance caf2a520-252a-4a78-bca0-1e719a4d1c4a on n-h1-858383-10 Oct 12 08:53:03.228759 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e5a6cc71-6d47-4b43-b77f-04fbb26626b8 req-25d6560d-57e7-4af4-b8db-574537d5075b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040374 Oct 12 08:53:03.230192 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1234/2322] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:53:03.403660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:03.404275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:03.424362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:03.424982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:03.429004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:03.435215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:03.440478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:03.441288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:03.442736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=26 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:03.443001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:03.448713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:03.449702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:03.467488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:03.468151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:03.468661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:03.469644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:03.471490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:03.472086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:03.906406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:03.917295 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4b5522af-a715-4133-bca4-8406b293d4bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1320 microversion: 2.1 time: 0.517731 Oct 12 08:53:03.918600 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1089/2323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:03 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:04.082534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:04.083690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:04.095480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:04.098403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:04.100838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:04.101793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:04.103820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:04.104495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:04.170245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:04.186968 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-28ad2c25-cd45-42b2-a768-5ce8a3bafdf5 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1372 microversion: 2.1 time: 0.744387 Oct 12 08:53:04.190416 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1235/2324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:03 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1372 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:04.209554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:04.210562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:04.229058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:04.229991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:04.230684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:04.231634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:04.232307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:04.232953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:04.439518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:04.450215 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e95df2ba-98ad-4231-a081-ba27f2099cc8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.371493 Oct 12 08:53:04.458074 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1090/2325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:04 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:04.493026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5d1a86dd-f9ae-45ab-9c59-41401bb0d014 req-be9160bc-9c5a-45cd-be0e-2b31d3382bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35be6073-b817-4b7d-90f5-1b9ecf1f92a9", "name": "network-vif-plugged", "status": "completed", "tag": "3eed2960-1011-403a-8e37-0354fe877f8e"}, {"server_uuid": "35be6073-b817-4b7d-90f5-1b9ecf1f92a9", "name": "network-vif-plugged", "status": "completed", "tag": "126044bb-c93e-4ac0-8869-0ac335709ac4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:04.521308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5d1a86dd-f9ae-45ab-9c59-41401bb0d014 req-be9160bc-9c5a-45cd-be0e-2b31d3382bb2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:04.522232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5d1a86dd-f9ae-45ab-9c59-41401bb0d014 req-be9160bc-9c5a-45cd-be0e-2b31d3382bb2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:04.522843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5d1a86dd-f9ae-45ab-9c59-41401bb0d014 req-be9160bc-9c5a-45cd-be0e-2b31d3382bb2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:04.568740 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5d1a86dd-f9ae-45ab-9c59-41401bb0d014 req-be9160bc-9c5a-45cd-be0e-2b31d3382bb2 service nova] Creating event network-vif-plugged:3eed2960-1011-403a-8e37-0354fe877f8e for instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 on n-h2-858383-10 Oct 12 08:53:04.569251 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5d1a86dd-f9ae-45ab-9c59-41401bb0d014 req-be9160bc-9c5a-45cd-be0e-2b31d3382bb2 service nova] Creating event network-vif-plugged:126044bb-c93e-4ac0-8869-0ac335709ac4 for instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 on n-h2-858383-10 Oct 12 08:53:04.583868 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5d1a86dd-f9ae-45ab-9c59-41401bb0d014 req-be9160bc-9c5a-45cd-be0e-2b31d3382bb2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094900 Oct 12 08:53:04.597083 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1091/2326] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:53:04.944234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:04.945071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:04.961164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:04.968368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:04.969085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:04.970001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:04.970638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:04.971200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:05.429963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:05.445161 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a04c2f31-a4b0-42c0-90c2-2498fe65ed18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1320 microversion: 2.1 time: 0.508006 Oct 12 08:53:05.449033 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1092/2327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:04 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:05.457234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:05.471792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:05.490326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:05.492060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:05.497641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:05.498676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:05.499155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:05.499942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:05.722043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:05.746640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5967a378-9793-406f-8c99-0a3cd80e0a9c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 1.541220 Oct 12 08:53:05.752034 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1236/2328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:04 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:05.772946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:05.774353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:05.805813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:05.807917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:05.818449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:05.819394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:05.819886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:05.820431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:05.836415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:05.848790 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cbfacf2c-c040-49a8-a942-acfcd6a01a5e tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1557 microversion: 2.1 time: 0.398396 Oct 12 08:53:05.852670 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1093/2329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:05 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1557 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:05.877831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:05.878027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:05.884935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:05.888571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:05.889169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:05.890118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:05.890734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:05.894035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:06.035185 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fcf573e7-d69d-4b04-afa6-9a9b2540eca0 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163540 Oct 12 08:53:06.036188 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1094/2330] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 08:53:05 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:53:06.431639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:06.462997 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a1592e8-0f5f-4ccc-b0c4-9891e31cbef4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1333 microversion: 2.1 time: 0.700948 Oct 12 08:53:06.478322 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1237/2331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:05 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1333 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:06.481597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:06.482214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:06.488736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:06.489220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:06.496078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:06.502431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:06.503095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:06.506125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:06.519293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:06.671630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-bcd5738d-03fc-4237-b3cc-486012745e52 req-592e928e-fbdb-4c31-bc27-d99157c999a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814", "name": "network-vif-plugged", "status": "completed", "tag": "e94727c5-ffb3-4193-ac33-68322d68eea9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:06.691838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bcd5738d-03fc-4237-b3cc-486012745e52 req-592e928e-fbdb-4c31-bc27-d99157c999a2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:06.697178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bcd5738d-03fc-4237-b3cc-486012745e52 req-592e928e-fbdb-4c31-bc27-d99157c999a2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:06.697800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bcd5738d-03fc-4237-b3cc-486012745e52 req-592e928e-fbdb-4c31-bc27-d99157c999a2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:06.760931 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-bcd5738d-03fc-4237-b3cc-486012745e52 req-592e928e-fbdb-4c31-bc27-d99157c999a2 service nova] Creating event network-vif-plugged:e94727c5-ffb3-4193-ac33-68322d68eea9 for instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 on n-h2-858383-10 Oct 12 08:53:06.778517 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-bcd5738d-03fc-4237-b3cc-486012745e52 req-592e928e-fbdb-4c31-bc27-d99157c999a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110462 Oct 12 08:53:06.780765 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1238/2332] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:53:06.792050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:06.798124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:06.811841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:06.812443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:06.813000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:06.814589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:06.815164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:06.815692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:07.170857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:07.192902 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8007acce-b93f-4062-ba1c-f6c2f5a58509 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1320 microversion: 2.1 time: 0.724358 Oct 12 08:53:07.197385 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1095/2333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:06 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1320 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:07.494728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:07.496179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:07.502724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:07.503424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:07.504516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:07.505380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:07.506215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:07.506780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:07.712544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:07.721919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0428d835-1e40-45db-8663-fc0e6d97d947 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 0.939730 Oct 12 08:53:07.734368 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1239/2334] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:06 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:07.891008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:07.902260 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-36bf7ea9-395e-4a51-85f1-bcc3d89f34cd tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1669 microversion: 2.1 time: 0.413733 Oct 12 08:53:07.909096 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1096/2335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:07 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1669 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:07.935978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:07.936527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:07.953078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:07.953614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:07.954059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:07.954923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:07.955387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:07.955824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:07.958879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:08.048853 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3199a90a-e76a-4051-a35f-5431a5644778 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9/ips" status: 200 len: 180 microversion: 2.1 time: 0.117218 Oct 12 08:53:08.053918 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1240/2336] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 08:53:07 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9/ips => generated 180 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:08.065652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:08.066407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:08.078184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:08.082194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:08.082925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:08.083868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:08.093960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:08.094655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:08.143737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:53:08.219072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:08.219961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:08.231202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:08.232886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:08.235761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:08.236821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:08.238024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:08.240259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:08.314182 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fb480df1-4a93-41de-8974-94b232b3accf tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "DELETE /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 204 len: 0 microversion: 2.1 time: 0.252063 Oct 12 08:53:08.318401 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1097/2337] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:53:08 2022] DELETE /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:53:08.334092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:08.341520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:08.358100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:08.358737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:08.359315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:08.360484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:08.361156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:08.361801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:08.807601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:08.826733 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a873fad8-f586-4447-9400-43280c47d4c0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1320 microversion: 2.1 time: 0.611473 Oct 12 08:53:08.827724 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1241/2338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:08 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1320 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:08.833701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:08.844171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:08.844783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:08.845256 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e0e2619-fc07-44bf-a865-b0d082643b88 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1675 microversion: 2.1 time: 0.524072 Oct 12 08:53:08.866937 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1098/2339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:08 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1675 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:08.872945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:08.877784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:08.878531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:08.880229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:08.880915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:08.881622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:09.063291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-65026a19-d8ef-4bc6-963f-d8e29a09e1cc req-8d30f183-f486-4d87-b919-428afef549e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf2a520-252a-4a78-bca0-1e719a4d1c4a", "name": "network-vif-plugged", "status": "completed", "tag": "5689fee7-af4e-4b17-80b4-7f85a5866e27"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:09.082089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-65026a19-d8ef-4bc6-963f-d8e29a09e1cc req-8d30f183-f486-4d87-b919-428afef549e9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:09.085233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-65026a19-d8ef-4bc6-963f-d8e29a09e1cc req-8d30f183-f486-4d87-b919-428afef549e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:09.085791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-65026a19-d8ef-4bc6-963f-d8e29a09e1cc req-8d30f183-f486-4d87-b919-428afef549e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:09.114625 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-65026a19-d8ef-4bc6-963f-d8e29a09e1cc req-8d30f183-f486-4d87-b919-428afef549e9 service nova] Creating event network-vif-plugged:5689fee7-af4e-4b17-80b4-7f85a5866e27 for instance caf2a520-252a-4a78-bca0-1e719a4d1c4a on n-h1-858383-10 Oct 12 08:53:09.127454 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-65026a19-d8ef-4bc6-963f-d8e29a09e1cc req-8d30f183-f486-4d87-b919-428afef549e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069005 Oct 12 08:53:09.129992 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1099/2340] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:09.212929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-028cc0bc-a581-40e1-b96c-b388edeb6e44 req-d888d8a5-a436-4678-b371-2ad4f60500c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f7b507-2869-4d3b-a35a-904ac94e199c", "tag": "cf5877da-a042-42a4-b1bc-c9afc1cd1bab"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:09.233930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-028cc0bc-a581-40e1-b96c-b388edeb6e44 req-d888d8a5-a436-4678-b371-2ad4f60500c4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:09.234687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-028cc0bc-a581-40e1-b96c-b388edeb6e44 req-d888d8a5-a436-4678-b371-2ad4f60500c4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:09.235324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-028cc0bc-a581-40e1-b96c-b388edeb6e44 req-d888d8a5-a436-4678-b371-2ad4f60500c4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:09.260941 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-028cc0bc-a581-40e1-b96c-b388edeb6e44 req-d888d8a5-a436-4678-b371-2ad4f60500c4 service nova] Creating event network-changed:cf5877da-a042-42a4-b1bc-c9afc1cd1bab for instance 68f7b507-2869-4d3b-a35a-904ac94e199c on n-h1-858383-10 Oct 12 08:53:09.271796 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-028cc0bc-a581-40e1-b96c-b388edeb6e44 req-d888d8a5-a436-4678-b371-2ad4f60500c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063282 Oct 12 08:53:09.278801 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1100/2341] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:09.342785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:09.352551 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7b17e7c6-6599-4f9a-914e-35b8c29f2f8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1367 microversion: 2.1 time: 0.523749 Oct 12 08:53:09.371782 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1242/2342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:08 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1367 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:09.854836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:09.855553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:09.876023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:09.876697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:09.890743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:09.893779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:09.894852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:09.895400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:09.897157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:09.897896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:09.898995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:09.899525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:09.900196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:09.901824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:09.906085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:09.906314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:10.514335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:10.545348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4d8e6aa7-84af-4d3d-b755-a8be45a39027 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1675 microversion: 2.1 time: 0.672317 Oct 12 08:53:10.550163 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1243/2343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:09 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1675 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:10.566871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:10.573028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:10.587500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:10.589884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:10.591789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:10.593213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:10.600615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:10.602658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:11.004451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:11.015484 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-87ea6606-b6c6-4874-a59e-c25d312170f4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1320 microversion: 2.1 time: 1.169073 Oct 12 08:53:11.016087 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1101/2344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:09 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1320 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:11.577311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:11.578311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:11.603683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:11.606179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:11.608845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:11.609940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:11.610679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:11.613339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:12.178565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:12.211140 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1023e209-1ff5-4c80-baba-21b20567be81 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1556 microversion: 2.1 time: 1.651165 Oct 12 08:53:12.211850 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1244/2345] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:10 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1556 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:12.249813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:12.250678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:12.267872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:12.268719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:12.269582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:12.271353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:12.271980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:12.272633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:12.429882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:12.462991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1df5c6a9-b21b-42f2-8b03-8d179f17df02 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1675 microversion: 2.1 time: 0.886976 Oct 12 08:53:12.463950 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1102/2346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:11 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1675 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:12.474135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:12.474622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:12.492457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:12.492957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:12.493393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:12.494133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:12.494583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:12.495006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:12.886927 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-50466639-3d9b-4af6-9fe1-7d61e92e76d0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.421828 Oct 12 08:53:12.887531 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1103/2347] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 08:53:12 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-interface => generated 284 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:12.892276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0e80a343-e325-474b-b421-d8369efd4394 req-850c5d12-56b2-48c6-bf62-7f078fbd300b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35be6073-b817-4b7d-90f5-1b9ecf1f92a9", "name": "network-vif-deleted", "tag": "126044bb-c93e-4ac0-8869-0ac335709ac4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:12.914684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e80a343-e325-474b-b421-d8369efd4394 req-850c5d12-56b2-48c6-bf62-7f078fbd300b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:12.915320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e80a343-e325-474b-b421-d8369efd4394 req-850c5d12-56b2-48c6-bf62-7f078fbd300b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:12.915904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e80a343-e325-474b-b421-d8369efd4394 req-850c5d12-56b2-48c6-bf62-7f078fbd300b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:12.942844 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0e80a343-e325-474b-b421-d8369efd4394 req-850c5d12-56b2-48c6-bf62-7f078fbd300b service nova] Creating event network-vif-deleted:126044bb-c93e-4ac0-8869-0ac335709ac4 for instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 on n-h2-858383-10 Oct 12 08:53:12.956508 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0e80a343-e325-474b-b421-d8369efd4394 req-850c5d12-56b2-48c6-bf62-7f078fbd300b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063653 Oct 12 08:53:12.957540 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1104/2348] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:12.991366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c0a38bc3-9f90-46c8-9ab1-7c90e2721a7f req-fcb82100-59a4-4631-b487-bd7894ee7b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35be6073-b817-4b7d-90f5-1b9ecf1f92a9", "name": "network-vif-unplugged", "status": "completed", "tag": "3eed2960-1011-403a-8e37-0354fe877f8e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:13.013722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c0a38bc3-9f90-46c8-9ab1-7c90e2721a7f req-fcb82100-59a4-4631-b487-bd7894ee7b15 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:13.014276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c0a38bc3-9f90-46c8-9ab1-7c90e2721a7f req-fcb82100-59a4-4631-b487-bd7894ee7b15 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:13.014621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c0a38bc3-9f90-46c8-9ab1-7c90e2721a7f req-fcb82100-59a4-4631-b487-bd7894ee7b15 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:13.048563 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c0a38bc3-9f90-46c8-9ab1-7c90e2721a7f req-fcb82100-59a4-4631-b487-bd7894ee7b15 service nova] Creating event network-vif-unplugged:3eed2960-1011-403a-8e37-0354fe877f8e for instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 on n-h2-858383-10 Oct 12 08:53:13.058152 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c0a38bc3-9f90-46c8-9ab1-7c90e2721a7f req-fcb82100-59a4-4631-b487-bd7894ee7b15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083756 Oct 12 08:53:13.062509 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1105/2349] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:13.275894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:13.302077 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-87757f03-a5be-4dd0-969c-1f982e5369af tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1500 microversion: 2.1 time: 1.070803 Oct 12 08:53:13.305390 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1245/2350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:12 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1500 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:13.335788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:13.338576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:13.364764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:13.365174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:13.365654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:13.366342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:13.366789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:13.367219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:13.494660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:13.496915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:13.535635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:13.538309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:13.539936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:13.542614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:13.545198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:13.547978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:14.356235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:14.358117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:14.370954 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8cc45fd9-427f-44b6-9c64-a32793d2dd74 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1500 microversion: 2.1 time: 1.043091 Oct 12 08:53:14.373843 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1106/2351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:13 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1500 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:14.380779 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7769281b-ef21-4eae-ba5c-6f748fa7dbdc tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1495 microversion: 2.1 time: 0.893650 Oct 12 08:53:14.397463 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1246/2352] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:13 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1495 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:14.397660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:14.397660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:14.404386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:14.405074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:14.411661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:14.411661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:14.411661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:14.411661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:14.436284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:53:14.575167 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d2bf2155-c461-45d8-ae5a-a28994617e9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 204 len: 0 microversion: 2.1 time: 0.181591 Oct 12 08:53:14.579114 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1107/2353] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:53:14 2022] DELETE /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:53:14.595473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:14.596529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:14.614621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:14.615644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:14.616721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:14.618880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:14.619629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:14.620302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:15.385933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f58a24dd-a76e-4526-860a-6e9184d28a9f req-411b83a9-5ea0-4bcd-a9db-cd2748d585e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35be6073-b817-4b7d-90f5-1b9ecf1f92a9", "name": "network-vif-deleted", "tag": "3eed2960-1011-403a-8e37-0354fe877f8e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:15.409419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f58a24dd-a76e-4526-860a-6e9184d28a9f req-411b83a9-5ea0-4bcd-a9db-cd2748d585e9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:15.410347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f58a24dd-a76e-4526-860a-6e9184d28a9f req-411b83a9-5ea0-4bcd-a9db-cd2748d585e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:15.411471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f58a24dd-a76e-4526-860a-6e9184d28a9f req-411b83a9-5ea0-4bcd-a9db-cd2748d585e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:15.441124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f58a24dd-a76e-4526-860a-6e9184d28a9f req-411b83a9-5ea0-4bcd-a9db-cd2748d585e9 service nova] Creating event network-vif-deleted:3eed2960-1011-403a-8e37-0354fe877f8e for instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 on n-h2-858383-10 Oct 12 08:53:15.454435 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f58a24dd-a76e-4526-860a-6e9184d28a9f req-411b83a9-5ea0-4bcd-a9db-cd2748d585e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072655 Oct 12 08:53:15.455929 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1108/2354] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:53:15.473562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:15.474549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:15.492075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:15.492830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:15.493611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:15.494491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:15.495097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:15.496878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:15.578934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:15.579572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:15.580026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:15.580482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lazy-loading 'fault' on Instance uuid 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:53:15.616477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:15.633946 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6b52f663-d7a7-4617-8528-b61f11a663d7 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1506 microversion: 2.1 time: 1.048485 Oct 12 08:53:15.636806 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1247/2355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:14 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1506 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:15.910574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a533e9e2ed84f6eb570e389be2f2feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52c8325195f4024b1a917f2a1f0ca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:15.920738 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eb8cdaec-44a8-4519-892d-eab898e352a8 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 200 len: 1302 microversion: 2.1 time: 0.462404 Oct 12 08:53:15.924950 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1109/2356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:15 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 1302 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:16.666498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:16.668515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:16.686817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:16.688888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:16.692198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:16.696102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:16.696866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:16.697760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:16.951692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:16.952352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:16.962667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:16.966136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:16.966780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:16.967665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:16.969297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:16.971393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:16.995295 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] HTTP exception thrown: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Request method failure captured: Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 HTTP/1.1 Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn_nKhyUHoOcQ_w-32X6cWNcP5s06loXXRiHXPkQdeb7a_FC3ivmJCapuvxkFGFbthg7KGvjV1iDnP4dIWlrdZ75g1JPrZB0tNpBnAioGHEqSzPT037ClfBSkdsSljglsODIK0rmXtOzi6uHIbA63uC7jpnuthMqXEIqldhiphZpFPM Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}] Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 9a533e9e2ed84f6eb570e389be2f2feb Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '35be6073-b817-4b7d-90f5-1b9ecf1f92a9'} Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:16.997199 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:17.001095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:17.001095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:17.001095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:17.001095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:17.001095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:17.001095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:17.001095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:17.002998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Returning 404 to user: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:17.004069 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58e94c4c-5b45-4e4a-b982-d31d9c8e6116 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 404 len: 111 microversion: 2.1 time: 0.057169 Oct 12 08:53:17.005121 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1110/2357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:16 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:17.772389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b500922c-be1b-4457-92e9-a11bb76843d2 req-e44ce2a4-17e8-4f0f-866e-ab3bef5cc1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814", "tag": "e94727c5-ffb3-4193-ac33-68322d68eea9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:17.801978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b500922c-be1b-4457-92e9-a11bb76843d2 req-e44ce2a4-17e8-4f0f-866e-ab3bef5cc1e4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:17.802761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b500922c-be1b-4457-92e9-a11bb76843d2 req-e44ce2a4-17e8-4f0f-866e-ab3bef5cc1e4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:17.803406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b500922c-be1b-4457-92e9-a11bb76843d2 req-e44ce2a4-17e8-4f0f-866e-ab3bef5cc1e4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:17.860350 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b500922c-be1b-4457-92e9-a11bb76843d2 req-e44ce2a4-17e8-4f0f-866e-ab3bef5cc1e4 service nova] Creating event network-changed:e94727c5-ffb3-4193-ac33-68322d68eea9 for instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 on n-h2-858383-10 Oct 12 08:53:17.881960 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b500922c-be1b-4457-92e9-a11bb76843d2 req-e44ce2a4-17e8-4f0f-866e-ab3bef5cc1e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112938 Oct 12 08:53:17.886576 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1111/2358] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:17.907033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:17.943285 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71ec5296-3067-47a3-8567-7a39c00feb2c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1506 microversion: 2.1 time: 1.282352 Oct 12 08:53:17.959558 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1248/2359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:16 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1506 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:18.383702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bc1e56c3-b5f3-4f03-aba3-fe16dcb91039 req-4e654bc0-b94a-4541-af90-5de60eb7fc5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf2a520-252a-4a78-bca0-1e719a4d1c4a", "name": "network-vif-deleted", "tag": "5689fee7-af4e-4b17-80b4-7f85a5866e27"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:18.410000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bc1e56c3-b5f3-4f03-aba3-fe16dcb91039 req-4e654bc0-b94a-4541-af90-5de60eb7fc5b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:18.410574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bc1e56c3-b5f3-4f03-aba3-fe16dcb91039 req-4e654bc0-b94a-4541-af90-5de60eb7fc5b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:18.419121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bc1e56c3-b5f3-4f03-aba3-fe16dcb91039 req-4e654bc0-b94a-4541-af90-5de60eb7fc5b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:18.439681 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bc1e56c3-b5f3-4f03-aba3-fe16dcb91039 req-4e654bc0-b94a-4541-af90-5de60eb7fc5b service nova] Creating event network-vif-deleted:5689fee7-af4e-4b17-80b4-7f85a5866e27 for instance caf2a520-252a-4a78-bca0-1e719a4d1c4a on n-h1-858383-10 Oct 12 08:53:18.476106 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bc1e56c3-b5f3-4f03-aba3-fe16dcb91039 req-4e654bc0-b94a-4541-af90-5de60eb7fc5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096678 Oct 12 08:53:18.478853 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1112/2360] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:18.982098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:18.984566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:19.011159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:19.016741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:19.018948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:19.020067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:19.027097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:19.027888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:19.170120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:19.172100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:19.172810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:19.173516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'fault' on Instance uuid caf2a520-252a-4a78-bca0-1e719a4d1c4a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:53:19.362603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:19.373911 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-467743b3-ab1e-48e4-ba06-34ed631a6719 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 200 len: 1310 microversion: 2.1 time: 0.406176 Oct 12 08:53:19.377301 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1249/2361] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:18 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 1310 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:20.407022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:20.408457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:20.428599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:20.431068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:20.432033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:20.436274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:20.437101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:20.437736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:20.483746 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a HTTP/1.1 Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'caf2a520-252a-4a78-bca0-1e719a4d1c4a'} Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:20.491765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:20.496222 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:20.496222 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:20.496222 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:20.496222 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:20.496222 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:53:20.496222 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:20.499641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:20.503616 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05bb8843-000c-49ea-91f5-031ca5586a43 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 404 len: 111 microversion: 2.1 time: 0.102085 Oct 12 08:53:20.511816 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1113/2362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:20 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:20.518089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6635c6fa-8999-461d-b021-605026433bfc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: .version_select at 0x7f98491b6790>, body: {"keypair": {"name": "tempest-key-1046085639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaD9ZqjXqc7LJlUJ3lWyRcm//LNjOdax0a5ABi4C5Eo8MSQWpCY9t4faCk6pTzQw13A2YrmzKKJoeSdxUPd4VyQOBU/YQV4v8FYCMYHOayiEEq0tLEoKGaxrbkW/3eNWw=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:20.538493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-6635c6fa-8999-461d-b021-605026433bfc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:20.545403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-6635c6fa-8999-461d-b021-605026433bfc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:20.578103 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6635c6fa-8999-461d-b021-605026433bfc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.064406 Oct 12 08:53:20.579222 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1250/2363] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:53:20 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:53:20.590167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c7510108-5756-40ff-8d25-7daaafecdd0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '.version_select at 0x7f984cd7e8b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:20.598509 n-d-858383-10 devstack@n-api.service[127007]: WARNING oslo_db.sqlalchemy.utils [None req-c7510108-5756-40ff-8d25-7daaafecdd0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 08:53:20.611601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:20.621574 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c7510108-5756-40ff-8d25-7daaafecdd0a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.035659 Oct 12 08:53:20.625156 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1114/2364] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:53:20 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:21.007525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-359574149", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-key-1046085639", "networks": [{"uuid": "5694562d-e360-435c-86bf-39f253be6d82"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:21.164775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] validate_networks() for [('5694562d-e360-435c-86bf-39f253be6d82', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:53:23.812541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:23.812541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:23.826708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:23.829089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:23.830330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:23.831759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:23.837151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:23.839243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:23.870453 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] HTTP exception thrown: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Request method failure captured: Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 HTTP/1.1 Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn_nKhyUHoOcQ_w-32X6cWNcP5s06loXXRiHXPkQdeb7a_FC3ivmJCapuvxkFGFbthg7KGvjV1iDnP4dIWlrdZ75g1JPrZB0tNpBnAioGHEqSzPT037ClfBSkdsSljglsODIK0rmXtOzi6uHIbA63uC7jpnuthMqXEIqldhiphZpFPM Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}] Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 9a533e9e2ed84f6eb570e389be2f2feb Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '35be6073-b817-4b7d-90f5-1b9ecf1f92a9'} Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:53:23.872612 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.876825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.878665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Returning 404 to user: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:23.879711 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e038799c-3293-438c-919c-abf24dffa477 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "DELETE /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 404 len: 111 microversion: 2.1 time: 0.086699 Oct 12 08:53:23.884053 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1115/2365] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:53:23 2022] DELETE /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:23.893320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:23.894692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 35be6073-b817-4b7d-90f5-1b9ecf1f92a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:23.903182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:23.903923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:23.904843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:23.905796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:23.906437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:23.907152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:23.923981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:23.926402 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] HTTP exception thrown: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Request method failure captured: Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 HTTP/1.1 Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn_nKhyUHoOcQ_w-32X6cWNcP5s06loXXRiHXPkQdeb7a_FC3ivmJCapuvxkFGFbthg7KGvjV1iDnP4dIWlrdZ75g1JPrZB0tNpBnAioGHEqSzPT037ClfBSkdsSljglsODIK0rmXtOzi6uHIbA63uC7jpnuthMqXEIqldhiphZpFPM Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}] Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 9a533e9e2ed84f6eb570e389be2f2feb Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '35be6073-b817-4b7d-90f5-1b9ecf1f92a9'} Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:23.928646 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.932731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:23.932731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:23.932731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:23.932731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:23.932731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:23.932731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. Oct 12 08:53:23.932731 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.935681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Returning 404 to user: Instance 35be6073-b817-4b7d-90f5-1b9ecf1f92a9 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:23.936743 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-75b34356-3b65-4550-85e3-708d874bc20e tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9" status: 404 len: 111 microversion: 2.1 time: 0.051514 Oct 12 08:53:23.941252 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1116/2366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:23 2022] GET /compute/v2.1/servers/35be6073-b817-4b7d-90f5-1b9ecf1f92a9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:23.947476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:23.948260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:23.965159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:23.966073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:23.967890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:23.968830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:23.969654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:23.970233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:23.994960 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] HTTP exception thrown: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Request method failure captured: Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea HTTP/1.1 Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn_nKhyUHoOcQ_w-32X6cWNcP5s06loXXRiHXPkQdeb7a_FC3ivmJCapuvxkFGFbthg7KGvjV1iDnP4dIWlrdZ75g1JPrZB0tNpBnAioGHEqSzPT037ClfBSkdsSljglsODIK0rmXtOzi6uHIbA63uC7jpnuthMqXEIqldhiphZpFPM Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}] Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 9a533e9e2ed84f6eb570e389be2f2feb Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '270ccda0-0058-4f07-9852-1a30012c5aea'} Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:53:23.998546 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:24.002590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:24.004251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Returning 404 to user: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:24.005332 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-39743281-8ae4-4021-af7a-1e1714087170 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "DELETE /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 404 len: 111 microversion: 2.1 time: 0.062719 Oct 12 08:53:24.010925 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1117/2367] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:53:23 2022] DELETE /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:24.028803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:24.029842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] [instance: 270ccda0-0058-4f07-9852-1a30012c5aea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:24.038142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:24.038953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:24.039641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:24.040685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:24.041493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:24.042110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:24.062145 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] HTTP exception thrown: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Request method failure captured: Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea HTTP/1.1 Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRn_nKhyUHoOcQ_w-32X6cWNcP5s06loXXRiHXPkQdeb7a_FC3ivmJCapuvxkFGFbthg7KGvjV1iDnP4dIWlrdZ75g1JPrZB0tNpBnAioGHEqSzPT037ClfBSkdsSljglsODIK0rmXtOzi6uHIbA63uC7jpnuthMqXEIqldhiphZpFPM Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a52c8325195f4024b1a917f2a1f0ca7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a52c8325195f4024b1a917f2a1f0ca7e"}]}] Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a52c8325195f4024b1a917f2a1f0ca7e Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestMultiNic-2060105725 Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 9a533e9e2ed84f6eb570e389be2f2feb Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestMultiNic-2060105725-project Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '270ccda0-0058-4f07-9852-1a30012c5aea'} Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:24.064211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:24.068698 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:24.068698 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:24.068698 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:24.068698 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:24.068698 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:24.068698 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. Oct 12 08:53:24.068698 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:24.070374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] Returning 404 to user: Instance 270ccda0-0058-4f07-9852-1a30012c5aea could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:24.071478 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1cfe122-179f-413e-9629-4000a2f0c2c4 tempest-ServersTestMultiNic-2060105725 tempest-ServersTestMultiNic-2060105725-project] 10.222.0.40 "GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea" status: 404 len: 111 microversion: 2.1 time: 0.059272 Oct 12 08:53:24.075804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1118/2368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:24 2022] GET /compute/v2.1/servers/270ccda0-0058-4f07-9852-1a30012c5aea => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:24.267567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:53:24.268180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:53:24.268440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:53:24.269024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:53:24.269695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:53:24.294759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:24.295226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:24.295814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:24.296718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:24.297340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:24.297997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:24.343627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:24.356935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:24.396742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:53:24.399534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:53:24.528189 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57040bef-8a8a-431e-9ae2-86fbc8c795f5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.525971 Oct 12 08:53:24.528853 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1251/2369] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:53:24.540614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-388f5b55-0a93-46cc-bc8b-0725b41f7e45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:24.541226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-388f5b55-0a93-46cc-bc8b-0725b41f7e45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:24.962355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-388f5b55-0a93-46cc-bc8b-0725b41f7e45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:24.995874 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-388f5b55-0a93-46cc-bc8b-0725b41f7e45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1228 microversion: 2.1 time: 0.449409 Oct 12 08:53:25.015716 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1119/2370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:24 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1228 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:26.022769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:26.023386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:26.045667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:26.053531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:26.056749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:26.060496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:26.061129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:26.065654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:26.374932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:26.396939 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6649287d-f00e-479c-91a7-71da40d78dc0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1280 microversion: 2.1 time: 0.378228 Oct 12 08:53:26.429000 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1252/2371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:26 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1280 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:26.661885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2632e01a-9d35-468a-a9ef-a18232ff3b40 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] Calling method '.version_select at 0x7f984cd7e670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:26.955930 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2632e01a-9d35-468a-a9ef-a18232ff3b40 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.574473 Oct 12 08:53:26.957249 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1120/2372] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:53:26 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:26.970969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03e484e1-3dca-4634-9fd9-45baa12a11d7 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] Action: 'create', calling method: .version_select at 0x7f98488970d0>, body: {"pool": "non_exist_pool"} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:27.051796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-03e484e1-3dca-4634-9fd9-45baa12a11d7 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] HTTP exception thrown: Floating IP pool not found. Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03e484e1-3dca-4634-9fd9-45baa12a11d7 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] Request method failure captured: Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 26 Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCGCWDSlWH_TKulTN2PsnVR-yLzh6J8RNmoUxO8FtxivwaQOaalNaU59blMB2eHedHO05XM7QeYmm01QZDS2Se2LJbMUdLq0MTtI_u9bU2SpwpeUbZki5Wt_jMBdPxH3YRKUE2NwU8X_boVdpU8ahCrybbqhctps5j_mKUCmVKekic Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 0bd978f64c774bee8a58a9e74a13a9bb Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1677625130 Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0bd978f64c774bee8a58a9e74a13a9bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0bd978f64c774bee8a58a9e74a13a9bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0bd978f64c774bee8a58a9e74a13a9bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0bd978f64c774bee8a58a9e74a13a9bb"}]}] Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1677625130 Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 0bd978f64c774bee8a58a9e74a13a9bb Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1677625130 Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FloatingIPsNegativeTestJSON-1677625130-project Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 70d28b4a1e2d4d46b0b40caf7f969ecd Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1677625130-project Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: {"pool": "non_exist_pool"} Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: exception: Floating IP pool not found. Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:27.053421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:27.056935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 12 08:53:27.056935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.058913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03e484e1-3dca-4634-9fd9-45baa12a11d7 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] Returning 404 to user: Floating IP pool not found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:27.059975 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-03e484e1-3dca-4634-9fd9-45baa12a11d7 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.093326 Oct 12 08:53:27.061058 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1253/2373] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:53:26 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:53:27.070786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17e16d01-4aa5-4595-916b-821facccb2e9 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] Calling method '.version_select at 0x7f9848dbc310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:27.364223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:27.364433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:27.381745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:27.382951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:27.386042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:27.389961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:27.390703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:27.391354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:27.492639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-17e16d01-4aa5-4595-916b-821facccb2e9 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 850b8882-e21e-4d82-8021-a046c8d774c3 could not be found", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:53:27.493353 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-17e16d01-4aa5-4595-916b-821facccb2e9 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] HTTP exception thrown: Floating IP not found for ID 850b8882-e21e-4d82-8021-a046c8d774c3 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17e16d01-4aa5-4595-916b-821facccb2e9 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] Request method failure captured: Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-floating-ips/850b8882-e21e-4d82-8021-a046c8d774c3 HTTP/1.1 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCGCWDSlWH_TKulTN2PsnVR-yLzh6J8RNmoUxO8FtxivwaQOaalNaU59blMB2eHedHO05XM7QeYmm01QZDS2Se2LJbMUdLq0MTtI_u9bU2SpwpeUbZki5Wt_jMBdPxH3YRKUE2NwU8X_boVdpU8ahCrybbqhctps5j_mKUCmVKekic Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 0bd978f64c774bee8a58a9e74a13a9bb Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1677625130 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0bd978f64c774bee8a58a9e74a13a9bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0bd978f64c774bee8a58a9e74a13a9bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0bd978f64c774bee8a58a9e74a13a9bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0bd978f64c774bee8a58a9e74a13a9bb"}]}] Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1677625130 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 0bd978f64c774bee8a58a9e74a13a9bb Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1677625130 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FloatingIPsNegativeTestJSON-1677625130-project Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 70d28b4a1e2d4d46b0b40caf7f969ecd Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1677625130-project Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: exception: Floating IP not found for ID 850b8882-e21e-4d82-8021-a046c8d774c3 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '850b8882-e21e-4d82-8021-a046c8d774c3'} Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 850b8882-e21e-4d82-8021-a046c8d774c3 could not be found Oct 12 08:53:27.495239 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-165edf78-a7d3-48cb-8010-af028ee4157c'] Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 850b8882-e21e-4d82-8021-a046c8d774c3. Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 850b8882-e21e-4d82-8021-a046c8d774c3 Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 850b8882-e21e-4d82-8021-a046c8d774c3 Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17e16d01-4aa5-4595-916b-821facccb2e9 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] Returning 404 to user: Floating IP not found for ID 850b8882-e21e-4d82-8021-a046c8d774c3 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-17e16d01-4aa5-4595-916b-821facccb2e9 tempest-FloatingIPsNegativeTestJSON-1677625130 tempest-FloatingIPsNegativeTestJSON-1677625130-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/850b8882-e21e-4d82-8021-a046c8d774c3" status: 404 len: 111 microversion: 2.1 time: 0.430357 Oct 12 08:53:27.498927 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1121/2374] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:53:27 2022] DELETE /compute/v2.1/os-floating-ips/850b8882-e21e-4d82-8021-a046c8d774c3 => generated 111 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:27.505686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:27.506259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:27.528342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:27.528865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:27.529297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:27.533278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:27.533939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:27.534450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:27.731141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:27.739544 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8f205325-cc10-4b46-9d28-e7e8985f27d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1286 microversion: 2.1 time: 0.240912 Oct 12 08:53:27.740179 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1122/2375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:27 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1286 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:28.524031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:28.537578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7293b836-60d1-4701-b7c2-559cad790223 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 1.177428 Oct 12 08:53:28.553868 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1254/2376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:27 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:28.772045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:28.773251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:28.784037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:28.784785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:28.785360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:28.786237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:28.786828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:28.787394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:29.096277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:29.139687 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fbd2ef41-ebd0-4894-9c85-327efcb4371f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.376758 Oct 12 08:53:29.141694 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1123/2377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:28 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:29.564152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:29.565811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:29.590580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:29.598804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:29.599752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:29.600446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:29.601396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:29.607334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:29.607955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:30.090910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:30.100151 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d0a8d3c-4e8c-4c9a-b64c-11f521b3f72d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.541803 Oct 12 08:53:30.101340 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1255/2378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:29 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:30.123991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-937419902"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:30.130197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:30.149516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:30.151895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:30.153009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:30.153937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:30.158019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:30.160958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:30.164852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:30.165652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:30.177862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:30.179932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:30.182743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:30.184128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:30.184842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:30.187021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:30.497567 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d1cf292-5bdd-4d1f-b57f-daa1f3ba22d9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.376832 Oct 12 08:53:30.503239 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1124/2379] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:53:30 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 08:53:30.698173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:30.709224 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-753b7bdd-006b-437b-9763-57f799bdd14d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.548100 Oct 12 08:53:30.710597 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1256/2380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:30 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:31.617564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bd99f3c9-5c92-486c-a6a8-6c1e730c545f req-e0607d48-1edc-468e-95a3-a83b2f87acf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0075c4-c98b-4f57-8761-d05545c78f1a", "tag": "900f5367-3ea6-414e-a9da-7444f8668467"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:31.637774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bd99f3c9-5c92-486c-a6a8-6c1e730c545f req-e0607d48-1edc-468e-95a3-a83b2f87acf7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:31.639455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bd99f3c9-5c92-486c-a6a8-6c1e730c545f req-e0607d48-1edc-468e-95a3-a83b2f87acf7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:31.640111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bd99f3c9-5c92-486c-a6a8-6c1e730c545f req-e0607d48-1edc-468e-95a3-a83b2f87acf7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:31.667321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bd99f3c9-5c92-486c-a6a8-6c1e730c545f req-e0607d48-1edc-468e-95a3-a83b2f87acf7 service nova] Creating event network-changed:900f5367-3ea6-414e-a9da-7444f8668467 for instance 8c0075c4-c98b-4f57-8761-d05545c78f1a on n-h1-858383-10 Oct 12 08:53:31.676288 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bd99f3c9-5c92-486c-a6a8-6c1e730c545f req-e0607d48-1edc-468e-95a3-a83b2f87acf7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064049 Oct 12 08:53:31.681103 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1125/2381] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:31.735201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:31.736432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:31.751752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:31.760753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:31.761642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:31.762849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:31.763526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:31.764179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:32.096671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:32.104705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc599f55-a02d-4536-bee7-012deab731d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.374611 Oct 12 08:53:32.119095 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1257/2382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:31 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:33.131627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:33.132191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:33.143526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:33.144019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:33.144447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:33.152247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:33.152981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:33.153617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:33.279927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-12c56bfd-a092-4bf1-8a6c-7311d8346e3e req-9a77a60f-15e3-4571-8c8a-4478b23c66d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "name": "network-vif-unplugged", "status": "completed", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:33.292036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12c56bfd-a092-4bf1-8a6c-7311d8346e3e req-9a77a60f-15e3-4571-8c8a-4478b23c66d0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:33.292516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12c56bfd-a092-4bf1-8a6c-7311d8346e3e req-9a77a60f-15e3-4571-8c8a-4478b23c66d0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:33.293127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12c56bfd-a092-4bf1-8a6c-7311d8346e3e req-9a77a60f-15e3-4571-8c8a-4478b23c66d0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:33.309841 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-12c56bfd-a092-4bf1-8a6c-7311d8346e3e req-9a77a60f-15e3-4571-8c8a-4478b23c66d0 service nova] Creating event network-vif-unplugged:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:53:33.330582 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-12c56bfd-a092-4bf1-8a6c-7311d8346e3e req-9a77a60f-15e3-4571-8c8a-4478b23c66d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054908 Oct 12 08:53:33.331213 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1258/2383] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:33.977348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:33.990457 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-18b1917e-156d-4b93-b516-a74a02d0cda6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.863927 Oct 12 08:53:34.001881 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1126/2384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:33 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:35.015958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:35.020562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:35.028403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:35.035801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=10 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:35.057870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:35.058664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:35.060106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:35.060983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:35.063314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:35.064816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:35.881185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:35.931620 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06a2f02b-f5c7-49cf-b732-9bb45758fb15 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.915993 Oct 12 08:53:35.935881 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1259/2385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:35 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:36.958830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:36.959921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:36.971218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:36.977652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:36.979006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:36.981144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:36.986651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:36.988006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:36.991180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:37.516108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-37370035-eb26-457e-8f4a-973f460c1d10 req-b03d41d2-6185-464a-876e-8b8de2840022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "name": "network-vif-plugged", "status": "completed", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:37.544898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-37370035-eb26-457e-8f4a-973f460c1d10 req-b03d41d2-6185-464a-876e-8b8de2840022 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:37.547206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-37370035-eb26-457e-8f4a-973f460c1d10 req-b03d41d2-6185-464a-876e-8b8de2840022 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:37.560129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-37370035-eb26-457e-8f4a-973f460c1d10 req-b03d41d2-6185-464a-876e-8b8de2840022 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:37.600407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:37.606987 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-37370035-eb26-457e-8f4a-973f460c1d10 req-b03d41d2-6185-464a-876e-8b8de2840022 service nova] Creating event network-vif-plugged:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:53:37.621502 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-37370035-eb26-457e-8f4a-973f460c1d10 req-b03d41d2-6185-464a-876e-8b8de2840022 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119961 Oct 12 08:53:37.623184 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1260/2386] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:37.970694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:38.004301 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3becc771-d33b-44e9-b5c9-b69f3c8e8bb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 1.050238 Oct 12 08:53:38.005110 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1127/2387] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:36 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:39.031695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:39.032363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:39.063117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:39.063972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:39.064388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:39.070360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:39.070867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:39.073923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:39.405808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:39.423142 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db5764a6-a00f-465b-8673-f0f194dd9e90 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.397193 Oct 12 08:53:39.424870 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1261/2388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:39 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:40.306196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9529d48b-65a3-47cc-b1d9-45ba43dbbecf tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Calling method '.version_select at 0x7f984cd08040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:40.452050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:40.456082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:40.457201 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9529d48b-65a3-47cc-b1d9-45ba43dbbecf tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733" status: 200 len: 637 microversion: 2.1 time: 0.155205 Oct 12 08:53:40.459603 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1128/2389] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:53:40 2022] GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733 => generated 637 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:53:40.474757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3a1c9b4a-f5d4-4d6a-93aa-baa8df9045ad tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'update_all', calling method: .version_select at 0x7f984881fee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:40.474954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:40.475342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:40.486842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:40.487793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:40.488289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:40.488729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:40.592578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-3a1c9b4a-f5d4-4d6a-93aa-baa8df9045ad tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:40.625740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-3a1c9b4a-f5d4-4d6a-93aa-baa8df9045ad tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:41.080210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:41.098693 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-56766ff9-d21d-4055-8cf2-b51fd4b14b44 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.652792 Oct 12 08:53:41.099654 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1262/2390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:40 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:41.200554 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3a1c9b4a-f5d4-4d6a-93aa-baa8df9045ad tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 61 microversion: 2.1 time: 0.729966 Oct 12 08:53:41.201340 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1129/2391] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:53:40 2022] PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 61 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:41.211137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-189547df-55cc-4d66-aee4-f53ed5b98ba9 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Calling method '.version_select at 0x7f9848e1ff70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:41.590225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d3b2297-5782-499b-be06-0aeb9f51697d tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Action: 'create', calling method: .version_select at 0x7f98489c3160>, body: {"keypair": {"name": "tempest-keypair-867344562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0wDO09HAMMyvKKg4Fk7tusUh2qC+eq2WPU4j+xE/ApynVVY4I3SzaFGj9kvx3x7w3AOHWBu0/KpbNnoNWUjdZsqt0RMygqdS9ma3m6tyRwYMSAicPOSE+IdoTyjGjzCA=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:41.659830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-6d3b2297-5782-499b-be06-0aeb9f51697d tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Getting quotas for project cdd691de25004ed7830feb606255332b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:41.679161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-6d3b2297-5782-499b-be06-0aeb9f51697d tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Getting quotas for user cec3cf3ce9754f5ab926cb97accf6c10 and project cdd691de25004ed7830feb606255332b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:41.765764 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d3b2297-5782-499b-be06-0aeb9f51697d tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.664928 Oct 12 08:53:41.769627 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1263/2392] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:53:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:41.789888 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-189547df-55cc-4d66-aee4-f53ed5b98ba9 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "DELETE /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.582818 Oct 12 08:53:41.793645 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1130/2393] 10.222.0.40 () {58 vars in 1296 bytes} [Wed Oct 12 08:53:41 2022] DELETE /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata/os_version => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:53:41.799208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-48bb49b5-c009-4430-9538-60afacbcf3b1 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Calling method '.version_select at 0x7f9848983160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:41.902095 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-48bb49b5-c009-4430-9538-60afacbcf3b1 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 37 microversion: 2.1 time: 0.106665 Oct 12 08:53:41.903209 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1264/2394] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:53:41 2022] GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 37 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:41.914175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5296105b-c2ef-4099-b2c1-2ef9b136b016 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'update_all', calling method: .version_select at 0x7f9848dbc8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:42.032043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5296105b-c2ef-4099-b2c1-2ef9b136b016 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:42.050696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5296105b-c2ef-4099-b2c1-2ef9b136b016 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:42.127864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:42.128843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:42.147462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:42.149764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:42.152099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:42.154895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:42.160071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:42.161592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:42.684816 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5296105b-c2ef-4099-b2c1-2ef9b136b016 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 61 microversion: 2.1 time: 0.774833 Oct 12 08:53:42.685655 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1131/2395] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:53:41 2022] PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 61 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:42.690998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e2f99f3d-a38b-42ab-86ff-121f9cd57bac req-17b406bc-4913-4d2b-a687-442f7514fafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0075c4-c98b-4f57-8761-d05545c78f1a", "name": "network-vif-plugged", "status": "completed", "tag": "900f5367-3ea6-414e-a9da-7444f8668467"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:42.712500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e2f99f3d-a38b-42ab-86ff-121f9cd57bac req-17b406bc-4913-4d2b-a687-442f7514fafb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:42.717284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e2f99f3d-a38b-42ab-86ff-121f9cd57bac req-17b406bc-4913-4d2b-a687-442f7514fafb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:42.718058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e2f99f3d-a38b-42ab-86ff-121f9cd57bac req-17b406bc-4913-4d2b-a687-442f7514fafb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:42.741988 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e2f99f3d-a38b-42ab-86ff-121f9cd57bac req-17b406bc-4913-4d2b-a687-442f7514fafb service nova] Creating event network-vif-plugged:900f5367-3ea6-414e-a9da-7444f8668467 for instance 8c0075c4-c98b-4f57-8761-d05545c78f1a on n-h1-858383-10 Oct 12 08:53:42.756283 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e2f99f3d-a38b-42ab-86ff-121f9cd57bac req-17b406bc-4913-4d2b-a687-442f7514fafb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069103 Oct 12 08:53:42.757961 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1132/2396] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:42.766894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d3f1b6e-9a30-4db0-b2f5-8a3da1a8a1b0 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Calling method '.version_select at 0x7f984cd085e0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:42.791268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:42.805897 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c09f26c4-19fc-4176-8d81-3633122e8a7b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.683036 Oct 12 08:53:42.810172 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1265/2397] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:42 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:42.875719 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d3f1b6e-9a30-4db0-b2f5-8a3da1a8a1b0 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.115682 Oct 12 08:53:42.876655 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1133/2398] 10.222.0.40 () {58 vars in 1290 bytes} [Wed Oct 12 08:53:42 2022] GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata/os_distro => generated 33 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:42.888353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2466f80b-7b55-414c-93c0-42ea642ed06a tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'update_all', calling method: .version_select at 0x7f98494d8790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:42.983602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2466f80b-7b55-414c-93c0-42ea642ed06a tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:42.999030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2466f80b-7b55-414c-93c0-42ea642ed06a tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:43.422927 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2466f80b-7b55-414c-93c0-42ea642ed06a tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 61 microversion: 2.1 time: 0.538951 Oct 12 08:53:43.423951 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1266/2399] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:53:42 2022] PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 61 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:43.434918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-598fa0d3-ff54-462c-a25d-87cbc0367a49 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Calling method '.version_select at 0x7f984cd70430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:43.501985 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-598fa0d3-ff54-462c-a25d-87cbc0367a49 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 61 microversion: 2.1 time: 0.072442 Oct 12 08:53:43.502560 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1134/2400] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:53:43 2022] GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 61 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:43.513922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35064a04-6eb7-43fd-ac95-bc1553a80fb7 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'update_all', calling method: .version_select at 0x7f9848a61a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:43.595845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-35064a04-6eb7-43fd-ac95-bc1553a80fb7 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:43.603146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-35064a04-6eb7-43fd-ac95-bc1553a80fb7 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:43.834789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:43.835531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:43.852191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:43.853064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:43.870615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:43.877969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:43.884456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:43.886269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:43.960915 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-35064a04-6eb7-43fd-ac95-bc1553a80fb7 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 61 microversion: 2.1 time: 0.451498 Oct 12 08:53:43.963170 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1267/2401] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:53:43 2022] PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 61 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:43.986190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-435e2e45-5853-4c04-9411-b521c2052511 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'update_all', calling method: .version_select at 0x7f9843f6e310>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:44.056476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-435e2e45-5853-4c04-9411-b521c2052511 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:44.094576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-435e2e45-5853-4c04-9411-b521c2052511 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:44.751639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:44.788496 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b45ec139-101b-4cc6-83d5-a1447925c176 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1328 microversion: 2.1 time: 0.952524 Oct 12 08:53:44.792161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1135/2402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:43 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1328 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:44.949629 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-435e2e45-5853-4c04-9411-b521c2052511 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 64 microversion: 2.1 time: 0.978548 Oct 12 08:53:44.959443 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1268/2403] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:53:43 2022] PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 64 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:44.964234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e9328a8-af4f-422a-bc56-32730185ce89 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Calling method '.version_select at 0x7f984cd70c10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:45.064868 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e9328a8-af4f-422a-bc56-32730185ce89 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 64 microversion: 2.1 time: 0.105009 Oct 12 08:53:45.066013 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1136/2404] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:53:44 2022] GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 64 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:45.077009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe2b2223-7080-4653-8095-0568fe89c992 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'update_all', calling method: .version_select at 0x7f98488973a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:45.199495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-fe2b2223-7080-4653-8095-0568fe89c992 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:45.214585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-fe2b2223-7080-4653-8095-0568fe89c992 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:45.828172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:45.828804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:45.848285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:45.848810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:45.849261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:45.859336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:45.859934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:45.860481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:45.963468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe2b2223-7080-4653-8095-0568fe89c992 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 61 microversion: 2.1 time: 0.890980 Oct 12 08:53:45.964422 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1269/2405] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:53:45 2022] PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 61 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:45.982674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d15ce791-1325-4901-b3e8-1f04aa7d30ad tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'update', calling method: .version_select at 0x7f9843fa88b0>, body: {"meta": {"os_version": "alt"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:46.104280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d15ce791-1325-4901-b3e8-1f04aa7d30ad tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:46.120423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d15ce791-1325-4901-b3e8-1f04aa7d30ad tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:46.713962 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d15ce791-1325-4901-b3e8-1f04aa7d30ad tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.740447 Oct 12 08:53:46.715144 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1270/2406] 10.222.0.40 () {60 vars in 1313 bytes} [Wed Oct 12 08:53:45 2022] PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata/os_version => generated 31 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:46.724772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "05ea04e3-01a9-4d9e-9a80-67f2eae348fd"}], "security_groups": [{"name": "tempest-securitygroup--863344191"}], "key_name": "tempest-keypair-867344562", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:46.952285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] validate_networks() for [('05ea04e3-01a9-4d9e-9a80-67f2eae348fd', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:53:47.069455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:47.079103 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12420709-bee3-498f-809c-71c8ffa96f06 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1508 microversion: 2.1 time: 1.264005 Oct 12 08:53:47.082945 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1137/2407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:45 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1508 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:47.089152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9e3855c-b07f-407a-9dc6-2c5314d48e58 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Calling method '.version_select at 0x7f984cd084c0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:47.172899 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9e3855c-b07f-407a-9dc6-2c5314d48e58 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 58 microversion: 2.1 time: 0.088812 Oct 12 08:53:47.173755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1138/2408] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:53:47 2022] GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 58 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:47.186592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:47.193452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:47.216332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:47.216824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:47.217259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:47.218001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:47.218447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:47.218900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:47.714584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:47.724829 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a53c75f-6efd-4cba-9e7b-f32502b8cf61 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1508 microversion: 2.1 time: 0.542498 Oct 12 08:53:47.728750 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1139/2409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:47 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1508 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:47.752415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-11d655b4-543e-4aff-993c-12ab8818d033 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'update_all', calling method: .version_select at 0x7f984cdba5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:47.938823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-11d655b4-543e-4aff-993c-12ab8818d033 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:47.959123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-11d655b4-543e-4aff-993c-12ab8818d033 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:48.724779 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-11d655b4-543e-4aff-993c-12ab8818d033 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 61 microversion: 2.1 time: 0.992393 Oct 12 08:53:48.734656 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1140/2410] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:53:47 2022] PUT /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 61 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:48.740551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:48.741267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:48.759934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:48.760676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:48.761261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:48.762639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:48.763302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:48.764274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:48.830859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:53:48.846932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:53:48.848058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:53:48.848736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:53:48.849359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:53:48.850665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:53:48.885360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:48.887181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:48.889924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:48.891121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:48.900077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:48.901044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:48.944348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Getting quotas for project cdd691de25004ed7830feb606255332b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:48.959187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Getting quotas for user cec3cf3ce9754f5ab926cb97accf6c10 and project cdd691de25004ed7830feb606255332b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:48.989809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:53:49.001292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:53:49.030819 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45b3447e-b317-4a89-9bcd-8671f7ba985d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 204 len: 0 microversion: 2.1 time: 0.293458 Oct 12 08:53:49.032957 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1141/2411] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:53:48 2022] DELETE /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:53:49.056640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01f6eafb-eb4e-429c-a459-74371728dc94"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:49.069931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:49.081421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:49.082207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:49.086889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:49.088131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:49.088761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:49.089600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:49.212454 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-924a9bbf-c90c-47e3-85a5-b2cf89191a44 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.496125 Oct 12 08:53:49.228899 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1271/2412] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:53:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 2513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:53:49.263346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-789459b2-438d-46aa-abfb-02ddb3159631 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Action: 'create', calling method: .version_select at 0x7f9843fa8820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:49.401412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-789459b2-438d-46aa-abfb-02ddb3159631 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:49.431705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-789459b2-438d-46aa-abfb-02ddb3159631 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Getting quotas for user 3ca3a549b3e94a959aacc4c7a2cf3351 and project 1099075b3c2d4a40876e4b66d4c4ea0d. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:50.210896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-789459b2-438d-46aa-abfb-02ddb3159631 tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "POST /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 85 microversion: 2.1 time: 0.978018 Oct 12 08:53:50.212135 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1272/2413] 10.222.0.40 () {60 vars in 1281 bytes} [Wed Oct 12 08:53:49 2022] POST /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 85 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:50.219363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:50.221385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:50.237579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:50.239471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:50.241300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:50.246134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:50.246620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:50.247069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:50.636309 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae579eb8-5d4f-4c0a-a9d6-75b2d7952be4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "POST /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.599445 Oct 12 08:53:50.642392 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1142/2414] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 08:53:49 2022] POST /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments => generated 194 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:50.683697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:50.684223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:50.685305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:50.704316 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-32c4f450-5f16-4a31-9d63-f54d63f3a0ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1514 microversion: 2.1 time: 0.490906 Oct 12 08:53:50.705487 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1273/2415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:50 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1514 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:50.711724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e3d0dbb-599b-4947-896a-705d2d17276e tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] Calling method '.version_select at 0x7f9848861310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:50.739380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:50.757244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:50.764262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:50.772407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:50.779681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:50.784640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:50.894224 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e3d0dbb-599b-4947-896a-705d2d17276e tempest-ImagesMetadataTestJSON-1611016737 tempest-ImagesMetadataTestJSON-1611016737-project] 10.222.0.40 "GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata" status: 200 len: 85 microversion: 2.1 time: 0.186980 Oct 12 08:53:50.895067 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1274/2416] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:53:50 2022] GET /compute/v2.1/images/3b5a5efe-ce2d-433a-9cf0-2058f3f6e733/metadata => generated 85 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:53:51.148584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:51.151401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:51.169017 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5888fbbc-b1ae-41a9-84b7-0a1cd6d85202 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1221 microversion: 2.1 time: 0.498289 Oct 12 08:53:51.169930 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1143/2417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:50 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1221 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:51.739599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:51.740290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:51.766825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:51.770867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:51.771462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:51.774702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:51.777856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:51.781431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:52.208060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:52.210281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:52.267998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:52.269340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:52.271052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:52.275326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:52.277578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:52.279298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:52.696856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:52.708443 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f788baef-1226-4d93-812a-d0acdba449bb tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1283 microversion: 2.1 time: 0.512051 Oct 12 08:53:52.709776 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1144/2418] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:52 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1283 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:52.742013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:52.775644 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed8fb5ce-5406-48b2-be2e-edcdcf3a526e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1514 microversion: 2.1 time: 1.042024 Oct 12 08:53:52.776393 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1275/2419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:51 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1514 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:52.863906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-27bfa78b-3cda-4fee-bbcb-72e345541528 req-e254f91b-0112-4811-a541-1c3e15877118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0075c4-c98b-4f57-8761-d05545c78f1a", "name": "network-vif-deleted", "tag": "900f5367-3ea6-414e-a9da-7444f8668467"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:52.899410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-27bfa78b-3cda-4fee-bbcb-72e345541528 req-e254f91b-0112-4811-a541-1c3e15877118 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:52.904082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-27bfa78b-3cda-4fee-bbcb-72e345541528 req-e254f91b-0112-4811-a541-1c3e15877118 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:52.905529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-27bfa78b-3cda-4fee-bbcb-72e345541528 req-e254f91b-0112-4811-a541-1c3e15877118 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:52.951511 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-27bfa78b-3cda-4fee-bbcb-72e345541528 req-e254f91b-0112-4811-a541-1c3e15877118 service nova] Creating event network-vif-deleted:900f5367-3ea6-414e-a9da-7444f8668467 for instance 8c0075c4-c98b-4f57-8761-d05545c78f1a on n-h1-858383-10 Oct 12 08:53:52.970710 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-27bfa78b-3cda-4fee-bbcb-72e345541528 req-e254f91b-0112-4811-a541-1c3e15877118 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112591 Oct 12 08:53:52.977187 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1145/2420] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:53.736806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:53.737644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:53.741613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:53.761317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:53.762100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:53.762660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:53.763531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:53.764438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:53.764979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:53.801001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:53.802267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:53.828663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:53.831608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:53.835837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:53.838518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:53.839125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:53.839676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:53.919153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:53.943918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:53.944740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:53.945489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:53.946185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'fault' on Instance uuid 8c0075c4-c98b-4f57-8761-d05545c78f1a {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:53:54.029202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:54.050563 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dac767a9-98a3-4338-ad2d-146b5be034ef tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1283 microversion: 2.1 time: 0.317363 Oct 12 08:53:54.053681 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1276/2421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:53 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1283 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:53:54.223986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:54.240517 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7d90d254-09ac-43ee-93de-1111e6bbc9ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 200 len: 1318 microversion: 2.1 time: 0.438674 Oct 12 08:53:54.241552 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1146/2422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:53 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:54.661081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e2d95ae-d47a-47a6-b1c6-a212a67b5c9d"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:54.665236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:54.673155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:54.673968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:54.674562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:54.675448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:54.676727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:54.677374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:55.080307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:55.081178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:55.107808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:55.109635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:55.111179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:55.115815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:55.117560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:55.121917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:55.222700 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-192e4041-9cfc-4345-9aa2-abde1f099d8f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "POST /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.565683 Oct 12 08:53:55.250043 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1277/2423] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 08:53:54 2022] POST /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 194 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:53:55.283208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:55.290290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:55.318134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:55.324097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:55.326010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:55.329825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:55.335843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:55.336485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:55.414398 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a HTTP/1.1 Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '8c0075c4-c98b-4f57-8761-d05545c78f1a'} Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:55.416640 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:55.420776 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:55.420776 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:55.420776 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:55.420776 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:55.420776 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:53:55.420776 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:55.426734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:55.435094 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-64b60b6f-27b1-4b37-89ef-2d1d0e9f2469 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 404 len: 111 microversion: 2.1 time: 0.170532 Oct 12 08:53:55.441258 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1278/2424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:55 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:53:55.466090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8126eb0f-b814-4cd7-b3d9-a9ab52806af2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '.version_select at 0x7f9843f6e430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:55.528924 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8126eb0f-b814-4cd7-b3d9-a9ab52806af2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-key-1046085639" status: 202 len: 0 microversion: 2.1 time: 0.082791 Oct 12 08:53:55.536000 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1279/2425] 10.222.0.40 () {58 vars in 1209 bytes} [Wed Oct 12 08:53:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1046085639 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:53:55.780433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-841173985", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5694562d-e360-435c-86bf-39f253be6d82"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:55.912209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] validate_networks() for [('5694562d-e360-435c-86bf-39f253be6d82', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:53:55.914485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:55.926999 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c609e6de-0c47-452a-abe1-0764d431466a tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.851316 Oct 12 08:53:55.945287 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1147/2426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:55 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:56.951678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:56.952342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:56.963699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:56.964182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:56.977911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:56.978778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:56.979266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:56.979701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:57.395563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:57.407186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6cf2747a-c344-42ed-ac9a-77a6a7ed4213 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.459205 Oct 12 08:53:57.410323 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1148/2427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:56 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:57.488256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:53:57.488829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:53:57.489588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:53:57.490004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:53:57.490458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:53:57.516336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:57.516994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:57.517799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:57.518706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:57.522970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:57.523607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:57.583194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:53:57.595971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:53:57.632309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:53:57.640113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:53:57.774986 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aac4acee-7aeb-40e1-8417-603423278c9a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.999075 Oct 12 08:53:57.781710 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1280/2428] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:53:57.789276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a7946ada-0842-40da-99a5-d248f3f7797b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:57.789945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a7946ada-0842-40da-99a5-d248f3f7797b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:57.876818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1118adad-69b1-4cfa-86ed-1e39324e3d80 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Calling method '.version_select at 0x7f984cd08dc0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:57.936299 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-1118adad-69b1-4cfa-86ed-1e39324e3d80 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] HTTP exception thrown: Image not found. Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1118adad-69b1-4cfa-86ed-1e39324e3d80 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Request method failure captured: Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/9661a274-b603-498d-bb14-2b10cfdd839e/metadata/os_distro HTTP/1.1 Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCkIgQATYE2MGPPXHI5Euo3CrwvgEYJ4TyvDHQF6BaHzp7mVxIhHoRcmBS37rGYWp1r-qF70aFWXOYZ3XCeYgVR05d7W1bQMJ40_UZGsN8DQOyUMAWJzX2XcuD-6IiFsGzIRi0N8N40zGT897pHSkG40RUYThHiB_oNGpf_U4k95WA Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}] Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3183b4d9d461401f8c77118d3d7f4a51 Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'image_id': '9661a274-b603-498d-bb14-2b10cfdd839e', 'id': 'os_distro'} Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9661a274-b603-498d-bb14-2b10cfdd839e Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:53:57.946468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9661a274-b603-498d-bb14-2b10cfdd839e could not be found. Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1118adad-69b1-4cfa-86ed-1e39324e3d80 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1118adad-69b1-4cfa-86ed-1e39324e3d80 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] 10.222.0.40 "DELETE /compute/v2.1/images/9661a274-b603-498d-bb14-2b10cfdd839e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.536608 Oct 12 08:53:57.950408 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1149/2429] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 12 08:53:57 2022] DELETE /compute/v2.1/images/9661a274-b603-498d-bb14-2b10cfdd839e/metadata/os_distro => generated 62 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:53:57.960079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c04f980-4f8a-4534-b6b5-0fdc19152134 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Calling method '.version_select at 0x7f984ccf8820>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:58.004027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=12 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:53:58.051475 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-6c04f980-4f8a-4534-b6b5-0fdc19152134 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] HTTP exception thrown: Image not found. Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c04f980-4f8a-4534-b6b5-0fdc19152134 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Request method failure captured: Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/images/853eeb65-520f-4507-a375-ee2757a87cde/metadata/os_version HTTP/1.1 Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCkIgQATYE2MGPPXHI5Euo3CrwvgEYJ4TyvDHQF6BaHzp7mVxIhHoRcmBS37rGYWp1r-qF70aFWXOYZ3XCeYgVR05d7W1bQMJ40_UZGsN8DQOyUMAWJzX2XcuD-6IiFsGzIRi0N8N40zGT897pHSkG40RUYThHiB_oNGpf_U4k95WA Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}] Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3183b4d9d461401f8c77118d3d7f4a51 Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'image_id': '853eeb65-520f-4507-a375-ee2757a87cde', 'id': 'os_version'} Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 853eeb65-520f-4507-a375-ee2757a87cde Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:53:58.053867 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 853eeb65-520f-4507-a375-ee2757a87cde could not be found. Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c04f980-4f8a-4534-b6b5-0fdc19152134 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c04f980-4f8a-4534-b6b5-0fdc19152134 tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] 10.222.0.40 "GET /compute/v2.1/images/853eeb65-520f-4507-a375-ee2757a87cde/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.100089 Oct 12 08:53:58.062172 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1150/2430] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 12 08:53:57 2022] GET /compute/v2.1/images/853eeb65-520f-4507-a375-ee2757a87cde/metadata/os_version => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:53:58.072519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c63548f-f9fc-496b-bba3-c2f4e8196b7c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Calling method '.version_select at 0x7f984ccf81f0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:58.113448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a7946ada-0842-40da-99a5-d248f3f7797b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:58.121899 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-9c63548f-f9fc-496b-bba3-c2f4e8196b7c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] HTTP exception thrown: Image not found. Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c63548f-f9fc-496b-bba3-c2f4e8196b7c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Request method failure captured: Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/images/2bd66bd6-5b5d-42c4-b3e6-2e9f75d9b45f/metadata HTTP/1.1 Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCkIgQATYE2MGPPXHI5Euo3CrwvgEYJ4TyvDHQF6BaHzp7mVxIhHoRcmBS37rGYWp1r-qF70aFWXOYZ3XCeYgVR05d7W1bQMJ40_UZGsN8DQOyUMAWJzX2XcuD-6IiFsGzIRi0N8N40zGT897pHSkG40RUYThHiB_oNGpf_U4k95WA Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}] Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3183b4d9d461401f8c77118d3d7f4a51 Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'image_id': '2bd66bd6-5b5d-42c4-b3e6-2e9f75d9b45f'} Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2bd66bd6-5b5d-42c4-b3e6-2e9f75d9b45f Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:53:58.123976 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2bd66bd6-5b5d-42c4-b3e6-2e9f75d9b45f could not be found. Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:53:58.127812 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.132053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c63548f-f9fc-496b-bba3-c2f4e8196b7c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:58.135618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a7946ada-0842-40da-99a5-d248f3f7797b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1208 microversion: 2.1 time: 0.345833 Oct 12 08:53:58.140295 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c63548f-f9fc-496b-bba3-c2f4e8196b7c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] 10.222.0.40 "GET /compute/v2.1/images/2bd66bd6-5b5d-42c4-b3e6-2e9f75d9b45f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.076854 Oct 12 08:53:58.142796 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1281/2431] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:57 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1208 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:58.144953 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1151/2432] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:53:58 2022] GET /compute/v2.1/images/2bd66bd6-5b5d-42c4-b3e6-2e9f75d9b45f/metadata => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:53:58.168552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dc8b59ea-7947-45de-a442-f367e1bdc76f tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Action: 'update_all', calling method: .version_select at 0x7f9843fc0160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:58.278110 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-dc8b59ea-7947-45de-a442-f367e1bdc76f tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] HTTP exception thrown: Image not found. Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dc8b59ea-7947-45de-a442-f367e1bdc76f tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Request method failure captured: Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/images/a95b7715-eeef-444c-8499-e4bf5efbd753/metadata HTTP/1.1 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 57 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCkIgQATYE2MGPPXHI5Euo3CrwvgEYJ4TyvDHQF6BaHzp7mVxIhHoRcmBS37rGYWp1r-qF70aFWXOYZ3XCeYgVR05d7W1bQMJ40_UZGsN8DQOyUMAWJzX2XcuD-6IiFsGzIRi0N8N40zGT897pHSkG40RUYThHiB_oNGpf_U4k95WA Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}] Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3183b4d9d461401f8c77118d3d7f4a51 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: exception: Image not found. Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'image_id': 'a95b7715-eeef-444c-8499-e4bf5efbd753', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a95b7715-eeef-444c-8499-e4bf5efbd753 Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:53:58.283558 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a95b7715-eeef-444c-8499-e4bf5efbd753 could not be found. Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dc8b59ea-7947-45de-a442-f367e1bdc76f tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Returning 404 to user: Image not found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dc8b59ea-7947-45de-a442-f367e1bdc76f tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] 10.222.0.40 "PUT /compute/v2.1/images/a95b7715-eeef-444c-8499-e4bf5efbd753/metadata" status: 404 len: 62 microversion: 2.1 time: 0.128100 Oct 12 08:53:58.293614 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1282/2433] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:53:58 2022] PUT /compute/v2.1/images/a95b7715-eeef-444c-8499-e4bf5efbd753/metadata => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:53:58.302400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d55dc755-bbfb-409d-8ca4-c6ab40132eac tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Action: 'update', calling method: .version_select at 0x7f984ccf8a60>, body: {"meta": {"os_distro": "alt"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:58.347995 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d55dc755-bbfb-409d-8ca4-c6ab40132eac tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] HTTP exception thrown: Image not found. Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d55dc755-bbfb-409d-8ca4-c6ab40132eac tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Request method failure captured: Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/images/97ddafd5-b487-49ed-bd90-f13d5f5f23c5/metadata/os_distro HTTP/1.1 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 30 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCkIgQATYE2MGPPXHI5Euo3CrwvgEYJ4TyvDHQF6BaHzp7mVxIhHoRcmBS37rGYWp1r-qF70aFWXOYZ3XCeYgVR05d7W1bQMJ40_UZGsN8DQOyUMAWJzX2XcuD-6IiFsGzIRi0N8N40zGT897pHSkG40RUYThHiB_oNGpf_U4k95WA Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}] Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3183b4d9d461401f8c77118d3d7f4a51 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: {"meta": {"os_distro": "alt"}} Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'image_id': '97ddafd5-b487-49ed-bd90-f13d5f5f23c5', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 97ddafd5-b487-49ed-bd90-f13d5f5f23c5 Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:53:58.350283 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 97ddafd5-b487-49ed-bd90-f13d5f5f23c5 could not be found. Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:53:58.354513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.370035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d55dc755-bbfb-409d-8ca4-c6ab40132eac tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:58.377167 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d55dc755-bbfb-409d-8ca4-c6ab40132eac tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] 10.222.0.40 "PUT /compute/v2.1/images/97ddafd5-b487-49ed-bd90-f13d5f5f23c5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.082603 Oct 12 08:53:58.389966 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1152/2434] 10.222.0.40 () {60 vars in 1310 bytes} [Wed Oct 12 08:53:58 2022] PUT /compute/v2.1/images/97ddafd5-b487-49ed-bd90-f13d5f5f23c5/metadata/os_distro => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:53:58.401826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ccce9c7d-90a0-474c-9ea3-095c6d5ddb8c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Action: 'create', calling method: .version_select at 0x7f9843ee9550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:53:58.433668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:58.434695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:58.465694 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-ccce9c7d-90a0-474c-9ea3-095c6d5ddb8c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] HTTP exception thrown: Image not found. Oct 12 08:53:58.468372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:58.470389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ccce9c7d-90a0-474c-9ea3-095c6d5ddb8c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Request method failure captured: Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/images/d75086fa-8b2c-41f4-84cd-46777ad0aa04/metadata HTTP/1.1 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 57 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCkIgQATYE2MGPPXHI5Euo3CrwvgEYJ4TyvDHQF6BaHzp7mVxIhHoRcmBS37rGYWp1r-qF70aFWXOYZ3XCeYgVR05d7W1bQMJ40_UZGsN8DQOyUMAWJzX2XcuD-6IiFsGzIRi0N8N40zGT897pHSkG40RUYThHiB_oNGpf_U4k95WA Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96e6b3e4327e48c3b30e950e7f5422ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96e6b3e4327e48c3b30e950e7f5422ae"}]}] Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 96e6b3e4327e48c3b30e950e7f5422ae Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3183b4d9d461401f8c77118d3d7f4a51 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1000462968-project Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: exception: Image not found. Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'image_id': 'd75086fa-8b2c-41f4-84cd-46777ad0aa04', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d75086fa-8b2c-41f4-84cd-46777ad0aa04 Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 08:53:58.470960 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d75086fa-8b2c-41f4-84cd-46777ad0aa04 could not be found. Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:53:58.474898 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:53:58.481377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:58.481767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ccce9c7d-90a0-474c-9ea3-095c6d5ddb8c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] Returning 404 to user: Image not found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:53:58.482648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:53:58.483739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ccce9c7d-90a0-474c-9ea3-095c6d5ddb8c tempest-ImagesMetadataNegativeTestJSON-1000462968 tempest-ImagesMetadataNegativeTestJSON-1000462968-project] 10.222.0.40 "POST /compute/v2.1/images/d75086fa-8b2c-41f4-84cd-46777ad0aa04/metadata" status: 404 len: 62 microversion: 2.1 time: 0.086924 Oct 12 08:53:58.485124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:53:58.488968 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1283/2435] 10.222.0.40 () {60 vars in 1281 bytes} [Wed Oct 12 08:53:58 2022] POST /compute/v2.1/images/d75086fa-8b2c-41f4-84cd-46777ad0aa04/metadata => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:53:58.490008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:53:59.170980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8b96297-9a6e-493c-9ba7-ebdd417dedee tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:53:59.171775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c8b96297-9a6e-493c-9ba7-ebdd417dedee tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:53:59.307569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:59.325595 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-358d47fd-ccf8-4056-9e0d-30d2b1e3e848 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.897333 Oct 12 08:53:59.328181 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1153/2436] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:58 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:53:59.961038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c8b96297-9a6e-493c-9ba7-ebdd417dedee tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:53:59.984477 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c8b96297-9a6e-493c-9ba7-ebdd417dedee tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1208 microversion: 2.1 time: 0.820068 Oct 12 08:53:59.988836 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1284/2437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:53:59 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1208 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:00.349779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:00.350414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:00.364299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:00.364821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:00.365261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:00.366122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:00.391194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:00.392032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:01.016093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:01.016827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:01.030926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:01.031536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:01.033804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:01.034788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:01.035429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:01.036859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:01.175414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:01.189314 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-087cc985-957b-4430-ab58-33ad908923d4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1266 microversion: 2.1 time: 0.174479 Oct 12 08:54:01.193861 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1285/2438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:01 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:01.879821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6784a09f-f260-4075-9c9a-517ec9b64535 req-afb9e75a-1fdd-44f0-a58d-a19d050e0f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a5c393-6cbb-47cf-95c1-f3aea250be94", "tag": "d49f8b56-744d-4ea9-bbe9-1885d2f42af6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:01.903863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6784a09f-f260-4075-9c9a-517ec9b64535 req-afb9e75a-1fdd-44f0-a58d-a19d050e0f86 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:01.904963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6784a09f-f260-4075-9c9a-517ec9b64535 req-afb9e75a-1fdd-44f0-a58d-a19d050e0f86 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:01.905653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6784a09f-f260-4075-9c9a-517ec9b64535 req-afb9e75a-1fdd-44f0-a58d-a19d050e0f86 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:01.934066 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6784a09f-f260-4075-9c9a-517ec9b64535 req-afb9e75a-1fdd-44f0-a58d-a19d050e0f86 service nova] Creating event network-changed:d49f8b56-744d-4ea9-bbe9-1885d2f42af6 for instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 on n-h2-858383-10 Oct 12 08:54:01.943523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6784a09f-f260-4075-9c9a-517ec9b64535 req-afb9e75a-1fdd-44f0-a58d-a19d050e0f86 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067603 Oct 12 08:54:01.946602 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1286/2439] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:54:02.221118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:02.224867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:02.238043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:02.249219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:02.249748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:02.253610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:02.254301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:02.254751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:02.594807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:02.603607 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-92df87b8-6ac9-46e0-96ab-06b27cfa98e7 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 2.258997 Oct 12 08:54:02.604197 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1154/2440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:00 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:02.725812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:02.768681 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6daa628-98ec-4db5-8498-588eaeac175c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1308 microversion: 2.1 time: 0.546243 Oct 12 08:54:02.771521 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1287/2441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:02 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1308 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:03.466788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1241250938", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "2f204459-03a5-4e90-a59a-2dbecd872d0d"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:03.584877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1199946011", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "a89cb8de-3356-4d1b-a516-3c348eab6ff9"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:03.586121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] validate_networks() for [('2f204459-03a5-4e90-a59a-2dbecd872d0d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:03.688662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] validate_networks() for [('a89cb8de-3356-4d1b-a516-3c348eab6ff9', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:04.952625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:04.953856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:04.954522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:04.955142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:04.955702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:04.973752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:04.977834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:04.979765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:04.980754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:04.988079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:04.991005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:05.054878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=47 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:05.066780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for project f77355ddeba541b189e41cb089a07eba. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:05.086270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for user 3662e9666cc14f80a5ea16670a6f1595 and project f77355ddeba541b189e41cb089a07eba. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:05.143259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:05.151599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:05.263668 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ecafba8-8c02-4cfd-b7a6-498856b37a58 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858001 Oct 12 08:54:05.264332 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1288/2442] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:54:05.288310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:05.288961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:05.308050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:05.308782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:05.309381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:05.310326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:05.313033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:05.316599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:05.716502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:05.731313 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38d3ee88-237d-4b5f-a96c-42c88828cc97 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.455982 Oct 12 08:54:05.734157 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1289/2443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:05 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:05.741412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:05.744465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:05.761316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:05.764764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:05.766532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:05.767529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:05.770031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:05.770708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:05.926720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:05.927317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:05.927595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:05.928001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:05.928412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:05.948470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:05.948963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:05.949392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:05.960112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:05.961000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:05.961650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:06.043388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:06.066426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for user 3571292391094d83901f21ccb18ec2d8 and project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:06.142039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:06.156045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:06.184510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:06.198138 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f336c075-7c31-4c3b-b12a-974443fc9df6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1308 microversion: 2.1 time: 0.459864 Oct 12 08:54:06.199555 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1290/2444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:05 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:06.306061 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b35b467-7e40-4b8c-bee1-8922857c12b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.255103 Oct 12 08:54:06.314275 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1155/2445] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:54:06.339902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:06.340961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:06.422260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:06.426171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:06.437615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:06.445596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:06.456247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:06.460953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:06.528275 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-83dc02b8-325a-48b5-afb3-87ff653cc675 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] 10.222.0.40 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.327411 Oct 12 08:54:06.541268 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1291/2446] 10.222.0.40 () {58 vars in 1128 bytes} [Wed Oct 12 08:54:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 08:54:06.572324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a435bbe-5d20-4bdc-a2d0-a919589ebb82 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:06.573631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a435bbe-5d20-4bdc-a2d0-a919589ebb82 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:06.716556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0a435bbe-5d20-4bdc-a2d0-a919589ebb82 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:06.744295 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a435bbe-5d20-4bdc-a2d0-a919589ebb82 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1215 microversion: 2.1 time: 0.194635 Oct 12 08:54:06.748466 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1292/2447] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:06 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:06.763949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:06.772473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5211cb9d-b4b3-43ec-998a-241308256d67 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Calling method '.version_select at 0x7f9848861040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:06.772706 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d41b88f-213d-4cf7-9198-6ef2deb30806 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1215 microversion: 2.1 time: 0.456460 Oct 12 08:54:06.773086 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1156/2448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:06 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1215 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:06.793025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8c507283-afd6-4ed2-91a1-c06587d1b35d req-08d3211b-8827-4c7d-b52a-3e5eec0943c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757ee68a-1a1a-40dd-9516-be192f1863bf", "tag": "3649455c-f917-46d3-ad36-878c465d3d6f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:06.827084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8c507283-afd6-4ed2-91a1-c06587d1b35d req-08d3211b-8827-4c7d-b52a-3e5eec0943c6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:06.827618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8c507283-afd6-4ed2-91a1-c06587d1b35d req-08d3211b-8827-4c7d-b52a-3e5eec0943c6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:06.828047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8c507283-afd6-4ed2-91a1-c06587d1b35d req-08d3211b-8827-4c7d-b52a-3e5eec0943c6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:06.831539 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-5211cb9d-b4b3-43ec-998a-241308256d67 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] HTTP exception thrown: Image not found. Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5211cb9d-b4b3-43ec-998a-241308256d67 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Request method failure captured: Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCsxJDR7RqinWg0EAjHN_XNXMZDVQCLitLIvEIpvI2po-FunldyK2mwJc0MIdq9qSv1BC7qrFupENS3v8_NzdiQbg63ocr9hz-bFUDRu1VXOUGmBgrlz7nngnJNgOHV-J1x1HuAdksrPBdIqebSIyF6y3WtED9_y87s3no2VX9a1nU Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_947505423f5441529e09d85ef6e49cbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}] Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 2c07078713c248a5ab1e47be74a53844 Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: exception: Image not found. Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '-1'} Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.834158 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:54:06.837777 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.842889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5211cb9d-b4b3-43ec-998a-241308256d67 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Returning 404 to user: Image not found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:06.844238 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5211cb9d-b4b3-43ec-998a-241308256d67 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] 10.222.0.40 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.094612 Oct 12 08:54:06.845029 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1293/2449] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Oct 12 08:54:06 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:54:06.855914 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8c507283-afd6-4ed2-91a1-c06587d1b35d req-08d3211b-8827-4c7d-b52a-3e5eec0943c6 service nova] Creating event network-changed:3649455c-f917-46d3-ad36-878c465d3d6f for instance 757ee68a-1a1a-40dd-9516-be192f1863bf on n-h1-858383-10 Oct 12 08:54:06.858499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:06.860093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:06.864685 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8c507283-afd6-4ed2-91a1-c06587d1b35d req-08d3211b-8827-4c7d-b52a-3e5eec0943c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075244 Oct 12 08:54:06.865339 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1157/2450] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:06.876310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-912653e2-dd0e-43cc-babc-d63a6968d737 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Calling method '.version_select at 0x7f984ccbc550>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:06.887424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:06.895883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:06.896666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:06.899215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:06.900892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:06.901996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:06.928377 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-912653e2-dd0e-43cc-babc-d63a6968d737 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] HTTP exception thrown: Image not found. Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-912653e2-dd0e-43cc-babc-d63a6968d737 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Request method failure captured: Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/51cb502d-ffec-4666-bf38-66902b8ff94j HTTP/1.1 Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCsxJDR7RqinWg0EAjHN_XNXMZDVQCLitLIvEIpvI2po-FunldyK2mwJc0MIdq9qSv1BC7qrFupENS3v8_NzdiQbg63ocr9hz-bFUDRu1VXOUGmBgrlz7nngnJNgOHV-J1x1HuAdksrPBdIqebSIyF6y3WtED9_y87s3no2VX9a1nU Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_947505423f5441529e09d85ef6e49cbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}] Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2c07078713c248a5ab1e47be74a53844 Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '51cb502d-ffec-4666-bf38-66902b8ff94j'} Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 51cb502d-ffec-4666-bf38-66902b8ff94j to delete Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 51cb502d-ffec-4666-bf38-66902b8ff94j could not be found. Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:06.931178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:54:06.935839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:06.939821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-912653e2-dd0e-43cc-babc-d63a6968d737 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:06.941049 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-912653e2-dd0e-43cc-babc-d63a6968d737 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] 10.222.0.40 "DELETE /compute/v2.1/images/51cb502d-ffec-4666-bf38-66902b8ff94j" status: 404 len: 62 microversion: 2.1 time: 0.074430 Oct 12 08:54:06.942718 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1158/2451] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:06 2022] DELETE /compute/v2.1/images/51cb502d-ffec-4666-bf38-66902b8ff94j => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:54:06.962362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2a710d9e-5c6a-4142-89a4-46a32730989f tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Calling method '.version_select at 0x7f984ccbcaf0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:07.001883 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2a710d9e-5c6a-4142-89a4-46a32730989f tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] HTTP exception thrown: Image not found. Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2a710d9e-5c6a-4142-89a4-46a32730989f tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Request method failure captured: Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/cd1b4c7f-8dc1-4b28-bd97-07332cf3a89e1 HTTP/1.1 Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCsxJDR7RqinWg0EAjHN_XNXMZDVQCLitLIvEIpvI2po-FunldyK2mwJc0MIdq9qSv1BC7qrFupENS3v8_NzdiQbg63ocr9hz-bFUDRu1VXOUGmBgrlz7nngnJNgOHV-J1x1HuAdksrPBdIqebSIyF6y3WtED9_y87s3no2VX9a1nU Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_947505423f5441529e09d85ef6e49cbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}] Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2c07078713c248a5ab1e47be74a53844 Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'cd1b4c7f-8dc1-4b28-bd97-07332cf3a89e1'} Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd1b4c7f-8dc1-4b28-bd97-07332cf3a89e1 to delete Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd1b4c7f-8dc1-4b28-bd97-07332cf3a89e1 could not be found. Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.004210 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:54:07.007746 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.011119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2a710d9e-5c6a-4142-89a4-46a32730989f tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:07.014241 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2a710d9e-5c6a-4142-89a4-46a32730989f tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] 10.222.0.40 "DELETE /compute/v2.1/images/cd1b4c7f-8dc1-4b28-bd97-07332cf3a89e1" status: 404 len: 62 microversion: 2.1 time: 0.056429 Oct 12 08:54:07.022322 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1159/2452] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:54:06 2022] DELETE /compute/v2.1/images/cd1b4c7f-8dc1-4b28-bd97-07332cf3a89e1 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:54:07.027948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d83c99f-70a2-43c5-9af7-3b841cc497c2 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Calling method '.version_select at 0x7f984ccbc310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:07.097864 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2d83c99f-70a2-43c5-9af7-3b841cc497c2 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] HTTP exception thrown: Image not found. Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d83c99f-70a2-43c5-9af7-3b841cc497c2 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Request method failure captured: Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/tempest-invalid-489380605 HTTP/1.1 Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCsxJDR7RqinWg0EAjHN_XNXMZDVQCLitLIvEIpvI2po-FunldyK2mwJc0MIdq9qSv1BC7qrFupENS3v8_NzdiQbg63ocr9hz-bFUDRu1VXOUGmBgrlz7nngnJNgOHV-J1x1HuAdksrPBdIqebSIyF6y3WtED9_y87s3no2VX9a1nU Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_947505423f5441529e09d85ef6e49cbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}] Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2c07078713c248a5ab1e47be74a53844 Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'tempest-invalid-489380605'} Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-489380605 to delete Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-489380605 could not be found. Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.099765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.103254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d83c99f-70a2-43c5-9af7-3b841cc497c2 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:07.109770 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d83c99f-70a2-43c5-9af7-3b841cc497c2 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] 10.222.0.40 "DELETE /compute/v2.1/images/tempest-invalid-489380605" status: 404 len: 62 microversion: 2.1 time: 0.077542 Oct 12 08:54:07.114659 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1160/2453] 10.222.0.40 () {58 vars in 1203 bytes} [Wed Oct 12 08:54:07 2022] DELETE /compute/v2.1/images/tempest-invalid-489380605 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:54:07.158118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efb83d5d-1efc-40e9-bb84-197863771be4 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Calling method '.version_select at 0x7f984cca19d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:07.243273 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-efb83d5d-1efc-40e9-bb84-197863771be4 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] HTTP exception thrown: Image not found. Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efb83d5d-1efc-40e9-bb84-197863771be4 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Request method failure captured: Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/0442b755-a440-44f7-8ee9-1e11716c6812 HTTP/1.1 Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCsxJDR7RqinWg0EAjHN_XNXMZDVQCLitLIvEIpvI2po-FunldyK2mwJc0MIdq9qSv1BC7qrFupENS3v8_NzdiQbg63ocr9hz-bFUDRu1VXOUGmBgrlz7nngnJNgOHV-J1x1HuAdksrPBdIqebSIyF6y3WtED9_y87s3no2VX9a1nU Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/947505423f5441529e09d85ef6e49cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_947505423f5441529e09d85ef6e49cbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/947505423f5441529e09d85ef6e49cbf"}]}] Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 947505423f5441529e09d85ef6e49cbf Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-799475648 Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2c07078713c248a5ab1e47be74a53844 Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-799475648-project Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '0442b755-a440-44f7-8ee9-1e11716c6812'} Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0442b755-a440-44f7-8ee9-1e11716c6812 to delete Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0442b755-a440-44f7-8ee9-1e11716c6812 could not be found. Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.248116 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 08:54:07.251792 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:07.254547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efb83d5d-1efc-40e9-bb84-197863771be4 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:07.258060 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efb83d5d-1efc-40e9-bb84-197863771be4 tempest-ImagesDeleteNegativeTestJSON-799475648 tempest-ImagesDeleteNegativeTestJSON-799475648-project] 10.222.0.40 "DELETE /compute/v2.1/images/0442b755-a440-44f7-8ee9-1e11716c6812" status: 404 len: 62 microversion: 2.1 time: 0.136483 Oct 12 08:54:07.260628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1161/2454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:07 2022] DELETE /compute/v2.1/images/0442b755-a440-44f7-8ee9-1e11716c6812 => generated 62 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:54:07.275797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:07.280107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:07.287934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:07.288890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:07.289561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:07.290611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:07.292228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:07.292843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:07.525751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:07.559622 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-debd3ba5-7fd1-4ae0-99e3-59ce1fc48bd1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.713143 Oct 12 08:54:07.560303 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1294/2455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:06 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:07.774494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d2b1f74-c3af-438b-b440-efc436a3a83f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:07.775187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d2b1f74-c3af-438b-b440-efc436a3a83f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:07.968528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d2b1f74-c3af-438b-b440-efc436a3a83f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:08.001906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d2b1f74-c3af-438b-b440-efc436a3a83f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1215 microversion: 2.1 time: 0.224466 Oct 12 08:54:08.003609 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1295/2456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:07 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:08.038421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:08.039039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:08.064003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:08.077286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:08.079147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:08.086438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:08.088631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:08.124088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:08.171873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:08.193881 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32c940d6-3c79-4169-9e49-869df6996a85 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1308 microversion: 2.1 time: 0.926063 Oct 12 08:54:08.212387 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1162/2457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:07 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1308 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:08.271177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:08.284873 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2604d52-e399-412f-95af-51a3d0b186cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1271 microversion: 2.1 time: 0.279043 Oct 12 08:54:08.285790 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1296/2458] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:08 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:08.583353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:08.584466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:08.599182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:08.600002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:08.601779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:08.604489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:08.606129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:08.607395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:09.030283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:09.031052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:09.041600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:09.047677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:09.048167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:09.048600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:09.056179 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94cc0877-3cd1-4811-8ae9-e71ad24ff3fd tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.472288 Oct 12 08:54:09.058527 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1163/2459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:08 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:09.059697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:09.060194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:09.060632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:09.078079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:09.200926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:09.217905 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d988e58e-255d-4a2c-9bf9-6aa060da2ec9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1267 microversion: 2.1 time: 0.191948 Oct 12 08:54:09.218513 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1297/2460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:09 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:09.231962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:09.236713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:09.246270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:09.249281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:09.251382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:09.252540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:09.259974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:09.261009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:09.313465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:09.314067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:09.324492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:09.324983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:09.325425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:09.326149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:09.326596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:09.327052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:09.444180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:09.454585 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a970c716-9456-48bf-afa3-4eb087affbee tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1269 microversion: 2.1 time: 0.145656 Oct 12 08:54:09.455155 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1298/2461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:09 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:09.553866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:09.563014 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-88752e44-7449-4e1f-9e5d-30bd4c06a945 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1308 microversion: 2.1 time: 0.346467 Oct 12 08:54:09.579017 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1164/2462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:09 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:10.086516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:10.087165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:10.102676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:10.103177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:10.103611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:10.114538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:10.118394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:10.119014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:10.244544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:10.245262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:10.269750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:10.270251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:10.270688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:10.271402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:10.271846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:10.308892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:10.531208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:10.543440 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55c910e7-9f2d-4a4b-b9dd-2e625dbe5c62 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.464343 Oct 12 08:54:10.547544 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1299/2463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:10 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:10.558488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:10.559323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:10.576334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:10.577043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:10.578804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:10.582813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:10.584765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:10.586068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:10.692424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:10.704998 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac164a99-97f7-4603-9e98-18e716b9628d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1267 microversion: 2.1 time: 0.464495 Oct 12 08:54:10.705622 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1165/2464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:10 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1267 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:10.710207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:10.710818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:10.735147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:10.735893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:10.736656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:10.738253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:10.738860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:10.743079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:11.132697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:11.142044 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3813f914-2bce-4def-9c08-9c5a6ac607fd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.593169 Oct 12 08:54:11.160173 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1300/2465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:10 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:11.176655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:11.180381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:11.198086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:11.200955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:11.201548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:11.203376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:11.205728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:11.208606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:11.229625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:11.249936 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-def66cb5-9814-4fb8-b8cd-d3cfbc506efe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1308 microversion: 2.1 time: 0.542031 Oct 12 08:54:11.267001 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1166/2466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:10 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:11.568267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:11.568882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:11.584047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:11.584630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:11.585070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:11.585814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:11.586278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:11.586692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:11.634800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:11.647278 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f33b88f9-b733-4215-8667-9ecf2fb3578d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.485463 Oct 12 08:54:11.649932 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1301/2467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:11 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:11.676565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1304435239"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:11.679570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:11.696115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:11.697114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:11.697788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:11.698704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:11.699368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:11.700000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.028536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-914b516c-eabc-44fa-bb4a-37ff0a11b0c0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.355614 Oct 12 08:54:12.030121 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1302/2468] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:54:11 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 12 08:54:12.043047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:12.044220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:12.060998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.063782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.064583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.069606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.070592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.071238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.490583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:12.502193 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-51a3eb33-0bac-4841-85f3-04e27a814d2b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.937714 Oct 12 08:54:12.503361 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1167/2469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:11 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:12.514974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f4648b24-856b-49f3-b1e3-e2bf511b53c3 req-cdb47624-5d2f-4d0d-8210-5595ec94e28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a5c393-6cbb-47cf-95c1-f3aea250be94", "name": "network-vif-plugged", "status": "completed", "tag": "d49f8b56-744d-4ea9-bbe9-1885d2f42af6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:12.525113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f4648b24-856b-49f3-b1e3-e2bf511b53c3 req-cdb47624-5d2f-4d0d-8210-5595ec94e28b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.525866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f4648b24-856b-49f3-b1e3-e2bf511b53c3 req-cdb47624-5d2f-4d0d-8210-5595ec94e28b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.526449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f4648b24-856b-49f3-b1e3-e2bf511b53c3 req-cdb47624-5d2f-4d0d-8210-5595ec94e28b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.538780 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f4648b24-856b-49f3-b1e3-e2bf511b53c3 req-cdb47624-5d2f-4d0d-8210-5595ec94e28b service nova] Creating event network-vif-plugged:d49f8b56-744d-4ea9-bbe9-1885d2f42af6 for instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 on n-h2-858383-10 Oct 12 08:54:12.546282 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f4648b24-856b-49f3-b1e3-e2bf511b53c3 req-cdb47624-5d2f-4d0d-8210-5595ec94e28b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041312 Oct 12 08:54:12.547356 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1168/2470] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:12.575636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:12.582761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:12.594422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.595209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.595871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.596890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.597590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.598242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.757068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:12.767890 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67b436a5-ef4d-45c3-a44a-2e14d51fee89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 0.735929 Oct 12 08:54:12.772934 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1303/2471] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:12 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:12.785585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:12.786423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:12.799187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.802407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.803013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.815198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.815965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.817963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.944684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:12.956658 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-499b73d1-7afc-4452-b271-af1b1ec77ba8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.406306 Oct 12 08:54:12.957477 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1169/2472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:12 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:12.965537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:12.972061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:12.983313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.984750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.985426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:12.986402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:12.987142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:12.987817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:13.273473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:13.285033 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4759cdb-3a7b-4514-b3da-1996738f6936 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.510561 Oct 12 08:54:13.285998 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1304/2473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:12 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:13.291457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ce13a64c-d37a-43bb-952d-74c268a8495d req-851fa59c-07b9-462d-b91e-ebd4aeea3f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47229845-cf46-4d08-b972-de308074dab4", "tag": "5a595f0e-9643-433b-8ce2-5c59e9bd812a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:13.306863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:13.314055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce13a64c-d37a-43bb-952d-74c268a8495d req-851fa59c-07b9-462d-b91e-ebd4aeea3f24 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:13.314983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce13a64c-d37a-43bb-952d-74c268a8495d req-851fa59c-07b9-462d-b91e-ebd4aeea3f24 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:13.316040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:13.316780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce13a64c-d37a-43bb-952d-74c268a8495d req-851fa59c-07b9-462d-b91e-ebd4aeea3f24 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:13.331598 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7435698e-3a7a-47ec-8b9e-f6198f29c558 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1308 microversion: 2.1 time: 0.372468 Oct 12 08:54:13.333658 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1170/2474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:12 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:13.346567 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ce13a64c-d37a-43bb-952d-74c268a8495d req-851fa59c-07b9-462d-b91e-ebd4aeea3f24 service nova] Creating event network-changed:5a595f0e-9643-433b-8ce2-5c59e9bd812a for instance 47229845-cf46-4d08-b972-de308074dab4 on n-h1-858383-10 Oct 12 08:54:13.354560 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ce13a64c-d37a-43bb-952d-74c268a8495d req-851fa59c-07b9-462d-b91e-ebd4aeea3f24 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065037 Oct 12 08:54:13.356471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1305/2475] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:13.532020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:13.534021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:13.542007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:13.542501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:13.543127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:13.543986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:13.544601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:13.545025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:13.759494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:13.768883 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0107e38a-e8f6-4e34-98fb-de64a68cdab1 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1350 microversion: 2.1 time: 0.243003 Oct 12 08:54:13.769471 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1171/2476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:13 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1350 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:13.799988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:13.801226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:13.809615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:13.810113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:13.810556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:13.811372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:13.811986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:13.812422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:13.980245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:13.981083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:13.987629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:13.988303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:13.989078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:13.989978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:13.990582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:13.991158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:14.054387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:14.063563 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c16b642b-6b92-4412-8d5e-2d6ae21d8b02 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 0.267745 Oct 12 08:54:14.079469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1306/2477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:13 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:14.108875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cb5a4a7c-1be0-4b4c-bd55-746b1ce973ac req-60883a9b-be60-43cc-979b-c5495cfe911b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f1c5a2-257a-4fb3-8dd0-4062d0300446", "tag": "035941b5-8cda-4353-bdae-6e475183dc66"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:14.119379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb5a4a7c-1be0-4b4c-bd55-746b1ce973ac req-60883a9b-be60-43cc-979b-c5495cfe911b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:14.120043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb5a4a7c-1be0-4b4c-bd55-746b1ce973ac req-60883a9b-be60-43cc-979b-c5495cfe911b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:14.120750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cb5a4a7c-1be0-4b4c-bd55-746b1ce973ac req-60883a9b-be60-43cc-979b-c5495cfe911b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:14.133619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cb5a4a7c-1be0-4b4c-bd55-746b1ce973ac req-60883a9b-be60-43cc-979b-c5495cfe911b service nova] Creating event network-changed:035941b5-8cda-4353-bdae-6e475183dc66 for instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 on n-h1-858383-10 Oct 12 08:54:14.140053 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cb5a4a7c-1be0-4b4c-bd55-746b1ce973ac req-60883a9b-be60-43cc-979b-c5495cfe911b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034863 Oct 12 08:54:14.141912 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1307/2478] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:54:14.258978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:14.267506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b6f3c95e-0190-44a4-ac07-8c0e54eee305 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1688 microversion: 2.1 time: 0.291090 Oct 12 08:54:14.268090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1172/2479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:13 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1688 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:14.313422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:14.314400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:14.322968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:14.323902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:14.324949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:14.326015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:14.326656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:14.329017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:14.358823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:14.359618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:14.367770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:14.368400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:14.376711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:14.380097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:14.380613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:14.381052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:14.482870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:14.490860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13726fa0-b3b0-4c89-a3a5-06d59c473a91 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.182052 Oct 12 08:54:14.501927 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1308/2480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:14 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:14.578740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d212be32-93cf-490f-9585-af26d77ee071 req-75a1afff-989e-49f2-bf99-743742393c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757ee68a-1a1a-40dd-9516-be192f1863bf", "name": "network-vif-plugged", "status": "completed", "tag": "3649455c-f917-46d3-ad36-878c465d3d6f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:14.588975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d212be32-93cf-490f-9585-af26d77ee071 req-75a1afff-989e-49f2-bf99-743742393c27 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:14.589830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d212be32-93cf-490f-9585-af26d77ee071 req-75a1afff-989e-49f2-bf99-743742393c27 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:14.590338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d212be32-93cf-490f-9585-af26d77ee071 req-75a1afff-989e-49f2-bf99-743742393c27 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:14.602700 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d212be32-93cf-490f-9585-af26d77ee071 req-75a1afff-989e-49f2-bf99-743742393c27 service nova] Creating event network-vif-plugged:3649455c-f917-46d3-ad36-878c465d3d6f for instance 757ee68a-1a1a-40dd-9516-be192f1863bf on n-h1-858383-10 Oct 12 08:54:14.607856 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d212be32-93cf-490f-9585-af26d77ee071 req-75a1afff-989e-49f2-bf99-743742393c27 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Oct 12 08:54:14.608550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1309/2481] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:14.650507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:14.659623 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-762300dc-cfd2-4327-a061-fe7da4ec5f19 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1308 microversion: 2.1 time: 0.306581 Oct 12 08:54:14.660573 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1173/2482] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:14 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:14.797303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:14.798709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:14.812955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:14.813577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:14.815737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:14.817043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:14.817762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:14.818417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.011633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:15.026553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:15.040852 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7cbe4592-efdb-4609-9ccc-cda8665f1308 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1541 microversion: 2.1 time: 0.251711 Oct 12 08:54:15.042339 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1310/2483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:14 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1541 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:15.065419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:15.066070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:15.075224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.075850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.076435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.077234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.078146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.078640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.087323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:15.088003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:15.098989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:15.100765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.101404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.102049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.102606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.103059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.103477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.268089 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6ad34a70-47b4-4584-8640-b78e41c380a9 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207939 Oct 12 08:54:15.270773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1174/2484] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 08:54:15 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:54:15.292107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:15.292714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:15.301606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.302010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.302461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.303164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.303607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.309336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.657227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:15.671653 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c1a6f7d4-a96c-418d-b301-36fb518eb69e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1688 microversion: 2.1 time: 0.383245 Oct 12 08:54:15.682611 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1175/2485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:15 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1688 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:15.696598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:15.697892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:15.708464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.709996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.711184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.715129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.715129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.715129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.811365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:15.822983 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5616a0f4-82af-43d7-8592-12ee31891601 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 0.740310 Oct 12 08:54:15.824723 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1311/2486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:15 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:15.830231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:15.831736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:15.840991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.841744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.843072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:15.843919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:15.844513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:15.845077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:16.000921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:16.124113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:16.456626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:16.465593 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c6ddfc1-b086-46b3-ae0d-f539c970fcdc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.781434 Oct 12 08:54:16.469984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1176/2487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:15 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:16.574947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:16.589580 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6b67386e-f77d-431d-885a-3180e29b3811 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1308 microversion: 2.1 time: 0.761262 Oct 12 08:54:16.590726 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1312/2488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:15 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1308 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:16.645709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b7e951c1-e6f3-4565-bfe7-3321dd80db66 req-3bd8b674-3fb1-4b37-a6ae-003014cc0a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "name": "network-vif-unplugged", "status": "completed", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:16.664294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b7e951c1-e6f3-4565-bfe7-3321dd80db66 req-3bd8b674-3fb1-4b37-a6ae-003014cc0a20 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:16.664947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b7e951c1-e6f3-4565-bfe7-3321dd80db66 req-3bd8b674-3fb1-4b37-a6ae-003014cc0a20 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:16.666921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b7e951c1-e6f3-4565-bfe7-3321dd80db66 req-3bd8b674-3fb1-4b37-a6ae-003014cc0a20 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:16.699273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:16.699994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:16.707751 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b7e951c1-e6f3-4565-bfe7-3321dd80db66 req-3bd8b674-3fb1-4b37-a6ae-003014cc0a20 service nova] Creating event network-vif-unplugged:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:54:16.709344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:16.713199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:16.715184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:16.728272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:16.728875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:16.729349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:16.741046 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b7e951c1-e6f3-4565-bfe7-3321dd80db66 req-3bd8b674-3fb1-4b37-a6ae-003014cc0a20 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099632 Oct 12 08:54:16.743485 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1177/2489] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:54:16.866102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:16.867093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:16.876317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:16.877110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:16.877785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:16.879100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:16.879778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:16.880366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:17.061908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:17.076931 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-96780296-82e1-4a33-8fe6-525fb0c9491b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.381081 Oct 12 08:54:17.089903 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1313/2490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:16 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:17.446239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:17.448602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:17.464930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:17.465427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:17.474243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:17.475140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:17.475632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:17.481091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:17.537271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:17.587183 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7bfb0679-ba89-4ba7-b99e-74092195ccc3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146181 Oct 12 08:54:17.594526 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1314/2491] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:17 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:17.602559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:17.603409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:17.612037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:17.613023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:17.613656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:17.614907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:17.615939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:17.616526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:17.750957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:17.761230 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-048c8e7c-5422-4581-b291-a76a8d52e5eb tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 0.910789 Oct 12 08:54:17.770264 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1178/2492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:16 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:17.785944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:17.786801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:17.798247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:17.799500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:17.799954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:17.800885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:17.809641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:17.810294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:17.996803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:18.067325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:18.079935 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3246dc95-c510-46fe-8fea-8a21bc31f63c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.481952 Oct 12 08:54:18.080373 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1315/2493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:17 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:18.098408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:18.101929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:18.125213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:18.131130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:18.131805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:18.132713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:18.133339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:18.138594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:18.157987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lazy-loading 'services' on Instance uuid 68f7b507-2869-4d3b-a35a-904ac94e199c {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:54:18.455331 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3c409d07-3a69-4786-96ed-433bff985c1b tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments/01f6eafb-eb4e-429c-a459-74371728dc94" status: 202 len: 0 microversion: 2.1 time: 0.683218 Oct 12 08:54:18.456667 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1179/2494] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 08:54:17 2022] DELETE /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments/01f6eafb-eb4e-429c-a459-74371728dc94 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:54:18.472436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:18.474507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:18.495686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:18.503629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:18.508559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:18.515667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:18.516390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:18.516996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:18.870249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:18.884192 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cbcb7020-2ee1-4982-87cf-796a0053d93e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1489 microversion: 2.1 time: 0.802658 Oct 12 08:54:18.885027 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1316/2495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:18 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1489 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:18.898823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ceb090a1-1180-4a41-b053-b520b4ee5107 req-0705ea00-c57d-4398-ad8a-e9084c1b9b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a5c393-6cbb-47cf-95c1-f3aea250be94", "tag": "d49f8b56-744d-4ea9-bbe9-1885d2f42af6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:18.934560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ceb090a1-1180-4a41-b053-b520b4ee5107 req-0705ea00-c57d-4398-ad8a-e9084c1b9b4e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:18.935192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ceb090a1-1180-4a41-b053-b520b4ee5107 req-0705ea00-c57d-4398-ad8a-e9084c1b9b4e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:18.938097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ceb090a1-1180-4a41-b053-b520b4ee5107 req-0705ea00-c57d-4398-ad8a-e9084c1b9b4e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:18.974771 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ceb090a1-1180-4a41-b053-b520b4ee5107 req-0705ea00-c57d-4398-ad8a-e9084c1b9b4e service nova] Creating event network-changed:d49f8b56-744d-4ea9-bbe9-1885d2f42af6 for instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 on n-h2-858383-10 Oct 12 08:54:18.986183 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ceb090a1-1180-4a41-b053-b520b4ee5107 req-0705ea00-c57d-4398-ad8a-e9084c1b9b4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099487 Oct 12 08:54:18.989484 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1317/2496] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:19.005991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:19.006971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:19.026063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:19.041714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:19.042704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:19.044922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:19.050335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:19.052548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:19.054801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:19.056728 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fcf24467-7617-4387-9850-d797c8864ec9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.598285 Oct 12 08:54:19.057663 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1180/2497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:18 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:19.079991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-70802e64-a31b-4b49-bcd3-0c3142066767 req-dadbe316-b169-4a8f-a3ab-7c8439206443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "name": "network-vif-plugged", "status": "completed", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:19.108327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-70802e64-a31b-4b49-bcd3-0c3142066767 req-dadbe316-b169-4a8f-a3ab-7c8439206443 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:19.109071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-70802e64-a31b-4b49-bcd3-0c3142066767 req-dadbe316-b169-4a8f-a3ab-7c8439206443 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:19.109805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-70802e64-a31b-4b49-bcd3-0c3142066767 req-dadbe316-b169-4a8f-a3ab-7c8439206443 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:19.150509 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-70802e64-a31b-4b49-bcd3-0c3142066767 req-dadbe316-b169-4a8f-a3ab-7c8439206443 service nova] Creating event network-vif-plugged:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:54:19.168840 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-70802e64-a31b-4b49-bcd3-0c3142066767 req-dadbe316-b169-4a8f-a3ab-7c8439206443 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103400 Oct 12 08:54:19.181994 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1181/2498] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:19.188550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:19.208541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:19.239338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:19.245607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:19.249383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:19.255340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:19.258030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:19.258653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:19.612412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:19.625400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10e6e339-79a9-4038-9158-f9039e670c1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.439790 Oct 12 08:54:19.629075 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1182/2499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:19 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:19.638313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-841173985", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5694562d-e360-435c-86bf-39f253be6d82"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:19.774318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] validate_networks() for [('5694562d-e360-435c-86bf-39f253be6d82', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:19.847751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:19.856191 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-82486c3b-8f26-4637-bbd4-4267a554fea2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 0.863609 Oct 12 08:54:19.882745 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1318/2500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:18 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:20.391763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a64e7fcf-cdd4-44b5-9540-e2f0f74ada30"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:20.394747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:20.412272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:20.417348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:20.418190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:20.419183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:20.420175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:20.420822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:20.683591 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] HTTP exception thrown: Volume a64e7fcf-cdd4-44b5-9540-e2f0f74ada30 could not be found. Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Request method failure captured: Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments/6e2d95ae-d47a-47a6-b1c6-a212a67b5c9d HTTP/1.1 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 74 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoBP8Nr3xD8xGAlHpvWxMu4w5oe2TD53cw1_EpWxJhHx2fEXvdWDIECM3l8hcv4USyED9K6RBROCuvunHt7g77zcSxaV_szBW5d2CpbaDxlHk-27UdIvf1B7mVBkNWjBdUm0NpY_IJrKUDlwKbypKrVAONWNvMR6IxYeUkfUVqQ_xUw Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 81c675b7842c4660acb7513dfddd3119 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesAdminNegativeTest-2140583681 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81c675b7842c4660acb7513dfddd3119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81c675b7842c4660acb7513dfddd3119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81c675b7842c4660acb7513dfddd3119"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81c675b7842c4660acb7513dfddd3119"}]}] Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesAdminNegativeTest-2140583681 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 81c675b7842c4660acb7513dfddd3119 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2140583681 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesAdminNegativeTest-2140583681-project-admin Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: af56859c324b46d2b71c1fc6d7377ef2 Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesAdminNegativeTest-2140583681-project-admin Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: {"volumeAttachment": {"volumeId": "a64e7fcf-cdd4-44b5-9540-e2f0f74ada30"}} Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: exception: Volume a64e7fcf-cdd4-44b5-9540-e2f0f74ada30 could not be found. Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': 'bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814', 'id': '6e2d95ae-d47a-47a6-b1c6-a212a67b5c9d', 'body': {'volumeAttachment': {'volumeId': 'a64e7fcf-cdd4-44b5-9540-e2f0f74ada30'}}} Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a64e7fcf-cdd4-44b5-9540-e2f0f74ada30 could not be found. (HTTP 404) (Request-ID: req-1ed86389-fa43-4542-ad4d-a2bb590f50ea) Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 08:54:20.733475 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a64e7fcf-cdd4-44b5-9540-e2f0f74ada30 could not be found. Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume a64e7fcf-cdd4-44b5-9540-e2f0f74ada30 could not be found. Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a64e7fcf-cdd4-44b5-9540-e2f0f74ada30 could not be found. Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Returning 400 to user: Volume a64e7fcf-cdd4-44b5-9540-e2f0f74ada30 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a1dba7f-6cb5-4a83-a581-8306224aa88b tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments/6e2d95ae-d47a-47a6-b1c6-a212a67b5c9d" status: 400 len: 107 microversion: 2.1 time: 0.852018 Oct 12 08:54:20.737399 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1319/2501] 10.222.0.40 () {60 vars in 1433 bytes} [Wed Oct 12 08:54:19 2022] PUT /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments/6e2d95ae-d47a-47a6-b1c6-a212a67b5c9d => generated 107 bytes in 853 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:54:20.751227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:20.751908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:20.779732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:20.780240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:20.781177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:20.781411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:20.781904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:20.782336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:21.281116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:21.299870 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c74a5dd0-d665-4777-9972-056d8a30c84e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.562211 Oct 12 08:54:21.313119 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1320/2502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:20 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:21.317526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:21.321530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:21.341255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:21.343915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:21.345387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:21.347492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:21.347982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:21.348428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:21.607584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:21.619138 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88cce633-b449-492f-be29-75713a258213 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.317259 Oct 12 08:54:21.619899 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1321/2503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:21 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:21.626578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:21.627448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:21.640728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:21.640728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:21.641028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:21.641569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:21.642043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:21.642466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:21.781333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:21.781840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:21.782259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:21.782728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:21.783145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:21.817861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:21.820849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:21.821744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:21.822736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:21.825627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:21.826583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:21.869937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:21.886894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:21.917247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:21.917819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:21.922478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:21.926130 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e03174f-02d3-4d45-a57d-04c8ed776178 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 0.304214 Oct 12 08:54:21.937732 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1322/2504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:21 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:21.938248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:21.942519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:21.956821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:21.968732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:21.969387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:21.970373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:21.974489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:21.975200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:22.049244 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-405c3049-6566-426d-af80-14907eda2db9 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418618 Oct 12 08:54:22.050224 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1183/2505] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:54:22.061998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bddf3544-a6f8-48e3-8ff4-39b45dcf7efc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:22.062881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bddf3544-a6f8-48e3-8ff4-39b45dcf7efc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:22.219218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lazy-loading 'services' on Instance uuid bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:54:22.396676 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-03f55863-5150-4a1b-9ed1-3f0c84a8d8e4 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments/6e2d95ae-d47a-47a6-b1c6-a212a67b5c9d" status: 202 len: 0 microversion: 2.1 time: 0.464442 Oct 12 08:54:22.400773 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1323/2506] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 08:54:21 2022] DELETE /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments/6e2d95ae-d47a-47a6-b1c6-a212a67b5c9d => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:54:22.423676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:22.424404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:22.425525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bddf3544-a6f8-48e3-8ff4-39b45dcf7efc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:22.435543 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bddf3544-a6f8-48e3-8ff4-39b45dcf7efc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1208 microversion: 2.1 time: 0.377881 Oct 12 08:54:22.450986 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1184/2507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:22 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1208 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:22.450986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:22.450986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:22.451533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:22.451533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:22.451533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:22.451533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:22.451533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:22.451533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:22.459255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:22.459810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:22.460263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:22.461068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:22.461675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:22.462111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:22.552315 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b9fdaa0-a541-443a-961c-f817c368940d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113162 Oct 12 08:54:22.552916 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1185/2508] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:22 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:22.644512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:22.645136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:22.655103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:22.657043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:22.657593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:22.658339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:22.662966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:22.663655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:22.783355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:22.794085 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9de6daf2-0e76-4346-9373-3f6a06922fa4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.391968 Oct 12 08:54:22.810871 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1324/2509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:22 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:22.930025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:22.942314 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45f397a2-0bc1-4e4b-a9ff-622852c635c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.302149 Oct 12 08:54:22.965491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:22.966503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:22.972910 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1186/2510] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:22 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:22.975627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:22.976564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:22.977630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:22.978587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:22.979789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:22.980427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:23.204626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-760737676", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "0a41b357-9e1a-4739-bdde-df451b1badd5"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:23.311209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] validate_networks() for [('0a41b357-9e1a-4739-bdde-df451b1badd5', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:23.480550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:23.494050 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be6c3dbc-01a4-4ac4-ba5a-1b56838b6c73 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 0.533216 Oct 12 08:54:23.495945 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1325/2511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:22 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:23.516367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:23.517270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:23.549430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:23.549814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:23.550605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:23.551647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:23.552257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:23.553635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:23.740152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:23.753105 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dcc69d86-c7ee-4c85-ad33-577f4dfe9659 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1260 microversion: 2.1 time: 0.252909 Oct 12 08:54:23.761525 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1326/2512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:23 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:23.766028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:23.774902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:23.788020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:23.794037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:23.794660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:23.795951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:23.796552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:23.797092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:23.880054 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6560d60-046e-4001-a81b-8e572d3cb095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123685 Oct 12 08:54:23.887419 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1327/2513] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:23 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:23.897559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:23.898989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:23.907037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:23.907847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:23.908432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:23.909730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:23.910641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:23.911217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:24.155558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:24.156168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:24.156435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:24.156897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:24.157331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:24.159912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:24.180133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:24.189830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:24.190291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:24.191115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:24.191576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:24.192002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:24.274609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Getting quotas for project 70848fd10ea847968908b8ba3f30b907. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:24.292701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Getting quotas for user 90150a5342474fd0ad10fc853b2c5d96 and project 70848fd10ea847968908b8ba3f30b907. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:24.337693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:24.345190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:24.521935 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a3df4fe3-d9d4-4042-935f-4b09cf0541dc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.376132 Oct 12 08:54:24.527608 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1187/2514] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:54:24.560470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:24.561181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:24.591331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:24.591860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:24.592298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:24.593012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:24.597358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:24.597994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:25.304987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:25.320418 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9a57669-2cbe-4607-8a84-04f94e66d808 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 1.431482 Oct 12 08:54:25.323179 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1328/2515] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:23 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:25.334389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d4c26802-c38f-457c-adb5-facc97ac6efd req-404e0f26-7daa-45cc-807f-db10bd2d91fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47229845-cf46-4d08-b972-de308074dab4", "name": "network-vif-plugged", "status": "completed", "tag": "5a595f0e-9643-433b-8ce2-5c59e9bd812a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:25.377807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d4c26802-c38f-457c-adb5-facc97ac6efd req-404e0f26-7daa-45cc-807f-db10bd2d91fb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:25.379253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d4c26802-c38f-457c-adb5-facc97ac6efd req-404e0f26-7daa-45cc-807f-db10bd2d91fb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:25.380412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d4c26802-c38f-457c-adb5-facc97ac6efd req-404e0f26-7daa-45cc-807f-db10bd2d91fb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:25.409025 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d4c26802-c38f-457c-adb5-facc97ac6efd req-404e0f26-7daa-45cc-807f-db10bd2d91fb service nova] Creating event network-vif-plugged:5a595f0e-9643-433b-8ce2-5c59e9bd812a for instance 47229845-cf46-4d08-b972-de308074dab4 on n-h1-858383-10 Oct 12 08:54:25.426207 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d4c26802-c38f-457c-adb5-facc97ac6efd req-404e0f26-7daa-45cc-807f-db10bd2d91fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100821 Oct 12 08:54:25.433941 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1329/2516] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:25.444479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:25.445623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:25.470472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:25.474408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:25.475073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:25.478863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:25.479531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:25.480221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:25.600792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:25.612506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aff54871-132d-4192-ad1c-7517fbe637ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 1.083468 Oct 12 08:54:25.613132 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1188/2517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:24 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:25.626864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4327419b-eeab-45b2-82f7-616cafd9a4a8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:25.627728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4327419b-eeab-45b2-82f7-616cafd9a4a8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:25.740998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4327419b-eeab-45b2-82f7-616cafd9a4a8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:25.762877 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4327419b-eeab-45b2-82f7-616cafd9a4a8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1217 microversion: 2.1 time: 0.148164 Oct 12 08:54:25.779955 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1189/2518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:25 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:25.785388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:25.786342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:25.796610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:25.797691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:25.798423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:25.800989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:25.801868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:25.802586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:26.512366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:26.521031 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b20ca164-1c93-45e6-932c-611435d69e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 1.085529 Oct 12 08:54:26.525512 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1330/2519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:25 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:26.542487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:26.545131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:26.559852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:26.560544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:26.561095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:26.562156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:26.562734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:26.563275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:26.636412 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8dcb6941-a6d3-4969-a1ed-be3cfec7f10d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109540 Oct 12 08:54:26.637501 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1331/2520] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:26 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:26.645232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:26.647043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:26.656333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:26.657319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:26.657998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:26.658930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:26.659584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:26.676715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:26.682830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:26.712538 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1940c0bb-e166-469a-9bb4-92940309cb87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1308 microversion: 2.1 time: 0.929731 Oct 12 08:54:26.726064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:26.737147 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1190/2521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:25 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1308 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:26.755418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:26.756519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:26.776826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:26.782506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:26.783288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:26.784866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:26.785634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:26.786312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:26.992244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:27.032547 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf6558c5-c140-492a-824b-fd66370a54cf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.393425 Oct 12 08:54:27.036236 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1332/2522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:26 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:27.056619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:27.059381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:27.075674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.082445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.084129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.085881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.086658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.087692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.233240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:27.236095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:27.254942 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cd1e650b-bdae-4de9-962b-51fa0b214ea2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1311 microversion: 2.1 time: 0.512830 Oct 12 08:54:27.258677 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1191/2523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:26 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1311 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:27.370947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:27.400370 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e23869bf-4c9d-4f33-a6b2-14a4e89cbdae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1269 microversion: 2.1 time: 0.362627 Oct 12 08:54:27.400984 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1333/2524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:27 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1269 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:27.446519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3690cbcd-de21-4481-b5de-a7d129120927 req-62d97807-885b-494f-a03a-4e3a07360ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f1c5a2-257a-4fb3-8dd0-4062d0300446", "name": "network-vif-plugged", "status": "completed", "tag": "035941b5-8cda-4353-bdae-6e475183dc66"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:27.458919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3690cbcd-de21-4481-b5de-a7d129120927 req-62d97807-885b-494f-a03a-4e3a07360ad6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.459644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3690cbcd-de21-4481-b5de-a7d129120927 req-62d97807-885b-494f-a03a-4e3a07360ad6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.460654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3690cbcd-de21-4481-b5de-a7d129120927 req-62d97807-885b-494f-a03a-4e3a07360ad6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.480971 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3690cbcd-de21-4481-b5de-a7d129120927 req-62d97807-885b-494f-a03a-4e3a07360ad6 service nova] Creating event network-vif-plugged:035941b5-8cda-4353-bdae-6e475183dc66 for instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 on n-h1-858383-10 Oct 12 08:54:27.488390 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3690cbcd-de21-4481-b5de-a7d129120927 req-62d97807-885b-494f-a03a-4e3a07360ad6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045603 Oct 12 08:54:27.493144 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1192/2525] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:27.552270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:27.552895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:27.561473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.561991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.562426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.569535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.570049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.570520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.651276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:27.653608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:27.670222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.674587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.675281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.676287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.686292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.687035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.756654 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bfe0bf1e-4c3c-4624-aad7-da6b96c21d8c tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110144 Oct 12 08:54:27.764079 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1193/2526] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:27 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:27.776340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:27.778102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:27.795167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.795760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.796269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.797113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:27.797759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:27.798261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:27.975665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:27.983833 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ea6a65a7-689a-4ec8-b44e-5002af7d3dda tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1315 microversion: 2.1 time: 0.435441 Oct 12 08:54:27.987409 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1334/2527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:27 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:28.061627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:28.062750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:28.079169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:28.080996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:28.081679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:28.086346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:28.087111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:28.087787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:28.339630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:28.353961 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ffcc5f4c-b734-44ed-a4ec-9312e347b66b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1308 microversion: 2.1 time: 0.583643 Oct 12 08:54:28.360283 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1194/2528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:27 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1308 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:28.383254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:28.385067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:28.411350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:28.417350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:28.420648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:28.425752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:28.429612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:28.434338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:28.684266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:28.697625 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8c194061-e0fb-45bd-b6d1-a60140cf8089 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.642035 Oct 12 08:54:28.702277 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1335/2529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:28 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:28.717947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:28.718598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:28.725109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:28.727843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:28.728575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:28.734291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:28.735136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:28.736889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:29.305463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:29.317983 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cee20a9a-21bf-4346-b4ae-81c4aa94b0e6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1317 microversion: 2.1 time: 0.614090 Oct 12 08:54:29.338717 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1336/2530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:28 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:29.348624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:29.351358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:29.361680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:29.362175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:29.362614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:29.363327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:29.363782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:29.364691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:29.427960 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d42afce5-a308-42c6-bfb2-7ae47dd2e841 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087956 Oct 12 08:54:29.434391 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1337/2531] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:29 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:29.439853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:29.443204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:29.456926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:29.457423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:29.457883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:29.460836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:29.461297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:29.461762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:29.855245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:29.865855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c847ca51-ecf9-42ce-82d6-68a194291d20 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1495 microversion: 2.1 time: 1.502571 Oct 12 08:54:29.871048 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1195/2532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:28 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1495 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:29.891237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ca668c86-2899-4270-8bf7-8a3634d7ddda req-d1f040bd-c5cb-4a56-9b2a-e12afdcc9c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2764c38-ba1d-40b4-aa9f-b381bd049f04", "tag": "efe30d70-689b-4252-b845-be01fb792840"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:29.913242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ca668c86-2899-4270-8bf7-8a3634d7ddda req-d1f040bd-c5cb-4a56-9b2a-e12afdcc9c76 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:29.913749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ca668c86-2899-4270-8bf7-8a3634d7ddda req-d1f040bd-c5cb-4a56-9b2a-e12afdcc9c76 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:29.914183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ca668c86-2899-4270-8bf7-8a3634d7ddda req-d1f040bd-c5cb-4a56-9b2a-e12afdcc9c76 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:29.933347 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ca668c86-2899-4270-8bf7-8a3634d7ddda req-d1f040bd-c5cb-4a56-9b2a-e12afdcc9c76 service nova] Creating event network-changed:efe30d70-689b-4252-b845-be01fb792840 for instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 on n-h2-858383-10 Oct 12 08:54:29.951419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ca668c86-2899-4270-8bf7-8a3634d7ddda req-d1f040bd-c5cb-4a56-9b2a-e12afdcc9c76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071229 Oct 12 08:54:29.958006 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1196/2533] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:29.970516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:29.971257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:29.987161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:29.987648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:29.997898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:29.998752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:29.999224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:29.999673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.087153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:30.095701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb267991-fbef-4016-94d8-e07bf1fbe71e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1501 microversion: 2.1 time: 0.660261 Oct 12 08:54:30.098089 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1338/2534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:29 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1501 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:30.103624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:30.108810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:30.126195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.127464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.129730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.130639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.132378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.132970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.213530 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-21729570-92da-414c-bfa7-82addf371ada tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113546 Oct 12 08:54:30.214745 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1339/2535] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:30 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:54:30.219706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:30.220798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:30.228861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.229613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.230287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.231188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.231825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.232509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.404877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:30.415482 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1896736-d85b-488e-b23d-99960ccfb43e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1308 microversion: 2.1 time: 0.456097 Oct 12 08:54:30.416325 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1197/2536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:29 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:30.624927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:30.636554 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2527672-4049-487b-8f6f-169adcb0aac2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.420578 Oct 12 08:54:30.641770 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1340/2537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:30 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:30.651615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:30.652615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:30.664406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.670247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.671149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.672106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.675727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.676500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.702154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:30.702773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:30.718578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.719106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.719511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.720227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.734234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.734688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.740106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:54:30.907717 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c075b3a3-3a07-4315-81e1-18ecc6921113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 204 len: 0 microversion: 2.1 time: 0.264229 Oct 12 08:54:30.912936 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1341/2538] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:54:30 2022] DELETE /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:54:30.918523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:30.919225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:30.927378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.927782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.928544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:30.931726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:30.932573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:30.933058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.144811 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fd529404-40d0-4c0c-85a7-e0a56f303c7d tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1648 microversion: 2.1 time: 0.709774 Oct 12 08:54:31.165164 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1198/2539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:30 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1648 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:31.171155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:31.176823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:31.191622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.192399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.193458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.194339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.194942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.195562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.231043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:31.269236 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4488b651-733a-498e-93d1-dab559100fb6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1317 microversion: 2.1 time: 0.354864 Oct 12 08:54:31.269733 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-59d50f8a-df7f-47a8-a353-7bfb04ea80a6 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102738 Oct 12 08:54:31.273673 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1199/2540] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:31 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:54:31.282276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:31.286119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:31.292879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.293592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.294156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.295144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.295724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.296273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.299067 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1342/2541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:30 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:31.327024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:31.327779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:31.354176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.354709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.355152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.362324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.362813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.363247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.385670 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c82382ed-347d-4b6c-a9bf-dd7397be01bb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110422 Oct 12 08:54:31.397556 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1200/2542] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:31 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:31.414821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4dcf7bf5-f87e-41e2-b8a6-5376d8665083 req-08c710a9-1c59-4ebd-92d1-14f5463c4a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5400c2d-3481-43fa-87b9-9a1886f2dae3", "tag": "c8b07757-93d9-4bd6-bdfd-097594ad4c3e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:31.431575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4dcf7bf5-f87e-41e2-b8a6-5376d8665083 req-08c710a9-1c59-4ebd-92d1-14f5463c4a25 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.437453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4dcf7bf5-f87e-41e2-b8a6-5376d8665083 req-08c710a9-1c59-4ebd-92d1-14f5463c4a25 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.438130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4dcf7bf5-f87e-41e2-b8a6-5376d8665083 req-08c710a9-1c59-4ebd-92d1-14f5463c4a25 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.477075 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4dcf7bf5-f87e-41e2-b8a6-5376d8665083 req-08c710a9-1c59-4ebd-92d1-14f5463c4a25 service nova] Creating event network-changed:c8b07757-93d9-4bd6-bdfd-097594ad4c3e for instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 on n-h2-858383-10 Oct 12 08:54:31.482714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4dcf7bf5-f87e-41e2-b8a6-5376d8665083 req-08c710a9-1c59-4ebd-92d1-14f5463c4a25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083729 Oct 12 08:54:31.483821 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1201/2543] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:31.488912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:31.499756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:31.512377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.512888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.513368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.518317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.518991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.521290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.808504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:31.817285 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ab8f1b63-ee64-4d20-8447-b4f1a65ce437 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1507 microversion: 2.1 time: 0.515787 Oct 12 08:54:31.821755 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1343/2544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:31 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1507 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:31.837296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:31.837993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:31.849927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.850589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.851139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.851985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.852542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.853068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.913868 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf988871-96d0-4637-9c50-62f811adfec8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1648 microversion: 2.1 time: 0.428595 Oct 12 08:54:31.918482 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1202/2545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:31 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1648 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:31.919922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:54:31.931152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:31.932951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:31.957392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.957877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.958314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:31.959022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:31.959485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:31.959913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.113008 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-721413f3-0a12-4f4e-b502-40def75a79f4 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 204 len: 0 microversion: 2.1 time: 0.287975 Oct 12 08:54:32.114114 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1344/2546] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:54:31 2022] DELETE /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:54:32.150674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:32.153226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:32.174705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.175245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.175691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.176427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.176882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.177309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.238242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:32.399379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:32.410660 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8bc9cc35-ef2a-439d-afdd-4ca153f073fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1308 microversion: 2.1 time: 0.489113 Oct 12 08:54:32.411333 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1203/2547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:31 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:32.416490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8f73e6b0-5422-40f7-ae51-d9b96972c1cf tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:32.421147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f73e6b0-5422-40f7-ae51-d9b96972c1cf tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.421841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f73e6b0-5422-40f7-ae51-d9b96972c1cf tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.422437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f73e6b0-5422-40f7-ae51-d9b96972c1cf tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.423308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f73e6b0-5422-40f7-ae51-d9b96972c1cf tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.424089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f73e6b0-5422-40f7-ae51-d9b96972c1cf tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.424773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f73e6b0-5422-40f7-ae51-d9b96972c1cf tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.458867 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8f73e6b0-5422-40f7-ae51-d9b96972c1cf tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046144 Oct 12 08:54:32.467221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:32.467511 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1204/2548] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 08:54:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:32.469525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:32.469662 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-838b6212-1676-4a37-97ea-17454b2b091d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.353510 Oct 12 08:54:32.477612 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1345/2549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:32 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:32.478104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:32.483178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:32.483792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:32.487543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.488231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.489676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.490561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.491157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.491728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.499966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.500493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.500935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.503508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.503972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.504397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.727616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:32.746603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b79a621a-a11c-4502-b440-024cd5d8af51 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1682 microversion: 2.1 time: 0.281818 Oct 12 08:54:32.747775 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1205/2550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:32 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1682 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:32.754515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:32.760014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:32.769241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.770076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.770679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.772007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.774282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.774878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.796491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:32.809952 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e7ca25b-110a-4aeb-a7b9-2c3bc63b3470 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1317 microversion: 2.1 time: 0.332361 Oct 12 08:54:32.810837 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1346/2551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:32 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:32.835021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": true, "disk_over_commit": false}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:32.855366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:32.887286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.888157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.890172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.892211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.895681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.898220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.913102 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6f5c5fd3-c600-4583-98d8-5cd9b2f37c2b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163987 Oct 12 08:54:32.922394 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1206/2552] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:32 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:32.933736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:32.934600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:32.950512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.951349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.951948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.953517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:32.954123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:32.954720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:32.965026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lazy-loading 'flavor' on Instance uuid 47229845-cf46-4d08-b972-de308074dab4 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:54:32.980969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 47229845-cf46-4d08-b972-de308074dab4] Going to try to live migrate instance to n-h2-858383-10 {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:54:33.194933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:33.204278 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b25572a4-a72d-4216-9560-87ccdf29b54a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 200 len: 1507 microversion: 2.1 time: 0.280554 Oct 12 08:54:33.222822 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1207/2553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:32 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:33.443279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:33.445315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:33.460114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:33.462858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:33.463829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:33.464720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:33.466988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:33.469006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:33.986163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:34.000470 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7ac1a2b-e2ce-4b85-9b41-9a29d2a80b3a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1308 microversion: 2.1 time: 0.566659 Oct 12 08:54:34.003750 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1208/2554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:33 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1308 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:34.021369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:34.022145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:34.034583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:34.039603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:34.040168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:34.041081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:34.041792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:34.043423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:34.793651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:34.804786 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f374e596-07db-4395-9e5b-f691626c1bea tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.797947 Oct 12 08:54:34.808723 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1209/2555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:34 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:34.821909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:34.825771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:34.843066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:34.844874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:34.844874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:34.847431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:34.848098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:34.853093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:35.411376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:35.419629 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4464327f-8fd6-4e13-8c3b-18df33b2cae9 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1682 microversion: 2.1 time: 0.609368 Oct 12 08:54:35.422926 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1210/2556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:34 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1682 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:35.428941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:35.440300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:35.447435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:35.454199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:35.454789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:35.455683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:35.456242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:35.456742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:35.482997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:35.750977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:35.757916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=16 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:35.763773 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c1b2b890-8431-4eba-9437-35848f0831a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1317 microversion: 2.1 time: 0.339622 Oct 12 08:54:35.764489 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1211/2557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:35 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:35.788166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:35.790776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:35.811409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:35.812108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:35.812334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:35.815866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:35.817324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:35.818639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:35.856014 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b10644d-f72d-4a8d-8e9d-06bdcbb3aa95 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072221 Oct 12 08:54:35.861842 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1212/2558] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:35 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:35.869856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:35.871014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:35.881020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:35.882253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:35.882957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:35.883916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:35.884603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:35.885173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:35.905937 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 HTTP/1.1 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '43f1c5a2-257a-4fb3-8dd0-4062d0300446'} Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:35.909933 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:35.914707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:35.914707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:35.914707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:35.914707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:35.914707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:35.914707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:54:35.914707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:35.915123 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c7549493-c20d-451f-aee8-69431d15243e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4/action" status: 202 len: 0 microversion: 2.1 time: 3.096484 Oct 12 08:54:35.916716 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1347/2559] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:54:32 2022] POST /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4/action => generated 0 bytes in 3104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:54:35.924173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:35.925662 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf6ab406-4272-40e2-96d9-ce34dccd3879 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 404 len: 111 microversion: 2.1 time: 0.061098 Oct 12 08:54:35.926649 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1213/2560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:35 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:54:35.941950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a3573e3d-ff5e-404f-9441-72ee67eddace req-33bd7f22-f323-429c-9183-030a7c57d506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f1c5a2-257a-4fb3-8dd0-4062d0300446", "name": "network-vif-deleted", "tag": "035941b5-8cda-4353-bdae-6e475183dc66"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:35.945308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:35.946177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:35.954729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:35.955687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:35.956326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:35.957873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:35.973001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:35.973994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.012899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a3573e3d-ff5e-404f-9441-72ee67eddace req-33bd7f22-f323-429c-9183-030a7c57d506 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:36.019079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a3573e3d-ff5e-404f-9441-72ee67eddace req-33bd7f22-f323-429c-9183-030a7c57d506 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:36.026514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a3573e3d-ff5e-404f-9441-72ee67eddace req-33bd7f22-f323-429c-9183-030a7c57d506 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.079680 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a3573e3d-ff5e-404f-9441-72ee67eddace req-33bd7f22-f323-429c-9183-030a7c57d506 service nova] Creating event network-vif-deleted:035941b5-8cda-4353-bdae-6e475183dc66 for instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 on n-h1-858383-10 Oct 12 08:54:36.109630 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a3573e3d-ff5e-404f-9441-72ee67eddace req-33bd7f22-f323-429c-9183-030a7c57d506 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186985 Oct 12 08:54:36.110856 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1348/2561] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:36.138819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8b3d5a44-e040-4857-80c4-82f8f10a8eb6 req-cb410da7-84cf-4d40-b94f-c26e953c786b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2764c38-ba1d-40b4-aa9f-b381bd049f04", "name": "network-vif-plugged", "status": "completed", "tag": "efe30d70-689b-4252-b845-be01fb792840"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:36.167478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8b3d5a44-e040-4857-80c4-82f8f10a8eb6 req-cb410da7-84cf-4d40-b94f-c26e953c786b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:36.169363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8b3d5a44-e040-4857-80c4-82f8f10a8eb6 req-cb410da7-84cf-4d40-b94f-c26e953c786b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:36.170635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8b3d5a44-e040-4857-80c4-82f8f10a8eb6 req-cb410da7-84cf-4d40-b94f-c26e953c786b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.199446 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8b3d5a44-e040-4857-80c4-82f8f10a8eb6 req-cb410da7-84cf-4d40-b94f-c26e953c786b service nova] Creating event network-vif-plugged:efe30d70-689b-4252-b845-be01fb792840 for instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 on n-h2-858383-10 Oct 12 08:54:36.213474 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8b3d5a44-e040-4857-80c4-82f8f10a8eb6 req-cb410da7-84cf-4d40-b94f-c26e953c786b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099302 Oct 12 08:54:36.216661 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1349/2562] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:36.231317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:36.232325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:36.250825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:36.251488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:36.251941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.252660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:36.253118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:36.254348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.548650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:36.559522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c005a5a5-5af6-4211-8658-cc66e5604c0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.341160 Oct 12 08:54:36.560146 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1350/2563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:36 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:36.571964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:36.573554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:36.581671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:36.586321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:36.586966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.587863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:36.588466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:36.589066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.810460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:36.824260 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-04d362ef-ba87-4d03-a3ff-ed6277949de5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1308 microversion: 2.1 time: 0.885229 Oct 12 08:54:36.826295 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1214/2564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:35 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1308 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:36.833365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-660025368", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "2f204459-03a5-4e90-a59a-2dbecd872d0d"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:36.865750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:36.877798 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-977840fb-5bf6-4738-b859-a1b9a62693ad tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1505 microversion: 2.1 time: 0.310211 Oct 12 08:54:36.905487 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1351/2565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:36 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:36.905487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:36.905487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:36.925202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:36.925798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:36.926136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.926849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:36.927305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:36.927748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:36.949787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] validate_networks() for [('2f204459-03a5-4e90-a59a-2dbecd872d0d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:37.034983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ddcb6fa0027468bae2b3d917c4a7fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ff14b2964549dabef982ff05657230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:37.043756 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae04d415-3d83-4362-ae22-2f3be57397e3 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 200 len: 1614 microversion: 2.1 time: 0.150695 Oct 12 08:54:37.045239 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1352/2566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:36 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 1614 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:37.050528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:37.051384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:37.059968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:37.060770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:37.061313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:37.062239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:37.062963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:37.063591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:37.222424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:37.231831 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ff20fd1-df46-4e2b-bf46-11bf0bb8f669 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1317 microversion: 2.1 time: 0.185046 Oct 12 08:54:37.234008 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1353/2567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:37 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:37.240038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:37.242502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:37.249509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:37.252122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:37.253085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:37.258169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:37.259723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:37.260355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:37.260925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:37.307754 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a5dc899-6c60-400d-a112-8ddc3cd10095 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071602 Oct 12 08:54:37.308869 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1354/2568] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:54:37 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:54:37.520103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1144857552", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "4f532d19-5c86-4e02-8797-d99cfa48fa40"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:37.614688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] validate_networks() for [('4f532d19-5c86-4e02-8797-d99cfa48fa40', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:38.162502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:38.164448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:38.165095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:38.165688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:38.166366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:38.182613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.183098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.183536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.199545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.201317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.203765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.251323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:38.259896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for user 3571292391094d83901f21ccb18ec2d8 and project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:38.296214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:38.299148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:38.391571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:38.392132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:38.393033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:38.393550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:38.394297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:38.406648 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-062f26f2-2dff-44f6-be4b-7311a9817f8b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.578856 Oct 12 08:54:38.408108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.409319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.409430 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1215/2569] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:54:38.410267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.411248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.412076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.412717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.418547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:38.423991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:38.432810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.438893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.439660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.439922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Getting quotas for project ecfcb084646547968793714916aa6e91. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:38.443110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.443746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.444332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.469907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Getting quotas for user 87645feeea9f4f0b93b3dddae933d343 and project ecfcb084646547968793714916aa6e91. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:38.490013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:38.493184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:38.611144 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b43d7c2b-39b0-4cd0-9e3d-2df426512898 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095237 Oct 12 08:54:38.628618 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1355/2570] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:54:38.636361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:38.637369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:38.648638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.649353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.650038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.651815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.652493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.653126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.754665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:38.779860 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-657c9775-535c-4613-ad9d-5047fa3bb0a5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.369254 Oct 12 08:54:38.806299 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1216/2571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:38 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:38.826419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:38.827121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:38.843967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.845092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.846168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:38.848904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:38.849469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:38.850046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.029779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:39.051288 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5a1f4161-0d0a-4ebd-853d-e6780f6e7bf8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1488 microversion: 2.1 time: 0.420939 Oct 12 08:54:39.052737 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1356/2572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:38 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1488 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:39.058374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1ad89058-ab47-4de8-bfd4-6735bb0a3cbc req-6eb0647f-a37d-4709-b9c6-f110d85711b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f7b507-2869-4d3b-a35a-904ac94e199c", "name": "network-vif-deleted", "tag": "cf5877da-a042-42a4-b1bc-c9afc1cd1bab"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:39.069678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ad89058-ab47-4de8-bfd4-6735bb0a3cbc req-6eb0647f-a37d-4709-b9c6-f110d85711b8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.070348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ad89058-ab47-4de8-bfd4-6735bb0a3cbc req-6eb0647f-a37d-4709-b9c6-f110d85711b8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.074252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ad89058-ab47-4de8-bfd4-6735bb0a3cbc req-6eb0647f-a37d-4709-b9c6-f110d85711b8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.090355 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1ad89058-ab47-4de8-bfd4-6735bb0a3cbc req-6eb0647f-a37d-4709-b9c6-f110d85711b8 service nova] Creating event network-vif-deleted:cf5877da-a042-42a4-b1bc-c9afc1cd1bab for instance 68f7b507-2869-4d3b-a35a-904ac94e199c on n-h1-858383-10 Oct 12 08:54:39.097269 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1ad89058-ab47-4de8-bfd4-6735bb0a3cbc req-6eb0647f-a37d-4709-b9c6-f110d85711b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042725 Oct 12 08:54:39.098354 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1357/2573] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:39.106147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:39.106951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:39.118056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.118056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.118056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.118403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.118802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.119235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.159319 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] HTTP exception thrown: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Request method failure captured: Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c HTTP/1.1 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoAAIMbf3efXQsKahJvhMEoTdUN7kT_scY1jnggxtMJOiu8yQkHjx5US5y7X6YTvDCOYo5YL5gs2uAC5FKYID5soh2zXdrlMPqQvJpZHCf-_CMQSvlzm3NqcuBGUh8cLrQX3_GUa2U6H8mMITCgr5KQoT20OMTPl16HMurwFcYa8b5w Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 53ff14b2964549dabef982ff05657230 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53ff14b2964549dabef982ff05657230"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53ff14b2964549dabef982ff05657230"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53ff14b2964549dabef982ff05657230"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53ff14b2964549dabef982ff05657230"}]}] Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 53ff14b2964549dabef982ff05657230 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachSCSIVolumeTestJSON-15139781-project Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 2ddcb6fa0027468bae2b3d917c4a7fcc Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-15139781-project Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '68f7b507-2869-4d3b-a35a-904ac94e199c'} Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:39.164136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:39.168468 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:39.168468 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:39.168468 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:39.168468 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:39.168468 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:39.168468 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:39.168468 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:39.168468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Returning 404 to user: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:39.169223 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2565d7d5-fc7a-4c9c-be18-298e4255fbb1 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 404 len: 111 microversion: 2.1 time: 0.066017 Oct 12 08:54:39.170556 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1358/2574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:39 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:54:39.181468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:39.184136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:39.201368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.201941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.202378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.203628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.203628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.206006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.484008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:39.500707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a36518e-69e7-434c-8ec2-a2441f0f43a2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1317 microversion: 2.1 time: 0.328956 Oct 12 08:54:39.503385 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1359/2575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:39 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:39.512662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a04bc32-440a-4cfb-9981-99c497a12afc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:39.513595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a04bc32-440a-4cfb-9981-99c497a12afc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:39.618337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a04bc32-440a-4cfb-9981-99c497a12afc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:39.629331 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a04bc32-440a-4cfb-9981-99c497a12afc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1214 microversion: 2.1 time: 0.124306 Oct 12 08:54:39.645479 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1360/2576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:39 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:39.645479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae3dd92f-c32e-4d2a-8f8f-075865411cf5 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:39.645479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae3dd92f-c32e-4d2a-8f8f-075865411cf5 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:39.716530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae3dd92f-c32e-4d2a-8f8f-075865411cf5 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:39.717506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:39.734549 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e9e71397-b15d-4255-8389-e27c56f4ae21 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1505 microversion: 2.1 time: 0.923898 Oct 12 08:54:39.739593 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae3dd92f-c32e-4d2a-8f8f-075865411cf5 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1218 microversion: 2.1 time: 0.103603 Oct 12 08:54:39.740285 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1361/2577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:39 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:39.756588 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1217/2578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:38 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1505 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:39.756783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-58b862ff-4a73-49a5-a941-5a64ad6fc009 req-e0fd9925-b981-4adb-b355-713075a62958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5400c2d-3481-43fa-87b9-9a1886f2dae3", "name": "network-vif-plugged", "status": "completed", "tag": "c8b07757-93d9-4bd6-bdfd-097594ad4c3e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:39.764710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:39.765528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:39.776696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.777202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.777675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.778383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.779434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.779870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.816886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-58b862ff-4a73-49a5-a941-5a64ad6fc009 req-e0fd9925-b981-4adb-b355-713075a62958 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.836556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-58b862ff-4a73-49a5-a941-5a64ad6fc009 req-e0fd9925-b981-4adb-b355-713075a62958 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.838986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-58b862ff-4a73-49a5-a941-5a64ad6fc009 req-e0fd9925-b981-4adb-b355-713075a62958 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.878396 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-58b862ff-4a73-49a5-a941-5a64ad6fc009 req-e0fd9925-b981-4adb-b355-713075a62958 service nova] Creating event network-vif-plugged:c8b07757-93d9-4bd6-bdfd-097594ad4c3e for instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 on n-h2-858383-10 Oct 12 08:54:39.885516 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-58b862ff-4a73-49a5-a941-5a64ad6fc009 req-e0fd9925-b981-4adb-b355-713075a62958 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144002 Oct 12 08:54:39.887498 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1362/2579] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:39.897410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9816f8e5-7117-4596-9a68-b0c70e9ad639 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '.version_select at 0x7f9843e159d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:39.923801 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9816f8e5-7117-4596-9a68-b0c70e9ad639 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493624682" status: 202 len: 0 microversion: 2.1 time: 0.033991 Oct 12 08:54:39.925048 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1363/2580] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 08:54:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493624682 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:54:39.931443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:39.932832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:39.941330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.942065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.942743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:39.943699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:39.944238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:39.944727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.229018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:40.240980 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3bd1203a-dd9d-46db-9a57-953a373e304e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1489 microversion: 2.1 time: 0.483049 Oct 12 08:54:40.257501 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1218/2581] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:39 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1489 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:40.266304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:40.267023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:40.274812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.275695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.276315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.277031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.277501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.277934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.320083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:40.340870 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-35332959-5aff-4f64-96fd-421073f8fff2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.403989 Oct 12 08:54:40.342214 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1364/2582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:39 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:40.458893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:40.466418 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82db5fb6-bb1d-463b-8e3a-d6bef9506026 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1488 microversion: 2.1 time: 0.207383 Oct 12 08:54:40.467774 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1219/2583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:40 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1488 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:40.493510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:40.494022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:40.506246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.506783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.507708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.508563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.509044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.509514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.529426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:40.530167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:40.544715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.545258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.546772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.547516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.548022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.550365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.566023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:54:40.627138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:40.681402 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-64cf48f0-ec59-4a54-b6d2-998c1fb92ff3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 204 len: 0 microversion: 2.1 time: 0.193143 Oct 12 08:54:40.683205 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1365/2584] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:54:40 2022] DELETE /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:54:40.689355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:40.690335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:40.696996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.697788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.698329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.699159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.699719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.700256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.772309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:40.786367 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ff8c1017-f3fd-496b-a349-b752debc05b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1317 microversion: 2.1 time: 0.261588 Oct 12 08:54:40.786970 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1220/2585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:40 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:40.797753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:40.797753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:40.804721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:40.813724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.813724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.813724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.813724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.813724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.813724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.819725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-def13374-490a-4c81-8b20-12c8617a7271 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1266 microversion: 2.1 time: 0.134607 Oct 12 08:54:40.820495 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1366/2586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:40 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:40.827193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:40.827983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:40.836463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.837718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.838262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.839087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:40.839669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:40.840197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:40.952033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:40.968029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d84b1868-2ba0-4889-bed9-1caf7f9e42f8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1214 microversion: 2.1 time: 0.146104 Oct 12 08:54:40.978121 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1367/2587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:40 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:40.978759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:40.979436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:41.011602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.012234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.012581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:41.013475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.013971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.014614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:41.080313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:41.089334 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5579325-19aa-44ac-a8d8-c345c75a4f39 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1494 microversion: 2.1 time: 0.301129 Oct 12 08:54:41.089959 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1221/2588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:40 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1494 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:41.138713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-597d036b-0dd6-4913-907f-07a3b48a45d5 req-92977e88-b789-4586-b0a0-82ab261d9511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47229845-cf46-4d08-b972-de308074dab4", "name": "network-vif-unplugged", "status": "completed", "tag": "5a595f0e-9643-433b-8ce2-5c59e9bd812a"}, {"name": "network-changed", "server_uuid": "47229845-cf46-4d08-b972-de308074dab4", "tag": "5a595f0e-9643-433b-8ce2-5c59e9bd812a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:41.161465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:41.166016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-597d036b-0dd6-4913-907f-07a3b48a45d5 req-92977e88-b789-4586-b0a0-82ab261d9511 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.167225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-597d036b-0dd6-4913-907f-07a3b48a45d5 req-92977e88-b789-4586-b0a0-82ab261d9511 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.167842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-597d036b-0dd6-4913-907f-07a3b48a45d5 req-92977e88-b789-4586-b0a0-82ab261d9511 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:41.185688 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-597d036b-0dd6-4913-907f-07a3b48a45d5 req-92977e88-b789-4586-b0a0-82ab261d9511 service nova] Creating event network-vif-unplugged:5a595f0e-9643-433b-8ce2-5c59e9bd812a for instance 47229845-cf46-4d08-b972-de308074dab4 on n-h1-858383-10 Oct 12 08:54:41.186449 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-597d036b-0dd6-4913-907f-07a3b48a45d5 req-92977e88-b789-4586-b0a0-82ab261d9511 service nova] Creating event network-changed:5a595f0e-9643-433b-8ce2-5c59e9bd812a for instance 47229845-cf46-4d08-b972-de308074dab4 on n-h1-858383-10 Oct 12 08:54:41.192907 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-597d036b-0dd6-4913-907f-07a3b48a45d5 req-92977e88-b789-4586-b0a0-82ab261d9511 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.067598 Oct 12 08:54:41.194936 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1222/2589] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:41.369289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:41.370339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:41.383147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.383963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.384909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:41.387070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.391711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.392765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:41.576242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:41.584142 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-49de09c7-73c6-40ab-a8c6-98c0b061cdc0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1505 microversion: 2.1 time: 0.614444 Oct 12 08:54:41.588085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1368/2590] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:40 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1505 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:41.754690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:41.771030 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-151b7482-f521-4575-98a5-5024c5dbcdb3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1683 microversion: 2.1 time: 0.407121 Oct 12 08:54:41.781461 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1223/2591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:41 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1683 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:41.811758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:41.812377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:41.837199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.842345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.842345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:41.842345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.842345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.842345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:41.850241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:41.851164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:41.876597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.877387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.878010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:41.878879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:41.882359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:41.883002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:42.106473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:42.120185 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c4c72491-d0aa-4934-bbce-b1219d7594a7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1272 microversion: 2.1 time: 0.275235 Oct 12 08:54:42.123804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1224/2592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:41 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:42.145425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:42.147731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:42.163944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:42.166860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:42.171283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:42.173235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:42.179370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:42.180001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:42.293882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:42.304769 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45186d4e-5d9b-43f3-a022-1d117f411852 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1317 microversion: 2.1 time: 0.495748 Oct 12 08:54:42.305426 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1369/2593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:41 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:42.319508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:42.319826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:42.333068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:42.333599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:42.334039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:42.334746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:42.335201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:42.335626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:42.365591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:42.377574 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7797da12-f68b-4e76-b16e-ffd18ce34f94 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1288 microversion: 2.1 time: 0.249639 Oct 12 08:54:42.378637 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1225/2594] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:42 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1288 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:42.607949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:42.609529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:42.642693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:42.644552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:42.646587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:42.650255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:42.651096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:42.653765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:43.112526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:43.121183 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bbad3cb5-5f38-4941-ab52-2f63892c64eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1505 microversion: 2.1 time: 0.517257 Oct 12 08:54:43.134250 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1226/2595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:42 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:43.148708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:43.149587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:43.157228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:43.160525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:43.161126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:43.162046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:43.162729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:43.164672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:43.224711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:43.233729 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d6def28-0a47-49f2-84f5-048e3c258080 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1494 microversion: 2.1 time: 0.927094 Oct 12 08:54:43.254285 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1370/2596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:42 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1494 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:43.263640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:43.264214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:43.281669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:43.282170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:43.282607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:43.283318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:43.283888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:43.284185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:43.578938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:43.590899 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a9cac9e-0866-4f81-812b-e223f75d7296 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.452149 Oct 12 08:54:43.591963 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1227/2597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:43 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:43.603517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:43.604437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:43.614810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:43.622388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:43.623019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:43.624092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:43.624671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:43.625213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:43.838211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:43.846548 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3370be1c-6744-4a80-a3ab-dab9756a5fa6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.590477 Oct 12 08:54:43.855882 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1371/2598] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:43 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:43.861070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:43.861850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:43.890631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:43.891397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:43.892690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:43.894656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:43.895359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:43.897705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.240148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:44.249412 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-da32b1c7-78a3-425d-9df3-68654e35d113 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1507 microversion: 2.1 time: 0.656253 Oct 12 08:54:44.274223 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1228/2599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:43 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1507 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:44.287687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-7f2dcdff-9c43-4c4a-99e1-714300486bb1 req-c774339b-4854-4c2d-9a37-fbd925074a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2764c38-ba1d-40b4-aa9f-b381bd049f04", "name": "network-vif-deleted", "tag": "efe30d70-689b-4252-b845-be01fb792840"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:44.297414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:44.307244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae041961-21da-47a1-aeb8-00ab482b4328 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1318 microversion: 2.1 time: 0.449523 Oct 12 08:54:44.314360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7f2dcdff-9c43-4c4a-99e1-714300486bb1 req-c774339b-4854-4c2d-9a37-fbd925074a37 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.315999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7f2dcdff-9c43-4c4a-99e1-714300486bb1 req-c774339b-4854-4c2d-9a37-fbd925074a37 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.316625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7f2dcdff-9c43-4c4a-99e1-714300486bb1 req-c774339b-4854-4c2d-9a37-fbd925074a37 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.320715 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1372/2600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:43 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:44.333117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:44.333936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:44.341070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.341620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.342295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.343006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.343471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.343950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.347140 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7f2dcdff-9c43-4c4a-99e1-714300486bb1 req-c774339b-4854-4c2d-9a37-fbd925074a37 service nova] Creating event network-vif-deleted:efe30d70-689b-4252-b845-be01fb792840 for instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 on n-h2-858383-10 Oct 12 08:54:44.366468 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-7f2dcdff-9c43-4c4a-99e1-714300486bb1 req-c774339b-4854-4c2d-9a37-fbd925074a37 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090368 Oct 12 08:54:44.367701 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1229/2601] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:44.377255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:44.378511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:44.394204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.395063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.398474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.399490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.400918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.402102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.461215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:44.485323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.487537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.490811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.491309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'fault' on Instance uuid b2764c38-ba1d-40b4-aa9f-b381bd049f04 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:54:44.586825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:44.594797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a0b1a4a-83da-4294-b0a8-c9e8ea9368f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1505 microversion: 2.1 time: 0.272960 Oct 12 08:54:44.611601 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1373/2602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:44 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:44.616929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:44.617598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:44.620145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:44.623990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.624564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.625009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.625745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.626201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.626625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.629312 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8c771773-9168-43a7-88cf-95db07f679a8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 200 len: 1298 microversion: 2.1 time: 0.260197 Oct 12 08:54:44.629950 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1230/2603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:44 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 1298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:44.752645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:44.753656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:44.763297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.764257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.764942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.765873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.766533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.767898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.811352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:44.831113 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6139bc88-eba8-4e26-9315-138cd0e9d068 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1507 microversion: 2.1 time: 0.216869 Oct 12 08:54:44.831923 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1374/2604] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:44 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:44.854821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:44.857917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:44.875953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.876478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.877023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:44.878089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:44.878620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:44.879114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.008346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:45.009592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:45.009592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:45.009879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:45.010349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:45.078148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:45.084405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.085240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.085820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.086635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.087311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.087862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.100999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:45.117530 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c466ad56-80b7-4f52-92d5-d53f6a6ec988 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.369375 Oct 12 08:54:45.117816 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4570ffaa-dc76-4413-9ba8-829dc3a4df8f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "POST /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3/action" status: 202 len: 1109 microversion: 2.1 time: 0.266886 Oct 12 08:54:45.122169 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1231/2605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:44 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:45.132807 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1375/2606] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:54:44 2022] POST /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3/action => generated 1109 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 12 08:54:45.135832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:45.137792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:45.141544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:45.142166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:45.148944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.149455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.149914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.150617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.151119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.151551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.165563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.168260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.169932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.171855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.173769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.175310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.468660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:45.483958 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12995926-0bbb-47ce-b9b4-8c00cb16069a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.349787 Oct 12 08:54:45.484720 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1376/2607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:45 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:45.489507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:45.490011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:45.498684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.499330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.499892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.500883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.501777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.502345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.782202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:45.794550 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8bda970-d1cf-426c-833d-c1a14ccfba57 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.670691 Oct 12 08:54:45.795811 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1232/2608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:45 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:45.803147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:45.805120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:45.812260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.812989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.813622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.814535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:45.814994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:45.815574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:45.884497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:45.896515 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7c8a9f56-0527-4cc2-9c85-8df18d64b415 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1318 microversion: 2.1 time: 0.409093 Oct 12 08:54:45.898714 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1377/2609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:45 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:46.053471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-286d9af9-ef73-40fd-be24-e1b60437c45f req-e28a5faa-8958-4ba9-8bac-3df479892939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8defa84-3694-41e0-b0ea-4ec9d270a48a", "tag": "350ccd25-c7e5-418c-9547-b51233f41ff6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:46.073141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-286d9af9-ef73-40fd-be24-e1b60437c45f req-e28a5faa-8958-4ba9-8bac-3df479892939 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.073914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-286d9af9-ef73-40fd-be24-e1b60437c45f req-e28a5faa-8958-4ba9-8bac-3df479892939 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.075008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-286d9af9-ef73-40fd-be24-e1b60437c45f req-e28a5faa-8958-4ba9-8bac-3df479892939 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.110971 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-286d9af9-ef73-40fd-be24-e1b60437c45f req-e28a5faa-8958-4ba9-8bac-3df479892939 service nova] Creating event network-changed:350ccd25-c7e5-418c-9547-b51233f41ff6 for instance c8defa84-3694-41e0-b0ea-4ec9d270a48a on n-h1-858383-10 Oct 12 08:54:46.117290 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-286d9af9-ef73-40fd-be24-e1b60437c45f req-e28a5faa-8958-4ba9-8bac-3df479892939 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216650 Oct 12 08:54:46.118377 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1378/2610] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:46.124245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:46.125193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:46.133305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.133902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.134424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.135595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.136158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.136972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.162795 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 HTTP/1.1 Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'b2764c38-ba1d-40b4-aa9f-b381bd049f04'} Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:46.171034 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:46.175243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:46.175243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:46.175243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:46.175243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:46.175243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:54:46.175243 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:46.176246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:46.177354 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4badd868-0701-4ae3-ac4e-40b72af6aa7c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 404 len: 111 microversion: 2.1 time: 0.057650 Oct 12 08:54:46.178484 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1379/2611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:46 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:54:46.188867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:46.189652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:46.216180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.216968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.217590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.218466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.219424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.219996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.259299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:54:46.323335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:46.418060 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a762cf0-e46c-4ad6-a195-9dfc085d4fa5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 204 len: 0 microversion: 2.1 time: 0.232074 Oct 12 08:54:46.424469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1380/2612] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:54:46 2022] DELETE /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:54:46.438820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:46.440282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:46.457950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.458815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.459470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.460456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.461143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.461812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.671426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:46.680464 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0d884b58-1cf9-40c7-b2b5-a9b4ccad9596 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1495 microversion: 2.1 time: 0.253731 Oct 12 08:54:46.698365 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1381/2613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:46 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1495 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:46.704568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:46.705837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:46.715014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.715956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.716791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.717688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.718428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.719133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.800345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:46.818522 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d8cdedf-0f79-4eb4-8420-c3f2ac049421 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1505 microversion: 2.1 time: 1.021194 Oct 12 08:54:46.819301 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1233/2614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:45 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1505 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:46.849356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:46.850180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:46.863232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.863896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.864489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.865654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.866283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.866875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.915139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:46.923362 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88a15ab6-e08e-4edf-8e43-80383d943189 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.223623 Oct 12 08:54:46.923936 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1382/2615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:46 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:46.935827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5e642f53-766a-4adb-bd32-80483cb223bd req-26809172-8a22-4f3c-9075-215f465f4fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "name": "network-vif-unplugged", "status": "completed", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:46.946201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5e642f53-766a-4adb-bd32-80483cb223bd req-26809172-8a22-4f3c-9075-215f465f4fa5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.946884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5e642f53-766a-4adb-bd32-80483cb223bd req-26809172-8a22-4f3c-9075-215f465f4fa5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.947468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5e642f53-766a-4adb-bd32-80483cb223bd req-26809172-8a22-4f3c-9075-215f465f4fa5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.958965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5e642f53-766a-4adb-bd32-80483cb223bd req-26809172-8a22-4f3c-9075-215f465f4fa5 service nova] Creating event network-vif-unplugged:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 08:54:46.964290 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5e642f53-766a-4adb-bd32-80483cb223bd req-26809172-8a22-4f3c-9075-215f465f4fa5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038860 Oct 12 08:54:46.965232 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1383/2616] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:46.970914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:46.971610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:46.979285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.979785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.980204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:46.981093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:46.981965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:46.982528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.068317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:47.077292 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cd69bea1-6e92-4ed4-8bf0-a70c0c5b1891 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.245882 Oct 12 08:54:47.078160 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1234/2617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:46 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:47.082918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:47.083759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:47.090032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.090847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.091494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.092406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.093083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.093757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.130537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:47.140935 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-65b32f62-0b12-4f6a-baa6-d387e56b26b6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.174322 Oct 12 08:54:47.156614 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1384/2618] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:46 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:47.156614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:47.156614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:47.164432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.165039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.165587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.166385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.166903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.168227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.182574 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] HTTP exception thrown: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Request method failure captured: Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c HTTP/1.1 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoAAIMbf3efXQsKahJvhMEoTdUN7kT_scY1jnggxtMJOiu8yQkHjx5US5y7X6YTvDCOYo5YL5gs2uAC5FKYID5soh2zXdrlMPqQvJpZHCf-_CMQSvlzm3NqcuBGUh8cLrQX3_GUa2U6H8mMITCgr5KQoT20OMTPl16HMurwFcYa8b5w Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 53ff14b2964549dabef982ff05657230 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53ff14b2964549dabef982ff05657230"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53ff14b2964549dabef982ff05657230"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53ff14b2964549dabef982ff05657230"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53ff14b2964549dabef982ff05657230"}]}] Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 53ff14b2964549dabef982ff05657230 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachSCSIVolumeTestJSON-15139781-project Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 2ddcb6fa0027468bae2b3d917c4a7fcc Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-15139781-project Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '68f7b507-2869-4d3b-a35a-904ac94e199c'} Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:54:47.184528 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Returning 404 to user: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:47.187974 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5340a78-a107-436d-b780-69999f07ed05 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 404 len: 111 microversion: 2.1 time: 0.043231 Oct 12 08:54:47.189683 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1385/2619] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:54:47 2022] DELETE /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:54:47.194636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:47.195354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:47.197358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:47.203647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.204133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.204572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.205279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.205788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.206216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.241147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:47.249496 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c69a9072-de48-4756-bbf6-cceb9529521d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1318 microversion: 2.1 time: 0.170063 Oct 12 08:54:47.250219 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1235/2620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:47 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:47.255674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:47.256297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] [instance: 68f7b507-2869-4d3b-a35a-904ac94e199c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:47.262696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.263178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.263617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.264312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.264765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.265235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.279110 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] HTTP exception thrown: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Request method failure captured: Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c HTTP/1.1 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoAAIMbf3efXQsKahJvhMEoTdUN7kT_scY1jnggxtMJOiu8yQkHjx5US5y7X6YTvDCOYo5YL5gs2uAC5FKYID5soh2zXdrlMPqQvJpZHCf-_CMQSvlzm3NqcuBGUh8cLrQX3_GUa2U6H8mMITCgr5KQoT20OMTPl16HMurwFcYa8b5w Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 53ff14b2964549dabef982ff05657230 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53ff14b2964549dabef982ff05657230"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53ff14b2964549dabef982ff05657230"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53ff14b2964549dabef982ff05657230"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53ff14b2964549dabef982ff05657230"}]}] Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 53ff14b2964549dabef982ff05657230 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-15139781 Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachSCSIVolumeTestJSON-15139781-project Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2ddcb6fa0027468bae2b3d917c4a7fcc Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-15139781-project Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '68f7b507-2869-4d3b-a35a-904ac94e199c'} Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:47.280791 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] Returning 404 to user: Instance 68f7b507-2869-4d3b-a35a-904ac94e199c could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5913fc8c-cbb9-4516-9da2-14f3db593a00 tempest-AttachSCSIVolumeTestJSON-15139781 tempest-AttachSCSIVolumeTestJSON-15139781-project] 10.222.0.40 "GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c" status: 404 len: 111 microversion: 2.1 time: 0.031088 Oct 12 08:54:47.284500 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1236/2621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:47 2022] GET /compute/v2.1/servers/68f7b507-2869-4d3b-a35a-904ac94e199c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:54:47.350478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:47.358802 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13b385f4-49a5-4573-b337-25bfa64f1b43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.167735 Oct 12 08:54:47.359391 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1386/2622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:47 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:47.381418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:47.382043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:47.388370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.388863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.389308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.390058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.390522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.390965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.630711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:47.647018 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6cfa0d11-5225-494f-a56d-d2beee78756a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.269514 Oct 12 08:54:47.647527 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1237/2623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:47 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:47.671492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:47.673852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:47.692096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.692612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.693053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.693813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.701007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.701466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.707019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:47.708015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:47.717035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.717952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.718615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.719529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.721052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.721713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.880616 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-41f55b0f-bbbd-4e12-aa01-b72d3ac06620 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.212862 Oct 12 08:54:47.881968 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1387/2624] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:54:47 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:54:47.908238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:47.910501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:47.919862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.920638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.921390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:47.922322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:47.922924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:47.923604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.198547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:48.218720 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8c43e87-033b-49e4-af11-5c34b56b5705 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1495 microversion: 2.1 time: 0.516024 Oct 12 08:54:48.234815 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1238/2625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:47 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1495 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:48.241291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:48.242301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:48.258866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:48.267595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.268850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.270639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.275189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.278081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.279092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.280976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:48.295887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:48.310269 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b0d52609-2e77-4024-a840-3c076a370009 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1505 microversion: 2.1 time: 0.426693 Oct 12 08:54:48.311031 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1388/2626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:47 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:48.334581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:48.336823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:48.344216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.346503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.347262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.348325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.349002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.349676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.425091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:48.710104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:48.727098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3e8bf5a-8534-4f43-b056-85ec2df2da5a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.399765 Oct 12 08:54:48.727929 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1389/2627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:48 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:48.733705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:48.734481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:48.741700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.742391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.743110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.744067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.744664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.745230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.855359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:48.863829 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3797ab09-eabd-4d74-860b-c68a3e372bef tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1672 microversion: 2.1 time: 0.627641 Oct 12 08:54:48.880353 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1239/2628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:48 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1672 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:48.885545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d00c86f0-615c-46e2-86ab-b3ddc76b71e6 req-d834d332-fc2e-4a15-86e0-49aacb81d63d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8f1954-4bec-4117-b3d5-490f2908bff5", "tag": "44e55864-d023-4107-ad14-cc79728d03f7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:48.900145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d00c86f0-615c-46e2-86ab-b3ddc76b71e6 req-d834d332-fc2e-4a15-86e0-49aacb81d63d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.900872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d00c86f0-615c-46e2-86ab-b3ddc76b71e6 req-d834d332-fc2e-4a15-86e0-49aacb81d63d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.901615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d00c86f0-615c-46e2-86ab-b3ddc76b71e6 req-d834d332-fc2e-4a15-86e0-49aacb81d63d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.913331 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d00c86f0-615c-46e2-86ab-b3ddc76b71e6 req-d834d332-fc2e-4a15-86e0-49aacb81d63d service nova] Creating event network-changed:44e55864-d023-4107-ad14-cc79728d03f7 for instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 on n-h1-858383-10 Oct 12 08:54:48.918425 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d00c86f0-615c-46e2-86ab-b3ddc76b71e6 req-d834d332-fc2e-4a15-86e0-49aacb81d63d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036572 Oct 12 08:54:48.919257 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1240/2629] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:48.924136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:48.924745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:48.931853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.932497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.932803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.934258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:48.934258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:48.934563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:48.992025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:49.008439 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cb11606-cfda-45fd-9210-57efdd2bf5a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.278860 Oct 12 08:54:49.021321 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1390/2630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:48 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:49.248389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:49.249167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:49.256145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.259358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.262248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.263241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.263686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.265915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.384516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:49.397551 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-44e75829-2aa4-4f96-945d-96d24d1dc55c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1453 microversion: 2.1 time: 0.152933 Oct 12 08:54:49.398317 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1391/2631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:49 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:49.404998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:49.405904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:49.416366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.416882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.417315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.418040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.418487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.419027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.441249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:49.450806 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9f9bbd8e-37f8-4af0-b289-a984aad82b04 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1318 microversion: 2.1 time: 0.530588 Oct 12 08:54:49.451926 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1241/2632] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:48 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:49.562663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:49.571098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-084c5bfd-cecb-4cb9-9fa8-b742c35414b8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1495 microversion: 2.1 time: 0.171399 Oct 12 08:54:49.571748 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1392/2633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:49 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1495 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:49.593990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d82691e-d612-4030-8324-cff3c542d1be tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '.version_select at 0x7f98489ef550>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:49.597932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d82691e-d612-4030-8324-cff3c542d1be tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.598491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d82691e-d612-4030-8324-cff3c542d1be tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.598941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d82691e-d612-4030-8324-cff3c542d1be tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.605924 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d82691e-d612-4030-8324-cff3c542d1be tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.015740 Oct 12 08:54:49.606588 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1242/2634] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:54:49 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:49.619857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:49.620514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:49.626672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.627221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.627713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.628482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.628995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.629498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.738353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=10 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:49.755949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:49.756569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:49.763772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.764269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.764707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.765409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.765913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.766336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.826429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7401e44a-2c9d-45c6-aba2-b2671810d099 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1648 microversion: 2.1 time: 0.210225 Oct 12 08:54:49.827015 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1393/2635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:49 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1648 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:49.888769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:49.889676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:49.908053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.910994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.911666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:49.912579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:49.913036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:49.913488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.136939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:50.145406 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c6cd3e0f-9961-4f8d-b5d0-64c0e6cc92b4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1672 microversion: 2.1 time: 0.262886 Oct 12 08:54:50.146045 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1394/2636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:49 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1672 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:50.150917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-758985894", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "a89cb8de-3356-4d1b-a516-3c348eab6ff9"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:50.208549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] validate_networks() for [('a89cb8de-3356-4d1b-a516-3c348eab6ff9', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:50.396840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:50.411934 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f4c3be24-77ad-43c8-b65a-c9997b30126c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.660905 Oct 12 08:54:50.412554 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1243/2637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:49 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:50.433788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:50.434593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:50.441054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:50.441656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:50.442207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.442909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:50.443425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:50.443916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.640966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:50.641396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:50.641901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:50.642953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:50.643550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:50.653167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:50.653971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:50.654597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.655335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:50.655789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:50.656215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.674616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for project f77355ddeba541b189e41cb089a07eba. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:50.680532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for user 3662e9666cc14f80a5ea16670a6f1595 and project f77355ddeba541b189e41cb089a07eba. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:50.699207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:50.702117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:50.720687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:50.732321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-533607a8-1489-41dd-9474-1a61083eb4b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.318537 Oct 12 08:54:50.749593 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1244/2638] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:50 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:50.757541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:50.757541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:50.763390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:50.763858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:50.764287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.765053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:50.765615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:50.766044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.777357 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a8aa8a97-9b56-4905-bfd9-10089ac9445f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630046 Oct 12 08:54:50.781632 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1395/2639] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:54:50.792905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:50.793568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:50.805362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:50.807697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:50.808035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.808759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:50.812248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:50.812474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:50.913330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:50.945202 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-80f73688-67a9-4568-bd43-5dcfde560d07 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1293 microversion: 2.1 time: 0.186694 Oct 12 08:54:50.946401 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1245/2640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:50 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1293 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:50.952194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-088757a0-b008-407a-b08a-96b9bdb37292 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:50.952612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-088757a0-b008-407a-b08a-96b9bdb37292 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:51.062090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:51.070738 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-92a4b6ee-f417-4f6c-bca5-00ef7041930b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1318 microversion: 2.1 time: 0.287920 Oct 12 08:54:51.077344 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1396/2641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:50 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:51.102985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-12b8799b-651d-4493-a344-5c478294bcc9 req-afad84d0-e382-40cb-9d6a-b0e7496190b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757ee68a-1a1a-40dd-9516-be192f1863bf", "name": "network-vif-deleted", "tag": "3649455c-f917-46d3-ad36-878c465d3d6f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:51.139522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12b8799b-651d-4493-a344-5c478294bcc9 req-afad84d0-e382-40cb-9d6a-b0e7496190b0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.140061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12b8799b-651d-4493-a344-5c478294bcc9 req-afad84d0-e382-40cb-9d6a-b0e7496190b0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.140501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-12b8799b-651d-4493-a344-5c478294bcc9 req-afad84d0-e382-40cb-9d6a-b0e7496190b0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.163720 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-12b8799b-651d-4493-a344-5c478294bcc9 req-afad84d0-e382-40cb-9d6a-b0e7496190b0 service nova] Creating event network-vif-deleted:3649455c-f917-46d3-ad36-878c465d3d6f for instance 757ee68a-1a1a-40dd-9516-be192f1863bf on n-h1-858383-10 Oct 12 08:54:51.172384 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-12b8799b-651d-4493-a344-5c478294bcc9 req-afad84d0-e382-40cb-9d6a-b0e7496190b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092609 Oct 12 08:54:51.174179 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1397/2642] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:51.184162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:51.187726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:51.200297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.201233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.206723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.208677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.209497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.211017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.216167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:51.327649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-088757a0-b008-407a-b08a-96b9bdb37292 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:51.341188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-088757a0-b008-407a-b08a-96b9bdb37292 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1210 microversion: 2.1 time: 0.392174 Oct 12 08:54:51.343863 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1246/2643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:50 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1210 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:51.437396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:51.438391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:51.454328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.456003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.456654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.458042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.460009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.460608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.565354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:51.581721 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e1c70dd6-cbd4-48b5-882d-71183a1e31ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.404670 Oct 12 08:54:51.584359 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1398/2644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:51 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:51.609396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:51.611734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:51.629982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.630486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.630925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.631640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.632297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.632728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.704466 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-476a0327-8b4b-4061-a574-ceb72a2cb0ad tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 200 len: 322 microversion: 2.1 time: 0.101394 Oct 12 08:54:51.710860 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1399/2645] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:54:51 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 322 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:54:51.717758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:51.718473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:51.728603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.729939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.730384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.731562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:51.731995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:51.732499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:51.935088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:51.945379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:51.947303 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b4c34df-b0dd-4f21-af0b-acea410037d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.234678 Oct 12 08:54:51.948477 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1400/2646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:51 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:51.966881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:51.968109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:51.975604 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efa82f9b-4719-494f-9add-8ac13aa04510 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.543057 Oct 12 08:54:51.991640 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1247/2647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:51 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:51.991640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:51.991640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:51.997163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.002717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.003561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.005982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.006235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.006667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.007106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.007827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.008278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.008569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.008685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.009894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.103614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.105775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.107084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.108515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'fault' on Instance uuid 757ee68a-1a1a-40dd-9516-be192f1863bf {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:54:52.234745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:52.244250 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02211d9c-3b24-4641-b945-6e8752006604 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.293967 Oct 12 08:54:52.257472 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1401/2648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:51 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:52.257472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:52.257472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:52.259360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.260070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.264364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.265200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.265777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.267273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.274586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:52.290104 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a22ee0af-74b1-411f-8a1e-ecae9a7db725 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 200 len: 1298 microversion: 2.1 time: 0.307752 Oct 12 08:54:52.290752 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1248/2649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:51 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 1298 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:52.299313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:52.300203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:52.308869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.309971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.310568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.312660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.313303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.314023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.346259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:52.425554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:52.437032 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df9abe63-fe6c-4aac-baf4-747c650a68e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.190712 Oct 12 08:54:52.451423 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1402/2650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:52 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:52.463248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:52.464191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:52.471630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.472346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.472927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.473792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.474382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.474948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.598323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:52.622150 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7014cfc-aa30-484d-9f54-9da471934e68 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1262 microversion: 2.1 time: 0.166201 Oct 12 08:54:52.624094 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1403/2651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:52 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1262 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:52.629682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:52.630724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:52.638857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.639500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.640144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.642971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.643618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.655823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.769573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:52.782420 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee0cdb05-e46f-478b-b1a7-af8469dc4e7b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1318 microversion: 2.1 time: 0.490585 Oct 12 08:54:52.783255 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1249/2652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:52 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:52.901834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:52.911789 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c63e8f71-c15e-4e34-b5c7-3cf0813ae86a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.285971 Oct 12 08:54:52.912641 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1404/2653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:52 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:52.936954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:52.937682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:52.944387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.944949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.945491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:52.946390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:52.947199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:52.947676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.008958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:53.010750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:53.017290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:53.017812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:53.018248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.018949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:53.019402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:53.020274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.182049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:53.191031 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0031463a-736e-41bb-87de-ce9af42b5ccb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.185942 Oct 12 08:54:53.191964 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1405/2654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:53 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:53.272865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:53.273822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:53.280782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:53.282055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:53.282623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.284373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:53.284977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:53.285540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.438016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:53.446213 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14940ffe-0529-4521-a027-7a8cf761747d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.177285 Oct 12 08:54:53.446808 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1406/2655] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:53 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:53.451527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:53.452234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:53.459586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:53.460308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:53.460883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.461758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:53.462392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:53.462813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.477232 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf HTTP/1.1 Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '757ee68a-1a1a-40dd-9516-be192f1863bf'} Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:53.478997 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-539cd1df-1592-400b-ba58-64bd8dac2dcc tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 404 len: 111 microversion: 2.1 time: 0.032543 Oct 12 08:54:53.482889 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1407/2656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:53 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:54:53.540118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1834756075", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5694562d-e360-435c-86bf-39f253be6d82"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:53.595759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] validate_networks() for [('5694562d-e360-435c-86bf-39f253be6d82', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:53.608939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:53.617708 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3bc2c518-35e0-48f0-9db6-488b79543b87 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.684947 Oct 12 08:54:53.618599 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1250/2657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:52 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:53.647217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:53.648057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:53.655394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:53.655890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:53.657274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.657274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:53.657499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:53.657937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:53.769580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:53.777749 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-34678616-a260-4c7b-b71d-7ecd5797ffe7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1268 microversion: 2.1 time: 0.134512 Oct 12 08:54:53.793720 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1251/2658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:53 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:53.799349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1566533344", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "d30a231a-ae95-4ebb-90c8-46232d6674b8"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:53.857534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] validate_networks() for [('d30a231a-ae95-4ebb-90c8-46232d6674b8', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:54:54.477321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:54.477825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:54.478268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:54.478643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:54.479059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:54.495843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:54.496517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:54.497175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:54.498243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:54.499105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:54.499751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:54.520325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:54.525830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:54.539359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:54.542501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:54.640394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:54:54.640811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:54:54.641286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:54:54.641721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:54:54.642133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:54:54.642624 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a11913b-2241-414b-839a-181ecfdbcf87 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104714 Oct 12 08:54:54.648698 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1408/2659] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:54:54.660327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:54.661530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:54.664145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:54.664642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:54.665078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:54.665877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:54.671212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:54.671831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:54.672173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:54.673007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:54.673670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:54.675599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:54.677113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:54.678051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:54.734397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:54:54.748696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for user 54fad01e2e6e41d0887895b131051ee1 and project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:54:54.780553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:54:54.784038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:54:54.923040 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e52139f-4f53-4b96-8d55-26b753809865 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127367 Oct 12 08:54:54.927393 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1252/2660] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:54:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:54:54.943583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:54.944210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:54.959414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:54.960316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:54.960963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:54.961913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:54.963204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:54.963930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.045709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:55.056886 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4bc53af6-5c50-425e-858b-1527e626fc61 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1318 microversion: 2.1 time: 0.405427 Oct 12 08:54:55.057842 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1409/2661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:54 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:55.073532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8a513d50-f2d0-41ed-b096-cf9394fe1b5c req-d6616a4d-03c0-4ca1-8e4d-caa041278b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8f1954-4bec-4117-b3d5-490f2908bff5", "name": "network-vif-plugged", "status": "completed", "tag": "44e55864-d023-4107-ad14-cc79728d03f7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:55.090197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8a513d50-f2d0-41ed-b096-cf9394fe1b5c req-d6616a4d-03c0-4ca1-8e4d-caa041278b28 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.090747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8a513d50-f2d0-41ed-b096-cf9394fe1b5c req-d6616a4d-03c0-4ca1-8e4d-caa041278b28 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.091182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8a513d50-f2d0-41ed-b096-cf9394fe1b5c req-d6616a4d-03c0-4ca1-8e4d-caa041278b28 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.117098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8a513d50-f2d0-41ed-b096-cf9394fe1b5c req-d6616a4d-03c0-4ca1-8e4d-caa041278b28 service nova] Creating event network-vif-plugged:44e55864-d023-4107-ad14-cc79728d03f7 for instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 on n-h1-858383-10 Oct 12 08:54:55.133508 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8a513d50-f2d0-41ed-b096-cf9394fe1b5c req-d6616a4d-03c0-4ca1-8e4d-caa041278b28 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068709 Oct 12 08:54:55.134138 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1410/2662] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:54:55.149167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:55.151763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:55.178853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.180709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.180941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.183818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.185898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.188001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.475552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:55.490184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:55.497420 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ff7cef8-a45f-445e-8441-bfaf67be0154 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.569023 Oct 12 08:54:55.499917 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1253/2663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:54 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:55.502499 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f4c27727-4ecf-45d8-b72c-1214ed47175e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.367178 Oct 12 08:54:55.503931 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1411/2664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:55 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:55.508718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:55.510185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:55.511049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:55.515440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:55.518720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.523378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.525754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.528139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.529327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.529947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.530761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.531658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.532794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.533836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.534042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.535695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.665934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:55.675244 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12a91342-ce2a-4335-87a0-5bbb2333f212 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1213 microversion: 2.1 time: 0.173984 Oct 12 08:54:55.689501 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1254/2665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:55 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:55.699569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e150d3e1-6958-49a7-9ede-3216241894de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:55.700606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e150d3e1-6958-49a7-9ede-3216241894de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:55.798251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e150d3e1-6958-49a7-9ede-3216241894de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:55.815637 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e150d3e1-6958-49a7-9ede-3216241894de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1215 microversion: 2.1 time: 0.134727 Oct 12 08:54:55.816241 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1255/2666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:55 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:55.835743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:55.836351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:55.847920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.848601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.849199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.850063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:55.851604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:55.852187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:55.917126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:54:56.014742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:56.023096 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a955d437-2b89-449e-b485-363971531870 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 204 len: 0 microversion: 2.1 time: 0.199021 Oct 12 08:54:56.024367 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1256/2667] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:54:55 2022] DELETE /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:54:56.034968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:56.035919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:56.037873 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-412d697b-8498-4d47-9946-8a2d0f21f68d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1310 microversion: 2.1 time: 0.531342 Oct 12 08:54:56.039185 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1412/2668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:55 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1310 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:56.043813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.044380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.044939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.045873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.046376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.048159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.083236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:56.084049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:56.093266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.094106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.094634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.095457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.095972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.096510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.285561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:56.295686 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ff26fc70-112f-4a9c-b6ac-590221de9c4d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1318 microversion: 2.1 time: 0.217362 Oct 12 08:54:56.296271 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1413/2669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:56 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:56.310964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3ac61857-43c1-428b-bc65-aae66ccda0e1 req-5dbe7406-f6fe-488c-afa6-5c90d55bef7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a4c781-b18e-4145-8fa8-a8197652846b", "tag": "b8b52663-79a8-4f9d-89f5-5f8e0225c14c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:56.321027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ac61857-43c1-428b-bc65-aae66ccda0e1 req-5dbe7406-f6fe-488c-afa6-5c90d55bef7c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.321541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ac61857-43c1-428b-bc65-aae66ccda0e1 req-5dbe7406-f6fe-488c-afa6-5c90d55bef7c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.322007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ac61857-43c1-428b-bc65-aae66ccda0e1 req-5dbe7406-f6fe-488c-afa6-5c90d55bef7c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.335752 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3ac61857-43c1-428b-bc65-aae66ccda0e1 req-5dbe7406-f6fe-488c-afa6-5c90d55bef7c service nova] Creating event network-changed:b8b52663-79a8-4f9d-89f5-5f8e0225c14c for instance 95a4c781-b18e-4145-8fa8-a8197652846b on n-h2-858383-10 Oct 12 08:54:56.340842 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3ac61857-43c1-428b-bc65-aae66ccda0e1 req-5dbe7406-f6fe-488c-afa6-5c90d55bef7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035580 Oct 12 08:54:56.341460 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1414/2670] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:54:56.374993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:56.383297 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-50774598-fded-49a5-b73e-7f192ca69dc8 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1664 microversion: 2.1 time: 0.354217 Oct 12 08:54:56.384074 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1257/2671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:56 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1664 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:56.524938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:56.525849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:56.532709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.533201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.534846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.534846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.534846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.535253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.540326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:56.541027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:56.548156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.549339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.549982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.550922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.551870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.552491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.685763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:56.693742 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-189ff3ba-ba5f-44e8-802a-34be684cf77b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.173542 Oct 12 08:54:56.694407 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1415/2672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:56 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:56.704519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:56.705418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:56.711896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.712385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.712823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.713557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.714036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.714467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.782922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:56.791324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:56.792709 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f853952-0738-4726-adb0-d60606707488 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1261 microversion: 2.1 time: 0.092256 Oct 12 08:54:56.793690 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1416/2673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:56 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:56.813481 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b7c143a3-fb1e-42a9-992f-205151684a31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.276962 Oct 12 08:54:56.814364 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1258/2674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:56 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:56.840941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:56.841589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:56.847799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.848286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.848722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.849428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:56.849898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:56.850318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:56.915184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:56.917682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:56.924725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d32bbfbc-a717-4351-88b9-49b14e3d5698 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1211 microversion: 2.1 time: 0.087745 Oct 12 08:54:56.925309 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1417/2675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:56 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:57.064763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:57.065385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:57.068897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:57.074393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.074924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.075366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.076263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.076906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.077341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.203299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-fa5e3fa7-62f9-4d91-ba69-c7b728496c33 req-abf90699-1eb2-49eb-8b51-8066707ada54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8defa84-3694-41e0-b0ea-4ec9d270a48a", "name": "network-vif-plugged", "status": "completed", "tag": "350ccd25-c7e5-418c-9547-b51233f41ff6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:54:57.223502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fa5e3fa7-62f9-4d91-ba69-c7b728496c33 req-abf90699-1eb2-49eb-8b51-8066707ada54 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.224248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fa5e3fa7-62f9-4d91-ba69-c7b728496c33 req-abf90699-1eb2-49eb-8b51-8066707ada54 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.225990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fa5e3fa7-62f9-4d91-ba69-c7b728496c33 req-abf90699-1eb2-49eb-8b51-8066707ada54 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.243431 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-fa5e3fa7-62f9-4d91-ba69-c7b728496c33 req-abf90699-1eb2-49eb-8b51-8066707ada54 service nova] Creating event network-vif-plugged:350ccd25-c7e5-418c-9547-b51233f41ff6 for instance c8defa84-3694-41e0-b0ea-4ec9d270a48a on n-h1-858383-10 Oct 12 08:54:57.248422 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-fa5e3fa7-62f9-4d91-ba69-c7b728496c33 req-abf90699-1eb2-49eb-8b51-8066707ada54 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049624 Oct 12 08:54:57.249026 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1418/2676] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:54:57.320525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:57.321140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:57.329720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.330281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.330843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.331799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.332313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.332760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.394159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:57.403174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-00ee3671-1dac-4755-b024-c88134fb48ef tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1310 microversion: 2.1 time: 0.341715 Oct 12 08:54:57.404005 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1259/2677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:57 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1310 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:57.408961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:57.409698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:57.416507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.417264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.417887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.419470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.420097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.420573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.490750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:57.501214 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-96958188-4aa6-4bfc-ad01-4da7759dc34f tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1507 microversion: 2.1 time: 0.185592 Oct 12 08:54:57.502276 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1419/2678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:57 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:57.718903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:57.720227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:57.729785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.733267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.734610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.739177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.739885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.740641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.958162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:57.968712 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1e3902df-d7df-4073-96f1-f70b9f0b4d14 tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1664 microversion: 2.1 time: 0.563415 Oct 12 08:54:57.969913 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1260/2679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:57 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1664 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:57.974942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:57.975737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:57.982155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.982921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.983573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:57.984472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:57.985160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:57.985807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:58.156515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:58.187958 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ca4e47c-ee97-4a93-8b87-f297e35f591a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.472354 Oct 12 08:54:58.203139 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1420/2680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:57 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:58.209426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:58.211647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:58.218632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:58.219218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:58.219651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:58.220358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:58.220988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:58.221221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:58.444503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:58.456092 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3cf7d88d-6939-4147-aab8-650ed4620968 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1267 microversion: 2.1 time: 0.484347 Oct 12 08:54:58.472829 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1261/2681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:57 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1267 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:58.485952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:58.487026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:58.498954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:58.499924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:58.500704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:58.502692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:58.503438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:58.504102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:58.588279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:58.608207 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2cc66202-2d41-4706-9064-715a5fb65eef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.403704 Oct 12 08:54:58.613526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:58.614633 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1421/2682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:58 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:58.619680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:58.623960 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7114738c-7e7f-4760-92f4-573af94707c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1273 microversion: 2.1 time: 0.149523 Oct 12 08:54:58.624903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:58.627236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:54:58.634612 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1262/2683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:58 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:58.639861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:58.640592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:58.641224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:58.642192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:58.642712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:58.643194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.003623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:59.005048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:59.017335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.020224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.021034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.024581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.026381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.028021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.043536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:59.058417 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b61b845-a400-4a56-9911-194b17488ca3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1310 microversion: 2.1 time: 0.442325 Oct 12 08:54:59.075400 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1422/2684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:58 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1310 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:54:59.198530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec3cf3ce9754f5ab926cb97accf6c10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd691de25004ed7830feb606255332b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:59.207032 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42b82d30-324f-4793-9b4d-540c2d3f8b4b tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 200 len: 1597 microversion: 2.1 time: 0.209071 Oct 12 08:54:59.208493 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1263/2685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:58 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 1597 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:59.212297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:59.212903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:59.229328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.229611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.230223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.230633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.231194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.231646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.486352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:59.486967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:59.506100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.506904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.507811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.508783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.510122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.510717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.579778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:59.593778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d005cf29-e7be-4c93-a7a8-87cfeb46cb6f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.385096 Oct 12 08:54:59.595443 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1423/2686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:59 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:59.640772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:59.642162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:59.649486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.650327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.651064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.651836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.652477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.653210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.814427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:54:59.823198 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e6d4f4b-36c5-452e-a813-f8f82a91935a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1267 microversion: 2.1 time: 0.340686 Oct 12 08:54:59.823801 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1264/2687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:59 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:54:59.837062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:54:59.837707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:54:59.894747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.900440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.901290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:54:59.902414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:54:59.903935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:54:59.914311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:00.018582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:00.028646 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06002572-27af-4967-af4f-c549c39dcabc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1314 microversion: 2.1 time: 0.395610 Oct 12 08:55:00.031056 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1424/2688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:59 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:00.052945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9dee6679-0d98-4e7c-9264-d54d3621731f req-b8c54997-a3e6-4535-85e3-ae35ff5d0ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a5c393-6cbb-47cf-95c1-f3aea250be94", "name": "network-vif-deleted", "tag": "d49f8b56-744d-4ea9-bbe9-1885d2f42af6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:00.085429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9dee6679-0d98-4e7c-9264-d54d3621731f req-b8c54997-a3e6-4535-85e3-ae35ff5d0ef7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:00.085795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9dee6679-0d98-4e7c-9264-d54d3621731f req-b8c54997-a3e6-4535-85e3-ae35ff5d0ef7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:00.086239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9dee6679-0d98-4e7c-9264-d54d3621731f req-b8c54997-a3e6-4535-85e3-ae35ff5d0ef7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:00.098522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9dee6679-0d98-4e7c-9264-d54d3621731f req-b8c54997-a3e6-4535-85e3-ae35ff5d0ef7 service nova] Creating event network-vif-deleted:d49f8b56-744d-4ea9-bbe9-1885d2f42af6 for instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 on n-h2-858383-10 Oct 12 08:55:00.103674 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9dee6679-0d98-4e7c-9264-d54d3621731f req-b8c54997-a3e6-4535-85e3-ae35ff5d0ef7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069353 Oct 12 08:55:00.104593 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1425/2689] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:00.110242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:00.111105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:00.122807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:00.123320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:00.123748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:00.124465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:00.125233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:00.125676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:00.882881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:00.903565 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9585677-5f77-4d91-98c9-9ac0dde38f10 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1315 microversion: 2.1 time: 1.076625 Oct 12 08:55:00.905752 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1265/2690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:54:59 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:00.912950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8082a9b2-80bd-4f81-bab3-2679a358eee1"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:00.927611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:00.952394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:00.953854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:00.954603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:00.955536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:00.956180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:00.958422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:00.962831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:01.111259 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] HTTP exception thrown: Volume a4c1b172-31db-4b8a-95e7-dcca10229fb7 could not be found. Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Request method failure captured: Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5/os-volume_attachments/a4c1b172-31db-4b8a-95e7-dcca10229fb7 HTTP/1.1 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 74 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoBP8Nr3xD8xGAlHpvWxMu4w5oe2TD53cw1_EpWxJhHx2fEXvdWDIECM3l8hcv4USyED9K6RBROCuvunHt7g77zcSxaV_szBW5d2CpbaDxlHk-27UdIvf1B7mVBkNWjBdUm0NpY_IJrKUDlwKbypKrVAONWNvMR6IxYeUkfUVqQ_xUw Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 81c675b7842c4660acb7513dfddd3119 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesAdminNegativeTest-2140583681 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81c675b7842c4660acb7513dfddd3119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81c675b7842c4660acb7513dfddd3119"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81c675b7842c4660acb7513dfddd3119"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81c675b7842c4660acb7513dfddd3119"}]}] Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesAdminNegativeTest-2140583681 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 81c675b7842c4660acb7513dfddd3119 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2140583681 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesAdminNegativeTest-2140583681-project-admin Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: af56859c324b46d2b71c1fc6d7377ef2 Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesAdminNegativeTest-2140583681-project-admin Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: {"volumeAttachment": {"volumeId": "8082a9b2-80bd-4f81-bab3-2679a358eee1"}} Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: exception: Volume a4c1b172-31db-4b8a-95e7-dcca10229fb7 could not be found. Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': '3c8f1954-4bec-4117-b3d5-490f2908bff5', 'id': 'a4c1b172-31db-4b8a-95e7-dcca10229fb7', 'body': {'volumeAttachment': {'volumeId': '8082a9b2-80bd-4f81-bab3-2679a358eee1'}}} Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4c1b172-31db-4b8a-95e7-dcca10229fb7 could not be found. (HTTP 404) (Request-ID: req-db771cb7-7986-42b6-b7ca-83c61361c836) Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 08:55:01.115524 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4c1b172-31db-4b8a-95e7-dcca10229fb7 could not be found. Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4c1b172-31db-4b8a-95e7-dcca10229fb7 could not be found. Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4c1b172-31db-4b8a-95e7-dcca10229fb7 could not be found. Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] Returning 404 to user: Volume a4c1b172-31db-4b8a-95e7-dcca10229fb7 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-276606bd-6314-447f-a99a-e6d36bd94794 tempest-VolumesAdminNegativeTest-2140583681 tempest-VolumesAdminNegativeTest-2140583681-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5/os-volume_attachments/a4c1b172-31db-4b8a-95e7-dcca10229fb7" status: 404 len: 109 microversion: 2.1 time: 0.208427 Oct 12 08:55:01.124721 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1266/2691] 10.222.0.40 () {60 vars in 1433 bytes} [Wed Oct 12 08:55:00 2022] PUT /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5/os-volume_attachments/a4c1b172-31db-4b8a-95e7-dcca10229fb7 => generated 109 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:55:01.134686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:01.135894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] [instance: 01a5c393-6cbb-47cf-95c1-f3aea250be94] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:01.153298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:01.153828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:01.159269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:01.160269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:01.160756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:01.161205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:01.203004 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] HTTP exception thrown: Instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 could not be found. Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Request method failure captured: Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 HTTP/1.1 Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCUGlWJnCqFIrwXnqQprVMAb7DNAxfJy-w6gzD5pRXC6_urbh-yok4RCGGN--gNBKtv2hvjFhZLYeno3qDymgpqEh390wWJuMcw-3T3JSDAUwsOTkK6zYW_jpKZgK0BTZFfZQpiVouLeRLZY11yiadfJ6YqIPcxFqQEeSl_BKjTAMo Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: cdd691de25004ed7830feb606255332b Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestFqdnHostnames-265797760 Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cdd691de25004ed7830feb606255332b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cdd691de25004ed7830feb606255332b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cdd691de25004ed7830feb606255332b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cdd691de25004ed7830feb606255332b"}]}] Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestFqdnHostnames-265797760 Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: cdd691de25004ed7830feb606255332b Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-265797760 Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestFqdnHostnames-265797760-project Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: cec3cf3ce9754f5ab926cb97accf6c10 Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestFqdnHostnames-265797760-project Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 could not be found. Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '01a5c393-6cbb-47cf-95c1-f3aea250be94'} Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 could not be found. Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 could not be found. Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:01.204613 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.208334 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:01.208334 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:01.208334 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:01.208334 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:55:01.208334 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:55:01.208334 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 could not be found. Oct 12 08:55:01.208334 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:01.208334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Returning 404 to user: Instance 01a5c393-6cbb-47cf-95c1-f3aea250be94 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:55:01.210606 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d83ac57-a708-4f6e-b1d3-42ff0dd2affa tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94" status: 404 len: 111 microversion: 2.1 time: 0.086240 Oct 12 08:55:01.215707 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1267/2692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:01 2022] GET /compute/v2.1/servers/01a5c393-6cbb-47cf-95c1-f3aea250be94 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:55:01.220772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:01.223283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:01.232904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:01.234279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:01.235145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:01.237035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:01.237879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:01.240274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:01.639338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:01.648795 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d14d63c-feaa-4e5f-a113-e2241ceb5a07 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.436720 Oct 12 08:55:01.654816 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1268/2693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:01 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:01.663839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:01.667497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:01.682566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:01.683348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:01.684031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:01.689985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:01.691431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:01.692135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:01.692745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:01.707379 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-31023d82-7072-4a72-84a6-512db567424a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1310 microversion: 2.1 time: 1.600662 Oct 12 08:55:01.707999 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1426/2694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:00 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1310 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:01.712542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:01.713156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:01.729570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:01.730071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:01.730521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:01.731279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:01.731742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:01.732776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:01.991826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:02.017933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de4aa0b2-ae22-49e3-9de8-654aad2bde31 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1501 microversion: 2.1 time: 0.304358 Oct 12 08:55:02.019551 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1427/2695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:01 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1501 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:02.030926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-74630754-3e0c-48a0-aa85-600093e7044c tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] Calling method '.version_select at 0x7f9843e69ca0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:02.093528 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-74630754-3e0c-48a0-aa85-600093e7044c tempest-ServersTestFqdnHostnames-265797760 tempest-ServersTestFqdnHostnames-265797760-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867344562" status: 202 len: 0 microversion: 2.1 time: 0.069673 Oct 12 08:55:02.094855 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1428/2696] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 08:55:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867344562 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:02.112266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:02.112903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:02.127572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:02.131665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:02.132243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:02.133015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:02.133518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:02.134147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:02.449659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:02.463374 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7c87d785-e755-44c6-b99e-a7bfc2995380 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.805305 Oct 12 08:55:02.465067 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1269/2697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:01 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:02.474763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e56fa151-c283-448b-8d95-9095807da818 req-4cae3703-5070-4732-a8fb-e2b93f1960bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059f5eeb-8abc-4a2d-85d7-1832d79f9054", "tag": "f78111ff-c4de-4d2e-8495-2c6be34e1d8f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:02.497410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e56fa151-c283-448b-8d95-9095807da818 req-4cae3703-5070-4732-a8fb-e2b93f1960bc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:02.500568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e56fa151-c283-448b-8d95-9095807da818 req-4cae3703-5070-4732-a8fb-e2b93f1960bc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:02.503240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e56fa151-c283-448b-8d95-9095807da818 req-4cae3703-5070-4732-a8fb-e2b93f1960bc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:02.566517 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e56fa151-c283-448b-8d95-9095807da818 req-4cae3703-5070-4732-a8fb-e2b93f1960bc service nova] Creating event network-changed:f78111ff-c4de-4d2e-8495-2c6be34e1d8f for instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 on n-h1-858383-10 Oct 12 08:55:02.581164 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e56fa151-c283-448b-8d95-9095807da818 req-4cae3703-5070-4732-a8fb-e2b93f1960bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114560 Oct 12 08:55:02.584046 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1270/2698] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:02.610059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:02.624553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12b54eff-392d-4378-8c81-4332bf71a035 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1315 microversion: 2.1 time: 0.528539 Oct 12 08:55:02.627460 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1429/2699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:02 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:02.678796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:02.679495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:02.689555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:02.690047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:02.690482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:02.691181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:02.696072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:02.700140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:02.735824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:02.736631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:02.750837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:02.753192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:02.753685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:02.754433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:02.757538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:02.765114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:03.136781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:03.151753 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b74f3384-06a3-49c5-b72a-37e4f748c4c6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1310 microversion: 2.1 time: 0.419674 Oct 12 08:55:03.171033 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1430/2700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:02 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1310 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:03.497560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:03.497560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:03.500789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:03.501294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:03.501739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:03.502443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:03.502889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:03.503306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:03.516885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:03.530850 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ab9999e8-c80d-4c63-8655-2267b7a225db tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.856386 Oct 12 08:55:03.532803 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1271/2701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:02 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:03.658430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:03.663674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:03.684551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:03.685488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:03.686380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:03.692696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:03.696380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:03.697150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:03.740458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:03.754058 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-18e4016a-75ec-4db0-89ba-e2b58315a08a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.262174 Oct 12 08:55:03.757169 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1431/2702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:03 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:03.912666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-77c5f66b-d701-4317-8cd2-a01b666e6502 req-d1ad1e93-f94b-4f42-b366-4bc98f6d2288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f", "tag": "df96e422-6048-4a7b-84a9-69b6a2b5a284"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:03.923980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-77c5f66b-d701-4317-8cd2-a01b666e6502 req-d1ad1e93-f94b-4f42-b366-4bc98f6d2288 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:03.924754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-77c5f66b-d701-4317-8cd2-a01b666e6502 req-d1ad1e93-f94b-4f42-b366-4bc98f6d2288 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:03.925594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-77c5f66b-d701-4317-8cd2-a01b666e6502 req-d1ad1e93-f94b-4f42-b366-4bc98f6d2288 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:03.937308 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-77c5f66b-d701-4317-8cd2-a01b666e6502 req-d1ad1e93-f94b-4f42-b366-4bc98f6d2288 service nova] Creating event network-changed:df96e422-6048-4a7b-84a9-69b6a2b5a284 for instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f on n-h1-858383-10 Oct 12 08:55:03.942435 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-77c5f66b-d701-4317-8cd2-a01b666e6502 req-d1ad1e93-f94b-4f42-b366-4bc98f6d2288 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034056 Oct 12 08:55:03.943134 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1432/2703] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:55:04.177949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:04.178640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:04.188449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:04.189197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:04.189863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:04.190778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:04.191407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:04.192007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:04.285710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:04.303492 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6c2eb86-5a98-4b41-8f01-de1a294e153f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1315 microversion: 2.1 time: 0.655241 Oct 12 08:55:04.304200 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1272/2704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:03 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:04.512988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:04.534939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=12 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:04.546344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:04.546887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:04.561216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:04.561785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:04.562272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:04.563591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:04.564101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:04.564533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:04.602994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:04.646326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:55:04.653617 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80cd344f-0305-41dc-9bc5-40a075cace66 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1310 microversion: 2.1 time: 0.475808 Oct 12 08:55:04.654273 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1433/2705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:04 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1310 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:04.677906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:04.678569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:04.702429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:04.703764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:04.704222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:04.704958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:04.706176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:04.706826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:04.731635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:04.870881 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-63657e5f-9164-4f6a-b907-b72fd9a4895d tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 204 len: 0 microversion: 2.1 time: 0.329106 Oct 12 08:55:04.872288 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1273/2706] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:55:04 2022] DELETE /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:55:04.878542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:04.879846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:04.888576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:04.889508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:04.890198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:04.891138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:04.891780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:04.892568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.078906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:05.091626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d621ceb4-f40a-4816-88d5-a747b81c2c26 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.431582 Oct 12 08:55:05.092219 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1434/2707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:04 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:05.098735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:05.099705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:05.110995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:05.111839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:05.112533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.113629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:05.114292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:05.115098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.234657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:05.242367 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa4fde25-f704-4cf7-a258-5c9664aec95a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.368711 Oct 12 08:55:05.247949 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1274/2708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:04 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:05.251979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd4ed06b-5034-4f14-b1ac-622c5950a098"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:05.254988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:05.273157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:05.274063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:05.274063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.274791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:05.275252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:05.275683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.380758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:05.394956 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c8fe65a-ffa3-4430-9386-d8bd1fb35a17 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1513 microversion: 2.1 time: 0.301399 Oct 12 08:55:05.410972 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1435/2709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:05 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:05.410972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:05.410972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:05.426629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:05.427149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:05.427596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.428322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:05.428782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:05.429212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.806896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:05.810136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:05.823919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c848a574-a08c-404b-bce1-a8c565589ce0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1315 microversion: 2.1 time: 0.426994 Oct 12 08:55:05.825533 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1436/2710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:05 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:05.831949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:05.832853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:05.841781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:05.842631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:05.843320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.846492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:05.847066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:05.847972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:05.871518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:06.151119 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-08b55ef6-ec3a-4e4d-bf6d-c63da2ec9043 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902564 Oct 12 08:55:06.152523 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1275/2711] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 08:55:05 2022] POST /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:06.186515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:06.187576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:06.197416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.199000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.202412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.203264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.205848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.206892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.235952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:06.245683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59fed6a8-1f5d-47f1-bcd0-1db0c7fc7ca4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1310 microversion: 2.1 time: 0.418773 Oct 12 08:55:06.249403 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1437/2712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:05 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1310 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:06.275531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:06.276382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:06.283405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.284190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.284830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.285769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.286408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.287021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.497002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:06.513587 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f232984-ad0a-4888-9e8a-a437307c6bed tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.240044 Oct 12 08:55:06.514707 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1438/2713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:06 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:06.522347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:06.523532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:06.531983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.532642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.533250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.534811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.535492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.536355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.574440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:06.588672 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1043eb44-863b-41a8-8101-058c715918df tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.432105 Oct 12 08:55:06.589411 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1276/2714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:06 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:06.777413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:06.789620 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8624cb78-28bb-45fb-9d4a-935a41f73f7a tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1513 microversion: 2.1 time: 0.273306 Oct 12 08:55:06.790691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1439/2715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:06 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:06.841160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-918fa22b-1c0d-401f-9f8b-69c2a301f0df req-17f884a2-3151-4308-bbcb-c630c55d613c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a4c781-b18e-4145-8fa8-a8197652846b", "name": "network-vif-plugged", "status": "completed", "tag": "b8b52663-79a8-4f9d-89f5-5f8e0225c14c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:06.848265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:06.848884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:06.885345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-918fa22b-1c0d-401f-9f8b-69c2a301f0df req-17f884a2-3151-4308-bbcb-c630c55d613c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.885345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-918fa22b-1c0d-401f-9f8b-69c2a301f0df req-17f884a2-3151-4308-bbcb-c630c55d613c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.885345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-918fa22b-1c0d-401f-9f8b-69c2a301f0df req-17f884a2-3151-4308-bbcb-c630c55d613c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.887150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.887150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.887150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.887706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:06.888158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:06.888584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:06.920619 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-918fa22b-1c0d-401f-9f8b-69c2a301f0df req-17f884a2-3151-4308-bbcb-c630c55d613c service nova] Creating event network-vif-plugged:b8b52663-79a8-4f9d-89f5-5f8e0225c14c for instance 95a4c781-b18e-4145-8fa8-a8197652846b on n-h2-858383-10 Oct 12 08:55:06.935587 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-918fa22b-1c0d-401f-9f8b-69c2a301f0df req-17f884a2-3151-4308-bbcb-c630c55d613c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099005 Oct 12 08:55:06.936657 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1277/2716] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:07.096520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:07.105539 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-315110b7-f539-4aae-909c-914e65b995de tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1315 microversion: 2.1 time: 0.260865 Oct 12 08:55:07.121578 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1440/2717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:06 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:07.284624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:07.287186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:07.312963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:07.318117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:07.318883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:07.321132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:07.322293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:07.323368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:07.543019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:07.549900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:07.567632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:07.574000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:07.576204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:07.581113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:07.581915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:07.583224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:07.749806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:07.758886 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2696c29e-9418-4edf-ad6f-7079b47861f7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1310 microversion: 2.1 time: 0.489030 Oct 12 08:55:07.776560 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1278/2718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:07 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1310 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:07.783810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:07.787051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:07.815782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:07.818911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:07.819546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:07.820960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:07.825043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:07.825741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:07.885462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:07.903514 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d4399be-716e-43cf-9254-74f3b42f9f8d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.367343 Oct 12 08:55:07.904127 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1441/2719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:07 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:07.918586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:07.919813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:07.935803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:07.938626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:07.939723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:07.941884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:07.953221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:07.957135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:08.108789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:08.137779 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad68ca47-ea36-4cb4-bff6-2c7fe504793d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.356829 Oct 12 08:55:08.140513 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1279/2720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:07 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:08.162717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c3af2030-e6dd-4d84-aa5f-f9379bd929e4 req-141b7bb1-bf53-4073-8a30-92b74d2cf40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8f1954-4bec-4117-b3d5-490f2908bff5", "name": "network-vif-deleted", "tag": "44e55864-d023-4107-ad14-cc79728d03f7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:08.204295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c3af2030-e6dd-4d84-aa5f-f9379bd929e4 req-141b7bb1-bf53-4073-8a30-92b74d2cf40c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:08.210839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c3af2030-e6dd-4d84-aa5f-f9379bd929e4 req-141b7bb1-bf53-4073-8a30-92b74d2cf40c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:08.211589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c3af2030-e6dd-4d84-aa5f-f9379bd929e4 req-141b7bb1-bf53-4073-8a30-92b74d2cf40c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:08.236757 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c3af2030-e6dd-4d84-aa5f-f9379bd929e4 req-141b7bb1-bf53-4073-8a30-92b74d2cf40c service nova] Creating event network-vif-deleted:44e55864-d023-4107-ad14-cc79728d03f7 for instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 on n-h1-858383-10 Oct 12 08:55:08.242909 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c3af2030-e6dd-4d84-aa5f-f9379bd929e4 req-141b7bb1-bf53-4073-8a30-92b74d2cf40c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098403 Oct 12 08:55:08.244031 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1280/2721] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:08.250310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:08.251629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:08.256325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:08.259962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:08.260742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:08.261344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:08.262313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:08.262766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:08.263545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:08.268259 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f0d70a02-3f42-4a0c-b475-d54d1a992ba0 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 200 len: 1303 microversion: 2.1 time: 0.361766 Oct 12 08:55:08.271305 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1442/2722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:07 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 1303 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:08.542130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:08.565200 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8849d44-205b-444b-b735-b8af82d47cbf tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1315 microversion: 2.1 time: 0.319689 Oct 12 08:55:08.573170 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1281/2723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:08 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:08.783207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:08.784469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:08.805535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:08.808796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:08.809505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:08.811612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:08.812777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:08.815308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:08.932059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:08.933066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:08.952811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:08.955253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:08.956079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:08.961794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:08.963528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:08.964058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.176770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:09.194420 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d04642e6-2016-4d2c-8b0c-d0213b9a510c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1494 microversion: 2.1 time: 0.415192 Oct 12 08:55:09.195458 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1443/2724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:08 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1494 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:09.223472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2419fd15-3fa6-4260-993f-180a0c1ce74a req-9d8ade71-cab1-48e8-bfe2-2f597e33f7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059f5eeb-8abc-4a2d-85d7-1832d79f9054", "name": "network-vif-plugged", "status": "completed", "tag": "f78111ff-c4de-4d2e-8495-2c6be34e1d8f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:09.250141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2419fd15-3fa6-4260-993f-180a0c1ce74a req-9d8ade71-cab1-48e8-bfe2-2f597e33f7da service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.251479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2419fd15-3fa6-4260-993f-180a0c1ce74a req-9d8ade71-cab1-48e8-bfe2-2f597e33f7da service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.254491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2419fd15-3fa6-4260-993f-180a0c1ce74a req-9d8ade71-cab1-48e8-bfe2-2f597e33f7da service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.272937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:09.276725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:09.294437 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9947856c-5aa4-41f3-a3b7-69d6524ce69e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.367514 Oct 12 08:55:09.297401 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-2419fd15-3fa6-4260-993f-180a0c1ce74a req-9d8ade71-cab1-48e8-bfe2-2f597e33f7da service nova] Creating event network-vif-plugged:f78111ff-c4de-4d2e-8495-2c6be34e1d8f for instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 on n-h1-858383-10 Oct 12 08:55:09.305786 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2419fd15-3fa6-4260-993f-180a0c1ce74a req-9d8ade71-cab1-48e8-bfe2-2f597e33f7da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108934 Oct 12 08:55:09.306959 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1444/2725] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:09.315476 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1282/2726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:08 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:09.325387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:09.326228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:09.326953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:09.327802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:09.338753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.339828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.340643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.341997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.344429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.345531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.347315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.353845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.356393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.357413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.360411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.361197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.605076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:09.614863 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10d2e93a-42da-4913-8328-7d1a25b6804a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.296298 Oct 12 08:55:09.616083 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1283/2727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:09 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:09.639937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:09.640953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: 3c8f1954-4bec-4117-b3d5-490f2908bff5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:09.648690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.649428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.650042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.651578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.652725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.653159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.669292 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] HTTP exception thrown: Instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 could not be found. Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Request method failure captured: Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 HTTP/1.1 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoAxEDGVr7pzSFvMZURHIEzGIisOYGqXaXFa-XbXrWDqxgFYJMs2biMOMgAfLzppueI1iPCmEXsfKaTTTYNdm8JCfESe4sDkKc21S8fTgzlGsGkLEa82oOK2C1xY4BE3MhbzwgaTywuMa1t2Z67pQ69uJ7cvnBdGrvsvOvVorrcv6vQ Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: ecfcb084646547968793714916aa6e91 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesAdminNegativeTest-1487136870 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ecfcb084646547968793714916aa6e91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ecfcb084646547968793714916aa6e91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ecfcb084646547968793714916aa6e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ecfcb084646547968793714916aa6e91"}]}] Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesAdminNegativeTest-1487136870 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: ecfcb084646547968793714916aa6e91 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1487136870 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesAdminNegativeTest-1487136870-project Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 87645feeea9f4f0b93b3dddae933d343 Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesAdminNegativeTest-1487136870-project Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 could not be found. Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '3c8f1954-4bec-4117-b3d5-490f2908bff5'} Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 could not be found. Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 could not be found. Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:09.671455 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 could not be found. Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Returning 404 to user: Instance 3c8f1954-4bec-4117-b3d5-490f2908bff5 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:55:09.675335 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6bf54b70-b7a5-4aab-80cf-6d14d80573f7 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5" status: 404 len: 111 microversion: 2.1 time: 0.055322 Oct 12 08:55:09.676829 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1284/2728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:09 2022] GET /compute/v2.1/servers/3c8f1954-4bec-4117-b3d5-490f2908bff5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:55:09.682073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:09.682690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:09.690151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.690651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.691176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.693407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.693902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.694339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.777008 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bd4f4de9-d1db-455e-9fc0-a86fbf52a83b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1647 microversion: 2.1 time: 0.458173 Oct 12 08:55:09.781254 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1445/2729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:09 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1647 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:09.808717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:09.809334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:09.830750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.831501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.832329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.833051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:09.833543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:09.834140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:09.969045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:09.977570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-510f4c2e-438b-48f5-af2e-4dc92841387e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1315 microversion: 2.1 time: 0.299560 Oct 12 08:55:09.978389 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1285/2730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:09 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:10.320343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:10.321117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:10.331891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:10.332662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:10.334559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:10.337390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:10.338081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:10.340077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:10.625136 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78c73924-5a80-4b63-9946-3a602d51c2ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1647 microversion: 2.1 time: 0.821064 Oct 12 08:55:10.626439 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1446/2731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:09 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1647 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:10.646236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:10.647166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:10.654194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:10.655080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:10.655718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:10.656597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:10.657247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:10.657869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.109072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:11.120865 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2715c28-6a10-40f3-9d3e-db5f1254bd21 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.486858 Oct 12 08:55:11.122095 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1447/2732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:10 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:11.127893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1dfe9d52-2c04-4815-b8ba-1d486c0d52e3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:11.131993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dfe9d52-2c04-4815-b8ba-1d486c0d52e3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.132894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dfe9d52-2c04-4815-b8ba-1d486c0d52e3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.133558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dfe9d52-2c04-4815-b8ba-1d486c0d52e3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.134454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dfe9d52-2c04-4815-b8ba-1d486c0d52e3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.135062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dfe9d52-2c04-4815-b8ba-1d486c0d52e3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.135627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dfe9d52-2c04-4815-b8ba-1d486c0d52e3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.164117 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1dfe9d52-2c04-4815-b8ba-1d486c0d52e3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040379 Oct 12 08:55:11.165598 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1448/2733] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 08:55:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:11.179448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:11.181183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:11.189019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.189864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.190516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.191623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.192279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.192897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.213044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:11.228010 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f691ed14-a9ae-40ed-8139-04bc883b00bd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.908119 Oct 12 08:55:11.228907 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1286/2734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:10 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:11.237761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:11.239260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:11.256901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.257743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.258588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.259488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.260117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.260822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.344532 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7473943b-3f65-4e89-9ce6-75f14f6d3798 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b/action" status: 202 len: 0 microversion: 2.1 time: 0.109880 Oct 12 08:55:11.349620 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1287/2735] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:55:11 2022] POST /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:11.359736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:11.366968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:11.376624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.377588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.378185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.379038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.379653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.380474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.484776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:11.493119 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f87c7b42-5cde-4816-abe5-f2a18f8ce749 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1503 microversion: 2.1 time: 0.326326 Oct 12 08:55:11.495045 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1449/2736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:11 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:11.520552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c230b729-bebb-458e-9dae-655f7a565b8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:11.527193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c230b729-bebb-458e-9dae-655f7a565b8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.528050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c230b729-bebb-458e-9dae-655f7a565b8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.528707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c230b729-bebb-458e-9dae-655f7a565b8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.597064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c230b729-bebb-458e-9dae-655f7a565b8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Going to try to stop instance {{(pid=127006) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 08:55:11.652021 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c230b729-bebb-458e-9dae-655f7a565b8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054/action" status: 202 len: 0 microversion: 2.1 time: 0.137509 Oct 12 08:55:11.653417 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1450/2737] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:55:11 2022] POST /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:55:11.666608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:11.669034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:11.682877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.685677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.686198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.686998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:11.691205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:11.691738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:11.851264 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7dc9bc51-34e2-401a-859b-cc1bc11991f4 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1652 microversion: 2.1 time: 0.500094 Oct 12 08:55:11.851853 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1288/2738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:11 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1652 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:11.942645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:11.955944 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fddabb09-59d8-409e-b87c-201c04f3487a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.298269 Oct 12 08:55:11.957020 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1451/2739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:11 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:12.143930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:12.149265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:12.160610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:12.162261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:12.163302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:12.164492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:12.165164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:12.165817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:12.251251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:12.252406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:12.259564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:12.261751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:12.262368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:12.263776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:12.264382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:12.264961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:12.445683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:12.459225 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f919f308-7a6c-458b-af7b-897749b54ed0 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.211569 Oct 12 08:55:12.460559 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1452/2740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:12 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:12.584607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:12.594392 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c341579-260e-40b2-b556-99238d84c955 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.454176 Oct 12 08:55:12.599251 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1289/2741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:12 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:12.849174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-799d1ab8-876a-47c2-a0b4-725b16b6f0e9 req-eee9a5c2-aa9d-489d-ba32-a5d7d9ede291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f", "name": "network-vif-plugged", "status": "completed", "tag": "df96e422-6048-4a7b-84a9-69b6a2b5a284"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:12.868736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-799d1ab8-876a-47c2-a0b4-725b16b6f0e9 req-eee9a5c2-aa9d-489d-ba32-a5d7d9ede291 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:12.869249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-799d1ab8-876a-47c2-a0b4-725b16b6f0e9 req-eee9a5c2-aa9d-489d-ba32-a5d7d9ede291 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:12.869736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-799d1ab8-876a-47c2-a0b4-725b16b6f0e9 req-eee9a5c2-aa9d-489d-ba32-a5d7d9ede291 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:12.875930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:12.876578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:12.884896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:12.889165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:12.891604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:12.892592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:12.894110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:12.900466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:12.904756 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-799d1ab8-876a-47c2-a0b4-725b16b6f0e9 req-eee9a5c2-aa9d-489d-ba32-a5d7d9ede291 service nova] Creating event network-vif-plugged:df96e422-6048-4a7b-84a9-69b6a2b5a284 for instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f on n-h1-858383-10 Oct 12 08:55:12.910071 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-799d1ab8-876a-47c2-a0b4-725b16b6f0e9 req-eee9a5c2-aa9d-489d-ba32-a5d7d9ede291 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065204 Oct 12 08:55:12.911223 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1453/2742] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:12.986266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:12.987018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:13.002993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:13.003494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:13.005641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:13.007525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:13.010524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:13.011005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:13.342163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:13.351608 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f0ae88e-ef17-4aea-b7b0-bb70bca6ed1e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.370828 Oct 12 08:55:13.365472 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1454/2743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:12 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:13.400556 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-edf3ac9b-997f-4570-9d13-d2670db75f62 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1632 microversion: 2.1 time: 0.528359 Oct 12 08:55:13.402985 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1290/2744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:12 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1632 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:13.426133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-10", "block_migration": true, "disk_over_commit": false}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:13.430394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:13.451889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:13.452946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:13.454032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:13.455864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:13.456478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:13.457451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:13.463508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:13.485786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:13.486813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:13.496963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:13.497836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:13.499150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:13.501617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:13.504476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:13.505262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:13.567365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lazy-loading 'flavor' on Instance uuid 95a4c781-b18e-4145-8fa8-a8197652846b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:55:13.606713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Going to try to live migrate instance to n-h1-858383-10 {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:55:14.271155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:14.281701 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eeb5d7fb-6cb4-41fd-9c3b-85a2c97c7e38 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1309 microversion: 2.1 time: 0.800940 Oct 12 08:55:14.282620 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1291/2745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:13 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1309 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:14.288537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:14.289720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:14.296283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:14.297355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:14.298031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:14.298947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:14.299599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:14.306298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:14.827755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:14.871813 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a3c5b1d0-8c02-4d9c-ac9a-a71221e1747c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.585145 Oct 12 08:55:14.875496 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1292/2746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:14 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:14.891392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:14.893391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:14.905232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:14.906106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:14.906757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:14.907703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:14.908410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:14.909044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:15.234137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:15.244738 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a094fa0-08d0-456e-b94f-cbeab71aa7a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.365647 Oct 12 08:55:15.261484 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1293/2747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:14 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:15.310147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:15.311569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:15.324773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:15.335303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:15.335974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:15.336950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:15.341130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:15.341862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:15.731778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:15.744949 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6cf7e815-9236-4330-99f9-1e2f4407615b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1490 microversion: 2.1 time: 0.440377 Oct 12 08:55:15.748269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1294/2748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:15 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1490 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:15.774567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:15.778169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:15.807904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:15.809103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:15.809841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:15.810857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:15.812485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:15.813182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:15.999710 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2e8f93db-667f-4fcf-9ee9-c0f47262d6f3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "PUT /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1085 microversion: 2.1 time: 0.229282 Oct 12 08:55:16.013898 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1295/2749] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 08:55:15 2022] PUT /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1085 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:16.019215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:16.020199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:16.032759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:16.033806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:16.034461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:16.035805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:16.036059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:16.036602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:16.370338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:16.381820 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1442a3e6-4670-4507-b0ff-71faabd54d77 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1514 microversion: 2.1 time: 0.366235 Oct 12 08:55:16.382593 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1296/2750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:16 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:16.394940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:16.402407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:16.410743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:16.411450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:16.413207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:16.414172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:16.414796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:16.415510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:16.639570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:16.650322 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8ae62aa-9b08-4b1b-9ce9-32cbe5e08d3c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1511 microversion: 2.1 time: 0.264166 Oct 12 08:55:16.668288 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1297/2751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:16 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:16.684050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:16.685407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:16.693304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:16.694828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:16.695436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:16.696327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:16.696947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:16.697555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:16.717031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:16.908597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:16.922879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1f67022-eab5-476a-8adb-cdebb69143ba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.252082 Oct 12 08:55:16.942664 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1298/2752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:16 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:16.952479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:16.953428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:16.960184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:16.961030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:16.962242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:16.963293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:16.963989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:16.964710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.105770 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5afab6d8-eca7-4957-a680-e7be15f429ce tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b/action" status: 202 len: 0 microversion: 2.1 time: 3.683935 Oct 12 08:55:17.107227 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1455/2753] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:55:13 2022] POST /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b/action => generated 0 bytes in 3686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:17.117508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:17.118506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:17.136206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:17.137090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:17.137808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.139820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:17.141184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:17.143168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.606920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:17.614898 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b767192-0147-4ddc-97d4-3992e6703517 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1511 microversion: 2.1 time: 0.669541 Oct 12 08:55:17.626111 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1299/2754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:16 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1511 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:17.632594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:17.632775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:17.633381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:17.655766 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7de71272-f8bc-4f60-9f15-d913d8021d80 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1504 microversion: 2.1 time: 0.536020 Oct 12 08:55:17.658784 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1456/2755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:17 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:17.679690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:17.680527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:17.704867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:17.705373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:17.705840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.710372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:17.711073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:17.711751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.713780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:17.714385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:17.714834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.715593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:17.716013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:17.716440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.766208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:55:17.886513 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6e81847b-818c-46b1-a422-127344365889 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 204 len: 0 microversion: 2.1 time: 0.225611 Oct 12 08:55:17.887732 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1457/2756] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:55:17 2022] DELETE /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:55:17.898372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:17.899269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:17.908328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:17.909119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:17.909652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.910439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:17.910952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:17.911480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:17.948556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:55:18.074040 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d8d2a04-8501-4dd8-b5de-36d975cfe7cf tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 204 len: 0 microversion: 2.1 time: 0.183630 Oct 12 08:55:18.074752 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1458/2757] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:55:17 2022] DELETE /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:55:18.081456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:18.082288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:18.090436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:18.091011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:18.091450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:18.092399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:18.093222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:18.093906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:18.326418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:18.334746 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77e3238e-d6d6-42b5-b71c-0248f46dfaee tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1520 microversion: 2.1 time: 0.707491 Oct 12 08:55:18.335887 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1300/2758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:17 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1520 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:18.340753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:18.342730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:18.349564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:18.361603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:18.367869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:18.372711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:18.373623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:18.374224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:18.623787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:18.650120 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-948681b0-dc46-47ec-83b6-67b58a8dbf5f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1517 microversion: 2.1 time: 0.573704 Oct 12 08:55:18.676566 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1459/2759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:18 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1517 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:18.676566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:18.676566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:18.679048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:18.679048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:18.679048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:18.679370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:18.679630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:18.681073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:18.911953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:18.927366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6f0167e7-3f9b-4ff8-885c-2085a26116fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.590170 Oct 12 08:55:18.936180 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1301/2760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:18 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:18.960853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:18.961536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:19.009292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:19.010016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:19.010638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:19.011565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:19.012173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:19.016781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:19.242185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:19.252850 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aac2ba8f-092d-44b9-819d-072945d15fdd tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1680 microversion: 2.1 time: 0.588598 Oct 12 08:55:19.253727 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1460/2761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:18 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1680 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:19.362688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:19.363681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:19.380738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:19.381246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:19.381873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:19.382461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:19.382923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:19.383357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:19.755235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:19.763377 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f85536f-371a-4df8-957c-b65033644848 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1520 microversion: 2.1 time: 0.404698 Oct 12 08:55:19.777994 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1461/2762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:19 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:19.787703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:19.792086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:19.801549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:19.802282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:19.802923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:19.803869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:19.804530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:19.805162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:20.038876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:20.074544 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-899ec673-d1db-4cf3-a444-d93c2524b286 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1504 microversion: 2.1 time: 1.133051 Oct 12 08:55:20.075148 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1302/2763] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:18 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1504 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:20.103025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:20.106209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:20.155548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:20.156777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:20.157395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:20.158322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:20.158976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:20.159637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:20.212320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:20.221580 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-acceb55c-0144-485e-a463-c830f7eaec89 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1517 microversion: 2.1 time: 0.442269 Oct 12 08:55:20.222175 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1462/2764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:19 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1517 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:20.276441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:20.277164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:20.279137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:20.294772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:20.295226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:20.295662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:20.296372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:20.296827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:20.297250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:21.000856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:21.010559 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a1b2525f-27af-4060-9f05-ec73218050ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.922483 Oct 12 08:55:21.013456 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1303/2765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:20 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:21.020529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:21.026756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:21.043439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:21.044092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:21.044356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:21.045270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:21.045755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:21.046184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:21.145584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:21.163297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:21.180425 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-efbc9f66-c249-4673-8756-4d107f899e4b tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1680 microversion: 2.1 time: 0.908079 Oct 12 08:55:21.181935 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1463/2766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:20 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1680 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:21.207575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:21.208553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:21.220795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:21.221746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:21.222337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:21.224003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:21.225072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:21.225735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:21.548254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:21.557740 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-97ac3113-23f5-4727-883b-683cf62e17c8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1504 microversion: 2.1 time: 0.371837 Oct 12 08:55:21.562771 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1464/2767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:21 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:21.569669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:21.575393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:21.595474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:21.595976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:21.596601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:21.597510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:21.598116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:21.598695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:21.687956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:21.702422 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d20198e-333a-4d25-b6cf-1beba4a4c1f6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1520 microversion: 2.1 time: 0.687015 Oct 12 08:55:21.710294 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1304/2768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:21 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1520 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:21.715650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d0222082-7d74-421c-a243-e2175aa82912 req-63531ddb-e1dd-4d6c-8df9-7d6afa5757de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a4c781-b18e-4145-8fa8-a8197652846b", "name": "network-vif-unplugged", "status": "completed", "tag": "b8b52663-79a8-4f9d-89f5-5f8e0225c14c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:21.747329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d0222082-7d74-421c-a243-e2175aa82912 req-63531ddb-e1dd-4d6c-8df9-7d6afa5757de service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:21.754366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d0222082-7d74-421c-a243-e2175aa82912 req-63531ddb-e1dd-4d6c-8df9-7d6afa5757de service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:21.755078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d0222082-7d74-421c-a243-e2175aa82912 req-63531ddb-e1dd-4d6c-8df9-7d6afa5757de service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:21.773904 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d0222082-7d74-421c-a243-e2175aa82912 req-63531ddb-e1dd-4d6c-8df9-7d6afa5757de service nova] Creating event network-vif-unplugged:b8b52663-79a8-4f9d-89f5-5f8e0225c14c for instance 95a4c781-b18e-4145-8fa8-a8197652846b on n-h2-858383-10 Oct 12 08:55:21.789566 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d0222082-7d74-421c-a243-e2175aa82912 req-63531ddb-e1dd-4d6c-8df9-7d6afa5757de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077621 Oct 12 08:55:21.793756 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1305/2769] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:22.005351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b74b5b7e-507b-4883-b07d-32028363e78a tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Action: 'create', calling method: .version_select at 0x7f98489ef670>, body: {"pool": null} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:22.164430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:22.181323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85738d9a-c545-4b46-bd6c-5f957507876a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1475 microversion: 2.1 time: 0.616896 Oct 12 08:55:22.181950 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1465/2770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:21 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1475 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:22.186924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:22.187524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:22.204439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:22.204939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:22.205373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:22.206148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:22.206597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:22.207429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:22.238410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:22.480238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:22.488475 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2b565da-1046-43c4-afbd-025adcafb0da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.305438 Oct 12 08:55:22.489215 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1466/2771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:22 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:22.505081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:22.506679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:22.516193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:22.516790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:22.517311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:22.518149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:22.518693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:22.519442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:22.708982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:22.721303 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc2b87fe-0734-4215-83c5-c37a893aa5d8 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1680 microversion: 2.1 time: 0.222258 Oct 12 08:55:22.739319 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1467/2772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:22 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:22.745563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:22.747640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:22.755119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:22.756103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:22.756751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:22.758076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:22.758784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:22.759576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:22.797679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:55:22.946301 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-91f37a9b-1193-431b-87bc-9350453ce321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 204 len: 0 microversion: 2.1 time: 0.203939 Oct 12 08:55:22.949351 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1468/2773] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:55:22 2022] DELETE /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:55:22.963788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:22.965009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:22.974316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:22.979773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:22.980964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:22.982607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:22.983291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:22.983906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.129863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:23.141241 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b128457e-da4f-495a-a9b8-ef64c21f1963 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1504 microversion: 2.1 time: 0.186107 Oct 12 08:55:23.153469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1469/2774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:22 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:23.153469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-dda0a0f3-f230-48c4-8571-a94048295c2b req-bc1610e3-898f-4196-9be7-b20c6e99d6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f", "name": "network-vif-deleted", "tag": "df96e422-6048-4a7b-84a9-69b6a2b5a284"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:23.157100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dda0a0f3-f230-48c4-8571-a94048295c2b req-bc1610e3-898f-4196-9be7-b20c6e99d6cc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:23.157796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dda0a0f3-f230-48c4-8571-a94048295c2b req-bc1610e3-898f-4196-9be7-b20c6e99d6cc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:23.158431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dda0a0f3-f230-48c4-8571-a94048295c2b req-bc1610e3-898f-4196-9be7-b20c6e99d6cc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.173126 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-dda0a0f3-f230-48c4-8571-a94048295c2b req-bc1610e3-898f-4196-9be7-b20c6e99d6cc service nova] Creating event network-vif-deleted:df96e422-6048-4a7b-84a9-69b6a2b5a284 for instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f on n-h1-858383-10 Oct 12 08:55:23.181190 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-dda0a0f3-f230-48c4-8571-a94048295c2b req-bc1610e3-898f-4196-9be7-b20c6e99d6cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037028 Oct 12 08:55:23.181960 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1470/2775] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:23.190457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:23.191842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:23.200911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:23.202125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:23.202694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.203539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:23.204222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:23.204791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.439072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:23.456806 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d42c1956-eed5-4985-9a41-a6f0826e46c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1520 microversion: 2.1 time: 0.272626 Oct 12 08:55:23.470928 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1471/2776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:23 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:23.470928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:23.470928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:23.478497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:23.479049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:23.479657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.480411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:23.481044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:23.481359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.780693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:23.798249 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca2d6c73-6879-49b0-8cef-778b7c0491ab tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1553 microversion: 2.1 time: 0.336233 Oct 12 08:55:23.801070 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1472/2777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:23 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1553 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:23.818267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:23.818896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:23.835354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:23.842791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:23.851645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.860382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:23.860382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:23.860382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.954262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:23.954786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:23.956142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:23.957318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'fault' on Instance uuid a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:55:24.015226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:24.023388 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2b308301-19fc-481c-b2b1-0c53bb229d6c tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 200 len: 1320 microversion: 2.1 time: 0.218638 Oct 12 08:55:24.024299 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1473/2778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:23 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:24.046510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:24.047210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:24.054586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.055198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.056050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:24.056841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.057431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.058097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:24.351198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:24.362088 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ef17751-0730-42c4-878a-3df7672e50eb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.322178 Oct 12 08:55:24.380428 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1474/2779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:24 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:24.394583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:24.395207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:24.414698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.418790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.420503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:24.423637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.424716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.426324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:24.517826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.518389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.518935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:24.519522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lazy-loading 'fault' on Instance uuid bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:55:24.592161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87645feeea9f4f0b93b3dddae933d343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfcb084646547968793714916aa6e91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:24.611947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ea78c704-8275-4c1f-bd36-5a6ebb3f2881 tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 200 len: 1331 microversion: 2.1 time: 0.230297 Oct 12 08:55:24.627182 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1475/2780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:24 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 1331 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:24.725310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-abecbab0-3183-4a95-a096-13249ae6c135 req-5542dc74-6c0f-4b7c-8f41-a094bfe6eca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5400c2d-3481-43fa-87b9-9a1886f2dae3", "name": "network-vif-plugged", "status": "completed", "tag": "c8b07757-93d9-4bd6-bdfd-097594ad4c3e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:24.764705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-abecbab0-3183-4a95-a096-13249ae6c135 req-5542dc74-6c0f-4b7c-8f41-a094bfe6eca8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.778569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-abecbab0-3183-4a95-a096-13249ae6c135 req-5542dc74-6c0f-4b7c-8f41-a094bfe6eca8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.779181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-abecbab0-3183-4a95-a096-13249ae6c135 req-5542dc74-6c0f-4b7c-8f41-a094bfe6eca8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:24.820900 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-abecbab0-3183-4a95-a096-13249ae6c135 req-5542dc74-6c0f-4b7c-8f41-a094bfe6eca8 service nova] Creating event network-vif-plugged:c8b07757-93d9-4bd6-bdfd-097594ad4c3e for instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 on n-h2-858383-10 Oct 12 08:55:24.850732 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-abecbab0-3183-4a95-a096-13249ae6c135 req-5542dc74-6c0f-4b7c-8f41-a094bfe6eca8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220558 Oct 12 08:55:24.853272 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1476/2781] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:24.868366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-debb85d5-1cf0-45e4-b8af-47842f0ea61f req-a6081f6e-031b-4381-b91d-3218c6d99f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a4c781-b18e-4145-8fa8-a8197652846b", "tag": "b8b52663-79a8-4f9d-89f5-5f8e0225c14c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:24.908609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-debb85d5-1cf0-45e4-b8af-47842f0ea61f req-a6081f6e-031b-4381-b91d-3218c6d99f4d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.909468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-debb85d5-1cf0-45e4-b8af-47842f0ea61f req-a6081f6e-031b-4381-b91d-3218c6d99f4d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.909869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-debb85d5-1cf0-45e4-b8af-47842f0ea61f req-a6081f6e-031b-4381-b91d-3218c6d99f4d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:24.933922 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-debb85d5-1cf0-45e4-b8af-47842f0ea61f req-a6081f6e-031b-4381-b91d-3218c6d99f4d service nova] Creating event network-changed:b8b52663-79a8-4f9d-89f5-5f8e0225c14c for instance 95a4c781-b18e-4145-8fa8-a8197652846b on n-h2-858383-10 Oct 12 08:55:24.945739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-debb85d5-1cf0-45e4-b8af-47842f0ea61f req-a6081f6e-031b-4381-b91d-3218c6d99f4d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090865 Oct 12 08:55:24.950403 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1477/2782] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:24.957063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:24.958014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:24.965327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.966086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.966737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:24.968184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:24.968962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:24.969570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:25.187454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:25.200958 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a383f5b9-f703-4512-b494-6adfdee20a62 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1504 microversion: 2.1 time: 0.248591 Oct 12 08:55:25.201964 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1478/2783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:24 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:25.223807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:25.225029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:25.237302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:25.238884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:25.239668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:25.241201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:25.242064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:25.242719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:25.714434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:25.726490 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fdc89949-86f9-40f4-959b-7350e79055ac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1520 microversion: 2.1 time: 0.523061 Oct 12 08:55:25.730265 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1479/2784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:25 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:25.739801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:25.742513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:25.756498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:25.758611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:25.759378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:25.760264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:25.761095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:25.761778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.086925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:26.126447 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aca98836-6024-4519-bee3-c7acca251588 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1553 microversion: 2.1 time: 0.394925 Oct 12 08:55:26.139283 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1480/2785] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:25 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1553 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:26.146205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:26.150920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:26.176158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.176992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.201333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.202679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.205170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.205944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.252984 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f HTTP/1.1 Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f'} Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.255170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:26.261110 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:26.261110 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:26.261110 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:55:26.261110 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:55:26.261110 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:55:26.261110 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.270135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:55:26.271326 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-366ec784-09de-4f0d-bd3d-983a07b1372f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 404 len: 111 microversion: 2.1 time: 0.130578 Oct 12 08:55:26.272140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1481/2786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:26 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:55:26.282901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7d7842a8-cf9e-410f-a8e8-dc8618cbf5bd req-d5c0d7f0-66e1-4b59-9e92-e95e875abb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814", "name": "network-vif-deleted", "tag": "e94727c5-ffb3-4193-ac33-68322d68eea9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:26.296796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7d7842a8-cf9e-410f-a8e8-dc8618cbf5bd req-d5c0d7f0-66e1-4b59-9e92-e95e875abb5e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.297569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7d7842a8-cf9e-410f-a8e8-dc8618cbf5bd req-d5c0d7f0-66e1-4b59-9e92-e95e875abb5e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.298235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7d7842a8-cf9e-410f-a8e8-dc8618cbf5bd req-d5c0d7f0-66e1-4b59-9e92-e95e875abb5e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.312534 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b74b5b7e-507b-4883-b07d-32028363e78a tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.485577 Oct 12 08:55:26.314701 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1306/2787] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:55:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:26.320317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:26.321658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:26.337308 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7d7842a8-cf9e-410f-a8e8-dc8618cbf5bd req-d5c0d7f0-66e1-4b59-9e92-e95e875abb5e service nova] Creating event network-vif-deleted:e94727c5-ffb3-4193-ac33-68322d68eea9 for instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 on n-h2-858383-10 Oct 12 08:55:26.337685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:26.342057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.342710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.344560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.345635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.348201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.350050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.358325 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7d7842a8-cf9e-410f-a8e8-dc8618cbf5bd req-d5c0d7f0-66e1-4b59-9e92-e95e875abb5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084653 Oct 12 08:55:26.360740 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1482/2788] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:26.382678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:26.387846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] [instance: bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:26.405117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.406115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.407856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.408841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.411690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.413917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.454177 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] HTTP exception thrown: Instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 could not be found. Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Request method failure captured: Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 HTTP/1.1 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoAxEDGVr7pzSFvMZURHIEzGIisOYGqXaXFa-XbXrWDqxgFYJMs2biMOMgAfLzppueI1iPCmEXsfKaTTTYNdm8JCfESe4sDkKc21S8fTgzlGsGkLEa82oOK2C1xY4BE3MhbzwgaTywuMa1t2Z67pQ69uJ7cvnBdGrvsvOvVorrcv6vQ Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: ecfcb084646547968793714916aa6e91 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesAdminNegativeTest-1487136870 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ecfcb084646547968793714916aa6e91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ecfcb084646547968793714916aa6e91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ecfcb084646547968793714916aa6e91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ecfcb084646547968793714916aa6e91"}]}] Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesAdminNegativeTest-1487136870 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: ecfcb084646547968793714916aa6e91 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1487136870 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesAdminNegativeTest-1487136870-project Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 87645feeea9f4f0b93b3dddae933d343 Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesAdminNegativeTest-1487136870-project Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 could not be found. Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814'} Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 could not be found. Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 could not be found. Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:26.457130 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.461181 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:26.461181 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:26.461181 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:26.461181 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:55:26.461181 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:55:26.461181 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 could not be found. Oct 12 08:55:26.461181 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:55:26.467397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Returning 404 to user: Instance bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:55:26.468657 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1cbd6f0a-c42a-4bc1-8861-69c9cf9970fb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814" status: 404 len: 111 microversion: 2.1 time: 0.102231 Oct 12 08:55:26.469795 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1483/2789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:26 2022] GET /compute/v2.1/servers/bd5d3c50-c3ae-48b2-b2cd-4f2b5800c814 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:55:26.477072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:26.477942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:26.485955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.486823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.487775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.488927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:26.489670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:26.490584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:26.681076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:26.684661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:26.692423 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d136845-cc55-48d7-b6b7-e07bfabbe3fc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1504 microversion: 2.1 time: 0.221166 Oct 12 08:55:26.693623 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1484/2790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:26 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:26.714975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7b59252f-5c2f-4b1c-bf4c-378692639e2f tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Action: 'create', calling method: .version_select at 0x7f9843d65e50>, body: {"pool": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:27.175270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:27.186985 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-562fe315-2e72-4bc2-bcf7-332e5535a625 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.870483 Oct 12 08:55:27.206974 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1307/2791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:26 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:27.219994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3d2a113-e1f0-4a17-ae6b-db8d44bf8afb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] Calling method '.version_select at 0x7f98489e1310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:27.269737 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3d2a113-e1f0-4a17-ae6b-db8d44bf8afb tempest-VolumesAdminNegativeTest-1487136870 tempest-VolumesAdminNegativeTest-1487136870-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657414392" status: 202 len: 0 microversion: 2.1 time: 0.061350 Oct 12 08:55:27.272468 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1308/2792] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 08:55:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657414392 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:27.279294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1037651887", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5694562d-e360-435c-86bf-39f253be6d82"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:27.413373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] validate_networks() for [('5694562d-e360-435c-86bf-39f253be6d82', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:55:28.882649 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7b59252f-5c2f-4b1c-bf4c-378692639e2f tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.187737 Oct 12 08:55:28.884453 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1485/2793] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:55:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:28.891884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:28.893511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:28.918244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:28.918748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:28.919389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:28.920316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:28.920929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:28.921568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.180871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:29.208142 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-93d064cb-2b9c-47a9-8569-fa3ae6cfe3b1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1505 microversion: 2.1 time: 0.322271 Oct 12 08:55:29.209292 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1486/2794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:28 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:29.214474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:29.215312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:29.223412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.224141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.224867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.225838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.226453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.227036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.344412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:29.359538 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7a65199a-67ff-41b7-a3ba-91d65157da70 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1345 microversion: 2.1 time: 0.148868 Oct 12 08:55:29.365566 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1487/2795] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:29 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:29.370851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:29.371775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:29.396757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.398081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.399036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.401690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.410271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.410827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.617141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:55:29.617616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:55:29.617902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:55:29.618511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:55:29.619080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:55:29.629695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.630407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.631188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.632372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.632833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.633354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.669476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:29.682754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:55:29.688739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c5e753b-3021-4899-867c-069ce28440aa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1504 microversion: 2.1 time: 0.316375 Oct 12 08:55:29.692809 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1488/2796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:29 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:29.703842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Getting quotas for user 3e15f6bf271141d59471f6f77bb2be45 and project 8c561613c0cf4dbbbc6b7f3ff6a2d00e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:55:29.707051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:29.707982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:29.723936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:55:29.732265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:55:29.735441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.736693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.737381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.739434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.742871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.747233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.812876 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-139bbd4b-a7f7-4780-9ed2-124ebd0b9cb1 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538674 Oct 12 08:55:29.817228 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1309/2797] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:55:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:55:29.826565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-840f30e2-9d67-4071-9a72-991cfe26c968 req-61b777d3-ef02-40e7-b7d6-a78ed5882a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8defa84-3694-41e0-b0ea-4ec9d270a48a", "name": "network-vif-deleted", "tag": "350ccd25-c7e5-418c-9547-b51233f41ff6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:29.855911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-840f30e2-9d67-4071-9a72-991cfe26c968 req-61b777d3-ef02-40e7-b7d6-a78ed5882a2e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:29.856687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-840f30e2-9d67-4071-9a72-991cfe26c968 req-61b777d3-ef02-40e7-b7d6-a78ed5882a2e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:29.857300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-840f30e2-9d67-4071-9a72-991cfe26c968 req-61b777d3-ef02-40e7-b7d6-a78ed5882a2e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:29.888460 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-840f30e2-9d67-4071-9a72-991cfe26c968 req-61b777d3-ef02-40e7-b7d6-a78ed5882a2e service nova] Creating event network-vif-deleted:350ccd25-c7e5-418c-9547-b51233f41ff6 for instance c8defa84-3694-41e0-b0ea-4ec9d270a48a on n-h1-858383-10 Oct 12 08:55:29.905926 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-840f30e2-9d67-4071-9a72-991cfe26c968 req-61b777d3-ef02-40e7-b7d6-a78ed5882a2e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087229 Oct 12 08:55:29.909941 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1310/2798] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:29.931624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c491a10f-1615-48f7-83f5-379a30718e47 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Action: 'create', calling method: .version_select at 0x7f9848ad7d30>, body: {"pool": null} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:30.830953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:30.849979 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c4778ab6-6450-4c53-9129-bc1f4bd073b1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 1.155843 Oct 12 08:55:30.851508 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1489/2799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:29 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:30.867060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:30.867765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:30.890033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:30.890683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:30.891136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:30.891897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:30.892349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:30.897149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:31.352995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:31.364656 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bac1d825-b68c-4aa9-bbcd-a5123b12ea92 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 200 len: 1505 microversion: 2.1 time: 0.511987 Oct 12 08:55:31.379076 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1490/2800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:30 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:31.391440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:31.393160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:31.401135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:31.402042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:31.402687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:31.404984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:31.405896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:31.406607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:31.500850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:31.512332 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a7424383-680d-4d55-98a8-e666fa5c16da tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1261 microversion: 2.1 time: 0.131588 Oct 12 08:55:31.513105 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1491/2801] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:31 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1261 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:31.532010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:31.532672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:31.541733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:31.542165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:31.542603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:31.543310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:31.543762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:31.544188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:31.690079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:31.700337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69f2ff0a-a9d9-4b60-b418-53af56dba791 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1345 microversion: 2.1 time: 0.186345 Oct 12 08:55:31.714135 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1492/2802] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:31 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1345 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:31.721941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:31.722669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:31.730256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:31.730971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:31.731422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:31.732175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:31.732648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:31.733110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:32.109239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:32.129684 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0fd3f632-5876-421d-9692-129529e76b53 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1504 microversion: 2.1 time: 0.410893 Oct 12 08:55:32.139896 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1493/2803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:31 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:32.154089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:32.154662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:32.172230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:32.172984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:32.173618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:32.174492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:32.175111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:32.175806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:32.238923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:55:32.408297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fbcc06ec-e9df-45f8-99aa-a13f17022cac tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 204 len: 0 microversion: 2.1 time: 0.266770 Oct 12 08:55:32.420511 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1494/2804] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:55:32 2022] DELETE /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:55:32.426764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:32.427834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:32.435187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:32.436074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:32.436887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:32.438108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:32.438809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:32.439435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:32.938429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:32.950986 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-98fcbf4b-ec43-408d-beb8-ae59ba734d9e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.528699 Oct 12 08:55:32.966576 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1495/2805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:32 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:32.973636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:32.975083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:32.981767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:32.982502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:32.983164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:32.984059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:32.984690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:32.985343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:33.067099 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c491a10f-1615-48f7-83f5-379a30718e47 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.155391 Oct 12 08:55:33.068986 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1311/2806] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:55:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:33.074869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1375292397", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "0a41b357-9e1a-4739-bdde-df451b1badd5"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:33.177272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] validate_networks() for [('0a41b357-9e1a-4739-bdde-df451b1badd5', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:55:33.801787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:33.812719 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c49665e2-b0ec-4155-80bb-3ac7c8f770ca tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1309 microversion: 2.1 time: 0.842237 Oct 12 08:55:33.826015 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1496/2807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:32 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1309 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:33.833557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:33.834425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:33.844518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:33.845257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:33.846819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:33.847727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:33.854986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:33.855712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:34.087137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:34.100205 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-31180793-ea92-4a07-a5e9-46c025db7f09 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 200 len: 1345 microversion: 2.1 time: 0.272710 Oct 12 08:55:34.122877 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1497/2808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:33 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 1345 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:34.122877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2b6d20dc-ca82-45e2-8a51-f109adc335d6 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Action: 'create', calling method: .version_select at 0x7f9843dbe280>, body: {"pool": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:35.412275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:55:35.415337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:55:35.416491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:55:35.417059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:55:35.424446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:55:35.443449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:35.446292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:35.446871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:35.447835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:35.448658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:35.449858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:35.484398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Getting quotas for project 70848fd10ea847968908b8ba3f30b907. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:55:35.496001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Getting quotas for user 90150a5342474fd0ad10fc853b2c5d96 and project 70848fd10ea847968908b8ba3f30b907. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:55:35.518439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:55:35.522497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:55:35.620185 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-762ec723-e743-4e07-ab43-a7942641e88b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.549469 Oct 12 08:55:35.634785 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1312/2809] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:55:35.640518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:35.651963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:35.666761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:35.671181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:35.671843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:35.672754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:35.673353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:35.673951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:36.371729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:36.388732 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-31a30505-f86c-46f5-b4bd-a56e9ef77949 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1479 microversion: 2.1 time: 0.752225 Oct 12 08:55:36.390408 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1313/2810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:35 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1479 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:36.398848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:36.400115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:36.416415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:36.418920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:36.419807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:36.421386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:36.422480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:36.423178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.016826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:37.037855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82657f5c-1352-4ac0-a623-e3bfa87f2d8f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.645723 Oct 12 08:55:37.039322 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1314/2811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:36 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:37.046181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:37.047181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:37.058592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.059725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.060892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.062716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.063391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.064171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.312587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:37.325990 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e9b8ca6-7567-481b-8716-de85685a4e75 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1309 microversion: 2.1 time: 0.284348 Oct 12 08:55:37.346926 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1315/2812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:37 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1309 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:37.356645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:37.360128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:37.370415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.375311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.376464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.378408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.380526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.381570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.437422 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a HTTP/1.1 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'c8defa84-3694-41e0-b0ea-4ec9d270a48a'} Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:37.442603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.447515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:37.447515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:37.447515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:37.447515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:55:37.447515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:55:37.447515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.447515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.455550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:55:37.457031 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-acc852e7-c09c-4509-ab83-34b2f7a8e1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 404 len: 111 microversion: 2.1 time: 0.108800 Oct 12 08:55:37.460356 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1316/2813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:37 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:55:37.472814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:37.474678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:37.489751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.490490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.491521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.492887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.494281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.495734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.624819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:37.637407 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b20dffe2-ae78-40f9-b3df-faf86dbab5f5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1270 microversion: 2.1 time: 0.171210 Oct 12 08:55:37.638171 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1317/2814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:37 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:37.665250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9396b365-44a1-4c47-989c-d58606f8a47a req-4e64b6da-b7df-4d87-9871-0f5a5e8de877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5400c2d-3481-43fa-87b9-9a1886f2dae3", "name": "network-vif-deleted", "tag": "c8b07757-93d9-4bd6-bdfd-097594ad4c3e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:37.688870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9396b365-44a1-4c47-989c-d58606f8a47a req-4e64b6da-b7df-4d87-9871-0f5a5e8de877 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.689399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9396b365-44a1-4c47-989c-d58606f8a47a req-4e64b6da-b7df-4d87-9871-0f5a5e8de877 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.692101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9396b365-44a1-4c47-989c-d58606f8a47a req-4e64b6da-b7df-4d87-9871-0f5a5e8de877 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.719257 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9396b365-44a1-4c47-989c-d58606f8a47a req-4e64b6da-b7df-4d87-9871-0f5a5e8de877 service nova] Creating event network-vif-deleted:c8b07757-93d9-4bd6-bdfd-097594ad4c3e for instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 on n-h2-858383-10 Oct 12 08:55:37.727285 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9396b365-44a1-4c47-989c-d58606f8a47a req-4e64b6da-b7df-4d87-9871-0f5a5e8de877 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075247 Oct 12 08:55:37.730492 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1318/2815] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:37.739350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b24d06aa-d8ed-4637-8369-c203cde81d33 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '.version_select at 0x7f9848b9de50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:37.743454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b24d06aa-d8ed-4637-8369-c203cde81d33 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.744011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b24d06aa-d8ed-4637-8369-c203cde81d33 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.744515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b24d06aa-d8ed-4637-8369-c203cde81d33 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.769306 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b24d06aa-d8ed-4637-8369-c203cde81d33 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.037316 Oct 12 08:55:37.778070 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1319/2816] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:55:37 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:37.786081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:37.790670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:37.800236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.800732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.801170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.801951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.802753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.803195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.817893 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a/os-volume_attachments HTTP/1.1 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': 'c8defa84-3694-41e0-b0ea-4ec9d270a48a'} Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:55:37.819690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-063a64a6-76aa-4e1e-9db4-fc6173fa7cb6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041380 Oct 12 08:55:37.823468 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1320/2817] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:55:37 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:55:37.826803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:37.849596 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2b6d20dc-ca82-45e2-8a51-f109adc335d6 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.737718 Oct 12 08:55:37.850171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:37.850915 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1498/2818] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:55:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:37.864738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a899e21-88f8-438f-bf6b-6aa5016ac3ea tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Calling method '.version_select at 0x7f9843e1d040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:37.873923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.874420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.875280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:37.876106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:37.876572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:37.877002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:38.243240 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a899e21-88f8-438f-bf6b-6aa5016ac3ea tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/006772d7-62a2-4b48-a334-3b158bcd8574" status: 200 len: 141 microversion: 2.1 time: 0.384038 Oct 12 08:55:38.243789 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1220c94c-7c32-49b7-9333-24f6f2f0ad99 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1632 microversion: 2.1 time: 0.420479 Oct 12 08:55:38.244397 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1321/2819] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:37 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1632 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:38.253414 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1499/2820] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:55:37 2022] GET /compute/v2.1/os-floating-ips/006772d7-62a2-4b48-a334-3b158bcd8574 => generated 141 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:38.260341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:38.261345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:38.270567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:38.272723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:38.273743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:38.274793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:38.275511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:38.276506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:38.296531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-699014967", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "2f204459-03a5-4e90-a59a-2dbecd872d0d"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:38.384590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] validate_networks() for [('2f204459-03a5-4e90-a59a-2dbecd872d0d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:55:38.566672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:38.580333 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3de8ab7-edcd-47d2-b14e-721f8dece475 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.323673 Oct 12 08:55:38.581950 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1500/2821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:38 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:38.588905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e1fde8f7-142c-441d-bce8-9f3ca646d2fd tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Calling method '.version_select at 0x7f9843dbe310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:39.858690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:55:39.859247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:55:39.859603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:55:39.860371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:55:39.860371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:55:39.872476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:39.872968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:39.873410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:39.874186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:39.874638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:39.875320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:39.894572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:55:39.900342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for user 3571292391094d83901f21ccb18ec2d8 and project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:55:39.915158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:55:39.918394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:55:39.972834 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9f278829-86e4-4a7c-a07e-60f1da1237e9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.685828 Oct 12 08:55:39.980275 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1322/2822] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:55:39.985883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86889ce1-d35b-4da3-bb47-7239e2b4abd3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Action: 'create', calling method: .version_select at 0x7f9848aae9d0>, body: {"keypair": {"name": "tempest-keypair-62541734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4IHLxq+fU2wz17NO/UgF+DR8sPJKrDj5lBj+28jX0QokE1Qcp41bLqFZ0w9laFRELLCob3iDdNp5o0O6mXUciwsx2OS6x32rGuZvdLs8FNeCw3LxKdQ6PQMtJldUqxLg=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:40.005672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-86889ce1-d35b-4da3-bb47-7239e2b4abd3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for project f77355ddeba541b189e41cb089a07eba. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:55:40.011438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-86889ce1-d35b-4da3-bb47-7239e2b4abd3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for user 3662e9666cc14f80a5ea16670a6f1595 and project f77355ddeba541b189e41cb089a07eba. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:55:40.046595 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86889ce1-d35b-4da3-bb47-7239e2b4abd3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.064379 Oct 12 08:55:40.048068 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1323/2823] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:55:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:40.054981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:40.056397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:40.066318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:40.066930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:40.067470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:40.068336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:40.069090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:40.070252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:40.444894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:40.453763 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b7674087-5ee5-4aa3-abb0-22731f6767b4 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1309 microversion: 2.1 time: 0.404392 Oct 12 08:55:40.454355 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1324/2824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:40 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:40.467193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:40.468046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:40.486461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:40.488703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:40.489934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:40.493014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:40.493722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:40.496140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:40.508033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:40.993880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:41.008184 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a695c44f-67ef-483c-af90-660a66748712 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1318 microversion: 2.1 time: 0.539956 Oct 12 08:55:41.009157 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1325/2825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:40 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:41.022219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:41.023186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:41.034708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:41.036367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:41.038049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:41.041203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:41.043317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:41.043927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:41.315601 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e1fde8f7-142c-441d-bce8-9f3ca646d2fd tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/006772d7-62a2-4b48-a334-3b158bcd8574" status: 202 len: 0 microversion: 2.1 time: 2.732083 Oct 12 08:55:41.320687 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1501/2826] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:55:38 2022] DELETE /compute/v2.1/os-floating-ips/006772d7-62a2-4b48-a334-3b158bcd8574 => generated 0 bytes in 2736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:41.332214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:41.333635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:41.355849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:41.356597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:41.357050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:41.358502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:41.359161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:41.359598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:41.461149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:41.462164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:41.471077 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cb388be6-30a9-496d-a74d-925461e5a2fb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1513 microversion: 2.1 time: 0.460316 Oct 12 08:55:41.475582 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1326/2827] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:41 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1513 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:41.480374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-33ee1617-68db-4ffc-a4e6-9da90991c25b req-b328de01-ab62-40cd-9baa-777166747cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16", "tag": "78724171-073e-453f-89f3-9f0479c0ca12"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:41.485464 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c7e1357b-85aa-4781-a60e-acfc454e23a0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1266 microversion: 2.1 time: 0.162339 Oct 12 08:55:41.490235 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1502/2828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:41 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:41.507395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd764c87-83c6-419f-98c8-f32e87ac1410 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Calling method '.version_select at 0x7f9843d4e550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:41.514835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33ee1617-68db-4ffc-a4e6-9da90991c25b req-b328de01-ab62-40cd-9baa-777166747cff service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:41.515317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33ee1617-68db-4ffc-a4e6-9da90991c25b req-b328de01-ab62-40cd-9baa-777166747cff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:41.515880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33ee1617-68db-4ffc-a4e6-9da90991c25b req-b328de01-ab62-40cd-9baa-777166747cff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:41.537334 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-33ee1617-68db-4ffc-a4e6-9da90991c25b req-b328de01-ab62-40cd-9baa-777166747cff service nova] Creating event network-changed:78724171-073e-453f-89f3-9f0479c0ca12 for instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 on n-h1-858383-10 Oct 12 08:55:41.545777 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-33ee1617-68db-4ffc-a4e6-9da90991c25b req-b328de01-ab62-40cd-9baa-777166747cff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068861 Oct 12 08:55:41.549390 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1327/2829] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:41.574024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:41.574965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:41.581557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:41.589740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:41.590465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:41.591366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:41.591971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:41.592721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:42.104168 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd764c87-83c6-419f-98c8-f32e87ac1410 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.610316 Oct 12 08:55:42.104847 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1503/2830] 10.222.0.40 () {58 vars in 1164 bytes} [Wed Oct 12 08:55:41 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:55:42.115933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:42.116437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:42.149916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:42.151396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:42.152657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:42.171645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:42.173037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:42.175831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:42.226203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:42.239654 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8dc39392-de2e-4128-a136-dabbc82ca9bb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1309 microversion: 2.1 time: 0.688732 Oct 12 08:55:42.240300 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1328/2831] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:41 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1309 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:42.245183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:42.245823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:42.257738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:55:42.265057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:42.265594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:42.266040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:42.266762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:42.267219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:42.268317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:42.276495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:42.392168 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b1eb46dc-60d8-435e-aa26-2e4debed342b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 204 len: 0 microversion: 2.1 time: 0.285415 Oct 12 08:55:42.394270 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1504/2832] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:55:42 2022] DELETE /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:55:42.404210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e630972e-308e-41dc-b814-58e98a687cc4 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Calling method '.version_select at 0x7f9843d4eb80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:42.884493 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e630972e-308e-41dc-b814-58e98a687cc4 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.487522 Oct 12 08:55:42.885158 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1505/2833] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:55:42 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:42.889815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:42.890547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:42.912409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:42.912904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:42.913659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:42.914665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:42.915324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:42.916043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:42.937038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:42.962876 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1efb24d2-033d-44a9-ba95-fe814a04fb80 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1318 microversion: 2.1 time: 0.721072 Oct 12 08:55:42.963223 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1329/2834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:42 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:42.981415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:42.985122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:43.000914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:43.001781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:43.004157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:43.007504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:43.008240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:43.013104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:43.052674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:43.069857 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-902f7e9f-80ef-4c31-8933-63437c6c76a2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1272 microversion: 2.1 time: 0.182866 Oct 12 08:55:43.071833 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1506/2835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:42 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:43.083473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4121a1a-2461-4ebe-b6da-0a25d664063f tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Calling method '.version_select at 0x7f9843e99670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:43.618139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:43.630266 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c06af4cb-d70d-4136-bda2-b97597451142 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1490 microversion: 2.1 time: 0.656456 Oct 12 08:55:43.634243 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1330/2836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:42 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1490 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:43.639406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:43.646420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:43.654446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:43.658293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:43.658875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:43.660571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:43.662652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:43.663559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:44.449937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:44.467525 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ea8905f4-f377-4e53-a9bc-545ce3ab1845 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1309 microversion: 2.1 time: 0.828654 Oct 12 08:55:44.470018 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1331/2837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:43 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1309 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:44.475841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:44.479363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:44.486481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:44.488588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:44.489974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:44.490886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:44.492209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:44.493039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:44.493724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:44.606586 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9d97bf5-90c4-489e-9005-db49558e1d57 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 200 len: 130 microversion: 2.1 time: 0.133958 Oct 12 08:55:44.608881 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1332/2838] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:55:44 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 130 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:44.616286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:44.617482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:44.632028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:44.639939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:44.640763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:44.645754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:44.646421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:44.646865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:45.399174 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4121a1a-2461-4ebe-b6da-0a25d664063f tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/10abe5e8-2cc5-42f5-9064-8476b2fb81f5" status: 202 len: 0 microversion: 2.1 time: 2.325841 Oct 12 08:55:45.403088 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1507/2839] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:55:43 2022] DELETE /compute/v2.1/os-floating-ips/10abe5e8-2cc5-42f5-9064-8476b2fb81f5 => generated 0 bytes in 2330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:45.408772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:45.410593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:45.425665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:45.431232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:45.432024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:45.432972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:45.433753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:45.434392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:45.466246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:45.480128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-950f55ec-a511-490d-b4d6-9ad80aa93850 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1318 microversion: 2.1 time: 0.868658 Oct 12 08:55:45.482476 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1333/2840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:44 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:45.496038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9659489a-3b9e-40ff-9d4e-8c347df66cd9 req-a427d851-6aab-4a0f-846c-1ea0bb7e3ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16", "name": "network-vif-plugged", "status": "completed", "tag": "78724171-073e-453f-89f3-9f0479c0ca12"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:45.524946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9659489a-3b9e-40ff-9d4e-8c347df66cd9 req-a427d851-6aab-4a0f-846c-1ea0bb7e3ad3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:45.530278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9659489a-3b9e-40ff-9d4e-8c347df66cd9 req-a427d851-6aab-4a0f-846c-1ea0bb7e3ad3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:45.536843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9659489a-3b9e-40ff-9d4e-8c347df66cd9 req-a427d851-6aab-4a0f-846c-1ea0bb7e3ad3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:45.567014 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9659489a-3b9e-40ff-9d4e-8c347df66cd9 req-a427d851-6aab-4a0f-846c-1ea0bb7e3ad3 service nova] Creating event network-vif-plugged:78724171-073e-453f-89f3-9f0479c0ca12 for instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 on n-h1-858383-10 Oct 12 08:55:45.577942 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9659489a-3b9e-40ff-9d4e-8c347df66cd9 req-a427d851-6aab-4a0f-846c-1ea0bb7e3ad3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093242 Oct 12 08:55:45.580397 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1334/2841] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:45.594370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:45.601053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:45.615635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:45.619721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:45.620308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:45.624183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:45.625005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:45.625680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:45.810876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:45.821122 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1af3b8c2-fc1a-4faa-98d7-84bc77cd40ae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1314 microversion: 2.1 time: 0.416557 Oct 12 08:55:45.821761 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1508/2842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:45 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:45.828857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d0a5634c-ea25-480e-8fb3-0cca7bc876fb req-d631be6a-ada7-4d30-8321-532a4b3c1c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a27f9c-6b14-46e1-ac07-f7396ddd3a30", "tag": "e8479700-da16-4693-98d3-d3276027826c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:45.836382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:45.842595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d0a5634c-ea25-480e-8fb3-0cca7bc876fb req-d631be6a-ada7-4d30-8321-532a4b3c1c1d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:45.843378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d0a5634c-ea25-480e-8fb3-0cca7bc876fb req-d631be6a-ada7-4d30-8321-532a4b3c1c1d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:45.844020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d0a5634c-ea25-480e-8fb3-0cca7bc876fb req-d631be6a-ada7-4d30-8321-532a4b3c1c1d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:45.864517 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d0a5634c-ea25-480e-8fb3-0cca7bc876fb req-d631be6a-ada7-4d30-8321-532a4b3c1c1d service nova] Creating event network-changed:e8479700-da16-4693-98d3-d3276027826c for instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 on n-h2-858383-10 Oct 12 08:55:45.870228 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d0a5634c-ea25-480e-8fb3-0cca7bc876fb req-d631be6a-ada7-4d30-8321-532a4b3c1c1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047040 Oct 12 08:55:45.871728 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1509/2843] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:45.877180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-beb99ebc-868f-47a2-b614-1c7345865950 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Calling method '.version_select at 0x7f9843e99790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:46.425835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:46.436176 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-64b2c7b6-049d-4101-948f-f1504ba512ee tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.850504 Oct 12 08:55:46.450017 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1335/2844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:45 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:46.450017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:46.450017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:46.450017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:46.450717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:46.451219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:46.452179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:46.452805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:46.453404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:46.831127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:46.854019 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-70203c3d-4b86-4bc9-b3e9-d1ff6d70ef2a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1309 microversion: 2.1 time: 0.415563 Oct 12 08:55:46.856465 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1336/2845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:46 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:46.877801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-680307771", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "a89cb8de-3356-4d1b-a516-3c348eab6ff9"}], "security_groups": [{"name": "tempest-securitygroup--2145216434"}], "key_name": "tempest-keypair-62541734", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:47.015506 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-beb99ebc-868f-47a2-b614-1c7345865950 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/b8221ef5-26c6-4b45-895e-2ea00abebf65" status: 202 len: 0 microversion: 2.1 time: 1.142313 Oct 12 08:55:47.017872 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1510/2846] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:55:45 2022] DELETE /compute/v2.1/os-floating-ips/b8221ef5-26c6-4b45-895e-2ea00abebf65 => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:47.023093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:47.024460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:47.033184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:47.034373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:47.035057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:47.036213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:47.036941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:47.037723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:47.286877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] validate_networks() for [('a89cb8de-3356-4d1b-a516-3c348eab6ff9', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:55:47.328005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:47.340595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b45e44a7-f627-445c-9180-1fa0b1d71686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.321380 Oct 12 08:55:47.342163 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1511/2847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:47 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:47.349405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:47.350518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:47.367462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:47.372359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:47.373007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:47.373947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:47.374562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:47.377988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:47.616194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:47.634742 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79db4e62-770c-4154-92d3-868ba7038a6b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1318 microversion: 2.1 time: 0.290217 Oct 12 08:55:47.650936 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1512/2848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:47 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:47.656546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:47.657694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:47.667734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:47.668529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:47.669231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:47.670598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:47.671262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:47.671686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:47.928446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:47.938482 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dcf8c3a7-4444-46ac-94b4-724ce19b9350 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1314 microversion: 2.1 time: 0.285981 Oct 12 08:55:47.939087 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1513/2849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:47 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:47.944514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-479af01c-0472-4ca6-b9ae-542eac9f5fd2 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] Calling method '.version_select at 0x7f9843e874c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:49.021589 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-479af01c-0472-4ca6-b9ae-542eac9f5fd2 tempest-FloatingIPDetailsTestJSON-2098938467 tempest-FloatingIPDetailsTestJSON-2098938467-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/0925fa05-d5c4-4d89-9de4-69e1ebec1f41" status: 202 len: 0 microversion: 2.1 time: 1.081195 Oct 12 08:55:49.022493 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1514/2850] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:55:47 2022] DELETE /compute/v2.1/os-floating-ips/0925fa05-d5c4-4d89-9de4-69e1ebec1f41 => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:49.027242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:49.027859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:49.049024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.049578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.050030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.050777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.051227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.051656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.141657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:55:49.142224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:55:49.142871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:55:49.143514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:55:49.144156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:55:49.163819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.164314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.164759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.165518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.166035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.166464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.191237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for project f77355ddeba541b189e41cb089a07eba. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:55:49.200789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for user 3662e9666cc14f80a5ea16670a6f1595 and project f77355ddeba541b189e41cb089a07eba. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:55:49.229738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:55:49.235371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:55:49.310087 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ccb1921f-5df2-4f90-b8fd-c54a0ec55250 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.444308 Oct 12 08:55:49.311460 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1337/2851] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:55:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:55:49.317245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:49.318364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:49.326181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.327162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.328200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.330006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.331347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.332778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.499162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:49.513029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d1479bf5-10d9-419d-84d6-aa98ba61054d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.489439 Oct 12 08:55:49.525174 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1515/2852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:49 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:49.533370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:49.536966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:49.559635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.562028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.563467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.567124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.568518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.569209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.918129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:49.938609 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d1677ee5-0ef6-4363-b1f5-f25e7ae0dcb5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1318 microversion: 2.1 time: 0.410262 Oct 12 08:55:49.939241 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1516/2853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:49 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:49.962884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:49.963747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:49.975059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.980441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.981129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.982077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:49.983196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:49.983800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:49.989336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:49.998471 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35e62ea1-403b-4a1f-bc84-e0afa18f871a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1489 microversion: 2.1 time: 0.685471 Oct 12 08:55:50.001973 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1338/2854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:49 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1489 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:50.022720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b96d749f-2ce9-44f1-826d-2d8275d6f6f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:50.023773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b96d749f-2ce9-44f1-826d-2d8275d6f6f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:50.282226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b96d749f-2ce9-44f1-826d-2d8275d6f6f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:50.303004 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b96d749f-2ce9-44f1-826d-2d8275d6f6f9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1232 microversion: 2.1 time: 0.299652 Oct 12 08:55:50.329206 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1339/2855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:50 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1232 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:50.352947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:50.357038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:50.367209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:50.383203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.383705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.388714 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed5c0ac8-261c-451f-8cc8-dc0a0ca583d5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1314 microversion: 2.1 time: 0.429714 Oct 12 08:55:50.390230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1517/2856] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:49 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:50.394235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:50.395015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.395528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.395968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:50.396626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-22751227-a9c1-4bfa-906f-21db027ad7ee req-d8f1ac30-4874-4350-bd07-e96e31a6e959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78aad808-0e14-4eb1-87bb-b103b86b5079", "tag": "ec67a18c-bb8e-4965-bcdd-e42f1581e411"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:50.408182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-22751227-a9c1-4bfa-906f-21db027ad7ee req-d8f1ac30-4874-4350-bd07-e96e31a6e959 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.408806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-22751227-a9c1-4bfa-906f-21db027ad7ee req-d8f1ac30-4874-4350-bd07-e96e31a6e959 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.410154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-22751227-a9c1-4bfa-906f-21db027ad7ee req-d8f1ac30-4874-4350-bd07-e96e31a6e959 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:50.461747 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-22751227-a9c1-4bfa-906f-21db027ad7ee req-d8f1ac30-4874-4350-bd07-e96e31a6e959 service nova] Creating event network-changed:ec67a18c-bb8e-4965-bcdd-e42f1581e411 for instance 78aad808-0e14-4eb1-87bb-b103b86b5079 on n-h2-858383-10 Oct 12 08:55:50.471402 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-22751227-a9c1-4bfa-906f-21db027ad7ee req-d8f1ac30-4874-4350-bd07-e96e31a6e959 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077875 Oct 12 08:55:50.472980 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1518/2857] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:50.478985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2070074257"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:50.483136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:50.492496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.493338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.493983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:50.495422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.495987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.496516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:50.691075 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-687b8fe3-7792-485d-9836-e6a5622d1d12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "PUT /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1074 microversion: 2.1 time: 0.216647 Oct 12 08:55:50.694258 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1519/2858] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 08:55:50 2022] PUT /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1074 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:50.715086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:50.715871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:50.733955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.735035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.735581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:50.736425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.738970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.739529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:50.823693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:50.834039 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-503ee450-f0fb-4d28-8c72-829210c3344b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.502048 Oct 12 08:55:50.844642 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1340/2859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:50 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:50.963762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:50.964273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:50.980422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.984143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.984599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:50.985345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:50.985833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:50.986259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:51.021342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:51.032103 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f374445-436f-4ace-89ac-3247d68e76b5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1500 microversion: 2.1 time: 0.322145 Oct 12 08:55:51.032696 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1520/2860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:50 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1500 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:51.038793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1606503626", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "d30a231a-ae95-4ebb-90c8-46232d6674b8"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:51.138792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] validate_networks() for [('d30a231a-ae95-4ebb-90c8-46232d6674b8', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:55:51.492601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:51.501396 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5770d5d-f56f-4751-8523-a0e49a481e31 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1318 microversion: 2.1 time: 0.543195 Oct 12 08:55:51.516746 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1341/2861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:50 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:51.535409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:51.540243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:51.563300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:51.564046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:51.564630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:51.566653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:51.567279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:51.568079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:51.955288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:51.968149 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97d19805-0cd8-4b8c-aa25-148001ec4d4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1500 microversion: 2.1 time: 0.457643 Oct 12 08:55:51.978163 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1342/2862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:51 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1500 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:51.978163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:51.978163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:51.990673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:51.991155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:51.991592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:51.995615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:51.996292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:52.001958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:52.169467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:52.184218 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d17d88dd-8180-413f-835d-c81432a5e74c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1290 microversion: 2.1 time: 0.213929 Oct 12 08:55:52.186000 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1343/2863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:51 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1290 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:52.194622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:52.204330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:52.210913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:52.211402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:52.211844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:52.212601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:52.213058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:52.213505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:52.602674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:55:52.603359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:55:52.603612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:55:52.604106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:55:52.604435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:55:52.617914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:52.623520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:52.625608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:52.626773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:52.629906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:52.630564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:52.677857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:55:52.692604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for user 54fad01e2e6e41d0887895b131051ee1 and project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:55:52.717932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:55:52.720675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:55:52.848057 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8c7bd36-3e74-4c33-b6b3-aac43124caf9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.814158 Oct 12 08:55:52.848768 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1521/2864] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:55:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:55:52.857203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4eca3a68-e339-4e00-b105-0f1f43d3c816 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:52.868728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca3a68-e339-4e00-b105-0f1f43d3c816 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:52.869527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca3a68-e339-4e00-b105-0f1f43d3c816 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:52.870268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca3a68-e339-4e00-b105-0f1f43d3c816 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:52.912209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:52.940717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4eca3a68-e339-4e00-b105-0f1f43d3c816 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Going to try to stop instance {{(pid=127006) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 08:55:52.946940 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e418b748-9868-4e45-bc90-420446ce51a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1314 microversion: 2.1 time: 0.756664 Oct 12 08:55:52.952150 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1344/2865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:52 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:52.986742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-037b599d-7658-49c7-a4d9-9d365b0fb525 req-2c571532-26e0-4cbf-9244-e3ddede38f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a27f9c-6b14-46e1-ac07-f7396ddd3a30", "name": "network-vif-plugged", "status": "completed", "tag": "e8479700-da16-4693-98d3-d3276027826c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:53.052346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-037b599d-7658-49c7-a4d9-9d365b0fb525 req-2c571532-26e0-4cbf-9244-e3ddede38f24 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:53.053164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-037b599d-7658-49c7-a4d9-9d365b0fb525 req-2c571532-26e0-4cbf-9244-e3ddede38f24 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:53.053972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-037b599d-7658-49c7-a4d9-9d365b0fb525 req-2c571532-26e0-4cbf-9244-e3ddede38f24 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:53.077815 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4eca3a68-e339-4e00-b105-0f1f43d3c816 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "POST /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16/action" status: 202 len: 0 microversion: 2.1 time: 0.226121 Oct 12 08:55:53.079736 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1522/2866] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:55:52 2022] POST /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:55:53.091203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:53.115101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:53.116878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:53.128789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:53.130081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:53.131510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:53.133116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:53.135995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:53.136641 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-037b599d-7658-49c7-a4d9-9d365b0fb525 req-2c571532-26e0-4cbf-9244-e3ddede38f24 service nova] Creating event network-vif-plugged:e8479700-da16-4693-98d3-d3276027826c for instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 on n-h2-858383-10 Oct 12 08:55:53.136763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:53.166250 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-037b599d-7658-49c7-a4d9-9d365b0fb525 req-2c571532-26e0-4cbf-9244-e3ddede38f24 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206562 Oct 12 08:55:53.186944 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1345/2867] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:53.225497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4329e362-abfb-4f2e-88c1-9d59db1fbf84 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:53.226375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4329e362-abfb-4f2e-88c1-9d59db1fbf84 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:53.555148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4329e362-abfb-4f2e-88c1-9d59db1fbf84 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:53.566274 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4329e362-abfb-4f2e-88c1-9d59db1fbf84 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1215 microversion: 2.1 time: 0.372212 Oct 12 08:55:53.567755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1346/2868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:53 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1215 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:53.574123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:53.575728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:53.586129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:53.587101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:53.587845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:53.588808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:53.589723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:53.590465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:53.736920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:53.758541 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb959194-95bd-4b8a-9c74-b8fd4dc2d266 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1318 microversion: 2.1 time: 0.676617 Oct 12 08:55:53.759626 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1523/2869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:53 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:53.774206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:53.776187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:53.798725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:53.799229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:53.800561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:53.806032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:53.806601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:53.807061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:53.823790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:54.091391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:54.107178 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5a21edc5-91c4-44d8-9727-f0be08633355 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1290 microversion: 2.1 time: 0.344081 Oct 12 08:55:54.125141 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1524/2870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:53 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1290 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:54.130222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:54.136010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:54.155618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:54.157327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:54.157785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:54.159040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:54.159040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:54.159695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:54.506828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:54.517925 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cd4a5e0-3f86-4b45-9c82-68ee51ef0574 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1314 microversion: 2.1 time: 0.389672 Oct 12 08:55:54.537371 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1525/2871] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:54 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:54.597885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:54.598851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:54.609933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:54.610537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:54.611038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:54.612354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:54.612977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:54.613556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:54.656571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:54.667795 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4a038f9c-7a63-410a-8a76-f2c053c2b3d8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 1.098349 Oct 12 08:55:54.670123 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1347/2872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:53 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:54.749560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:54.760161 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5ec8a0dd-4f15-41c9-9783-d326a0b26457 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1267 microversion: 2.1 time: 0.166436 Oct 12 08:55:54.762413 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1526/2873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:54 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:54.785202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:54.785842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:54.794193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:54.794906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:54.795518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:54.796371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:54.796971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:54.797584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:55.131728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:55.132416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:55.143355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:55.144015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:55.144523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:55.148348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:55.148971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:55.149586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:55.317360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:55.348196 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f7ee25d-fa5d-483a-ae9a-2af473c2b88c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1290 microversion: 2.1 time: 0.206561 Oct 12 08:55:55.350008 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1527/2874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:55 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1290 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:55.427755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:55.443101 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-34695741-33fc-4089-aad8-6116cb33d46d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1318 microversion: 2.1 time: 0.661937 Oct 12 08:55:55.459900 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1348/2875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:54 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:55.519000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d2d34292-68bf-4105-ae56-5127af1af1c1 req-09c8837d-a349-4d74-89b3-606caa1a8623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78aad808-0e14-4eb1-87bb-b103b86b5079", "name": "network-vif-plugged", "status": "completed", "tag": "ec67a18c-bb8e-4965-bcdd-e42f1581e411"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:55.544026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:55.544631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:55.574801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2d34292-68bf-4105-ae56-5127af1af1c1 req-09c8837d-a349-4d74-89b3-606caa1a8623 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:55.576760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2d34292-68bf-4105-ae56-5127af1af1c1 req-09c8837d-a349-4d74-89b3-606caa1a8623 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:55.577418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2d34292-68bf-4105-ae56-5127af1af1c1 req-09c8837d-a349-4d74-89b3-606caa1a8623 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:55.584631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:55.585365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:55.588028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:55.588947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:55.591011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:55.591642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:55.610045 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d2d34292-68bf-4105-ae56-5127af1af1c1 req-09c8837d-a349-4d74-89b3-606caa1a8623 service nova] Creating event network-vif-plugged:ec67a18c-bb8e-4965-bcdd-e42f1581e411 for instance 78aad808-0e14-4eb1-87bb-b103b86b5079 on n-h2-858383-10 Oct 12 08:55:55.631316 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d2d34292-68bf-4105-ae56-5127af1af1c1 req-09c8837d-a349-4d74-89b3-606caa1a8623 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114950 Oct 12 08:55:55.632184 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1528/2876] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:55.705605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:55.707164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:55.721740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:55.722904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:55.728752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:55.732163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:55.733181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:55.734514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:56.133777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:56.145661 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-97794595-b9b4-4ab2-a6c7-5ef890876077 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.450528 Oct 12 08:55:56.149961 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1529/2877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:55 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:56.166191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:56.167214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:56.181827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:56.185766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:56.186523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:56.187609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:56.190091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:56.190787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:56.372694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:56.386916 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2616e54-0ad4-40bb-b0fe-2fae5d78ba8e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1273 microversion: 2.1 time: 0.233365 Oct 12 08:55:56.392421 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1530/2878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:56 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:56.402265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:56.403939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:56.435119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:56.435915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:56.439277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:56.442306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:56.443085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:56.444235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:56.467260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:56.477586 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-043f3976-e306-47d7-a020-c8a996fe2a0b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1314 microversion: 2.1 time: 0.938121 Oct 12 08:55:56.481773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1349/2879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:55 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1314 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:56.492855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:56.494743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:56.510084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:56.510592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:56.511029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:56.511750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:56.512489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:56.512924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:56.845430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:56.858022 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a61d0774-267c-4932-a5d4-a6ae7d107928 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.463274 Oct 12 08:55:56.860782 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1531/2880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:56 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:57.174969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:57.176063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:57.184915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.185998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.186602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.188159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.188771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.189902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.325641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:57.339880 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bd3c11f3-7110-4eec-abf4-f0cb8cd76503 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1508 microversion: 2.1 time: 0.855245 Oct 12 08:55:57.340939 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1350/2881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:56 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1508 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:57.367099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:57.368002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:57.374804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.375557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.376186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.377281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.378026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.378684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.506092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:57.516469 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-800ee78e-8089-4621-a5c3-b71d0b7427fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.346402 Oct 12 08:55:57.532454 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1532/2882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:57 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:57.541512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:57.542195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:57.549916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.550652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.551295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.552205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.552834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.553460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.636460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:57.645957 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d35b4b75-04cb-4c30-8c50-43eb73199902 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1273 microversion: 2.1 time: 0.112342 Oct 12 08:55:57.646985 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1533/2883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:57 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:57.667537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:57.673482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:57.686121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.686615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.687048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.687749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.688372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.688951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.806636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:57.822227 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-880c8c89-b10e-4656-a37b-8726c6720ba7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1508 microversion: 2.1 time: 0.458967 Oct 12 08:55:57.823120 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1351/2884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:57 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:57.847705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:57.850655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:57.866733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.867236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.867679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.868449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.868910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:57.869336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:57.954676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:57.964828 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38f1aa09-cb13-4926-ae7e-5a02740aa0b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1314 microversion: 2.1 time: 0.316388 Oct 12 08:55:57.965924 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1534/2885] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:57 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:57.987632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:57.991396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:57.999097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:57.999488 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2a16e595-f1d4-4147-ad55-04d6799df415 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "PUT /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1080 microversion: 2.1 time: 0.155735 Oct 12 08:55:58.000104 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1352/2886] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 08:55:57 2022] PUT /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1080 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:58.000479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.001143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.002279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.003374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.004020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.019137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:58.019752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:58.028018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.031209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.032354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.035236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.037382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.038164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.253190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:58.279999 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b7e724cf-f7a6-4719-947d-d1d2f27ab091 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.299938 Oct 12 08:55:58.295546 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1535/2887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:57 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:58.542723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:58.545063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:58.559196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.562976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.563918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.565634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.566351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.567687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.878823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:58.888965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec83f613-4ead-4efc-b4e0-260a08158e41 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.353733 Oct 12 08:55:58.890999 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1536/2888] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:58 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:58.895930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:58.896932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:58.905128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.905912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.906431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.907362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.907843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.908344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.909542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:58.933857 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d940e15-6668-483a-a19a-b2ff949e4b3d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1506 microversion: 2.1 time: 0.903954 Oct 12 08:55:58.935126 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1353/2889] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:58 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1506 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:58.956963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:58.957975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:58.967452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.972821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.973984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:58.975076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:58.975874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:58.976485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.182075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:55:59.214600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:59.230253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e1f76254-01f2-46b1-8a22-a538572eea77 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.338089 Oct 12 08:55:59.231448 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1537/2890] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:58 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:59.239112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:59.239856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:59.255285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.262093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.264860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.267332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.269247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.269775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.480769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:59.491483 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df0e18cc-0946-456b-8ca7-4e658fee195d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1314 microversion: 2.1 time: 0.258613 Oct 12 08:55:59.492662 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1538/2891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:59 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:59.500847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:59.502442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:59.504375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:59.510374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.511098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.511819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.512919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.513598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.514358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.515513 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b68af762-86cc-4030-b5c3-63ccf2f22795 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1506 microversion: 2.1 time: 0.562320 Oct 12 08:55:59.520128 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1354/2892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:58 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:55:59.528323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d361094c-5449-485d-93a7-4948a70be46a req-68a22622-8a52-4966-96ef-a112bea2939a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617dc413-650f-4340-933d-6fbf879240bf", "tag": "238873e3-bf59-47b5-bfd5-f3b69a1232cd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:59.539701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d361094c-5449-485d-93a7-4948a70be46a req-68a22622-8a52-4966-96ef-a112bea2939a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.542444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d361094c-5449-485d-93a7-4948a70be46a req-68a22622-8a52-4966-96ef-a112bea2939a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.543095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d361094c-5449-485d-93a7-4948a70be46a req-68a22622-8a52-4966-96ef-a112bea2939a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.562299 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d361094c-5449-485d-93a7-4948a70be46a req-68a22622-8a52-4966-96ef-a112bea2939a service nova] Creating event network-changed:238873e3-bf59-47b5-bfd5-f3b69a1232cd for instance 617dc413-650f-4340-933d-6fbf879240bf on n-h1-858383-10 Oct 12 08:55:59.568516 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d361094c-5449-485d-93a7-4948a70be46a req-68a22622-8a52-4966-96ef-a112bea2939a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046699 Oct 12 08:55:59.569509 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1355/2893] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:55:59.575361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:55:59.580073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:59.588565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.589313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.590099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.591030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.594504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.595163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.713582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:55:59.714006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:55:59.716412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:55:59.716828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:55:59.718354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:55:59.731458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:55:59.740586 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05560b6d-87b9-42d5-8ecd-edb2f4361fdd tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.246636 Oct 12 08:55:59.741369 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1539/2894] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:59 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:55:59.833515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:59.840888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.841689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.842432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.843423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.844254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.845227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.887766 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cd352283-19b1-4bfa-bc97-b1b97beca18d tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "POST /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30/action" status: 202 len: 1112 microversion: 2.1 time: 0.316746 Oct 12 08:55:59.888791 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1356/2895] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:55:59 2022] POST /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30/action => generated 1112 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 08:55:59.912467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:55:59.915396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:55:59.924061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.925180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.925865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:55:59.927098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:55:59.927870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:55:59.928726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.022089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-09c4ba0d-df6d-499e-80fc-d00973b4f171 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Action: 'create', calling method: .version_select at 0x7f9843ef90d0>, body: {"keypair": {"name": "tempest-keypair-1274004433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSUc8BDWOJ/srcodg9U/YVIRIESFX1A8k1Stpg4LcPrigfTpA/8WK7lp8Sjo3evaZ4pkTsnq9hXKYiHJa0bSxCdox294QrxKjeFBJ5mRf23LzNNECEM+q9A06c28OVHQA=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:00.040777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-09c4ba0d-df6d-499e-80fc-d00973b4f171 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:00.065201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-09c4ba0d-df6d-499e-80fc-d00973b4f171 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:00.101288 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-09c4ba0d-df6d-499e-80fc-d00973b4f171 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.297706 Oct 12 08:56:00.102084 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1540/2896] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 12 08:55:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 300 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 12 08:56:00.107654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:00.110038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:00.117032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:00.117714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:00.118475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.119280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:00.119804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:00.120280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.320651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:00.329933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eda1e000-5095-49d3-a317-e5f7bdcba195 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.226351 Oct 12 08:56:00.330820 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1541/2897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:00 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:00.335971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c02731b9-eee5-4e5d-9e9c-77189d669c1e tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9843ef93a0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:00.345750 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c02731b9-eee5-4e5d-9e9c-77189d669c1e tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1274004433" status: 200 len: 513 microversion: 2.2 time: 0.013514 Oct 12 08:56:00.353252 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1542/2898] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Oct 12 08:56:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1274004433 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:00.362068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:00.362793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:00.370412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:00.370915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:00.371361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.372164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:00.372635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:00.373337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.419986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:00.425161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:00.435095 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12ee2412-48a3-488c-baba-be5176988e2a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.528567 Oct 12 08:56:00.435739 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1357/2899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:55:59 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:00.442938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d512931f-cab2-4249-8fc8-0e6cb74d5755 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f98487a6c10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:00.485248 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d512931f-cab2-4249-8fc8-0e6cb74d5755 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274004433" status: 204 len: 0 microversion: 2.2 time: 0.047168 Oct 12 08:56:00.486148 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1358/2900] 10.222.0.40 () {60 vars in 1261 bytes} [Wed Oct 12 08:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274004433 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:00.500358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9277803e-abc1-4aa0-8554-17b8b01402f4 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Action: 'create', calling method: .version_select at 0x7f98489968b0>, body: {"keypair": {"name": "tempest-keypair-278273941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOy6TSrvizt0r5rgrm4xSL8zCzMd4NlhuAabFEZl7J0DyzVZjFWOb7XYsh/2ZZX8w3gq77GFH0raVUBjGYGwvs5tIeqONU9f4qj7IBuP5uLEgm1mwlulidXNDj7UcSbxw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:00.536086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=33 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:00.550368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9277803e-abc1-4aa0-8554-17b8b01402f4 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:00.563125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9277803e-abc1-4aa0-8554-17b8b01402f4 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:00.611605 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9277803e-abc1-4aa0-8554-17b8b01402f4 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.117852 Oct 12 08:56:00.625634 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1359/2901] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 12 08:56:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 12 08:56:00.631448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:00.632065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:00.644401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:00.644905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:00.645351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.646094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:00.646549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:00.646979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.666898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:00.675878 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c38a4478-8dc1-4c53-ba49-994ddbd205d3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.321073 Oct 12 08:56:00.686604 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1543/2902] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:00 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:00.701516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ab729f6-4cce-4dce-aa10-4c96aac68c48 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9843fc08b0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:00.724634 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ab729f6-4cce-4dce-aa10-4c96aac68c48 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278273941" status: 204 len: 0 microversion: 2.2 time: 0.029017 Oct 12 08:56:00.725554 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1544/2903] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Oct 12 08:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278273941 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:00.736349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05aafb6b-8eb2-45d8-bfbe-a12a2e6619cb tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Action: 'create', calling method: .version_select at 0x7f9843dbe670>, body: {"keypair": {"name": "tempest-keypair-1275562285", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:00.757125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-05aafb6b-8eb2-45d8-bfbe-a12a2e6619cb tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:00.763161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-05aafb6b-8eb2-45d8-bfbe-a12a2e6619cb tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:00.766615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:00.801523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05aafb6b-8eb2-45d8-bfbe-a12a2e6619cb tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.070051 Oct 12 08:56:00.803139 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1545/2904] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 12 08:56:00 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 08:56:00.809411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:00.811092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:00.815169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:00.828784 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef0ac5ea-41c5-4525-84ea-521b5ca05652 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1293 microversion: 2.1 time: 0.201983 Oct 12 08:56:00.831622 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1360/2905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:00 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1293 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:00.846974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:00.847819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:00.848405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.849395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:00.850814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:00.851443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:00.870062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-529cf9d2-a4a5-49ed-bdd7-aaf18288c782 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9848dbca60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:00.891875 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-529cf9d2-a4a5-49ed-bdd7-aaf18288c782 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275562285" status: 204 len: 0 microversion: 2.2 time: 0.028390 Oct 12 08:56:00.893021 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1361/2906] 10.222.0.40 () {60 vars in 1261 bytes} [Wed Oct 12 08:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275562285 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:00.912011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bc38b79-c671-410e-bacd-120c5e770e90 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Action: 'create', calling method: .version_select at 0x7f98487a6310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1188212925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaHMmnT4ddfd/klT5AnykXmowRWbs8eSfEfjzdQM0/Li8Lw9QDkqCB7C9mbpTypBb20h8Rw9aaMsD6U1RDLmEcg5XYWEVZ8rcZ3KhJBIIiNr0PnemDowhkOr+OsZ+V0oA=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:00.934914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:00.943467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5bc38b79-c671-410e-bacd-120c5e770e90 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:00.952884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5bc38b79-c671-410e-bacd-120c5e770e90 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:00.999311 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5bc38b79-c671-410e-bacd-120c5e770e90 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.097941 Oct 12 08:56:01.001522 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1362/2907] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 12 08:56:00 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 12 08:56:01.019568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3dc87ce9-55a0-4035-98d8-10f945e5b76e tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Action: 'create', calling method: .version_select at 0x7f984ccf1940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1614921885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3pwkMsWB1WYCOGNwBM6mYzpsUXYYorD6+WOgpEs0DY72lOwhwSAN4i2TYJN/PFcBEkwX+BBLGFEeabb8FLGVwYoBzgWsTb0GdU5MpCecYhxb+b8Yfwm8D5KzKMuYCW/g=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:01.041468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-3dc87ce9-55a0-4035-98d8-10f945e5b76e tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:01.058154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-3dc87ce9-55a0-4035-98d8-10f945e5b76e tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:01.120118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:01.126210 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3dc87ce9-55a0-4035-98d8-10f945e5b76e tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.116243 Oct 12 08:56:01.136371 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1363/2908] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 12 08:56:01 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 12 08:56:01.141769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-90be4668-d5b4-4e37-b36c-69410893bbc3 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Action: 'create', calling method: .version_select at 0x7f984cce7ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1378279127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9gAcDwaH4YpNWEjB0D9qqhKizrWFMJHSkM96OAQe+kTqPBgdDsv6O0HztdmH9qi6A4QuehiBP8AeR8W6KIIqz2YGaro77VZ1h7nNaPYwhkmzNYqKJ4JBTSnTFkwKzdXw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:01.144012 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67a65b7f-a241-4bb2-a407-e4ceccd42647 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.339609 Oct 12 08:56:01.144606 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1546/2909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:00 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:01.179113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-90be4668-d5b4-4e37-b36c-69410893bbc3 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:01.184904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-90be4668-d5b4-4e37-b36c-69410893bbc3 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:01.211562 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-90be4668-d5b4-4e37-b36c-69410893bbc3 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.073631 Oct 12 08:56:01.212844 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1364/2910] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 12 08:56:01 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 12 08:56:01.225688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed1df331-7d3b-48d4-bee2-90c0f1b15750 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9843ef90d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.231753 n-d-858383-10 devstack@n-api.service[127006]: WARNING oslo_db.sqlalchemy.utils [None req-ed1df331-7d3b-48d4-bee2-90c0f1b15750 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 08:56:01.242445 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed1df331-7d3b-48d4-bee2-90c0f1b15750 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.022445 Oct 12 08:56:01.243749 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1547/2911] 10.222.0.40 () {60 vars in 1177 bytes} [Wed Oct 12 08:56:01 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:01.255914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4b15393c-85d5-4aef-a905-22dbbb6c9dd8 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9848a48af0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.283565 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4b15393c-85d5-4aef-a905-22dbbb6c9dd8 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1378279127" status: 204 len: 0 microversion: 2.2 time: 0.032170 Oct 12 08:56:01.286153 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1365/2912] 10.222.0.40 () {60 vars in 1321 bytes} [Wed Oct 12 08:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1378279127 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:01.294675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0fa5ba35-86d7-4ce5-a92e-a9e189604425 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9843ee99d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.326039 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0fa5ba35-86d7-4ce5-a92e-a9e189604425 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1614921885" status: 204 len: 0 microversion: 2.2 time: 0.032388 Oct 12 08:56:01.327716 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1548/2913] 10.222.0.40 () {60 vars in 1321 bytes} [Wed Oct 12 08:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1614921885 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:01.335844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-971140e0-3e61-4cb0-9834-bad0163921f2 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f984cbc4c10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.369626 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-971140e0-3e61-4cb0-9834-bad0163921f2 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1188212925" status: 204 len: 0 microversion: 2.2 time: 0.037540 Oct 12 08:56:01.370159 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1366/2914] 10.222.0.40 () {60 vars in 1321 bytes} [Wed Oct 12 08:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1188212925 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:01.370853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.371796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:01.382614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66f5924a-5461-4cfb-b835-df4e7e5097a9 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Action: 'create', calling method: .version_select at 0x7f9848a489d0>, body: {"keypair": {"name": "tempest-keypair-1780374966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzsir2oKI1JKrbZVWvRsxP21o3XQ2bwtGcNkKInFEdtk74+diuxddcNyruzWFNON8fMVFCuL31zlYZyPPsFdzkUkoqHZ1SwK8N7b4xdcQKdVwlK3jsH/zo7xSdJKo7TEQ=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:01.385006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.385782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.386386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.387393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.388749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.389805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.409847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-66f5924a-5461-4cfb-b835-df4e7e5097a9 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:01.414255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-66f5924a-5461-4cfb-b835-df4e7e5097a9 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:01.445570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-66f5924a-5461-4cfb-b835-df4e7e5097a9 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.067045 Oct 12 08:56:01.451984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1367/2915] 10.222.0.40 () {62 vars in 1199 bytes} [Wed Oct 12 08:56:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 12 08:56:01.463317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d02f625a-6c8e-4fdf-a5cd-7b747083b399 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9849486af0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.487742 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d02f625a-6c8e-4fdf-a5cd-7b747083b399 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1780374966" status: 200 len: 513 microversion: 2.2 time: 0.033175 Oct 12 08:56:01.493381 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1368/2916] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Oct 12 08:56:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1780374966 => generated 513 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:01.504040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.505737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:01.524996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.526704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.529416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.530349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.531146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.534687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.593367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:01.602925 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bac47997-5416-4cb5-be20-a4e46d354b12 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.239522 Oct 12 08:56:01.604314 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1549/2917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:01 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:01.608857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95155ae5-5c0e-409b-b05a-bb2834b6cc6f tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9843de6550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.613689 n-d-858383-10 devstack@n-api.service[127006]: WARNING oslo_db.sqlalchemy.utils [None req-95155ae5-5c0e-409b-b05a-bb2834b6cc6f tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 08:56:01.619094 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95155ae5-5c0e-409b-b05a-bb2834b6cc6f tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.013708 Oct 12 08:56:01.625958 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1550/2918] 10.222.0.40 () {60 vars in 1177 bytes} [Wed Oct 12 08:56:01 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:01.631854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d2f1541a-fc32-491f-96e9-a323a70cebf2 req-e063aca9-27c9-4e25-82e9-1893e5b32d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78aad808-0e14-4eb1-87bb-b103b86b5079", "name": "network-vif-deleted", "tag": "ec67a18c-bb8e-4965-bcdd-e42f1581e411"}, {"name": "network-changed", "server_uuid": "81f40117-2505-4d89-a9fd-c3a992cfd9f7", "tag": "50c148f8-f4f7-4a59-a418-ac508c438101"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:01.648731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2f1541a-fc32-491f-96e9-a323a70cebf2 req-e063aca9-27c9-4e25-82e9-1893e5b32d51 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.649870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2f1541a-fc32-491f-96e9-a323a70cebf2 req-e063aca9-27c9-4e25-82e9-1893e5b32d51 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.650914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2f1541a-fc32-491f-96e9-a323a70cebf2 req-e063aca9-27c9-4e25-82e9-1893e5b32d51 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.669326 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d2f1541a-fc32-491f-96e9-a323a70cebf2 req-e063aca9-27c9-4e25-82e9-1893e5b32d51 service nova] Creating event network-vif-deleted:ec67a18c-bb8e-4965-bcdd-e42f1581e411 for instance 78aad808-0e14-4eb1-87bb-b103b86b5079 on n-h2-858383-10 Oct 12 08:56:01.669993 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d2f1541a-fc32-491f-96e9-a323a70cebf2 req-e063aca9-27c9-4e25-82e9-1893e5b32d51 service nova] Creating event network-changed:50c148f8-f4f7-4a59-a418-ac508c438101 for instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 on n-h2-858383-10 Oct 12 08:56:01.681354 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d2f1541a-fc32-491f-96e9-a323a70cebf2 req-e063aca9-27c9-4e25-82e9-1893e5b32d51 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.052761 Oct 12 08:56:01.682642 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1551/2919] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:01.690052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-583293cf-cb47-441d-a241-3597098d0316 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9843fe34c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.717806 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-583293cf-cb47-441d-a241-3597098d0316 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1780374966" status: 204 len: 0 microversion: 2.2 time: 0.033495 Oct 12 08:56:01.718473 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1552/2920] 10.222.0.40 () {60 vars in 1261 bytes} [Wed Oct 12 08:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1780374966 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:01.728069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.729026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:01.735730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.736224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.736669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.737185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:01.737428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.737918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.738352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.745831 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d6ceebb7-21ae-4947-a1a1-fcaab7292ed7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.250026 Oct 12 08:56:01.746426 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1369/2921] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:01 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:01.893479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:01.902551 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-540f97ff-50da-4d3c-9b7c-c53c0115254e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.178365 Oct 12 08:56:01.903273 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1553/2922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:01 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:01.906001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42b49a51-80aa-4b26-8576-73d296368b90 tempest-FlavorsV2NegativeTest-87128090 tempest-FlavorsV2NegativeTest-87128090-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.909276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Action: 'create', calling method: .version_select at 0x7f9843e6bdc0>, body: {"keypair": {"name": "tempest-keypair-603707390", "type": "x509"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:01.914361 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42b49a51-80aa-4b26-8576-73d296368b90 tempest-FlavorsV2NegativeTest-87128090 tempest-FlavorsV2NegativeTest-87128090-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.154316 Oct 12 08:56:01.914997 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1370/2923] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:56:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:01.919726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:01.921142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:01.933666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.934164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.934495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.935166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:01.935729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:01.936050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:01.977817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:01.996927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:02.006480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:02.015666 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dcc8c91d-5fcb-4f09-bc86-9dc85d101ee7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1293 microversion: 2.1 time: 0.099443 Oct 12 08:56:02.016263 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1371/2924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:01 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:02.044578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.processutils [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp70a3k5q2/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp70a3k5q2/temp.key -subj /CN=4d96d9efa31a41399ce1d414c6bd26f9 -extensions v3_req_client {{(pid=127006) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 12 08:56:02.172158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:02.173028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:02.182278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:02.183091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:02.183715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:02.184613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:02.185225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:02.185843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:02.205281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:02.535628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.processutils [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp70a3k5q2/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp70a3k5q2/temp.key -subj /CN=4d96d9efa31a41399ce1d414c6bd26f9 -extensions v3_req_client" returned: 0 in 0.490s {{(pid=127006) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 12 08:56:02.539872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:02.541247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.processutils [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp70a3k5q2/temp.key -password pass: {{(pid=127006) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 12 08:56:02.558124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a4ffa4be-2bb7-4573-b4a5-587e2dd812f0 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.390043 Oct 12 08:56:02.558996 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1372/2925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:02 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:02.581253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.processutils [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp70a3k5q2/temp.key -password pass:" returned: 0 in 0.043s {{(pid=127006) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 12 08:56:02.630166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:02.631183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:02.642888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:02.644242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:02.645219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:02.648995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:02.650344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:02.650875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:02.666070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:02.667494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:02.675143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Getting quotas for user 4d96d9efa31a41399ce1d414c6bd26f9 and project 3d2e1aed5c0d49b1bc2820a535ad606a. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:02.697724 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-840a25ef-46a9-4887-b67b-776d4aa3b82b tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.792997 Oct 12 08:56:02.701676 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1554/2926] 10.222.0.40 () {62 vars in 1198 bytes} [Wed Oct 12 08:56:01 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 798 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:02.715718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f397eeae-a513-48dc-a8ae-6de9a851e51e tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9843ee9280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:02.732304 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f397eeae-a513-48dc-a8ae-6de9a851e51e tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-603707390" status: 200 len: 1533 microversion: 2.2 time: 0.023130 Oct 12 08:56:02.733552 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1555/2927] 10.222.0.40 () {60 vars in 1255 bytes} [Wed Oct 12 08:56:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-603707390 => generated 1533 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:02.748417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d287028e-6072-4f3c-94a4-9ff2dac526f1 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f9843e2aa60>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:02.755820 n-d-858383-10 devstack@n-api.service[127006]: WARNING oslo_db.sqlalchemy.utils [None req-d287028e-6072-4f3c-94a4-9ff2dac526f1 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 08:56:02.766385 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d287028e-6072-4f3c-94a4-9ff2dac526f1 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.024263 Oct 12 08:56:02.767863 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1556/2928] 10.222.0.40 () {60 vars in 1177 bytes} [Wed Oct 12 08:56:02 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:02.777642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:02.779588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:02.787540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:02.788207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:02.789207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:02.791095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:02.791715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:02.792335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:03.006506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:03.017667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:03.023606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5158f05b-4d11-4b28-8dd3-22c0c0c8976a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.245971 Oct 12 08:56:03.029117 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e2a2197-b40c-4e78-9847-18b15a8f9eb5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.402871 Oct 12 08:56:03.030969 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1373/2929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:02 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:03.037804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e01ef52-1473-4bfe-a8e2-f8005d08a4a9 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] Calling method '.version_select at 0x7f984ccf8b80>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:03.041214 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1557/2930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:02 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:03.046353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6fc0b8f9-f25f-44ae-ba20-36f7b9f9c7af tempest-FlavorsV2NegativeTest-87128090 tempest-FlavorsV2NegativeTest-87128090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1062125060", "imageRef": "4aa11d8e-40c8-4201-95f4-bd6a51631af6", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:03.085599 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e01ef52-1473-4bfe-a8e2-f8005d08a4a9 tempest-KeyPairsV22TestJSON-1054410985 tempest-KeyPairsV22TestJSON-1054410985-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603707390" status: 204 len: 0 microversion: 2.2 time: 0.051380 Oct 12 08:56:03.086333 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1374/2931] 10.222.0.40 () {60 vars in 1258 bytes} [Wed Oct 12 08:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603707390 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:03.093570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:03.093957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:03.107263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:03.107984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:03.109636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:03.110366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:03.110854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:03.111239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:03.131498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-6fc0b8f9-f25f-44ae-ba20-36f7b9f9c7af tempest-FlavorsV2NegativeTest-87128090 tempest-FlavorsV2NegativeTest-87128090-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:56:03.422947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6fc0b8f9-f25f-44ae-ba20-36f7b9f9c7af tempest-FlavorsV2NegativeTest-87128090 tempest-FlavorsV2NegativeTest-87128090-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6fc0b8f9-f25f-44ae-ba20-36f7b9f9c7af tempest-FlavorsV2NegativeTest-87128090 tempest-FlavorsV2NegativeTest-87128090-project] Request method failure captured: Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 143 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoEhR9diVmMD9_l4VnNXsK6gBkcBLrZqAx2VYhG0gA31mh83tTlWI6--8P0868sx5hrlqz0sTNa3Bjx77-GR50kHbXP3tpWpV8nyLWIxpWPY_dffwbbv7wQnfsNrP20Gsp0cbfzbznLRTa1ihKmblej1RxY8A51Pi0JPypjPNJcx4-c Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: d743615fada3407cb25ea78355b2a326 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FlavorsV2NegativeTest-87128090 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d743615fada3407cb25ea78355b2a326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d743615fada3407cb25ea78355b2a326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d743615fada3407cb25ea78355b2a326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d743615fada3407cb25ea78355b2a326"}]}] Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FlavorsV2NegativeTest-87128090 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: d743615fada3407cb25ea78355b2a326 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-87128090 Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FlavorsV2NegativeTest-87128090-project Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 02ebe4ddb494476b88b8021f19adc90d Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FlavorsV2NegativeTest-87128090-project Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1062125060", "imageRef": "4aa11d8e-40c8-4201-95f4-bd6a51631af6", "flavorRef": "452"}} Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: exception: Flavor's memory is too small for requested image. Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1062125060', 'imageRef': '4aa11d8e-40c8-4201-95f4-bd6a51631af6', 'flavorRef': '452'}}} Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:56:03.428795 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 12 08:56:03.433825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:03.437500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6fc0b8f9-f25f-44ae-ba20-36f7b9f9c7af tempest-FlavorsV2NegativeTest-87128090 tempest-FlavorsV2NegativeTest-87128090-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:03.441660 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6fc0b8f9-f25f-44ae-ba20-36f7b9f9c7af tempest-FlavorsV2NegativeTest-87128090 tempest-FlavorsV2NegativeTest-87128090-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.398986 Oct 12 08:56:03.442257 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1558/2932] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:56:03 2022] POST /compute/v2.1/servers => generated 93 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 08:56:03.452035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:03.454932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:03.484801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:03.486446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:03.487410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:03.488756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:03.489516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:03.490046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:03.569054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:03.572381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:03.573292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:03.574260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lazy-loading 'fault' on Instance uuid 78aad808-0e14-4eb1-87bb-b103b86b5079 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:56:03.632561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:03.640289 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d35eb981-3134-4bd4-bbd0-d1937976957f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 200 len: 1304 microversion: 2.1 time: 0.196353 Oct 12 08:56:03.640887 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1559/2933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:03 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 1304 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:03.652894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:03.653871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:03.662747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:03.663810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:03.664688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:03.665922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:03.666592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:03.667176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:03.856645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:03.865418 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a172b8f2-f84b-4d2f-82f1-39d685848328 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.777789 Oct 12 08:56:03.869404 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1375/2934] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:03 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:03.913232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:03.924571 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d79a894-6966-4898-9ccf-e53f8d9958a4 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.279473 Oct 12 08:56:03.925932 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1560/2935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:03 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:04.058628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:04.059093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:04.060472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:04.060762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:04.079368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:04.080097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:04.080427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:04.081143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:04.082220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:04.082975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:04.085325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:04.085871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:04.086500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:04.088443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:04.090356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:04.090737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:04.354151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:04.364160 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24582a7b-bcf9-434f-977f-45ab0d4e812f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.319628 Oct 12 08:56:04.367772 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1376/2936] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:04 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:04.370921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:04.386388 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f3258d7c-f411-4dfa-995c-944b06cec740 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.336919 Oct 12 08:56:04.386956 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1561/2937] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:04 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:04.671879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:04.673764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:04.686917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:04.696539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:04.697027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:04.697827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:04.698292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:04.698744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:04.720944 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 HTTP/1.1 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '78aad808-0e14-4eb1-87bb-b103b86b5079'} Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:04.723625 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:04.728242 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bcec79eb-9f0a-49d5-90be-c253e608c166 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 404 len: 111 microversion: 2.1 time: 0.064629 Oct 12 08:56:04.728831 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1377/2938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:04 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:04.891310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:04.892316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:04.892711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-50140048", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "2f204459-03a5-4e90-a59a-2dbecd872d0d"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:04.911207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:04.911781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:04.912573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:04.913551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:04.914239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:04.914908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:04.960203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] validate_networks() for [('2f204459-03a5-4e90-a59a-2dbecd872d0d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:56:05.101048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:05.111244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8aab5d59-1c4c-43cc-8267-25eeb0b20b06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.224637 Oct 12 08:56:05.125777 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1562/2939] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:04 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:05.144207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:05.145016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:05.152017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:05.152594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:05.153395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:05.154455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:05.154619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:05.155031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:05.373798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:05.385896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8128acfa-cc96-46b3-9de9-603a6a7ea7c2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.257526 Oct 12 08:56:05.386744 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1563/2940] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:05 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:05.393426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:05.394251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:05.402302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:05.403457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:05.404103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:05.405539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:05.406346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:05.407085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:05.658776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:05.672405 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-607e7a83-0032-47d6-ab62-aef5b496d76c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.284279 Oct 12 08:56:05.673184 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1564/2941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:05 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:05.692688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:05.695639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:05.708610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:05.709617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:05.711000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:05.712090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:05.712795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:05.713809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:05.737013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:56:05.737641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:56:05.738312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:56:05.738880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:56:05.739603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:56:05.752659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:05.753486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:05.754085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:05.754977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:05.767414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:05.775634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:05.818128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:05.828463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for user 3571292391094d83901f21ccb18ec2d8 and project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:05.861903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:56:05.868220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:56:05.910239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:05.919814 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e868877c-98b7-40e0-a19d-6fcd9c0b7f7f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.238654 Oct 12 08:56:05.921078 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1565/2942] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:05 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:05.940143 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2543430b-9c13-481d-8c83-2e3633cda4d7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051771 Oct 12 08:56:05.947231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1378/2943] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:56:05.952969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0151046-1612-42fc-b2a3-512e1dc521d8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:05.953892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0151046-1612-42fc-b2a3-512e1dc521d8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:06.040653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0151046-1612-42fc-b2a3-512e1dc521d8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:06.067869 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0151046-1612-42fc-b2a3-512e1dc521d8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1213 microversion: 2.1 time: 0.118105 Oct 12 08:56:06.068684 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1566/2944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:05 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:06.142492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:06.143105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:06.151813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:06.152300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:06.154602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:06.156404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:06.156802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:06.157761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:06.416367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:06.416988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:06.436882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:06.438355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:06.451977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:06.458073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:06.458580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:06.463076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:06.569269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:06.583295 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4bf92b8f-e945-4357-99f0-345d8a87707c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.446836 Oct 12 08:56:06.602135 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1379/2945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:06 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:06.698044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:06.698747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:06.710729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:06.711974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:06.712627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:06.713306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:06.713813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:06.714576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:07.017994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:07.028397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ea44c06f-fc8f-4769-9f7b-ab4f97883fe7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.335234 Oct 12 08:56:07.031447 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1380/2946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:06 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:07.037239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-07cb6647-2a76-4c0b-adf6-f9ac7be30d8e req-8f5c474f-c824-42c3-a81b-1d65aaac9421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617dc413-650f-4340-933d-6fbf879240bf", "name": "network-vif-plugged", "status": "completed", "tag": "238873e3-bf59-47b5-bfd5-f3b69a1232cd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:07.048549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-07cb6647-2a76-4c0b-adf6-f9ac7be30d8e req-8f5c474f-c824-42c3-a81b-1d65aaac9421 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:07.049309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-07cb6647-2a76-4c0b-adf6-f9ac7be30d8e req-8f5c474f-c824-42c3-a81b-1d65aaac9421 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:07.050012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-07cb6647-2a76-4c0b-adf6-f9ac7be30d8e req-8f5c474f-c824-42c3-a81b-1d65aaac9421 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:07.066200 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-07cb6647-2a76-4c0b-adf6-f9ac7be30d8e req-8f5c474f-c824-42c3-a81b-1d65aaac9421 service nova] Creating event network-vif-plugged:238873e3-bf59-47b5-bfd5-f3b69a1232cd for instance 617dc413-650f-4340-933d-6fbf879240bf on n-h1-858383-10 Oct 12 08:56:07.072507 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-07cb6647-2a76-4c0b-adf6-f9ac7be30d8e req-8f5c474f-c824-42c3-a81b-1d65aaac9421 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039476 Oct 12 08:56:07.073499 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1381/2947] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:07.080729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:07.081709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:07.091290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:07.092355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:07.094236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:07.095128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:07.095772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:07.096281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:07.398668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:07.408121 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1df9dc5b-f8e4-45e7-b73c-b48488951065 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.997605 Oct 12 08:56:07.413476 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1567/2948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:06 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:07.430501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:07.435612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:07.438828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:07.450430 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e32baae7-875e-4f16-a258-ba09d5946c86 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.375399 Oct 12 08:56:07.458340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:07.473473 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1382/2949] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:07 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:07.473863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:07.473863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:07.473863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:07.473863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:07.473863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:07.609837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:07.610685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:07.612782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:07.627744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:07.628574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:07.629960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:07.630923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:07.633018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:07.635323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:07.710028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:07.719274 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-74a60bca-0818-43a0-a187-ddf819ead532 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1265 microversion: 2.1 time: 0.304497 Oct 12 08:56:07.734580 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1568/2950] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:07 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:08.056359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:08.057566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:08.077655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:08.078509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:08.079169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:08.080138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:08.080806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:08.081465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:08.150075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:08.163436 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-637e4cd6-1847-48ee-aae6-99a8709cb83b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.558250 Oct 12 08:56:08.164027 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1383/2951] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:07 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:08.383280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:08.394305 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cee5792-d237-4bf3-b8c7-b27c8c839173 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.344121 Oct 12 08:56:08.394973 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1569/2952] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:08 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:08.441419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:08.442405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:08.451640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:08.453969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:08.454651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:08.457243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:08.458336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:08.460532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:08.482665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:08.484182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:08.502938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:08.503750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:08.504384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:08.505397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:08.513843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:08.514307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:08.853778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:08.868214 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d676e001-72d5-4bd3-807a-93c686b2c607 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1358 microversion: 2.1 time: 0.429919 Oct 12 08:56:08.890139 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1384/2953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:08 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:08.905496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:08.906143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:08.948772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:08.955155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:08.958052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:08.962926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:08.968385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:08.969118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:09.110156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:09.121728 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-589775a4-ba51-4d3d-bd42-dbda81617b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.642823 Oct 12 08:56:09.125375 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1570/2954] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:08 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:09.140357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:09.154772 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c3add8b1-7409-453f-8e17-6bd6c1125107 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1271 microversion: 2.1 time: 0.263378 Oct 12 08:56:09.155722 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1385/2955] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:08 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:09.195555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:09.196715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:09.208759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:09.209718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:09.212340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:09.213347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:09.214334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:09.214965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:09.244689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:09.418331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:09.419668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:09.430628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:09.431352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:09.434984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:09.436059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:09.436705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:09.438124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:09.615162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:09.625727 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f543a137-3893-4cda-ab46-33e5c04c9546 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.441132 Oct 12 08:56:09.653887 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1571/2956] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:09 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:09.895341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:09.896326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:09.915912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:09.918819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:09.919439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:09.920280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:09.923011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:09.927435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:10.123754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:10.148795 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e34e5d3c-65db-47c9-9376-5f4d5db061eb tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.734689 Oct 12 08:56:10.152546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1386/2957] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:09 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:10.190288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8bf82410-ed0d-4ecb-9f12-fd3e52dbc914 req-e887b823-6901-4685-a58b-7ada56b3588a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f40117-2505-4d89-a9fd-c3a992cfd9f7", "name": "network-vif-plugged", "status": "completed", "tag": "50c148f8-f4f7-4a59-a418-ac508c438101"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:10.221132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8bf82410-ed0d-4ecb-9f12-fd3e52dbc914 req-e887b823-6901-4685-a58b-7ada56b3588a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:10.221903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8bf82410-ed0d-4ecb-9f12-fd3e52dbc914 req-e887b823-6901-4685-a58b-7ada56b3588a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:10.222644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8bf82410-ed0d-4ecb-9f12-fd3e52dbc914 req-e887b823-6901-4685-a58b-7ada56b3588a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:10.260570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8bf82410-ed0d-4ecb-9f12-fd3e52dbc914 req-e887b823-6901-4685-a58b-7ada56b3588a service nova] Creating event network-vif-plugged:50c148f8-f4f7-4a59-a418-ac508c438101 for instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 on n-h2-858383-10 Oct 12 08:56:10.283652 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8bf82410-ed0d-4ecb-9f12-fd3e52dbc914 req-e887b823-6901-4685-a58b-7ada56b3588a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099201 Oct 12 08:56:10.285010 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1387/2958] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:10.296489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:10.298271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:10.307890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:10.308883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:10.309554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:10.310549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:10.311230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:10.311906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:10.641057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:10.651734 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45a700c9-228d-4587-bc79-71b37f5a6e83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1542 microversion: 2.1 time: 0.760602 Oct 12 08:56:10.658979 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1572/2959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:09 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1542 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:10.664097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:10.666727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:10.681180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:10.682048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:10.683793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:10.686193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:10.686878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:10.689693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:10.796751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:10.821186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45df2588-2dbd-41cf-b4e0-dbf2374767fe tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.534350 Oct 12 08:56:10.837233 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1388/2960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:10 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:10.852096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:10.853158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:10.868897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:10.869860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:10.870483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:10.871618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:10.875445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:10.875986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:11.204971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:11.247571 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a57a3736-6da6-4d35-8b86-5748c0048ac2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1313 microversion: 2.1 time: 0.587297 Oct 12 08:56:11.251630 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1573/2961] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:10 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:11.272231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:11.287587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:11.316103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:11.319852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:11.320708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:11.322228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:11.323119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:11.323969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:11.381650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:11.402289 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82a1c825-c1ec-48a3-952b-66bcaf376221 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1315 microversion: 2.1 time: 0.563227 Oct 12 08:56:11.407361 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1389/2962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:10 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:11.424637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:11.426245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:11.442674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:11.445320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:11.446367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:11.447847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:11.448787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:11.449954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:11.680307 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0b84a2f-e53d-41bc-8c67-06274517197b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.425785 Oct 12 08:56:11.700425 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1574/2963] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 08:56:11 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-interface => generated 285 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:11.848172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:11.850629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:11.862431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:11.868083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:11.870951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:11.872373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:11.875209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:11.875887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:12.484364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:12.499175 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7f6ba51f-ad75-47c2-9378-787461b04987 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 1.087932 Oct 12 08:56:12.515762 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1390/2964] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:11 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:12.533564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:12.536673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:12.558514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:12.562549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:12.563260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:12.564842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:12.567233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:12.568128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:12.921101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:12.937413 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5246b799-0fd0-448c-86c6-244f29d413bf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1313 microversion: 2.1 time: 0.420130 Oct 12 08:56:12.938935 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1391/2965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:12 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:12.945256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:12.951883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:12.955047 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-44011214-e8c7-426c-964f-c721ef621899 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 1.113798 Oct 12 08:56:12.958119 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1575/2966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:11 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:12.970634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:12.996185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:12.996950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:12.997617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:12.999222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:12.999883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:13.000824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:13.483530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d15e354d-4fad-4bff-a3e9-5df744d16466 req-22c39a83-043c-4db2-b366-4fc16dc81de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d37e5f-33d5-40be-ae87-199d11002df1", "tag": "f2210409-b9d3-4c2b-9a47-5b93501231fa"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:13.518427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d15e354d-4fad-4bff-a3e9-5df744d16466 req-22c39a83-043c-4db2-b366-4fc16dc81de4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:13.519108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d15e354d-4fad-4bff-a3e9-5df744d16466 req-22c39a83-043c-4db2-b366-4fc16dc81de4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:13.519643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d15e354d-4fad-4bff-a3e9-5df744d16466 req-22c39a83-043c-4db2-b366-4fc16dc81de4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:13.557229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d15e354d-4fad-4bff-a3e9-5df744d16466 req-22c39a83-043c-4db2-b366-4fc16dc81de4 service nova] Creating event network-changed:f2210409-b9d3-4c2b-9a47-5b93501231fa for instance 58d37e5f-33d5-40be-ae87-199d11002df1 on n-h1-858383-10 Oct 12 08:56:13.562800 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d15e354d-4fad-4bff-a3e9-5df744d16466 req-22c39a83-043c-4db2-b366-4fc16dc81de4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083847 Oct 12 08:56:13.564300 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1576/2967] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:13.573943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:13.578465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:13.598496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:13.599299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:13.599966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:13.600858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:13.601520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:13.602160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:13.605198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:13.611603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:13.614363 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12304826-f007-4527-8683-90405b5e0597 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1503 microversion: 2.1 time: 0.668736 Oct 12 08:56:13.635925 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1392/2968] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:12 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1503 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:13.651367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:13.653816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:13.663167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:13.670344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:13.671150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:13.672115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:13.672814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:13.673409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:13.736448 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-382d7546-361b-4704-b5f0-22dd76523c05 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.099124 Oct 12 08:56:13.740338 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1393/2969] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:13 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:56:13.961765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:13.962594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:13.977788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:13.978282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:13.978819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:13.979696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:13.980153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:13.980577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:14.124610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:14.135605 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c818726a-de81-463a-ab47-1ba49514f971 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.569865 Oct 12 08:56:14.143036 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1577/2970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:13 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:14.161216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:14.168764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:14.183701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:14.184353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:14.184895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:14.185878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:14.191688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:14.192522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:14.331654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:14.339945 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d66c7230-4f3c-4801-8cc8-6860d4aa538c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1313 microversion: 2.1 time: 0.382694 Oct 12 08:56:14.342446 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1394/2971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:13 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:14.607069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:14.615318 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-56cf9ae9-a8e3-4a0f-93b7-3e48288c30a5 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.470106 Oct 12 08:56:14.626020 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1578/2972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:14 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:14.748343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:14.751178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:14.759031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:14.759741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:14.760314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:14.761165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:14.761923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:14.762507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:14.808125 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-31d0029f-9e51-4eaa-94b5-46e8f31f91dd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.063535 Oct 12 08:56:14.813629 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1395/2973] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:14 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:56:15.169517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:15.171436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:15.177968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:15.180363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.181258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.182115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.183304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.184221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.184965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.378345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:15.379887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:15.396173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.397023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.397900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.399036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.401183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.401919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.501464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:15.516720 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-037a8cf5-86c1-489c-bc5b-c4607ef11ed0 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.352288 Oct 12 08:56:15.518050 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1579/2974] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:15 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:15.628816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f6f68a71-60ea-4f56-92b0-ed896f8a7b93 req-082e4058-a417-4178-8a4e-2c9a88b6a277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617dc413-650f-4340-933d-6fbf879240bf", "tag": "238873e3-bf59-47b5-bfd5-f3b69a1232cd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:15.656039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f6f68a71-60ea-4f56-92b0-ed896f8a7b93 req-082e4058-a417-4178-8a4e-2c9a88b6a277 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.657180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f6f68a71-60ea-4f56-92b0-ed896f8a7b93 req-082e4058-a417-4178-8a4e-2c9a88b6a277 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.658047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f6f68a71-60ea-4f56-92b0-ed896f8a7b93 req-082e4058-a417-4178-8a4e-2c9a88b6a277 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.697355 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f6f68a71-60ea-4f56-92b0-ed896f8a7b93 req-082e4058-a417-4178-8a4e-2c9a88b6a277 service nova] Creating event network-changed:238873e3-bf59-47b5-bfd5-f3b69a1232cd for instance 617dc413-650f-4340-933d-6fbf879240bf on n-h1-858383-10 Oct 12 08:56:15.709239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f6f68a71-60ea-4f56-92b0-ed896f8a7b93 req-082e4058-a417-4178-8a4e-2c9a88b6a277 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088501 Oct 12 08:56:15.714188 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1580/2975] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:15.723053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:15.728747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:15.745457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.746075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.746635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.748533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.753470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.754170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.790407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:15.804397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:15.822447 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30c9f1ba-4f5d-4ab4-8f56-09b9e4947148 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1313 microversion: 2.1 time: 0.457840 Oct 12 08:56:15.824766 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1396/2976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:15 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:15.837033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:15.850467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:15.866719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=25 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:15.869251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.869988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.870518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.871441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:15.871906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:15.872340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:15.918376 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d0fecd9-412f-4960-819d-e9b507007a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.090818 Oct 12 08:56:15.922008 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1397/2977] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:15 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:56:16.063891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=24 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:16.530149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:16.546017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:16.548927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:16.549811 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c4c9cd60-41dd-452e-b4d2-18b658fed4d6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.824182 Oct 12 08:56:16.550589 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1581/2978] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:15 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:16.588629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:16.589162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:16.589737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:16.590698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:16.591398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:16.592041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:16.851509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:16.852177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:16.881272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:16.882013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:16.882912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:16.886597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:16.889700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:16.896211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:17.065836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:17.081259 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-69da2c9a-7091-40a4-9fa7-aba16e445001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.544338 Oct 12 08:56:17.101529 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1398/2979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:16 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:17.108454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:17.124606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:17.155900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:17.156394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:17.175917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:17.179537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:17.180226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:17.182167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:17.317755 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0de82322-540d-44f8-8b39-4dc73f3c7dae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.213958 Oct 12 08:56:17.318412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1399/2980] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:17 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:56:17.575003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:17.576132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:17.594130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:17.596480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:17.597268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:17.623062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:17.628080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:17.628704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:17.662360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:17.673618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-72c29f9b-c610-4450-8362-cdd7fd89c3f1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1313 microversion: 2.1 time: 0.827190 Oct 12 08:56:17.691233 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1582/2981] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:16 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1313 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:17.988917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:17.998439 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d274a7dd-713a-41a4-9c27-29dc31585fbb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.427952 Oct 12 08:56:17.999316 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1400/2982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:17 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:18.110890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:18.111515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:18.129897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:18.132974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:18.135102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:18.136133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:18.137019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:18.137673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:18.329612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:18.332673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:18.339441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:18.340531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:18.341263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:18.342357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:18.343104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:18.343763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:18.395682 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0eb90ab6-1a4c-4cca-b373-3948edf6c39d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.069850 Oct 12 08:56:18.396725 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1401/2983] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:18 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 08:56:18.585361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:18.594308 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38534e56-2980-42b9-b6f0-cbfc36c51a3b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.489814 Oct 12 08:56:18.611442 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1583/2984] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:18 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:18.705069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:18.705819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:18.713845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:18.714601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:18.715273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:18.715998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:18.716460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:18.716869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:18.936700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:18.951849 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d2e3c202-cbad-4d01-8a8a-9f500150577f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1313 microversion: 2.1 time: 0.251082 Oct 12 08:56:18.983859 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1402/2985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:18 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:19.022131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:19.022744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:19.030654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:19.033755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:19.034443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:19.035875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:19.036556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:19.038626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:19.410704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:19.414073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:19.427781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:19.430064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:19.430693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:19.434440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:19.435129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:19.436013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:19.607298 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-684b981d-a394-4d0c-af68-5c614d0349ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.202984 Oct 12 08:56:19.612541 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1403/2986] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:19 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:56:19.628857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:19.631055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:19.658498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:19.661749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:19.664346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:19.667743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:19.668282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:19.674159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:20.026178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:20.047458 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4760fc39-3708-4ed5-b8f4-59515bcbdcca tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.426458 Oct 12 08:56:20.058348 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1404/2987] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:19 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:20.128817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:20.141922 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-465eabc5-96af-4043-8fc0-7b53bc020f2f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 1.122943 Oct 12 08:56:20.162302 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1584/2988] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:19 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:20.169342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:20.170349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:20.177971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:20.179114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:20.179839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:20.181058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:20.182519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:20.183183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:20.268610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8626a78-0c48-433f-bebb-5cbde1348f3c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Action: 'create', calling method: .version_select at 0x7f984cbf3430>, body: {"keypair": {"name": "tempest-keypair-437587936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1jjYoYesCKQzVWPKaZnOb4ABcGE+tE8NwZ5H4k1o/ZMyaOFlvUJ8HPhpGVwhdrSXwUB/K7qHKmJLQBwnRX+/z6Nrv2WonIabqYpK/7nm6Coc5alomo7aRRiIxTEunmZA=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:20.305986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-b8626a78-0c48-433f-bebb-5cbde1348f3c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Getting quotas for project 0a452fe170084e50bdfdb383b0e4f788. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:20.316595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-b8626a78-0c48-433f-bebb-5cbde1348f3c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Getting quotas for user 17da5b8cde3a49a5ab97b85a40de4b5c and project 0a452fe170084e50bdfdb383b0e4f788. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:20.347756 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8626a78-0c48-433f-bebb-5cbde1348f3c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.287632 Oct 12 08:56:20.349805 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1405/2989] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 08:56:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:20.356887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-86ae8620-e707-40cf-8b03-cd6f4caed25e req-6950f91f-dea2-49e9-8f0f-764be6daf1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d37e5f-33d5-40be-ae87-199d11002df1", "name": "network-vif-plugged", "status": "completed", "tag": "f2210409-b9d3-4c2b-9a47-5b93501231fa"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:20.372684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-86ae8620-e707-40cf-8b03-cd6f4caed25e req-6950f91f-dea2-49e9-8f0f-764be6daf1f5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:20.373352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-86ae8620-e707-40cf-8b03-cd6f4caed25e req-6950f91f-dea2-49e9-8f0f-764be6daf1f5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:20.375450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-86ae8620-e707-40cf-8b03-cd6f4caed25e req-6950f91f-dea2-49e9-8f0f-764be6daf1f5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:20.402023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-86ae8620-e707-40cf-8b03-cd6f4caed25e req-6950f91f-dea2-49e9-8f0f-764be6daf1f5 service nova] Creating event network-vif-plugged:f2210409-b9d3-4c2b-9a47-5b93501231fa for instance 58d37e5f-33d5-40be-ae87-199d11002df1 on n-h1-858383-10 Oct 12 08:56:20.410634 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-86ae8620-e707-40cf-8b03-cd6f4caed25e req-6950f91f-dea2-49e9-8f0f-764be6daf1f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058752 Oct 12 08:56:20.411547 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1406/2990] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:20.624669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:20.633543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:20.643900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:20.654155 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a3c99e7-a6a5-41d0-a05f-fb89c64a23d6 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1313 microversion: 2.1 time: 0.487697 Oct 12 08:56:20.669464 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1585/2991] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:20 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:20.669923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:20.669923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:20.670094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:20.674708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:20.675984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:20.677796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:20.830976 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-329d99b1-31ea-4f66-9dc6-c2e9d7b1f78b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.211973 Oct 12 08:56:20.838251 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1407/2992] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:20 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 08:56:21.016784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2cb25813-3840-4f79-af5b-a1b179dbb2be tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Action: 'create', calling method: .version_select at 0x7f984882c4c0>, body: {"pool": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:21.077254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:21.078177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:21.096091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:21.098119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:21.098972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:21.103209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:21.103885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:21.106672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:21.473255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:21.482855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-04b46029-90be-4b6e-8013-83f2b5b2bbc2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.411052 Oct 12 08:56:21.483465 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1408/2993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:21 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:21.507472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:21.508092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:21.527319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:21.527966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:21.528500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:21.529228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:21.529712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:21.530144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:21.798710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:21.813084 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9da99b7a-3c2e-484e-abb0-720d9501f45f tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.309590 Oct 12 08:56:21.813932 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1409/2994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:21 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:21.849751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:21.851591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:21.873406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:21.875903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:21.876807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:21.879379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:21.881023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:21.885160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:22.746237 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2cb25813-3840-4f79-af5b-a1b179dbb2be tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.817733 Oct 12 08:56:22.747379 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1586/2995] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:56:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:56:22.764085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:22.767306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:22.782181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:22.783572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:22.784357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:22.785755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:22.786458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:22.787096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:22.851542 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d89fe564-fdc3-42a1-b2e5-8a5e9b9a7312 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.090846 Oct 12 08:56:22.866261 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1587/2996] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:22 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:56:22.882390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:22.885685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:22.897419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:22.898001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:22.898967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:22.900645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:22.901381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:22.902050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:23.004986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:23.020003 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa1c4a33-2b6e-4643-bc2f-13afdf929cfa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1313 microversion: 2.1 time: 1.191652 Oct 12 08:56:23.023161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1410/2997] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:21 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1313 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:23.033277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77955bd8-45c9-4eee-82eb-97e9d1c17358 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Calling method '.version_select at 0x7f984877c940>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:23.190423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:23.208394 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ba2e8c6-5234-4c13-bbdb-2846b1439b14 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.343050 Oct 12 08:56:23.209486 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1588/2998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:22 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:23.214609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:23.215639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:23.223757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:23.224327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:23.224827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:23.225803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:23.226331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:23.226928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:23.433478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:23.444546 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd74378f-f652-4eaf-a806-bfc1b3532a32 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1510 microversion: 2.1 time: 0.233322 Oct 12 08:56:23.449380 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1589/2999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:23 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:23.834757 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77955bd8-45c9-4eee-82eb-97e9d1c17358 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/836a99b4-478c-4460-be0e-518d3e6315e2" status: 200 len: 142 microversion: 2.1 time: 0.809846 Oct 12 08:56:23.838121 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1411/3000] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:56:23 2022] GET /compute/v2.1/os-floating-ips/836a99b4-478c-4460-be0e-518d3e6315e2 => generated 142 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:23.851971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-16fbe386-cf22-4549-a413-f272815f9b50 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Calling method '.version_select at 0x7f9843f4d9d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:23.877211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:23.879925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:23.894814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:23.897452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:23.898169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:23.899248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:23.901829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:23.902592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:23.972448 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-51818e9f-fdeb-4f31-85c1-4e7ec30fbca3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 14 microversion: 2.1 time: 0.101867 Oct 12 08:56:23.976953 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1412/3001] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:23 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 08:56:24.051647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:24.054113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:24.069827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:24.072169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:24.072622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:24.078422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:24.078925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:24.079375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:24.144160 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-16fbe386-cf22-4549-a413-f272815f9b50 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.296102 Oct 12 08:56:24.144938 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1590/3002] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:56:23 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:24.158901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-751967ad-5b60-43f3-a624-ccba8902db7b tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Calling method '.version_select at 0x7f9843fe3940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:25.017156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:25.063753 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a145c4b3-7ce0-4da3-8506-1e173083d113 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1500 microversion: 2.1 time: 1.017469 Oct 12 08:56:25.066344 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1413/3003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:24 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1500 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:25.076514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:25.077358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:25.085626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:25.086239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:25.086674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:25.087383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:25.087821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:25.088247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:25.492702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:25.501841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:25.529673 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8c68d129-9933-40c5-b81b-81cab963f303 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1517 microversion: 2.1 time: 0.457831 Oct 12 08:56:25.530564 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1414/3004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:25 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1517 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:25.537899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:25.538802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:25.567615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:25.568220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:25.568666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:25.569393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:25.569870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:25.570341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:25.805884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:25.819042 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7cc9a2a4-b1f3-418f-8296-b4b0f0b38c55 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1487 microversion: 2.1 time: 0.284946 Oct 12 08:56:25.822070 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1415/3005] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:25 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1487 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:25.833266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:25.839616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:25.848525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:25.849015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:25.849475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:25.851085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:25.851309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:25.856468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:26.160312 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-751967ad-5b60-43f3-a624-ccba8902db7b tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/836a99b4-478c-4460-be0e-518d3e6315e2" status: 202 len: 0 microversion: 2.1 time: 2.005832 Oct 12 08:56:26.160921 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1591/3006] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:56:24 2022] DELETE /compute/v2.1/os-floating-ips/836a99b4-478c-4460-be0e-518d3e6315e2 => generated 0 bytes in 2007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:26.174400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:26.177452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:26.188680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:26.189576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:26.190858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:26.192192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:26.193574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:26.194687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:26.237159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:26.274510 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-22def266-e335-4132-a4fa-cab94887edbc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1/action" status: 202 len: 0 microversion: 2.1 time: 0.111088 Oct 12 08:56:26.275582 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1592/3007] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:26 2022] POST /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:26.283410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1441276585", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0ee27f56-de1f-4674-832b-e63c49ed3383"}], "security_groups": [{"name": "tempest-securitygroup--1663048128"}], "key_name": "tempest-keypair-437587936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:26.571681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] validate_networks() for [('0ee27f56-de1f-4674-832b-e63c49ed3383', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:56:26.768723 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86cf5bcf-7981-47d7-ae5c-af3d1c350dd2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action" status: 200 len: 16389 microversion: 2.1 time: 0.945064 Oct 12 08:56:26.780069 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1416/3008] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:25 2022] POST /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7/action => generated 16389 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:56:26.799116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-245845899"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:26.806369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:26.814906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:26.815933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:26.816619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:26.817545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:26.818070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:26.818564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:26.993872 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee4f3db0-1a69-43c4-936c-e4bbcc4a7e47 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "PUT /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1059 microversion: 2.1 time: 0.212187 Oct 12 08:56:26.995761 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1417/3009] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 08:56:26 2022] PUT /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1059 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:27.042517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c40f342c-7714-4aa6-ada7-d6c3abf80e81 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Action: 'create', calling method: .version_select at 0x7f984cbd3940>, body: {"pool": null} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:27.211061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Getting quotas for project 0a452fe170084e50bdfdb383b0e4f788. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:27.216844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Getting quotas for user 17da5b8cde3a49a5ab97b85a40de4b5c and project 0a452fe170084e50bdfdb383b0e4f788. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:27.233387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:56:27.233840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:56:27.234478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:56:27.234900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:56:27.235341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:56:27.244041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:27.244674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:27.245124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:27.245913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:27.246373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:27.246807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:27.266615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Getting quotas for project 0a452fe170084e50bdfdb383b0e4f788. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:27.271434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Getting quotas for user 17da5b8cde3a49a5ab97b85a40de4b5c and project 0a452fe170084e50bdfdb383b0e4f788. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:27.284200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:56:27.287450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:56:27.344726 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1bf70a4b-c3b1-4f7d-a947-16a997af59b9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.067775 Oct 12 08:56:27.346142 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1593/3010] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:56:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:56:27.350970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:27.351890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:27.359830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:27.360590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:27.361194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:27.362106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:27.362726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:27.363538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:27.549095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:27.558269 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-786bdc5f-28b3-42ca-a9cb-dc1ba727b55f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1485 microversion: 2.1 time: 0.210957 Oct 12 08:56:27.558847 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1594/3011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:27 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1485 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:27.563679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:27.564279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:27.570864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:27.572732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:27.573314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:27.574234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:27.574832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:27.575416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:27.719750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:27.731036 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0ece6bed-1b50-49f9-ba20-8ea1e582325f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1523 microversion: 2.1 time: 0.171004 Oct 12 08:56:27.732189 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1595/3012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:27 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:27.862418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:27.862702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:27.869772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:27.870489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:27.871041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:27.871980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:27.872514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:27.873017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.026678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:28.034712 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f7b64fe1-a482-4a43-9834-60dfbcae2368 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.301123 Oct 12 08:56:28.035332 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1596/3013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:27 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:28.040142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5f833034-5b0b-44fb-97b4-e90b45276ab9 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Action: 'create', calling method: .version_select at 0x7f9848861f70>, body: {"keypair": {"name": "tempest-keypair-295715701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBit72PCbfbaqfylt4Dt7KrTMN+EL1miZyPSALjrVmz27k2/OgDEh7tFZONKVOblMIqd6WPBb1cG2+vtLEafL7LPITT7IgITr7RIvEHUrVEPHzJIzE/hbNCxYBr49qWIhQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:28.062756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-5f833034-5b0b-44fb-97b4-e90b45276ab9 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Getting quotas for project 288568b4164c4ab3824fcd2e946d2f31. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:28.067661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-5f833034-5b0b-44fb-97b4-e90b45276ab9 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Getting quotas for user b349f4b4b75445eba0205b73a6e6995d and project 288568b4164c4ab3824fcd2e946d2f31. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:28.092733 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5f833034-5b0b-44fb-97b4-e90b45276ab9 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.056234 Oct 12 08:56:28.093349 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1597/3014] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 08:56:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 08:56:28.097984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:28.098595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:28.104793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.105282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.105912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.106477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.106929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.107350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.315782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:28.327869 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69936bf2-29e3-48ac-911b-4ef33b89b440 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1486 microversion: 2.1 time: 0.233409 Oct 12 08:56:28.328452 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1598/3015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:28 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:28.341337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:28.342499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:28.349214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.350022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.350685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.351600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.352127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.352627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.364381 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c40f342c-7714-4aa6-ada7-d6c3abf80e81 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.367197 Oct 12 08:56:28.365016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1418/3016] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 08:56:26 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:28.370321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:28.371012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:28.378535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.379018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.379606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.380504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.380942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.381362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.408043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:56:28.430244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:28.438227 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c5da462-5a6b-4fd0-b7e6-648f7fbbc6be tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1281 microversion: 2.1 time: 0.106489 Oct 12 08:56:28.439216 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1599/3017] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:28 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:28.444001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:28.444826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:28.452133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.452719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.453230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.454022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.454686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.455185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.497955 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dd2c7720-9a6d-41b9-b056-5799162785f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 204 len: 0 microversion: 2.1 time: 0.131194 Oct 12 08:56:28.499012 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1419/3018] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:28 2022] DELETE /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:28.511842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:28.512560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:28.518829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.519572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.520379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.521152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.521823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.522562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.689294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:28.698782 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3762761-d500-4b58-98b5-3561f5eb21a2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1486 microversion: 2.1 time: 0.197532 Oct 12 08:56:28.702579 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1420/3019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:28 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1486 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:28.703340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:28.713066 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-191c7ebb-8845-46e9-8764-d2bdc3ca53e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.272619 Oct 12 08:56:28.714257 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1600/3020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:28 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:28.719074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:28.719957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:28.726391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0690e723-4fa7-435b-9541-874cf8920463 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Calling method '.version_select at 0x7f984cc3e670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:28.727113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.727873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.728520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.729649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.730801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.731443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.922427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:28.931690 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-27b5421b-574b-4a63-aacb-9d81267ec998 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1491 microversion: 2.1 time: 0.216221 Oct 12 08:56:28.933033 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1601/3021] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:28 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1491 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:28.941986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:28.942588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:28.949287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.949830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.950273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.950979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:28.951437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:28.951872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:28.979875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:56:29.061637 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-01c8fba9-d662-4261-b4da-8f749b057951 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 204 len: 0 microversion: 2.1 time: 0.127102 Oct 12 08:56:29.065424 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1602/3022] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:28 2022] DELETE /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:29.067609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:29.068481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:29.074910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.075399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.075828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.076528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.077018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.077493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.217040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:29.225326 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4eca1e9f-9e35-461e-90ad-3f9dd824d6b6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.161917 Oct 12 08:56:29.227039 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1603/3023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:29 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:29.231712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:29.232333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:29.238920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.239472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.239995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.240814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.241339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.241915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.382846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:29.391669 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13020cd8-3e40-46f3-aa7c-51dfed125479 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1523 microversion: 2.1 time: 0.163600 Oct 12 08:56:29.397591 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1604/3024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:29 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:29.397591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:29.397591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:29.404303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.404887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.405323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.406056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.406715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.407159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.566139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:29.574781 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-106ad860-d06d-42d3-b64c-623642bb1140 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1492 microversion: 2.1 time: 0.181447 Oct 12 08:56:29.575537 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1605/3025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:29 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1492 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:29.580445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:29.581067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:29.587456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.588045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.588556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.589370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.589992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.590498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.726055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:29.734690 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e22761bd-efea-46fd-9d52-aea5e0ca39df tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.157904 Oct 12 08:56:29.735400 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1606/3026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:29 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:29.740064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:29.740692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:29.747011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.747543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.748031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.748719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.749465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.749670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.815276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:29.823539 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71f3f2c6-c9d5-4f14-abf3-a2e06a636b7a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1335 microversion: 2.1 time: 0.087129 Oct 12 08:56:29.824128 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1607/3027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:29 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1335 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:29.843112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:29.843498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:29.850114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.850624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.851084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.851840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.852297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.852730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.879893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:29.904341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Locking {{(pid=127006) lock /opt/stack/nova/nova/compute/api.py:4847}} Oct 12 08:56:29.966403 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d6a006a-937b-4bf5-bbf5-e8aa0d804dc0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.140155 Oct 12 08:56:29.969929 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1608/3028] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:29 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:29.971717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:29.972356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:29.978417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.978909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.979369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:29.980055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:29.980524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:29.980974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.116846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:30.124946 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7169478f-f5c4-40eb-80a0-3f7acb4e07ea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1491 microversion: 2.1 time: 0.156904 Oct 12 08:56:30.125653 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1609/3029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:29 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1491 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:30.130463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:30.131080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:30.138704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.139360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.139804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.140530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.140994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.141430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.285886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:30.294266 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e6dd674-0da6-4444-8a6c-34e8020b63f3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.167549 Oct 12 08:56:30.295229 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1610/3030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:30 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:30.318387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb7ad47e-d5a7-4dfb-b873-084192edb2fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:30.324580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:30.325100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb7ad47e-d5a7-4dfb-b873-084192edb2fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.325574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb7ad47e-d5a7-4dfb-b873-084192edb2fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.326371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb7ad47e-d5a7-4dfb-b873-084192edb2fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.351265 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-eb7ad47e-d5a7-4dfb-b873-084192edb2fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] HTTP exception thrown: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 is locked Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb7ad47e-d5a7-4dfb-b873-084192edb2fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Request method failure captured: Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action HTTP/1.1 Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 15 Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoAP365udkWTpc1lydTu7qX_N7CXpUrjOBJr0wez-gl3lAesjFUCh22AjkyEVAwnIIkXt-GCDdntFDiEibPa4HlO8aL-I43zq87pr7cG6va0bJbScEIcJ_YPe04MxPmCpaxDESPZzAPttwxZ8Yj5L5edfZ8gmlofL9kN4xosW0HZYYo Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}] Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-758128117 Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-758128117-project Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 54fad01e2e6e41d0887895b131051ee1 Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-758128117-project Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: {"os-stop": {}} Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 is locked Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '77cfc40a-e74e-425f-9ff8-a23531e1f956', 'body': {'os-stop': {}}} Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 is locked Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 is locked Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 is locked Oct 12 08:56:30.353089 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.360596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb7ad47e-d5a7-4dfb-b873-084192edb2fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Returning 409 to user: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 is locked {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:30.360596 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb7ad47e-d5a7-4dfb-b873-084192edb2fd tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 409 len: 107 microversion: 2.1 time: 0.040736 Oct 12 08:56:30.360596 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1611/3031] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:30 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 107 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 08:56:30.365974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:30.366431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:30.368414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:30.375531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.376160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.376813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.377731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.378435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.378875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.425682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Unlocking {{(pid=127006) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 12 08:56:30.483726 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e933036-fcde-4314-ab96-e87234b59a5f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.121604 Oct 12 08:56:30.487357 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1612/3032] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:30 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:30.489262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:30.489727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:30.495848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.496338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.496901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.497531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.497979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.498397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.602339 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0690e723-4fa7-435b-9541-874cf8920463 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/131b3e3c-51ea-48be-b853-415f9bbb95c7" status: 202 len: 0 microversion: 2.1 time: 1.898477 Oct 12 08:56:30.607027 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1421/3033] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:56:28 2022] DELETE /compute/v2.1/os-floating-ips/131b3e3c-51ea-48be-b853-415f9bbb95c7 => generated 0 bytes in 1900 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:30.611183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d887fc03-3514-42d0-9a13-102f5322f478 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:30.618178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d887fc03-3514-42d0-9a13-102f5322f478 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.619030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d887fc03-3514-42d0-9a13-102f5322f478 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.619810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d887fc03-3514-42d0-9a13-102f5322f478 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.643728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:30.652848 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1cca8ea5-feb9-4cff-a8b9-ec1551179ec6 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1523 microversion: 2.1 time: 0.167453 Oct 12 08:56:30.656517 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1613/3034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:30 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:30.659223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:30.659796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:30.666742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.667253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.667701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.668777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.669372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.669832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.683748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d887fc03-3514-42d0-9a13-102f5322f478 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Going to try to stop instance {{(pid=127007) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 08:56:30.732814 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d887fc03-3514-42d0-9a13-102f5322f478 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.127670 Oct 12 08:56:30.733873 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1422/3035] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:30 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:30.741036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef520080-ff17-4816-ad22-6e483d40c280 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Calling method '.version_select at 0x7f984cc3ea60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:30.820008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:30.836360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG neutronclient.v2_0.client [None req-ef520080-ff17-4816-ad22-6e483d40c280 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 131b3e3c-51ea-48be-b853-415f9bbb95c7 could not be found", "detail": ""}} {{(pid=127007) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:56:30.837225 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ef520080-ff17-4816-ad22-6e483d40c280 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] HTTP exception thrown: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef520080-ff17-4816-ad22-6e483d40c280 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Request method failure captured: Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-floating-ips/131b3e3c-51ea-48be-b853-415f9bbb95c7 HTTP/1.1 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoE09NT5kGzp9jDqbUWKw3SWel3y-Fj2bLXJpJ3dSBT8iGurdtj2B3GKkzgPer15KKIMZF4WffvOl3Dt5Q0-6lu4TdrfiwHvGV84zVSMK3NlqbJRMq1-YswCo2ql_-880uRz5AkjLkZx7CVGuyAFjdQgEjkxmS6ikbqwZVVh6OS-gjs Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2c505a0a094b4a509b5071ef77da6f1e Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-FloatingIPsTestJSON-208864591 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c505a0a094b4a509b5071ef77da6f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c505a0a094b4a509b5071ef77da6f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c505a0a094b4a509b5071ef77da6f1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c505a0a094b4a509b5071ef77da6f1e"}]}] Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-FloatingIPsTestJSON-208864591 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2c505a0a094b4a509b5071ef77da6f1e Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-FloatingIPsTestJSON-208864591 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-FloatingIPsTestJSON-208864591-project Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 4089ff2086c9480d88a8836f52d8235c Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-FloatingIPsTestJSON-208864591-project Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: exception: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '131b3e3c-51ea-48be-b853-415f9bbb95c7'} Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 131b3e3c-51ea-48be-b853-415f9bbb95c7 could not be found Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0969a9d3-f609-4aac-ab20-03df71a6c41d'] Oct 12 08:56:30.839682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7. Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef520080-ff17-4816-ad22-6e483d40c280 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Returning 404 to user: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:30.843624 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef520080-ff17-4816-ad22-6e483d40c280 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/131b3e3c-51ea-48be-b853-415f9bbb95c7" status: 404 len: 111 microversion: 2.1 time: 0.108001 Oct 12 08:56:30.845920 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1423/3036] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:56:30 2022] GET /compute/v2.1/os-floating-ips/131b3e3c-51ea-48be-b853-415f9bbb95c7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:30.850607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:30.851429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:30.858252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-20585287-075f-4bbd-af69-69277cd30598 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1492 microversion: 2.1 time: 0.203085 Oct 12 08:56:30.859041 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1614/3037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:30 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1492 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:30.865740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.866466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.867290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.868257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.868890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.869632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.872613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:30.874318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:30.882033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.882648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.883159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.883958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:30.884486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:30.884983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:30.950695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:30.958765 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-986892d8-e6a2-49f0-a227-30a49021203a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1335 microversion: 2.1 time: 0.092105 Oct 12 08:56:30.959435 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1615/3038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:30 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:30.964864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43931cf2-2ab5-4365-91ac-5a1b007cb534 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Calling method '.version_select at 0x7f9843f4d790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:31.009838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-43931cf2-2ab5-4365-91ac-5a1b007cb534 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 131b3e3c-51ea-48be-b853-415f9bbb95c7 could not be found", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:56:31.010633 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-43931cf2-2ab5-4365-91ac-5a1b007cb534 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] HTTP exception thrown: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43931cf2-2ab5-4365-91ac-5a1b007cb534 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Request method failure captured: Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-floating-ips/131b3e3c-51ea-48be-b853-415f9bbb95c7 HTTP/1.1 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoE09NT5kGzp9jDqbUWKw3SWel3y-Fj2bLXJpJ3dSBT8iGurdtj2B3GKkzgPer15KKIMZF4WffvOl3Dt5Q0-6lu4TdrfiwHvGV84zVSMK3NlqbJRMq1-YswCo2ql_-880uRz5AkjLkZx7CVGuyAFjdQgEjkxmS6ikbqwZVVh6OS-gjs Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2c505a0a094b4a509b5071ef77da6f1e Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FloatingIPsTestJSON-208864591 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c505a0a094b4a509b5071ef77da6f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c505a0a094b4a509b5071ef77da6f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c505a0a094b4a509b5071ef77da6f1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c505a0a094b4a509b5071ef77da6f1e"}]}] Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FloatingIPsTestJSON-208864591 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2c505a0a094b4a509b5071ef77da6f1e Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FloatingIPsTestJSON-208864591 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FloatingIPsTestJSON-208864591-project Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 4089ff2086c9480d88a8836f52d8235c Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FloatingIPsTestJSON-208864591-project Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: exception: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '131b3e3c-51ea-48be-b853-415f9bbb95c7'} Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 131b3e3c-51ea-48be-b853-415f9bbb95c7 could not be found Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-111fd0f4-9a0b-424f-b94f-4f7493a66cd5'] Oct 12 08:56:31.012476 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7. Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43931cf2-2ab5-4365-91ac-5a1b007cb534 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] Returning 404 to user: Floating IP not found for ID 131b3e3c-51ea-48be-b853-415f9bbb95c7 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43931cf2-2ab5-4365-91ac-5a1b007cb534 tempest-FloatingIPsTestJSON-208864591 tempest-FloatingIPsTestJSON-208864591-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/131b3e3c-51ea-48be-b853-415f9bbb95c7" status: 404 len: 111 microversion: 2.1 time: 0.053422 Oct 12 08:56:31.016648 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1616/3039] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 08:56:30 2022] DELETE /compute/v2.1/os-floating-ips/131b3e3c-51ea-48be-b853-415f9bbb95c7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:31.149293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:31.150148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:31.157849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:31.158724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:31.159160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:31.160100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:31.160553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:31.160975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:31.206850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:31.217797 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2dd249c7-8d7e-4d78-ae27-215ea249d7e6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.372752 Oct 12 08:56:31.218726 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1424/3040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:30 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:31.503967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-818512989", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "50b9ce05-ca67-4ca9-9ad4-699238537e4c"}, {"port": "dd89cf22-dd9d-43c6-acf1-e972ac33ae09", "tag": "port-1"}, {"port": "732ae85e-6222-4561-8af6-1183c673884b", "tag": "port-2"}, {"uuid": "95e4f5a5-933c-4f8d-9b4e-c057de95db0f", "tag": "net-1"}, {"uuid": "95e4f5a5-933c-4f8d-9b4e-c057de95db0f"}, {"uuid": "db06c074-32fb-466e-aa98-df1679492034", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "db06c074-32fb-466e-aa98-df1679492034", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "fee13702-5742-4121-811f-39428e8170b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3de7bdba-e28c-4906-b0b2-305ef6cad8a6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "41c8493f-b539-4317-b6a4-27eac7dff9fb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--548517426"}], "key_name": "tempest-keypair-295715701", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:31.812707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] validate_networks() for [('50b9ce05-ca67-4ca9-9ad4-699238537e4c', None, None, None, None, None), (None, None, 'dd89cf22-dd9d-43c6-acf1-e972ac33ae09', None, None, None), (None, None, '732ae85e-6222-4561-8af6-1183c673884b', None, None, None), ('95e4f5a5-933c-4f8d-9b4e-c057de95db0f', None, None, None, None, None), ('95e4f5a5-933c-4f8d-9b4e-c057de95db0f', None, None, None, None, None), ('db06c074-32fb-466e-aa98-df1679492034', '10.2.2.100', None, None, None, None), ('db06c074-32fb-466e-aa98-df1679492034', '10.2.2.200', None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:56:32.011221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:32.020612 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5c75185c-9bc9-4b68-8b27-c5927d06d06b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1491 microversion: 2.1 time: 0.876162 Oct 12 08:56:32.022300 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1617/3041] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:31 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1491 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:32.027720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:32.028467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:32.034880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:32.035528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:32.036615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:32.037348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:32.037874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:32.038405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:32.430191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:32.440493 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d378942-3044-4d59-90f0-4d8f796741b3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1523 microversion: 2.1 time: 0.416855 Oct 12 08:56:32.447420 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1618/3042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:32 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:32.450473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1e5752a9-56c6-4ecf-b3ae-4b38b0450194 req-06b9d9d8-24f4-42c8-8e28-408af8e0bb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a27f9c-6b14-46e1-ac07-f7396ddd3a30", "name": "network-vif-unplugged", "status": "completed", "tag": "e8479700-da16-4693-98d3-d3276027826c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:32.462005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1e5752a9-56c6-4ecf-b3ae-4b38b0450194 req-06b9d9d8-24f4-42c8-8e28-408af8e0bb0b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:32.462640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1e5752a9-56c6-4ecf-b3ae-4b38b0450194 req-06b9d9d8-24f4-42c8-8e28-408af8e0bb0b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:32.463141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1e5752a9-56c6-4ecf-b3ae-4b38b0450194 req-06b9d9d8-24f4-42c8-8e28-408af8e0bb0b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:32.476369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1e5752a9-56c6-4ecf-b3ae-4b38b0450194 req-06b9d9d8-24f4-42c8-8e28-408af8e0bb0b service nova] Creating event network-vif-unplugged:e8479700-da16-4693-98d3-d3276027826c for instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 on n-h2-858383-10 Oct 12 08:56:32.482016 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1e5752a9-56c6-4ecf-b3ae-4b38b0450194 req-06b9d9d8-24f4-42c8-8e28-408af8e0bb0b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037892 Oct 12 08:56:32.488203 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1619/3043] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:32.496326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:32.497221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:32.505042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:32.505552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:32.505988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:32.506902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:32.507679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:32.509348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:32.819300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:32.847760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1fe91848-d483-4112-bc1c-dc365a869fde tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 200 len: 1492 microversion: 2.1 time: 0.358326 Oct 12 08:56:32.862062 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1620/3044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:32 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 1492 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:32.862062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:32.862062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:32.872631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:32.873338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:32.873988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:32.875155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:32.875772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:32.876427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:33.268100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:33.327762 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8241433e-656e-46a3-bec2-cbacf3504c2a tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1403 microversion: 2.1 time: 0.478276 Oct 12 08:56:33.333258 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1621/3045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:32 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1403 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:33.339233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:33.339859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:33.351133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:33.351643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:33.352091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:33.352815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:33.353277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:33.353739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:33.385690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=88,nova_cell1:UPDATE=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:33.623545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:33.632087 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3bf0fc18-b274-4b1d-b4f6-787745229998 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.297453 Oct 12 08:56:33.653224 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1622/3046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:33 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:33.661026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:33.661737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:33.669784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:33.670347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:33.671025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:33.671995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:33.672609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:33.673205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:33.722182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:33.722903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:33.723799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:33.725422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lazy-loading 'fault' on Instance uuid 58d37e5f-33d5-40be-ae87-199d11002df1 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:56:33.830505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:33.851447 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be5e6029-7b0f-42b6-8b41-7beb710d9e4a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 200 len: 1303 microversion: 2.1 time: 0.192511 Oct 12 08:56:33.852892 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1623/3047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:33 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 1303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:33.984405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-edc534c9-daeb-4f79-b83f-53abd7f5b201 req-909a8018-d669-42d4-b426-01d008f8b411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16", "name": "network-vif-deleted", "tag": "78724171-073e-453f-89f3-9f0479c0ca12"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:33.996910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edc534c9-daeb-4f79-b83f-53abd7f5b201 req-909a8018-d669-42d4-b426-01d008f8b411 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:33.997834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edc534c9-daeb-4f79-b83f-53abd7f5b201 req-909a8018-d669-42d4-b426-01d008f8b411 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:33.998518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edc534c9-daeb-4f79-b83f-53abd7f5b201 req-909a8018-d669-42d4-b426-01d008f8b411 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:34.010946 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-edc534c9-daeb-4f79-b83f-53abd7f5b201 req-909a8018-d669-42d4-b426-01d008f8b411 service nova] Creating event network-vif-deleted:78724171-073e-453f-89f3-9f0479c0ca12 for instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 on n-h1-858383-10 Oct 12 08:56:34.017616 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-edc534c9-daeb-4f79-b83f-53abd7f5b201 req-909a8018-d669-42d4-b426-01d008f8b411 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160893 Oct 12 08:56:34.018704 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1624/3048] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:34.044742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-328e8faa-f297-4e20-b3b3-a348bc1df0b4 req-f9cd781f-4c7d-460e-8e25-54f1439be179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d37e5f-33d5-40be-ae87-199d11002df1", "name": "network-vif-deleted", "tag": "f2210409-b9d3-4c2b-9a47-5b93501231fa"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:34.065006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-328e8faa-f297-4e20-b3b3-a348bc1df0b4 req-f9cd781f-4c7d-460e-8e25-54f1439be179 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:34.065844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-328e8faa-f297-4e20-b3b3-a348bc1df0b4 req-f9cd781f-4c7d-460e-8e25-54f1439be179 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:34.066715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-328e8faa-f297-4e20-b3b3-a348bc1df0b4 req-f9cd781f-4c7d-460e-8e25-54f1439be179 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:34.082248 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-328e8faa-f297-4e20-b3b3-a348bc1df0b4 req-f9cd781f-4c7d-460e-8e25-54f1439be179 service nova] Creating event network-vif-deleted:f2210409-b9d3-4c2b-9a47-5b93501231fa for instance 58d37e5f-33d5-40be-ae87-199d11002df1 on n-h1-858383-10 Oct 12 08:56:34.090330 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-328e8faa-f297-4e20-b3b3-a348bc1df0b4 req-f9cd781f-4c7d-460e-8e25-54f1439be179 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069484 Oct 12 08:56:34.091199 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1625/3049] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:34.102420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:34.103220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:34.112937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:34.113430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:34.113886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:34.114591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:34.115184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:34.115826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:34.356691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:34.377400 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5ee776d0-df9a-4354-99ce-1f47f57333b7 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1523 microversion: 2.1 time: 0.283666 Oct 12 08:56:34.399791 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1626/3050] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:34 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:34.414995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:34.417354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:34.435007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:34.437796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:34.438623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:34.442788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:34.443432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:34.444066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:34.464217 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 HTTP/1.1 Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16'} Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:34.466096 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:34.472272 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:34.472272 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:34.472272 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:34.472272 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:34.472272 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:34.472272 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:34.472272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:34.472830 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-874d463a-e03c-4266-b5d8-9a620f0993dd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 404 len: 111 microversion: 2.1 time: 0.069522 Oct 12 08:56:34.473797 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1627/3051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:34 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:34.506530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:34.507222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:34.519123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:34.519638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:34.520082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:34.520795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:34.521252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:34.521711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.155937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:35.164769 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5c73d2b-aa85-40dd-88a2-e99283e91c01 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1403 microversion: 2.1 time: 0.689748 Oct 12 08:56:35.165476 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1628/3052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:34 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1403 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:35.185487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:35.186217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:35.193148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.194142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.194950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.195977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.196669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.197307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.222750 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 HTTP/1.1 Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16'} Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:35.225248 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.229327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.231970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:35.232847 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c48e0df-c508-418a-b92d-e440b3ed8b4b tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 404 len: 111 microversion: 2.1 time: 0.051408 Oct 12 08:56:35.233651 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1629/3053] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:35 2022] DELETE /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:35.241094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:35.241782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:35.248129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.248984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.249627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.250517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.251155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.251750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.471792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:35.480619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bca02329-bac7-4644-abd7-0dc93692f8a7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.243238 Oct 12 08:56:35.481508 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1630/3054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:35 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:35.486440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:35.487055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:35.494011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.494494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.495176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.496215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.496710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.497110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.523397 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 HTTP/1.1 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '58d37e5f-33d5-40be-ae87-199d11002df1'} Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:35.529904 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:35.533866 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-293bdcb1-f419-49f2-a6dd-6a6f7ea61781 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 404 len: 111 microversion: 2.1 time: 0.050457 Oct 12 08:56:35.534656 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1631/3055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:35 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:35.556503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:35.557135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:35.564110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.565117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.565117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.565791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.566275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.566829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.586106 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 HTTP/1.1 Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16'} Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.588335 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6f41cb88-80d0-43db-b301-3a3eb95dd1fd tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16" status: 404 len: 111 microversion: 2.1 time: 0.054475 Oct 12 08:56:35.592136 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1632/3056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:35 2022] GET /compute/v2.1/servers/2476f1ed-455d-49fa-bcc9-fc2ebb6b3b16 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:35.601112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:35.601960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:35.611870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.612423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.612870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.613644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.614257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.614851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.793560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:56:35.794176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:56:35.794472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:56:35.795409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:56:35.795836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:56:35.807002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.807492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.807935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.808687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.809129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.809606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.828745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Getting quotas for project 288568b4164c4ab3824fcd2e946d2f31. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:35.831414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:35.837386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Getting quotas for user b349f4b4b75445eba0205b73a6e6995d and project 288568b4164c4ab3824fcd2e946d2f31. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:35.886884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:35.895567 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f8340a8-e99c-4773-997f-319270401c87 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1523 microversion: 2.1 time: 0.303771 Oct 12 08:56:35.896401 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1633/3057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:35 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:35.907316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:35.908372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:35.926541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.927871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.928880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.930803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:35.933979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:35.934482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:35.962894 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f HTTP/1.1 Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f'} Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:35.966174 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:35.971061 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:35.972724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:35.974235 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-20d0d3d7-a789-453d-a852-b49bdceda626 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 404 len: 111 microversion: 2.1 time: 0.076733 Oct 12 08:56:35.975425 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1634/3058] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:35 2022] DELETE /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:35.983294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1796263856", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "2f204459-03a5-4e90-a59a-2dbecd872d0d"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:36.057968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:56:36.060800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fee13702-5742-4121-811f-39428e8170b3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3de7bdba-e28c-4906-b0b2-305ef6cad8a6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41c8493f-b539-4317-b6a4-27eac7dff9fb',volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:56:36.072055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] validate_networks() for [('2f204459-03a5-4e90-a59a-2dbecd872d0d', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:56:36.475258 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-808f35e3-c3a3-485a-b269-01dc5d6487b7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.975217 Oct 12 08:56:36.477996 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1425/3059] 10.222.0.40 () {62 vars in 1189 bytes} [Wed Oct 12 08:56:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 4979 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 12 08:56:36.486489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1e669762-e60b-4fb6-b88e-d1019ec3e778 req-06d161de-c054-4734-9bc9-3078ee6df534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a27f9c-6b14-46e1-ac07-f7396ddd3a30", "name": "network-vif-plugged", "status": "completed", "tag": "e8479700-da16-4693-98d3-d3276027826c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:36.498172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1e669762-e60b-4fb6-b88e-d1019ec3e778 req-06d161de-c054-4734-9bc9-3078ee6df534 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.498653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1e669762-e60b-4fb6-b88e-d1019ec3e778 req-06d161de-c054-4734-9bc9-3078ee6df534 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.499451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1e669762-e60b-4fb6-b88e-d1019ec3e778 req-06d161de-c054-4734-9bc9-3078ee6df534 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.531419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1e669762-e60b-4fb6-b88e-d1019ec3e778 req-06d161de-c054-4734-9bc9-3078ee6df534 service nova] Creating event network-vif-plugged:e8479700-da16-4693-98d3-d3276027826c for instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 on n-h2-858383-10 Oct 12 08:56:36.537540 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1e669762-e60b-4fb6-b88e-d1019ec3e778 req-06d161de-c054-4734-9bc9-3078ee6df534 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058113 Oct 12 08:56:36.538988 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1426/3060] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:36.545806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:56:36.546576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:36.547134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:56:36.547473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:36.548012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:56:36.549343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:56:36.550370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:56:36.555031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.555589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.556159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.556864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.557316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.557765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.580418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.581743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.582403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.582591 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:36.583505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.584204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.586281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f HTTP/1.1 Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f'} Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:36.586552 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:36.590578 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:36.590578 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:36.590578 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:36.590578 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:36.590578 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. Oct 12 08:56:36.590578 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:36.590578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:36.592034 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-005e083e-2e57-43dc-a43b-72a2e0bc5da6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f" status: 404 len: 111 microversion: 2.1 time: 0.050973 Oct 12 08:56:36.592903 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1427/3061] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:36 2022] GET /compute/v2.1/servers/a4b9edd9-57db-4dcd-ab0e-ad3bd405d41f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:36.604215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-80325137-085d-40d1-9bad-cc290b741977 req-ff465472-00de-437a-a325-b9e3a69ecef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd619e37-8302-44d0-834b-ab2fec514440", "tag": "ea1c025a-5f90-4cdd-87a2-602f5c216e8c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:36.621677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-80325137-085d-40d1-9bad-cc290b741977 req-ff465472-00de-437a-a325-b9e3a69ecef6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.622170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-80325137-085d-40d1-9bad-cc290b741977 req-ff465472-00de-437a-a325-b9e3a69ecef6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.622605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-80325137-085d-40d1-9bad-cc290b741977 req-ff465472-00de-437a-a325-b9e3a69ecef6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.643273 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-80325137-085d-40d1-9bad-cc290b741977 req-ff465472-00de-437a-a325-b9e3a69ecef6 service nova] Creating event network-changed:ea1c025a-5f90-4cdd-87a2-602f5c216e8c for instance bd619e37-8302-44d0-834b-ab2fec514440 on n-h2-858383-10 Oct 12 08:56:36.644243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:36.650198 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-80325137-085d-40d1-9bad-cc290b741977 req-ff465472-00de-437a-a325-b9e3a69ecef6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055867 Oct 12 08:56:36.650804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1428/3062] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:36.653108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for user 3571292391094d83901f21ccb18ec2d8 and project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:36.667260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:36.668348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:36.680877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.681372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.681844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.682555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.683003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.683686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.687628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:56:36.690367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:56:36.758797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3cc6c439-a68b-4b51-9ad5-863ee25dd927 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781783 Oct 12 08:56:36.759562 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1635/3063] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:56:36.764571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5ad6b1cb-9d57-4460-bef8-46e53709ec39 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:36.765581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5ad6b1cb-9d57-4460-bef8-46e53709ec39 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:36.832051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5ad6b1cb-9d57-4460-bef8-46e53709ec39 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:36.842171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5ad6b1cb-9d57-4460-bef8-46e53709ec39 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:36.844203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5ad6b1cb-9d57-4460-bef8-46e53709ec39 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:36.845625 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5ad6b1cb-9d57-4460-bef8-46e53709ec39 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1284 microversion: 2.42 time: 0.084846 Oct 12 08:56:36.846430 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1636/3064] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:36 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:36.851869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:36.852564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:36.861332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.861944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.862432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:36.863201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:36.863784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:36.864262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.117184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:37.130083 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3848b80-82a7-4a39-9cba-4273aa9385a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.282080 Oct 12 08:56:37.131505 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1637/3065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:36 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:37.136922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.137752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.145267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.146160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.146799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.147936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.148659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.149382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.169902 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 HTTP/1.1 Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'b2764c38-ba1d-40b4-aa9f-b381bd049f04'} Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:37.172222 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.176066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.179714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:37.181109 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-858668ea-4191-42c6-af3e-fe7c8b6742ff tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 404 len: 111 microversion: 2.1 time: 0.048359 Oct 12 08:56:37.182234 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1638/3066] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:37 2022] DELETE /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:37.188755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55958656-9e4c-44c5-9ac4-0bd279b9624e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.190147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-55958656-9e4c-44c5-9ac4-0bd279b9624e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.256039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-55958656-9e4c-44c5-9ac4-0bd279b9624e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:37.264815 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55958656-9e4c-44c5-9ac4-0bd279b9624e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1215 microversion: 2.1 time: 0.081200 Oct 12 08:56:37.265758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1639/3067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:37 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:37.272531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.275920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.285981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.286847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.287492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.288967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.289671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.290339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.457255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:37.466497 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-547c69f2-a7bc-419e-9e9b-d05cb243ae97 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1403 microversion: 2.1 time: 0.810312 Oct 12 08:56:37.467080 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1429/3068] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:36 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1403 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:37.487210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:37.495440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.496060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: b2764c38-ba1d-40b4-aa9f-b381bd049f04] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.497275 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aff2b7d9-1723-43e5-a35b-8928bd9bc640 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1523 microversion: 2.1 time: 0.230157 Oct 12 08:56:37.498240 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1640/3069] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:37 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:37.518222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.519315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.523273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.524495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.526107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.527035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.550034 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 HTTP/1.1 Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'b2764c38-ba1d-40b4-aa9f-b381bd049f04'} Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.552839 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.559463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.559463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.559463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:37.559463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:37.559463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. Oct 12 08:56:37.559463 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.562792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance b2764c38-ba1d-40b4-aa9f-b381bd049f04 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:37.564411 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7ab40af8-caf0-4061-969e-e01ea435183e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04" status: 404 len: 111 microversion: 2.1 time: 0.077311 Oct 12 08:56:37.566253 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1430/3070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:37 2022] GET /compute/v2.1/servers/b2764c38-ba1d-40b4-aa9f-b381bd049f04 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:37.574815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.575316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.583315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.584015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.584671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.586097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.587022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.587664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.606680 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf HTTP/1.1 Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '757ee68a-1a1a-40dd-9516-be192f1863bf'} Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:37.609573 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.613509 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.617257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:37.618705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5a9cc819-5e65-4b6d-8b25-e451e88bded3 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 404 len: 111 microversion: 2.1 time: 0.047799 Oct 12 08:56:37.619888 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1641/3071] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:37 2022] DELETE /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:56:37.630957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.631712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 757ee68a-1a1a-40dd-9516-be192f1863bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.639445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.641266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.641734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.642731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.643256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.643690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.682816 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf HTTP/1.1 Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '757ee68a-1a1a-40dd-9516-be192f1863bf'} Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.686017 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.689876 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.689876 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.689876 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:37.689876 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:37.689876 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. Oct 12 08:56:37.689876 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.689876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 757ee68a-1a1a-40dd-9516-be192f1863bf could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:37.689876 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ca335bbc-5fa0-4146-aeae-7ea346205604 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf" status: 404 len: 111 microversion: 2.1 time: 0.063142 Oct 12 08:56:37.693921 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1431/3072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:37 2022] GET /compute/v2.1/servers/757ee68a-1a1a-40dd-9516-be192f1863bf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:37.706643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.707942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.720443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.721213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.721745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.722550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.723337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.723836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.757813 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a HTTP/1.1 Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '8c0075c4-c98b-4f57-8761-d05545c78f1a'} Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:37.760015 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:37.763994 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c0321c4-a466-42e5-bff9-b1bff888bdd6 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 404 len: 111 microversion: 2.1 time: 0.064475 Oct 12 08:56:37.764717 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1642/3073] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:37 2022] DELETE /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:37.774857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.775520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8c0075c4-c98b-4f57-8761-d05545c78f1a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.782207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.782947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.783591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.784514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.785141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.785639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.811670 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a HTTP/1.1 Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '8c0075c4-c98b-4f57-8761-d05545c78f1a'} Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.813860 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.821041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.821041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.821041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:37.821041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:37.821041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. Oct 12 08:56:37.821041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.824841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 8c0075c4-c98b-4f57-8761-d05545c78f1a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:37.826061 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-927120c3-b0c4-45b4-9acb-52cd7448f08d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a" status: 404 len: 111 microversion: 2.1 time: 0.057749 Oct 12 08:56:37.830391 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1432/3074] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:37 2022] GET /compute/v2.1/servers/8c0075c4-c98b-4f57-8761-d05545c78f1a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:37.835906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.836439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.843935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.844450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.845110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.846873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.847713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.848484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.879247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d34ec8e7-9c17-490b-81e1-2df8e3bae1d6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.880187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d34ec8e7-9c17-490b-81e1-2df8e3bae1d6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.884222 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a HTTP/1.1 Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'caf2a520-252a-4a78-bca0-1e719a4d1c4a'} Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:37.887075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:37.891280 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ba7d97d-75ed-4837-b56f-7b4618636f18 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 404 len: 111 microversion: 2.1 time: 0.056927 Oct 12 08:56:37.893499 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1643/3075] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:37 2022] DELETE /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:37.913563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.915017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: caf2a520-252a-4a78-bca0-1e719a4d1c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.924749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.925522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.926120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.926987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.927634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.928233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.963887 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a HTTP/1.1 Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'caf2a520-252a-4a78-bca0-1e719a4d1c4a'} Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.966145 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance caf2a520-252a-4a78-bca0-1e719a4d1c4a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd56134d-b35b-4317-9962-f293f1cb25d2 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a" status: 404 len: 111 microversion: 2.1 time: 0.069968 Oct 12 08:56:37.973008 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1644/3076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:37 2022] GET /compute/v2.1/servers/caf2a520-252a-4a78-bca0-1e719a4d1c4a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:37.976702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:37.977472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 66594999-2298-414d-8cd7-bfa6b4fa00b8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:37.983936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.984556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.985096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:37.985861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:37.986537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:37.988561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.007001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8 HTTP/1.1 Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '66594999-2298-414d-8cd7-bfa6b4fa00b8'} Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:38.008903 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.012587 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.013471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d34ec8e7-9c17-490b-81e1-2df8e3bae1d6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.014910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:38.016049 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b8bcb69-de75-4624-8e76-10122074c66d tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8" status: 404 len: 111 microversion: 2.1 time: 0.043023 Oct 12 08:56:38.019728 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1645/3077] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:37 2022] DELETE /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:38.022859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d34ec8e7-9c17-490b-81e1-2df8e3bae1d6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.025030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d34ec8e7-9c17-490b-81e1-2df8e3bae1d6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.025310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:38.025987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 66594999-2298-414d-8cd7-bfa6b4fa00b8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:38.026397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d34ec8e7-9c17-490b-81e1-2df8e3bae1d6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1284 microversion: 2.42 time: 0.154293 Oct 12 08:56:38.027355 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1433/3078] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:37 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:38.033112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.033646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.034085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.034782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.035244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.035670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.057167 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8 HTTP/1.1 Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '66594999-2298-414d-8cd7-bfa6b4fa00b8'} Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.058964 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 66594999-2298-414d-8cd7-bfa6b4fa00b8 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-58b59e87-002a-4b35-b244-acc0417a8be8 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8" status: 404 len: 111 microversion: 2.1 time: 0.040584 Oct 12 08:56:38.065187 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1646/3079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:38 2022] GET /compute/v2.1/servers/66594999-2298-414d-8cd7-bfa6b4fa00b8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:56:38.070101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:38.070630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:38.077182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.077748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.078188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.079077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.079693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.080282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.116162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:56:38.159555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:38.160723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:38.171865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.172601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.173219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.175377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.176041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.176655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.228026 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fd281dda-127f-416c-9e98-003bc30574cb tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 204 len: 0 microversion: 2.1 time: 0.161646 Oct 12 08:56:38.230909 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1434/3080] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:38 2022] DELETE /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:38.239445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:38.240989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:38.247688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.248171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.248806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.249548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.250845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.251445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.301946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:38.402673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.411233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e44ffc1c-58df-477c-89f0-13e0b5a43c63 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.256114 Oct 12 08:56:38.412194 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1647/3081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:38 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:38.417153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:38.418208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:38.424704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.425381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.426007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.426983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.427678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.428643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.517891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.533707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c2fd554-6a31-401a-8fa6-9eaa5996ec1d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1275 microversion: 2.1 time: 0.120252 Oct 12 08:56:38.534808 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1648/3082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:38 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:38.540890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:38.541788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:38.550532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.552823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.553646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.555139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.555864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.556316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.558041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.558777 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5e1bc3a-800a-4b0f-9d7b-768f5f574c82 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1480 microversion: 2.1 time: 0.323735 Oct 12 08:56:38.559361 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1435/3083] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:38 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1480 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:38.565267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:38.566185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:38.572565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.573361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.574046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.575048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.575571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.576067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.761452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.772247 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7edc3c3d-79c6-4c6c-8d59-f08814721bc2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1403 microversion: 2.1 time: 0.236190 Oct 12 08:56:38.786342 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1649/3084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:38 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1403 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:38.792719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.800787 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c728f96-c773-4c12-8b4d-330065853e42 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1508 microversion: 2.1 time: 0.239681 Oct 12 08:56:38.805474 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1436/3085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:38 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:38.825062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:38.826265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:38.833152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.833739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.834326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.835070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:38.835589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:38.836032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:38.979889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:38.982425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:38.989276 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c6b877df-e407-4c58-acfc-d4202474e4f1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 200 len: 1508 microversion: 2.1 time: 0.168775 Oct 12 08:56:38.989883 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1650/3086] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:38 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:39.011210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:39.011982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:39.019657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.020169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.020604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.021657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.022095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.022569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.048515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:56:39.052030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:39.052643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:39.059482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.059973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.060405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.061111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.061587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.062011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.132271 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94678032-4d81-430d-9142-4641295654c8 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "DELETE /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 204 len: 0 microversion: 2.1 time: 0.124589 Oct 12 08:56:39.133734 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1437/3087] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:56:39 2022] DELETE /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:56:39.182803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:39.192173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:39.193774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:39.194954 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0306820c-cbe5-41ab-904b-ff346fda4e5b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1518 microversion: 2.42 time: 0.147613 Oct 12 08:56:39.195515 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1651/3088] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:39 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:39.243424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1153969393", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "0a41b357-9e1a-4739-bdde-df451b1badd5"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:39.297350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] validate_networks() for [('0a41b357-9e1a-4739-bdde-df451b1badd5', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:56:39.435853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:39.436409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:39.442857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.443635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.444268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.445279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.445830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.446495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.601818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:39.610543 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dafe9bf9-da2c-4004-bddb-25e1ce7126ed tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.178568 Oct 12 08:56:39.626376 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1652/3089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:39 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:39.634593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3ae644be-ebf9-4b90-a9f6-e9a79f7dfc3c req-f214ac7f-d285-48fa-ab23-1b6493178db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd619e37-8302-44d0-834b-ab2fec514440", "name": "network-vif-plugged", "status": "completed", "tag": "ea1c025a-5f90-4cdd-87a2-602f5c216e8c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:39.640883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:39.649885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ae644be-ebf9-4b90-a9f6-e9a79f7dfc3c req-f214ac7f-d285-48fa-ab23-1b6493178db4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.650720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ae644be-ebf9-4b90-a9f6-e9a79f7dfc3c req-f214ac7f-d285-48fa-ab23-1b6493178db4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.651445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ae644be-ebf9-4b90-a9f6-e9a79f7dfc3c req-f214ac7f-d285-48fa-ab23-1b6493178db4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.667703 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3ae644be-ebf9-4b90-a9f6-e9a79f7dfc3c req-f214ac7f-d285-48fa-ab23-1b6493178db4 service nova] Creating event network-vif-plugged:ea1c025a-5f90-4cdd-87a2-602f5c216e8c for instance bd619e37-8302-44d0-834b-ab2fec514440 on n-h2-858383-10 Oct 12 08:56:39.675558 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3ae644be-ebf9-4b90-a9f6-e9a79f7dfc3c req-f214ac7f-d285-48fa-ab23-1b6493178db4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047417 Oct 12 08:56:39.676890 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1653/3090] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:39.684091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:39.685182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:39.693535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.694877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.695475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.696186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.696640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.697335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.768069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:39.777687 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88b8c7b9-d876-4856-afef-51945a14e460 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1285 microversion: 2.1 time: 0.098831 Oct 12 08:56:39.778359 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1654/3091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:39 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:39.786038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:39.786819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:39.793529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.794303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.795045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.796047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.796682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.797288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.884634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:56:39.885186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:56:39.885565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:56:39.885982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:56:39.886392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:56:39.914105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.915901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.917476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.920722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:39.921195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:39.921958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:39.944213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Getting quotas for project 70848fd10ea847968908b8ba3f30b907. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:56:39.949969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Getting quotas for user 90150a5342474fd0ad10fc853b2c5d96 and project 70848fd10ea847968908b8ba3f30b907. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:56:39.966513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:56:39.969998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:56:40.040429 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b601209a-5140-458c-9475-53bbb98f06c9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801176 Oct 12 08:56:40.041970 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1438/3092] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:56:40.047571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:40.048651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:40.053655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:40.062539 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89cf64a2-7c11-4a4b-8fa0-499c90c19a45 tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1480 microversion: 2.1 time: 0.282972 Oct 12 08:56:40.067967 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1655/3093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:39 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1480 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:40.074283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.078222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9430ebef-6ff1-45f1-bd79-95844dabaece tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:40.079000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.079656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.080613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.081277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.083736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.084001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9430ebef-6ff1-45f1-bd79-95844dabaece tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:40.201703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9430ebef-6ff1-45f1-bd79-95844dabaece tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:40.221213 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9430ebef-6ff1-45f1-bd79-95844dabaece tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1218 microversion: 2.1 time: 0.150249 Oct 12 08:56:40.223667 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1656/3094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:40 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:40.229480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:40.230455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:40.239963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.240697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.241365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.242400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.243191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.243953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.367905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:40.388608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:40.390145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:40.392271 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-72b18ac6-7f61-48c8-8619-1deaf9e8ff9f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1574 microversion: 2.42 time: 0.166326 Oct 12 08:56:40.392688 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1657/3095] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:40 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:40.408607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:40.424842 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-305f8e0b-cdcb-40ab-9f28-79be20ca22e9 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1403 microversion: 2.1 time: 0.380219 Oct 12 08:56:40.427283 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1439/3096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:40 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1403 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:40.651375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e65c0bbb-dfdf-42b0-8906-3806d3d041fe req-51a2c774-c428-4010-ada0-596b8aa90f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2b899b-d791-4d6e-b96d-bb4abd3f6959", "name": "network-vif-deleted", "tag": "edb66832-c169-4cc5-ba21-6fa1b454376c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:40.652458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:40.654876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:40.672903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.675036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.676485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.680113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e65c0bbb-dfdf-42b0-8906-3806d3d041fe req-51a2c774-c428-4010-ada0-596b8aa90f20 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.683964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.683964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.683964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.684314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e65c0bbb-dfdf-42b0-8906-3806d3d041fe req-51a2c774-c428-4010-ada0-596b8aa90f20 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.685409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e65c0bbb-dfdf-42b0-8906-3806d3d041fe req-51a2c774-c428-4010-ada0-596b8aa90f20 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.706690 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e65c0bbb-dfdf-42b0-8906-3806d3d041fe req-51a2c774-c428-4010-ada0-596b8aa90f20 service nova] Creating event network-vif-deleted:edb66832-c169-4cc5-ba21-6fa1b454376c for instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 on n-h1-858383-10 Oct 12 08:56:40.713872 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e65c0bbb-dfdf-42b0-8906-3806d3d041fe req-51a2c774-c428-4010-ada0-596b8aa90f20 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074969 Oct 12 08:56:40.727124 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1440/3097] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:40.805231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:40.806270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:40.813593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.814347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.814991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.815898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:40.816541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:40.817154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:40.979829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:40.991522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cba96853-997b-4385-a9ca-5889113807c9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.355736 Oct 12 08:56:40.998966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1658/3098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:40 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:41.092392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:41.093645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:41.104841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.106861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.107967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.109491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.110221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.110857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.174477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.174477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.174477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.174477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lazy-loading 'fault' on Instance uuid 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:56:41.249586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e15f6bf271141d59471f6f77bb2be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c561613c0cf4dbbbc6b7f3ff6a2d00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:41.270790 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a824885e-e0d1-4489-aa49-263e39de564e tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 200 len: 1283 microversion: 2.1 time: 0.182741 Oct 12 08:56:41.272063 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1659/3099] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:41 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 1283 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:41.277872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:41.279017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:41.285796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.286918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.287549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.288559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.289565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.290148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.384225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:41.395299 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a656d4bf-8f9b-4e54-af02-be26687dcd17 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1214 microversion: 2.1 time: 0.121606 Oct 12 08:56:41.408505 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1660/3100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:41 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:41.418054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:41.418914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:41.425139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.425875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.426494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.427371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.427972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.428919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.442655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:41.453264 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c925b9cb-176b-4517-85d9-24d9b47cff18 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1273 microversion: 2.1 time: 0.652559 Oct 12 08:56:41.486888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1441/3101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:40 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1273 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:41.497102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:41.499217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:41.512633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:41.517193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.517995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.518693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.521787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:41.522624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:41.523811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:41.524395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:41.526058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:41.536569 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6be0b013-07ca-4800-999d-86ebe298e972 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1592 microversion: 2.42 time: 0.113342 Oct 12 08:56:41.550986 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1661/3102] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:41 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1592 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:56:42.024050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:42.024786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:42.039592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:42.040878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:42.050280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:42.051134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:42.051618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:42.052057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:42.324359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:42.333839 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-41bda726-4800-4b0c-bcc4-9a4d82a06bf0 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1403 microversion: 2.1 time: 0.845175 Oct 12 08:56:42.338661 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1442/3103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:41 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1403 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:42.355672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:42.356554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] [instance: 8b2b899b-d791-4d6e-b96d-bb4abd3f6959] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:42.366080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:42.367647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:42.371632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:42.372581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:42.373246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:42.373947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:42.402216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:42.407230 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] HTTP exception thrown: Instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 could not be found. Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Request method failure captured: Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 HTTP/1.1 Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoA8kdAtD-j8lmsTW4WYQuaReF6PZUYGlLnOpSbYplfSVMA4NsaWZCh1uYwTAKaebhUjTBEcX88m1fZkTBEaJYSUhfmyGU0CAQGmJaXKGc_D4nXBSJDecgkx4Qd_WOhCbGVWauUxKH6WYw31Eo42WUKJiMHqWXP-vaqXLOf7b1iB4-s Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c561613c0cf4dbbbc6b7f3ff6a2d00e"}]}] Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestJSON-328280659 Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 8c561613c0cf4dbbbc6b7f3ff6a2d00e Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestJSON-328280659 Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestJSON-328280659-project Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3e15f6bf271141d59471f6f77bb2be45 Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestJSON-328280659-project Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 could not be found. Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '8b2b899b-d791-4d6e-b96d-bb4abd3f6959'} Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 could not be found. Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 could not be found. Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:42.408952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:42.415326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:42.415326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:42.415326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:42.415326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:42.415326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 could not be found. Oct 12 08:56:42.415326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:56:42.415877 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0eb6df95-055a-4122-9ba8-acb733674d62 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.391562 Oct 12 08:56:42.415877 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1662/3104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:42 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:42.417857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] Returning 404 to user: Instance 8b2b899b-d791-4d6e-b96d-bb4abd3f6959 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:42.420422 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07e691b2-d4f1-4309-8fdf-8e03e1987c4a tempest-ServersTestJSON-328280659 tempest-ServersTestJSON-328280659-project] 10.222.0.40 "GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959" status: 404 len: 111 microversion: 2.1 time: 0.080579 Oct 12 08:56:42.422497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:42.427223 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1443/3105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:42 2022] GET /compute/v2.1/servers/8b2b899b-d791-4d6e-b96d-bb4abd3f6959 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:42.443418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:42.462007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:42.462531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:42.462976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:42.464043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:42.464652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:42.465243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:42.483326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:42.484580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:42.493215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:42.498629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:42.499361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:42.500127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:42.500594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:42.501027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:42.968567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:42.983111 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-722bd0b5-c0f3-452d-b4ca-702f93f3c743 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1315 microversion: 2.1 time: 0.503461 Oct 12 08:56:42.984378 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1444/3106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:42 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:42.990050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:42.991045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:43.005095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:43.006362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:43.006995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:43.010464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:43.011273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:43.013744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:43.035347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:43.051823 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-82d78cc4-8fc4-423c-98d2-89c6b544aa7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1270 microversion: 2.1 time: 0.635755 Oct 12 08:56:43.057751 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1663/3107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:42 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1270 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:43.364594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:43.365361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:43.381985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:43.384657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:43.392412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:43.393416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:43.395123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:43.395729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:43.510727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:43.527845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:43.533973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:43.538602 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f11a58bb-308f-4f27-8ca8-3c77bb7c7cf7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1592 microversion: 2.42 time: 0.552858 Oct 12 08:56:43.539726 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1445/3108] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:42 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1592 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:43.558186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:43.559277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:43.571996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:43.572869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:43.574817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:43.576603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:43.585058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:43.587282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:43.943592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:43.983135 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c5ddd4f-2e80-493a-a5ab-b866604de578 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1589 microversion: 2.1 time: 0.622734 Oct 12 08:56:44.001483 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1664/3109] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:43 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1589 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:44.007863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b112d487-aaa5-479c-b110-0442cffbcc46 req-f791f17e-9864-49b9-8ead-a079ff0de06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a27f9c-6b14-46e1-ac07-f7396ddd3a30", "name": "network-vif-deleted", "tag": "e8479700-da16-4693-98d3-d3276027826c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:44.018136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b112d487-aaa5-479c-b110-0442cffbcc46 req-f791f17e-9864-49b9-8ead-a079ff0de06d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.018901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b112d487-aaa5-479c-b110-0442cffbcc46 req-f791f17e-9864-49b9-8ead-a079ff0de06d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.019498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b112d487-aaa5-479c-b110-0442cffbcc46 req-f791f17e-9864-49b9-8ead-a079ff0de06d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:44.033392 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b112d487-aaa5-479c-b110-0442cffbcc46 req-f791f17e-9864-49b9-8ead-a079ff0de06d service nova] Creating event network-vif-deleted:e8479700-da16-4693-98d3-d3276027826c for instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 on n-h2-858383-10 Oct 12 08:56:44.040082 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b112d487-aaa5-479c-b110-0442cffbcc46 req-f791f17e-9864-49b9-8ead-a079ff0de06d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035966 Oct 12 08:56:44.041843 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1665/3110] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:44.047728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:44.048625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:44.056424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.057297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.058085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:44.059122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.059742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.060394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:44.265047 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6554d54a-283d-4ea9-8df6-21949eb54730 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221762 Oct 12 08:56:44.265688 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1666/3111] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 08:56:44 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:44.270712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:44.271512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:44.285005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.288413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.288917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:44.293484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.294019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.294473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:44.466757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:44.476208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a23a5c3e-dbe9-4000-81e5-d1e0b9afbbb4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.935056 Oct 12 08:56:44.477465 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1446/3112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:43 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:44.499023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:44.500995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:44.507849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.509148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.510046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:44.511011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.512153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.512807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:44.773040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:44.778687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:44.782515 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67ddb062-8e39-4f4c-883a-f9e9bd6027b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1315 microversion: 2.1 time: 0.515767 Oct 12 08:56:44.786943 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a589b4a-8208-4af4-a91b-796219b6cac5 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1276 microversion: 2.1 time: 0.297320 Oct 12 08:56:44.790116 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1447/3113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:44 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1276 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:44.801885 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1667/3114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:44 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:44.818296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:44.820088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:44.836020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.836530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.839160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:44.839942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:44.840411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:44.840843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:45.499994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:45.500743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:45.514698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:45.517055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:45.517642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:45.518488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:45.523042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:45.523690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:45.816919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:45.840317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:45.842664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:45.849016 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db9cc851-c857-409f-9f9f-8b16783405a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.352919 Oct 12 08:56:45.865654 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1668/3115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:45 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:45.867230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:45.867776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:45.872184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:45.873586 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db058f9d-4536-4baf-8e1d-e10f83e933f3 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1659 microversion: 2.42 time: 1.082159 Oct 12 08:56:45.874165 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1448/3116] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:44 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1659 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:45.874365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:45.878147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:45.879201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:45.879819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:45.880043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:45.882433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:45.883638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:45.885373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:45.886253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:45.886982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:45.887419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:45.888118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:45.888747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:45.889170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:46.101174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:46.110404 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83fb913a-9dd6-4c58-8018-1358d68cf001 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1276 microversion: 2.1 time: 0.235177 Oct 12 08:56:46.111011 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1449/3117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:45 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:46.277167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:46.279579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:46.290907 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c8161d56-bab5-450e-bb29-6b80c9204407 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1315 microversion: 2.1 time: 0.427643 Oct 12 08:56:46.305471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1669/3118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:45 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:46.629332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-61ded623-57b3-4182-bd17-70a82c5ac76e req-5adb647a-af48-40d8-a94d-448a0a92e660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe06cee8-a199-43e0-b707-d7177639bcd6", "tag": "3091c101-3979-4de3-b96a-2ee038190880"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:46.666110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-61ded623-57b3-4182-bd17-70a82c5ac76e req-5adb647a-af48-40d8-a94d-448a0a92e660 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:46.666610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-61ded623-57b3-4182-bd17-70a82c5ac76e req-5adb647a-af48-40d8-a94d-448a0a92e660 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:46.667047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-61ded623-57b3-4182-bd17-70a82c5ac76e req-5adb647a-af48-40d8-a94d-448a0a92e660 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:46.703265 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-61ded623-57b3-4182-bd17-70a82c5ac76e req-5adb647a-af48-40d8-a94d-448a0a92e660 service nova] Creating event network-changed:3091c101-3979-4de3-b96a-2ee038190880 for instance fe06cee8-a199-43e0-b707-d7177639bcd6 on n-h1-858383-10 Oct 12 08:56:46.718632 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-61ded623-57b3-4182-bd17-70a82c5ac76e req-5adb647a-af48-40d8-a94d-448a0a92e660 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093140 Oct 12 08:56:46.719252 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1450/3119] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:46.872245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:46.873139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:46.880869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:46.883233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:46.883977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:46.884752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:46.886425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:46.887051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:46.887636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:46.904303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:46.905690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:46.926258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:46.933128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:46.934124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:46.935023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:46.935631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:46.936210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:47.388293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:47.398145 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0fbc334-5814-48df-864d-9d21ab8dd3b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1657 microversion: 2.1 time: 0.529641 Oct 12 08:56:47.406998 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1670/3120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:46 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1657 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:47.424315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:47.425697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:47.453665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:47.457001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:47.457777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:47.462244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:47.464025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:47.466027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:47.550957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:47.573213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:47.574996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:47.576459 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ea815e11-4245-4559-b302-aca671654f21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1659 microversion: 2.42 time: 0.676702 Oct 12 08:56:47.577256 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1451/3121] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:46 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1659 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:56:47.606423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:47.607412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:47.622016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:47.622814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:47.623459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:47.624391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:47.625096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:47.628655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:47.811908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:47.824162 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ebc690fc-a868-4dbe-a188-d51ed3a93ac9 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 0.413917 Oct 12 08:56:47.841534 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1671/3122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:47 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:47.841534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5f66e08-ebff-4d8a-a398-bde680d31252 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:47.852453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5f66e08-ebff-4d8a-a398-bde680d31252 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:47.852968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5f66e08-ebff-4d8a-a398-bde680d31252 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:47.854942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5f66e08-ebff-4d8a-a398-bde680d31252 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:47.907806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5f66e08-ebff-4d8a-a398-bde680d31252 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Going to try to start instance {{(pid=127006) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 08:56:48.019274 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5f66e08-ebff-4d8a-a398-bde680d31252 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.186391 Oct 12 08:56:48.024683 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1672/3123] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:47 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:48.046714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:48.050367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:48.069275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:48.077039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:48.077917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:48.078705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:48.079189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:48.079627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:49.352011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:49.368120 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78b278db-6db0-463b-9880-80c7f3282868 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1666 microversion: 2.1 time: 1.335701 Oct 12 08:56:49.370040 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1673/3124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:48 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1666 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:49.384047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:49.389055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:49.413487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:49.416558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:49.417244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:49.423773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:49.424525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:49.425348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:49.522903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:49.533246 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6038598c-1b2e-4eca-be2c-71f5ce754aea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1315 microversion: 2.1 time: 1.941957 Oct 12 08:56:49.549530 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1452/3125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:47 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1315 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:49.549530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:49.549530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:49.566727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:49.574090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:49.574727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:49.575879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:49.576449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:49.576975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:49.659897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:49.935265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:49.957165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=14 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:50.210357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=26 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:50.356469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:50.372859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:50.379991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:50.381801 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d74008e2-a005-4a21-915a-2843aa7d48fb tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1705 microversion: 2.42 time: 1.010386 Oct 12 08:56:50.382520 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1674/3126] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:49 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1705 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:50.395286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:50.396071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:50.414307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:50.415104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:50.415795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:50.423200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:50.423852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:50.424431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:50.805734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:50.820065 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cdff9fdb-25b2-4771-9225-ae6f79b9013a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 1.279546 Oct 12 08:56:50.857421 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1453/3127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:49 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:50.875969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:50.876599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:50.912345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:50.912981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:50.913830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:50.916481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:50.918014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:50.919623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:50.982475 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3284494-5b2b-4a96-ac8f-7f8dcb71e4ca tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1813 microversion: 2.1 time: 0.591949 Oct 12 08:56:50.984299 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1675/3128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:50 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1813 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:50.992550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:50.995119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:51.030806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:51.031897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:51.036912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:51.038131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:51.039749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:51.041198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:51.557689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:51.570460 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-850e63c0-dfb6-45d3-8a6d-ca312b8ed5f5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1315 microversion: 2.1 time: 0.584752 Oct 12 08:56:51.571067 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1676/3129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:50 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:51.578939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f2a734d-190a-4d09-bcd1-63010d1919cb tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:51.582893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f2a734d-190a-4d09-bcd1-63010d1919cb tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:51.594028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f2a734d-190a-4d09-bcd1-63010d1919cb tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:51.594505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f2a734d-190a-4d09-bcd1-63010d1919cb tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:51.597302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f2a734d-190a-4d09-bcd1-63010d1919cb tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:51.602998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f2a734d-190a-4d09-bcd1-63010d1919cb tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:51.603598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f2a734d-190a-4d09-bcd1-63010d1919cb tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:51.672993 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f2a734d-190a-4d09-bcd1-63010d1919cb tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.100550 Oct 12 08:56:51.679801 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1677/3130] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 08:56:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:51.692579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:51.697603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:51.710575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:51.714968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:51.718049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:51.719053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:51.720117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:51.722851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:52.432197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:52.441882 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf224a21-aff9-41e8-9ed4-19404808169b tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1589 microversion: 2.1 time: 0.760673 Oct 12 08:56:52.457471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1678/3131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:51 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1589 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:52.467916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f19f3beb-7225-47d0-b84a-43d77cf5bfa8 req-8d98d81a-c844-4f2b-9884-9a1d05d8c38c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd619e37-8302-44d0-834b-ab2fec514440", "tag": "ea1c025a-5f90-4cdd-87a2-602f5c216e8c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:52.486926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f19f3beb-7225-47d0-b84a-43d77cf5bfa8 req-8d98d81a-c844-4f2b-9884-9a1d05d8c38c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:52.487408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f19f3beb-7225-47d0-b84a-43d77cf5bfa8 req-8d98d81a-c844-4f2b-9884-9a1d05d8c38c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:52.491650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f19f3beb-7225-47d0-b84a-43d77cf5bfa8 req-8d98d81a-c844-4f2b-9884-9a1d05d8c38c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:52.520134 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f19f3beb-7225-47d0-b84a-43d77cf5bfa8 req-8d98d81a-c844-4f2b-9884-9a1d05d8c38c service nova] Creating event network-changed:ea1c025a-5f90-4cdd-87a2-602f5c216e8c for instance bd619e37-8302-44d0-834b-ab2fec514440 on n-h2-858383-10 Oct 12 08:56:52.526068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f19f3beb-7225-47d0-b84a-43d77cf5bfa8 req-8d98d81a-c844-4f2b-9884-9a1d05d8c38c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077402 Oct 12 08:56:52.526687 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1679/3132] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:52.533034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:52.534374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:52.541370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:52.542176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:52.542781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:52.544064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:52.545291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:52.546292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:52.864053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:52.876364 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a87ced44-8ce4-45ad-aed8-6737b629728e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1666 microversion: 2.1 time: 2.014873 Oct 12 08:56:52.880428 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1454/3133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:50 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1666 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:52.893117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:52.894394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:52.896243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:52.911220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:52.912028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:52.913735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:52.914975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:52.915415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:52.916447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:52.922773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:52.925822 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ab67b834-bf47-4039-9470-687d8aa00f37 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1705 microversion: 2.42 time: 0.398005 Oct 12 08:56:52.930211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:52.950549 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1680/3134] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:52 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1705 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:52.958438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:52.959473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:52.966810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:52.967544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:52.968170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:52.969717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:52.970514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:52.971722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:54.055258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:54.069609 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b7a7b5f-a6fe-462f-bf07-98babb9d79a9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1315 microversion: 2.1 time: 1.116089 Oct 12 08:56:54.079929 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1681/3135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:52 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1315 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:54.085270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:54.090465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:54.110668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:54.111566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:54.112214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:54.113143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:54.113839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:54.120072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:54.404762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:54.414435 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a8727a3c-d9c3-4dfa-be9d-82bb3534d6d3 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 1.532553 Oct 12 08:56:54.421063 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1455/3136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:52 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:54.426114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:54.429619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:54.441303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:54.444791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:54.445607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:54.447351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:54.448960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:54.449706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:54.785352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:54.810933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:54.813317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:54.819276 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d2b6543-2743-4432-aa7c-a537d5447641 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1751 microversion: 2.42 time: 0.395089 Oct 12 08:56:54.820056 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1456/3137] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:54 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1751 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:54.836048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "030ac370-5a58-4d71-bbf1-6423d42f2cf8", "device": "/dev/xvdb"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:54.839630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:54.852197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:54.856116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:54.859308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:54.871434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:54.872198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:54.872671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:54.877450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:54.924458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:54.944808 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b3f953a8-49c5-4017-aef5-f8dcb47095a0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1666 microversion: 2.1 time: 0.862995 Oct 12 08:56:54.947127 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1682/3138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:54 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1666 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:54.954903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0ba3ad68-8710-4723-b04a-80b140e68ab3 req-35c995ec-c7f8-4854-b16b-3caacbfce9ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071bc32d-5fae-47c9-a6e9-66d65dd0053b", "tag": "c4162fd1-20d6-4662-83a9-5e83561a5728"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:54.969689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0ba3ad68-8710-4723-b04a-80b140e68ab3 req-35c995ec-c7f8-4854-b16b-3caacbfce9ab service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:54.971028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0ba3ad68-8710-4723-b04a-80b140e68ab3 req-35c995ec-c7f8-4854-b16b-3caacbfce9ab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:54.971906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0ba3ad68-8710-4723-b04a-80b140e68ab3 req-35c995ec-c7f8-4854-b16b-3caacbfce9ab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:54.990730 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0ba3ad68-8710-4723-b04a-80b140e68ab3 req-35c995ec-c7f8-4854-b16b-3caacbfce9ab service nova] Creating event network-changed:c4162fd1-20d6-4662-83a9-5e83561a5728 for instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b on n-h2-858383-10 Oct 12 08:56:54.999141 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0ba3ad68-8710-4723-b04a-80b140e68ab3 req-35c995ec-c7f8-4854-b16b-3caacbfce9ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050102 Oct 12 08:56:54.999932 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1683/3139] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:55.117926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:55.124104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:55.162769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:55.163310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:55.163890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:55.164503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:55.164950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:55.165384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:55.320425 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d92f93cd-9466-4d14-affa-7d07e21a86d1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "POST /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497978 Oct 12 08:56:55.323195 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1457/3140] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 08:56:54 2022] POST /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 194 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:55.445252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:55.446771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:55.460157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:55.460921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:55.462223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:55.464874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:55.467311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:55.469253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:55.580791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:55.589388 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-22b256bb-06b8-4304-9d49-4f3f5e301d92 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1315 microversion: 2.1 time: 0.488597 Oct 12 08:56:55.608122 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1684/3141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:55 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:55.895025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-501d5754-f58e-4f4f-ac0a-f8d48fee59db tempest-FloatingIPDetailsNegativeTestJSON-52228868 tempest-FloatingIPDetailsNegativeTestJSON-52228868-project] Calling method '.version_select at 0x7f9848c97c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:55.959311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-501d5754-f58e-4f4f-ac0a-f8d48fee59db tempest-FloatingIPDetailsNegativeTestJSON-52228868 tempest-FloatingIPDetailsNegativeTestJSON-52228868-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 could not be found", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 08:56:55.960872 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-501d5754-f58e-4f4f-ac0a-f8d48fee59db tempest-FloatingIPDetailsNegativeTestJSON-52228868 tempest-FloatingIPDetailsNegativeTestJSON-52228868-project] HTTP exception thrown: Floating IP not found for ID 689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-501d5754-f58e-4f4f-ac0a-f8d48fee59db tempest-FloatingIPDetailsNegativeTestJSON-52228868 tempest-FloatingIPDetailsNegativeTestJSON-52228868-project] Request method failure captured: Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-floating-ips/689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 HTTP/1.1 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFXpUNBSM1gkh_o3arGBgnLVi4shYiEsDFJjCYkHwvuFwj1mOeXUkytpaUM6v1gxBAUEVO9Z9THORLWiGlehblKOA8TyEztLYaT8KtMOITnsB8xh8K_3hocaLcXp8OPwKS0EOyk1xscjHRYuRPM3dJ0WPEZZfVjV-cWm5pPLYEHKxw Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: cb905a300b5240a38b1ef511608dc204 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-52228868 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb905a300b5240a38b1ef511608dc204"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cb905a300b5240a38b1ef511608dc204"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cb905a300b5240a38b1ef511608dc204"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cb905a300b5240a38b1ef511608dc204"}]}] Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-52228868 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: cb905a300b5240a38b1ef511608dc204 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-52228868 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-52228868-project Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 69206ca988944149aa67f95741dd12ff Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-52228868-project Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: exception: Floating IP not found for ID 689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4'} Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 could not be found Oct 12 08:56:55.964659 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c7d3296-9df9-4c9d-8b5f-ccc4fa20d3ab'] Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4. Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 Oct 12 08:56:55.969133 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:56:55.975816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-501d5754-f58e-4f4f-ac0a-f8d48fee59db tempest-FloatingIPDetailsNegativeTestJSON-52228868 tempest-FloatingIPDetailsNegativeTestJSON-52228868-project] Returning 404 to user: Floating IP not found for ID 689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:56:55.977081 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-501d5754-f58e-4f4f-ac0a-f8d48fee59db tempest-FloatingIPDetailsNegativeTestJSON-52228868 tempest-FloatingIPDetailsNegativeTestJSON-52228868-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4" status: 404 len: 111 microversion: 2.1 time: 0.363079 Oct 12 08:56:55.978339 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1685/3142] 10.222.0.40 () {58 vars in 1260 bytes} [Wed Oct 12 08:56:55 2022] GET /compute/v2.1/os-floating-ips/689e63d1-62a3-41b7-b0a2-cacbf6f2e0e4 => generated 111 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:56:55.990174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d06a4c20-eb84-45e0-aea1-66ffb60d0282 req-3ad3332d-f2c6-48c9-a223-6f2f0199d97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06cee8-a199-43e0-b707-d7177639bcd6", "name": "network-vif-plugged", "status": "completed", "tag": "3091c101-3979-4de3-b96a-2ee038190880"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:56.026772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d06a4c20-eb84-45e0-aea1-66ffb60d0282 req-3ad3332d-f2c6-48c9-a223-6f2f0199d97c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.029191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d06a4c20-eb84-45e0-aea1-66ffb60d0282 req-3ad3332d-f2c6-48c9-a223-6f2f0199d97c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.029873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d06a4c20-eb84-45e0-aea1-66ffb60d0282 req-3ad3332d-f2c6-48c9-a223-6f2f0199d97c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:56.058339 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d06a4c20-eb84-45e0-aea1-66ffb60d0282 req-3ad3332d-f2c6-48c9-a223-6f2f0199d97c service nova] Creating event network-vif-plugged:3091c101-3979-4de3-b96a-2ee038190880 for instance fe06cee8-a199-43e0-b707-d7177639bcd6 on n-h1-858383-10 Oct 12 08:56:56.072029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d06a4c20-eb84-45e0-aea1-66ffb60d0282 req-3ad3332d-f2c6-48c9-a223-6f2f0199d97c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092227 Oct 12 08:56:56.089597 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1686/3143] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:56:56.127362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:56.129531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:56.140610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:56.155361 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71386857-d5f3-44f6-b240-778a4705501c tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 0.715685 Oct 12 08:56:56.158672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.159114 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1458/3144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:55 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:56.162661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.173674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:56.185843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.188833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.193114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:56.199660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:56.203943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:56.218192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.225004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.225805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:56.227798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.229602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.230236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:56.655112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:56.668082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:56.672199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:56.673431 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c35503c2-5827-4381-8983-d62d96e55baa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1751 microversion: 2.42 time: 0.580592 Oct 12 08:56:56.674037 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1687/3145] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:56 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1751 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:56.704562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:56.705829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:56.748910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.755246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.756089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:56.759031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.761806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.765028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:56.776486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:56.789296 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee44663d-2245-44b7-98ce-95830bd8e3a9 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.626817 Oct 12 08:56:56.789945 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1459/3146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:56 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:56.816741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:56.818044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:56.829739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.833813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.835426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:56.836213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:56.836699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:56.874353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:57.088537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:57.101695 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8d8e17fa-2576-4df3-99cc-126cefc35c3c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1315 microversion: 2.1 time: 0.408001 Oct 12 08:56:57.112769 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1688/3147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:56 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:57.183147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:57.184508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:57.195943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:57.196743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:57.197403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:57.202420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:57.203173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:57.203851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:57.208857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:56:57.583865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:57.595987 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a06d9fa3-00ed-44e4-9286-27505f2f2924 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 0.416661 Oct 12 08:56:57.597775 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1689/3148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:57 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:57.644674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:57.661394 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8dc3762a-0ddb-4cb7-84be-8cc47d7aa828 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.849119 Oct 12 08:56:57.662639 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1460/3149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:56 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:56:57.701136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:57.701961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:57.704936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:57.706300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:57.714918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:57.716134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:57.718141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:57.718506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:57.720490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:57.721158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:57.721759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:57.722387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:57.723008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:57.723381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:57.724509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:57.725205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:57.830198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Unlocking {{(pid=127006) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 12 08:56:57.924351 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0aa65978-9466-4ca4-82b3-cb0a2255fa65 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.242544 Oct 12 08:56:57.931798 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1690/3150] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:57 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:57.938622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:57.939470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:57.946992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:57.947632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:57.948160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:57.949023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:57.949683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:57.950197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:58.152735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:58.165428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:58.168135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:58.169761 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-494e66a4-eae4-4019-a5a1-92d538fc2300 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1797 microversion: 2.42 time: 0.469111 Oct 12 08:56:58.174952 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1461/3151] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:57 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1797 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:56:58.189993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:58.190806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:58.206385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:58.207075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:58.207683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:58.210035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:58.213023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:58.213723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:58.450600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:58.466001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f51d127-2d09-43f7-a7e4-60d77b0c6f20 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.532239 Oct 12 08:56:58.491682 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1691/3152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:57 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:58.504305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:58.506371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:58.518840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:58.522890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:58.523643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:58.532419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:58.533639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:58.534327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:58.795599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:58.810290 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8f77ffc-c09c-4e8a-a398-f4ff4f6005fa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1501 microversion: 2.1 time: 0.633975 Oct 12 08:56:58.821483 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1462/3153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:58 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1501 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:58.821483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:58.821483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:58.834361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:58.834764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:58.835203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:58.835922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:58.836374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:58.836772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:59.264847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:59.279405 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a582e9e7-b0b6-43b3-a132-2c2b02648dce tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.786002 Oct 12 08:56:59.280634 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1692/3154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:58 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:59.285748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:56:59.296715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:59.314263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:59.315025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:59.315649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:59.316550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:59.317166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:59.317819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:59.339398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:56:59.353612 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8cd7d36d-5ec9-4901-b9b0-abe9eabd7cbf tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 0.538849 Oct 12 08:56:59.355023 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1463/3155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:58 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:56:59.360369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lazy-loading 'flavor' on Instance uuid fe06cee8-a199-43e0-b707-d7177639bcd6 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:56:59.361206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:59.362091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:59.372290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:59.374154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:59.374944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:59.376733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:59.377428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:59.385707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:59.795808 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-566e6241-070a-41d4-ab74-1db892695cb8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6/action" status: 202 len: 0 microversion: 2.1 time: 0.510948 Oct 12 08:56:59.799223 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1693/3156] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:56:59 2022] POST /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:56:59.816976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:56:59.817882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:56:59.825301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:59.826557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:59.827160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:56:59.828147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:56:59.828731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:56:59.829356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.060762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:00.073083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:00.079454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:00.082785 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2fd3e363-6ad6-4e57-bc63-de617412ea14 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1797 microversion: 2.42 time: 0.726079 Oct 12 08:57:00.085715 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1464/3157] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:56:59 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1797 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:00.091083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:00.098251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:00.114220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:00.114643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:00.116983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.119005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:00.121070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:00.121779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.250918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:00.260551 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf219b69-a83f-4a26-9b36-c07f30de010e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.452790 Oct 12 08:57:00.264716 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1694/3158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:56:59 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:00.293666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:00.294818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:00.309142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:00.309852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:00.310446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.311322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:00.312956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:00.313697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.488098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c5709fd-a479-40e5-99af-a141ae0f5738 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.196029 Oct 12 08:57:00.491548 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1695/3159] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:57:00 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:57:00.503370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:00.505529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:00.520382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:00.523230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:00.523736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.525007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:00.525927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:00.526858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.619225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:00.631714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d671aa1-5861-4daa-b6a5-58b18f54b835 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.543405 Oct 12 08:57:00.632983 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1465/3160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:00 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:00.640538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:00.641599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:00.665812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:00.667830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:00.668528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.669778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:00.671335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:00.673763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:00.942974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:00.955774 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0bb5794-532b-4d7d-b473-d3bfa11d00d1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 0.462826 Oct 12 08:57:00.956376 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1696/3161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:00 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:01.112870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:01.113556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:01.129002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:01.129550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:01.130019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:01.130921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:01.131660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:01.132305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:01.492597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:01.504590 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-91d3d0d0-e145-4b37-95ee-78ccacd74171 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1675 microversion: 2.1 time: 0.868856 Oct 12 08:57:01.529932 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1466/3162] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:00 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1675 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:01.630283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:01.664865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:01.673093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:01.690321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:01.691232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:01.692615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:01.695560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:01.696539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:01.697200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:01.769230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:01.780584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:01.786109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:01.788767 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-160a0645-a512-4aeb-b446-4a966ace6160 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1843 microversion: 2.42 time: 0.680807 Oct 12 08:57:01.793156 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1697/3163] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:01 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1843 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:57:01.982609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:01.983436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:02.002634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:02.004290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:02.005297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:02.007990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:02.008479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:02.010260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:02.366682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:02.379665 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-812c88d9-3eae-43a2-bd59-792dda782ffd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 0.403106 Oct 12 08:57:02.386756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1698/3164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:01 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:02.411522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:02.428784 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4da00f66-5d20-476e-8b78-c78b8097891b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.771378 Oct 12 08:57:02.429909 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1467/3165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:01 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:02.536503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:02.537199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:02.550015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:02.550454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:02.550911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:02.551650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:02.552111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:02.552944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:02.823489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:02.824898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:02.832524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:02.833415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:02.834294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:02.835219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:02.835887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:02.836929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:02.837260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:02.847934 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29a82745-5219-44bc-bbdf-0e346e2ab16d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1655 microversion: 2.1 time: 0.315439 Oct 12 08:57:02.850497 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1699/3166] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:02 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1655 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:02.872792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:02.873606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:02.881375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:02.882110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:02.882706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:02.883599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:02.884210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:02.884823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:02.890700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:02.922652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:03.000586 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-034e8819-0642-49ca-be47-afbb2467c068 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.131806 Oct 12 08:57:03.004562 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1700/3167] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:57:02 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:57:03.023540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8e4171a3-0b54-44c6-819c-bf20dce785c8 req-3865d3d4-a2fa-4829-9f90-a7839f63f57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071bc32d-5fae-47c9-a6e9-66d65dd0053b", "name": "network-vif-plugged", "status": "completed", "tag": "c4162fd1-20d6-4662-83a9-5e83561a5728"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:03.065653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:03.071677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8e4171a3-0b54-44c6-819c-bf20dce785c8 req-3865d3d4-a2fa-4829-9f90-a7839f63f57e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:03.072199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8e4171a3-0b54-44c6-819c-bf20dce785c8 req-3865d3d4-a2fa-4829-9f90-a7839f63f57e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:03.072637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8e4171a3-0b54-44c6-819c-bf20dce785c8 req-3865d3d4-a2fa-4829-9f90-a7839f63f57e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:03.087556 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8e4171a3-0b54-44c6-819c-bf20dce785c8 req-3865d3d4-a2fa-4829-9f90-a7839f63f57e service nova] Creating event network-vif-plugged:c4162fd1-20d6-4662-83a9-5e83561a5728 for instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b on n-h2-858383-10 Oct 12 08:57:03.095315 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8e4171a3-0b54-44c6-819c-bf20dce785c8 req-3865d3d4-a2fa-4829-9f90-a7839f63f57e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088397 Oct 12 08:57:03.096852 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1701/3168] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:03.107399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:03.108114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:03.116370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:03.116870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:03.117311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:03.118451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:03.119485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:03.119924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:03.476454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:03.490468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:03.490976 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55ba28e6-bc6c-424b-bf14-8a0804abc303 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1662 microversion: 2.1 time: 0.392191 Oct 12 08:57:03.491579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1702/3169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:03 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1662 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:03.500488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-849a46c7-eab0-48fd-b173-fba2bfaaadda req-5a2ac316-8d96-4a05-a4ca-f8aa1830344e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "tag": "3a324a9b-e152-4288-b469-6bc1dd04ee7e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:03.517554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:03.519031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:03.527237 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2e7ac096-4f3f-4973-acf7-9fbde91bb028 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1843 microversion: 2.42 time: 0.707612 Oct 12 08:57:03.533797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-849a46c7-eab0-48fd-b173-fba2bfaaadda req-5a2ac316-8d96-4a05-a4ca-f8aa1830344e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:03.534341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-849a46c7-eab0-48fd-b173-fba2bfaaadda req-5a2ac316-8d96-4a05-a4ca-f8aa1830344e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:03.534709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-849a46c7-eab0-48fd-b173-fba2bfaaadda req-5a2ac316-8d96-4a05-a4ca-f8aa1830344e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:03.556260 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1468/3170] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:02 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1843 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:03.559673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:03.559673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:03.565707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-849a46c7-eab0-48fd-b173-fba2bfaaadda req-5a2ac316-8d96-4a05-a4ca-f8aa1830344e service nova] Creating event network-changed:3a324a9b-e152-4288-b469-6bc1dd04ee7e for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:57:03.572574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:03.573078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:03.573541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:03.574346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:03.574709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:03.575131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:03.575770 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-849a46c7-eab0-48fd-b173-fba2bfaaadda req-5a2ac316-8d96-4a05-a4ca-f8aa1830344e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081910 Oct 12 08:57:03.577206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1703/3171] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:03.582978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:03.598286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:03.608850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:03.610385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:03.611226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:03.612348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:03.613089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:03.622704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:03.827698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:03.837778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-19ce1b1a-2dee-4a47-ae00-ed95da37a3f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.259076 Oct 12 08:57:03.843466 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1704/3172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:03 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:04.298055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:04.321216 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-28ca7209-1778-418c-ae13-3fc250be044b tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1318 microversion: 2.1 time: 0.767850 Oct 12 08:57:04.323242 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1469/3173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:03 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:04.519035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:04.520822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:04.538987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:04.539515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:04.540162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:04.541352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:04.543202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:04.544947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:04.560615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:04.561648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:04.582585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:04.583083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:04.583522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:04.584271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:04.594062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:04.594625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:04.840784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:04.850729 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e64fac9-fae3-46c7-83be-e479928bd27d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.337639 Oct 12 08:57:04.853222 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1705/3174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:04 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:04.871257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:04.875026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:04.882497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:04.883266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:04.883860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:04.884730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:04.885403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:04.886029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.094161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:05.107237 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ecac7dc-e89e-4758-9caa-e057d3224bf3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.239119 Oct 12 08:57:05.108108 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1706/3175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:04 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:05.113091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:05.114231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:05.125076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:05.125922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:05.126623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.127484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:05.128010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:05.128502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.390945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:05.400339 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b82152c-5b99-466a-9d8f-cc8ca2bdfada tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.290924 Oct 12 08:57:05.409941 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1707/3176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:05 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:05.416640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:05.422078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:05.435596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:05.436269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:05.437962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.438768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:05.441646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:05.442456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.722517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:05.733256 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71f7a72e-a773-400a-9d5c-47ee2e5f7d7e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1509 microversion: 2.1 time: 0.321173 Oct 12 08:57:05.734957 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1708/3177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:05 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:05.741345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:05.742445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:05.749799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:05.750638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:05.751633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.752841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:05.753606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:05.754274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.767668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:05.780728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:05.786374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:05.788803 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20710cce-b156-487a-ac28-03ebec78b2fc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1843 microversion: 2.42 time: 1.233346 Oct 12 08:57:05.792384 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1470/3178] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:04 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1843 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:57:05.799252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:05.806490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:05.821708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:05.824550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:05.825242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.826619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:05.828286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:05.830868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:05.995507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:06.008641 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ece49853-f60f-4271-be32-6abaf934b39f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.270056 Oct 12 08:57:06.010946 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1709/3179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:05 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:06.033982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:06.034997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:06.042042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.042905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.043560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.044502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.045159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.045835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.209989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:06.220659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f42f7630-1e13-4398-ab0c-7a9c54539729 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.191681 Oct 12 08:57:06.233465 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1710/3180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:06 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:06.240155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:06.240155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:06.249628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.250125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.250563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.251272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.251725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.252212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.445800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:06.464205 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f6664d2d-73ba-451a-86cb-748e9cba6787 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.236823 Oct 12 08:57:06.465462 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1711/3181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:06 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:06.476059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:06.479574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:06.484725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:06.486223 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f27c717e-6d3a-4cc1-abd8-85208bb02471 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1509 microversion: 2.1 time: 0.690399 Oct 12 08:57:06.488454 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1471/3182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:05 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:06.493661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.494554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.495151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.496395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.497054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.497672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.514609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:06.517946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:06.525217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.526023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.526807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.527543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.528007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.528435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.627995 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c0e85b0d-0015-41f5-97ea-1aee24449ec1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "PUT /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1081 microversion: 2.1 time: 0.117830 Oct 12 08:57:06.653750 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1472/3183] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 08:57:06 2022] PUT /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1081 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:06.660993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-77069007-b6d3-40b7-abc9-2e0b258f4d04 req-fb6b3661-cdb1-4b1b-a719-8beff44e7b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "tag": "dd89cf22-dd9d-43c6-acf1-e972ac33ae09"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:06.673263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-77069007-b6d3-40b7-abc9-2e0b258f4d04 req-fb6b3661-cdb1-4b1b-a719-8beff44e7b44 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.673931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-77069007-b6d3-40b7-abc9-2e0b258f4d04 req-fb6b3661-cdb1-4b1b-a719-8beff44e7b44 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.674424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-77069007-b6d3-40b7-abc9-2e0b258f4d04 req-fb6b3661-cdb1-4b1b-a719-8beff44e7b44 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.688530 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-77069007-b6d3-40b7-abc9-2e0b258f4d04 req-fb6b3661-cdb1-4b1b-a719-8beff44e7b44 service nova] Creating event network-changed:dd89cf22-dd9d-43c6-acf1-e972ac33ae09 for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:57:06.699268 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-77069007-b6d3-40b7-abc9-2e0b258f4d04 req-fb6b3661-cdb1-4b1b-a719-8beff44e7b44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040926 Oct 12 08:57:06.702221 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1473/3184] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:06.713956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:06.717354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:06.731753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.732260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.732708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.734950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.735466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.738364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.760656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:06.777268 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53b4c822-ec36-446b-985b-8165cb419a0c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.308166 Oct 12 08:57:06.778224 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1712/3185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:06 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:06.804817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:06.805818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:06.816874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.819376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.820007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.820970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:06.821762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:06.822151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:06.977218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:06.986003 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-138fccfb-0c55-43d2-8256-8f5a51e9f15a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.185896 Oct 12 08:57:07.001544 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1713/3186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:06 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:07.006678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:07.007299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:07.014118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.015702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.015702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.015962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.016635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.017210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.224386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:07.235192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:07.236895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:07.238566 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f80343e6-bccd-4de6-89af-88e2c781868a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1864 microversion: 2.42 time: 0.235645 Oct 12 08:57:07.254526 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1714/3187] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:07 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1864 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:07.367116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:07.381087 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-13a8c2aa-a075-43c1-b954-9af7773ac492 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1507 microversion: 2.1 time: 0.677318 Oct 12 08:57:07.402370 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1474/3188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:06 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1507 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:07.408263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:07.411355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:07.422022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.422809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.423488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.424676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.425809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.426462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.492588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:07.493338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:07.506183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.508206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.510784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.512787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.513825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.515184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.683920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:07.697764 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-acea3117-c439-4dbd-996f-03042783cc9f tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1507 microversion: 2.1 time: 0.293231 Oct 12 08:57:07.716703 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1715/3189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:07 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:07.723056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:07.726966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:07.734182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.735311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.736183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.737557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.738183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.738810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.800930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:07.826983 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1aad45ed-db05-4cc3-a629-80565489caa4 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "PUT /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1083 microversion: 2.1 time: 0.108496 Oct 12 08:57:07.830123 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1716/3190] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 08:57:07 2022] PUT /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1083 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:07.853370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:07.854405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:07.863840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.864530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.865931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:07.868290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:07.868960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:07.869902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:08.023819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:08.033150 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a8fb2646-4ed2-440d-b0bb-ef4691bf1f2d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.548382 Oct 12 08:57:08.037937 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1475/3191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:07 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:08.267188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:08.267793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:08.288123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:08.288609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:08.289041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:08.289857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:08.290308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:08.290730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:08.602219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:08.613822 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-abb10333-eecf-4a87-8e5d-14679bbe8bdc tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1509 microversion: 2.1 time: 0.762325 Oct 12 08:57:08.614908 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1717/3192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:07 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1509 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:08.641130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:08.646867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:08.663707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:08.664359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:08.664910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:08.667056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:08.667642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:08.674777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:08.906662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:08.919376 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4733e4a9-e1a1-42f1-abe1-5a5a2f4f9273 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1509 microversion: 2.1 time: 0.285437 Oct 12 08:57:08.934022 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1718/3193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:08 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:08.946387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:08.946983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:08.953204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:08.953837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:08.954353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:08.955139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:08.955669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:08.956171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:08.982678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:57:09.112891 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-214ae988-ee50-44fd-af3a-7d6714c4afae tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "DELETE /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 204 len: 0 microversion: 2.1 time: 0.170226 Oct 12 08:57:09.117287 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1719/3194] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:57:08 2022] DELETE /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:57:09.125831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:09.128268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:09.144110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:09.144782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:09.145317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:09.146208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:09.148361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:09.148905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:09.301634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:09.320856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:09.324461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:09.327946 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2536d975-1a3a-4c33-bd98-276efce903bc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1885 microversion: 2.42 time: 1.064935 Oct 12 08:57:09.328551 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1476/3195] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:08 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1885 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:57:09.338118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:09.341481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:09.358422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:09.360171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:09.363226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:09.364181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:09.364835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:09.365494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:09.431277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:57:09.557118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:09.570031 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8470bce7-9ab3-43c4-89fa-0f5337704811 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.449312 Oct 12 08:57:09.571756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1720/3196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:09 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:09.586273 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.compute.api [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Instance is already in deleting state, ignoring this request Oct 12 08:57:09.586273 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e9792713-4964-4a68-b091-b9920639e93a tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "DELETE /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 204 len: 0 microversion: 2.1 time: 0.241660 Oct 12 08:57:09.586273 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1477/3197] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:57:09 2022] DELETE /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:57:09.588924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:09.590014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:09.597295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:09.602671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:09.603460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:09.604412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:09.605477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:09.606153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:09.736765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-76403d3d-db1b-4473-a724-3625d5337f1a req-9fda3e5a-f750-472a-8d7c-3ab605e0d9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "tag": "732ae85e-6222-4561-8af6-1183c673884b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:09.754648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-76403d3d-db1b-4473-a724-3625d5337f1a req-9fda3e5a-f750-472a-8d7c-3ab605e0d9d5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:09.755527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-76403d3d-db1b-4473-a724-3625d5337f1a req-9fda3e5a-f750-472a-8d7c-3ab605e0d9d5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:09.758065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-76403d3d-db1b-4473-a724-3625d5337f1a req-9fda3e5a-f750-472a-8d7c-3ab605e0d9d5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:09.784826 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-76403d3d-db1b-4473-a724-3625d5337f1a req-9fda3e5a-f750-472a-8d7c-3ab605e0d9d5 service nova] Creating event network-changed:732ae85e-6222-4561-8af6-1183c673884b for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:57:09.793685 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-76403d3d-db1b-4473-a724-3625d5337f1a req-9fda3e5a-f750-472a-8d7c-3ab605e0d9d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060479 Oct 12 08:57:09.794943 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1721/3198] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:57:10.198432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:10.207865 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-93b3af8e-d667-47e1-a84b-7aaec2f23c43 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1515 microversion: 2.1 time: 0.626084 Oct 12 08:57:10.208527 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1478/3199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:09 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1515 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:10.358393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:10.359220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:10.392442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:10.392941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:10.393379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:10.407392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:10.411013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:10.411588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:10.596828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:10.597484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:10.612065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:10.614635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:10.615129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:10.615868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:10.616338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:10.616861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:10.878820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:10.895248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:10.899188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:10.905064 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa1796bb-9780-4070-9a82-c9bb45d9062f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1885 microversion: 2.42 time: 0.552292 Oct 12 08:57:10.917822 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1722/3200] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:10 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1885 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:11.246394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:11.248722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:11.293909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:11.295932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:11.300631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:11.303929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:11.307349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:11.308054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:11.762887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:11.771797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6eb108e-3c86-47cd-bc13-e9b5cd297489 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1515 microversion: 2.1 time: 0.533945 Oct 12 08:57:11.775572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1723/3201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:11 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1515 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:11.939087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:11.939882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:11.949409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:11.952043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:11.952570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:11.953326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:11.956369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:11.960484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:12.396887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:12.403336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:12.413191 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a21b5984-930b-44e4-9b46-24832fd43e89 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 1.820781 Oct 12 08:57:12.414140 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1479/3202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:10 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:12.416031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:12.417529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:12.418733 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2c6a45e-cf00-403c-a93d-a5200498667c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1885 microversion: 2.42 time: 0.486364 Oct 12 08:57:12.433488 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1724/3203] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:11 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1885 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:12.720968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:12.721729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:12.738255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:12.738763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:12.739419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:12.740343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:12.740802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:12.741227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:12.803268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:12.803891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:12.821500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:12.822001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:12.822450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:12.823204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:12.823657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:12.824085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:13.189315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90150a5342474fd0ad10fc853b2c5d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70848fd10ea847968908b8ba3f30b907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:13.206783 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68f84cfe-bd1b-4bac-a7d8-121a2392ebfd tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 200 len: 1515 microversion: 2.1 time: 0.407272 Oct 12 08:57:13.223569 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1725/3204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:12 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 1515 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:13.443137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:13.454991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:13.473221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:13.476704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:13.477339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:13.478413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:13.479027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:13.486853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:13.528365 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-403dcb3a-c3f4-4431-a559-6bec8b0930a0 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1859 microversion: 2.1 time: 0.811407 Oct 12 08:57:13.528990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1480/3205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:12 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1859 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:13.541976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:13.542606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:13.576286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:13.576787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:13.577671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:13.577955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:13.578406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:13.578858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:13.829160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:13.844412 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e140c096-fa5f-4d22-a78d-c2ade2a54427 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.404728 Oct 12 08:57:13.847745 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1726/3206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:13 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:13.866025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ad5c506d-127e-4f46-be5b-17870473ab70 req-b06384fb-968e-45ab-9103-671c4e2874cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071bc32d-5fae-47c9-a6e9-66d65dd0053b", "name": "network-vif-deleted", "tag": "c4162fd1-20d6-4662-83a9-5e83561a5728"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:13.878651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad5c506d-127e-4f46-be5b-17870473ab70 req-b06384fb-968e-45ab-9103-671c4e2874cb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:13.879402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad5c506d-127e-4f46-be5b-17870473ab70 req-b06384fb-968e-45ab-9103-671c4e2874cb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:13.880158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad5c506d-127e-4f46-be5b-17870473ab70 req-b06384fb-968e-45ab-9103-671c4e2874cb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:13.904943 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ad5c506d-127e-4f46-be5b-17870473ab70 req-b06384fb-968e-45ab-9103-671c4e2874cb service nova] Creating event network-vif-deleted:c4162fd1-20d6-4662-83a9-5e83561a5728 for instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b on n-h2-858383-10 Oct 12 08:57:13.949057 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ad5c506d-127e-4f46-be5b-17870473ab70 req-b06384fb-968e-45ab-9103-671c4e2874cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099660 Oct 12 08:57:13.950516 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1727/3207] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:13.962214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": true, "disk_over_commit": false}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:13.976332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:13.996026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:13.997115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:13.999488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.000431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.003780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.004260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.082587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lazy-loading 'flavor' on Instance uuid 617dc413-650f-4340-933d-6fbf879240bf {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:57:14.100314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Going to try to live migrate instance to n-h2-858383-10 {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:57:14.433111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:14.449345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:14.452027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:14.454001 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8bf2d8e9-cda1-4e4d-b61c-2bd22bd4b4a1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1885 microversion: 2.42 time: 0.915859 Oct 12 08:57:14.469316 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1481/3208] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:13 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1885 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:14.487925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:14.496849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 071bc32d-5fae-47c9-a6e9-66d65dd0053b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:14.506534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.507306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.508793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.511029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.511506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.511963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.552916 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] HTTP exception thrown: Instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b could not be found. Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Request method failure captured: Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b HTTP/1.1 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoC-BgKoEX65U0KIXsLjUEW-yEzP56b8pNCDiNGvjRBMs8l875DmVtPJwmEGdwdmcLWkOAHJ9Msk2R7mygMOHJp238GDKYiP_xaaAbfSp4M6XLTbJBfCNde6Z-_-NGVcyWDvp1Qu_zBSsYqXOifKPraUd2zRi3gm-2jaYfrWW4VIOr8 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_70848fd10ea847968908b8ba3f30b907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}] Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 90150a5342474fd0ad10fc853b2c5d96 Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b could not be found. Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '071bc32d-5fae-47c9-a6e9-66d65dd0053b'} Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b could not be found. Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b could not be found. Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.555320 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b could not be found. Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Returning 404 to user: Instance 071bc32d-5fae-47c9-a6e9-66d65dd0053b could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b174d20-3879-4aa2-825d-0c74049a0ad2 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b" status: 404 len: 111 microversion: 2.1 time: 0.076706 Oct 12 08:57:14.560099 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1482/3209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:14 2022] GET /compute/v2.1/servers/071bc32d-5fae-47c9-a6e9-66d65dd0053b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:57:14.566184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:14.566709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:14.577505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.595370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.606046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.609201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.617197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.620507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.650259 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] HTTP exception thrown: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Request method failure captured: Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 HTTP/1.1 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoC-BgKoEX65U0KIXsLjUEW-yEzP56b8pNCDiNGvjRBMs8l875DmVtPJwmEGdwdmcLWkOAHJ9Msk2R7mygMOHJp238GDKYiP_xaaAbfSp4M6XLTbJBfCNde6Z-_-NGVcyWDvp1Qu_zBSsYqXOifKPraUd2zRi3gm-2jaYfrWW4VIOr8 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_70848fd10ea847968908b8ba3f30b907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}] Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 90150a5342474fd0ad10fc853b2c5d96 Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '74a27f9c-6b14-46e1-ac07-f7396ddd3a30'} Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:57:14.652007 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Returning 404 to user: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:57:14.656699 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3590bdb4-1046-4bf4-a455-b39a5efb829e tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "DELETE /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 404 len: 111 microversion: 2.1 time: 0.091708 Oct 12 08:57:14.658129 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1483/3210] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:57:14 2022] DELETE /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:57:14.663140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:14.663832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: 74a27f9c-6b14-46e1-ac07-f7396ddd3a30] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:14.670328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.670813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.671405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.672293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.672749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.673175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.726437 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] HTTP exception thrown: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Request method failure captured: Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 HTTP/1.1 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoC-BgKoEX65U0KIXsLjUEW-yEzP56b8pNCDiNGvjRBMs8l875DmVtPJwmEGdwdmcLWkOAHJ9Msk2R7mygMOHJp238GDKYiP_xaaAbfSp4M6XLTbJBfCNde6Z-_-NGVcyWDvp1Qu_zBSsYqXOifKPraUd2zRi3gm-2jaYfrWW4VIOr8 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_70848fd10ea847968908b8ba3f30b907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}] Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 90150a5342474fd0ad10fc853b2c5d96 Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '74a27f9c-6b14-46e1-ac07-f7396ddd3a30'} Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.735474 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Returning 404 to user: Instance 74a27f9c-6b14-46e1-ac07-f7396ddd3a30 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:57:14.740280 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-910b1f8a-657b-4726-a7ef-7c1bbd526628 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30" status: 404 len: 111 microversion: 2.1 time: 0.078073 Oct 12 08:57:14.745807 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1484/3211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:14 2022] GET /compute/v2.1/servers/74a27f9c-6b14-46e1-ac07-f7396ddd3a30 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:57:14.752924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:14.754959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:14.768988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.769837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.770434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.771480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.772091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.772671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.796107 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] HTTP exception thrown: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Request method failure captured: Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 HTTP/1.1 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoC-BgKoEX65U0KIXsLjUEW-yEzP56b8pNCDiNGvjRBMs8l875DmVtPJwmEGdwdmcLWkOAHJ9Msk2R7mygMOHJp238GDKYiP_xaaAbfSp4M6XLTbJBfCNde6Z-_-NGVcyWDvp1Qu_zBSsYqXOifKPraUd2zRi3gm-2jaYfrWW4VIOr8 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_70848fd10ea847968908b8ba3f30b907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}] Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 90150a5342474fd0ad10fc853b2c5d96 Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e5400c2d-3481-43fa-87b9-9a1886f2dae3'} Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:57:14.797928 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.802853 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.804469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Returning 404 to user: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:57:14.806653 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9f3a9d9-ef84-46c0-9581-f3b922416022 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 404 len: 111 microversion: 2.1 time: 0.059424 Oct 12 08:57:14.807361 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1485/3212] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:57:14 2022] DELETE /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:57:14.815933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:14.816799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] [instance: e5400c2d-3481-43fa-87b9-9a1886f2dae3] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:14.824979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.825977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.826605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.827478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.828087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.828667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.845402 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] HTTP exception thrown: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Request method failure captured: Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 HTTP/1.1 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoC-BgKoEX65U0KIXsLjUEW-yEzP56b8pNCDiNGvjRBMs8l875DmVtPJwmEGdwdmcLWkOAHJ9Msk2R7mygMOHJp238GDKYiP_xaaAbfSp4M6XLTbJBfCNde6Z-_-NGVcyWDvp1Qu_zBSsYqXOifKPraUd2zRi3gm-2jaYfrWW4VIOr8 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/70848fd10ea847968908b8ba3f30b907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_70848fd10ea847968908b8ba3f30b907"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/70848fd10ea847968908b8ba3f30b907"}]}] Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 70848fd10ea847968908b8ba3f30b907 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-688906331 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 90150a5342474fd0ad10fc853b2c5d96 Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiskConfigTestJSON-688906331-project Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e5400c2d-3481-43fa-87b9-9a1886f2dae3'} Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:14.847556 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.851878 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:14.851878 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:14.851878 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:14.851878 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:57:14.851878 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:57:14.851878 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. Oct 12 08:57:14.851878 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:57:14.857283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] Returning 404 to user: Instance e5400c2d-3481-43fa-87b9-9a1886f2dae3 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:57:14.858491 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-38616bcc-8e2f-400b-9f19-96bf92bb24c1 tempest-ServerDiskConfigTestJSON-688906331 tempest-ServerDiskConfigTestJSON-688906331-project] 10.222.0.40 "GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3" status: 404 len: 111 microversion: 2.1 time: 0.047068 Oct 12 08:57:14.862940 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1486/3213] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:14 2022] GET /compute/v2.1/servers/e5400c2d-3481-43fa-87b9-9a1886f2dae3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:57:14.890967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:14.891829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:14.900331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.901926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.905378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.906513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:14.907549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:14.908206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:14.917393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:15.422161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:15.431489 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c48f8953-7579-4bbf-9554-c89b07b2ef08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.550590 Oct 12 08:57:15.438151 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1487/3214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:14 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:15.486647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:15.487731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:15.497472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:15.498385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:15.499061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:15.500407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:15.501620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:15.502767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:15.991577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:16.020859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:16.022903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:16.024500 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-826ddf0c-05c0-4156-99cf-8d7a28df2543 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.542306 Oct 12 08:57:16.026369 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1488/3215] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:15 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:57:16.374629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-78409ecb-bfe8-4206-b205-01dffb3c7957 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'create', calling method: .version_select at 0x7f9843fe7ca0>, body: {"keypair": {"name": "tempest-keypair-1537088355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWPasHVuSxpSp+vFolbIVuvGasVkJwdjGlVzp6BwqT8AnWbAUfyJWoRWuRejo4kV/RJ66PDSgwAEluTd6hNXrgyhxUi4UNq8yJN+ngzc4RHb3kwhgHSyQ8gfgDGpJatSg=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:16.415257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-78409ecb-bfe8-4206-b205-01dffb3c7957 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Getting quotas for project 21e58c2e8c6c4f06a55edf513222d10b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:57:16.421486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-78409ecb-bfe8-4206-b205-01dffb3c7957 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Getting quotas for user c3acc9fef23b4066aaf89f766ff219f8 and project 21e58c2e8c6c4f06a55edf513222d10b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:57:16.469083 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-78409ecb-bfe8-4206-b205-01dffb3c7957 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.436998 Oct 12 08:57:16.470923 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1489/3216] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 08:57:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 444 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 08:57:16.483591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d8f6791c-fd83-4d8f-87d8-1b5713f1fe4f req-bb0a6d20-56f5-4667-8edd-dd3ff189cb9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "tag": "02fdd17d-834c-4946-a15e-652cc4faf437"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:16.503010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8f6791c-fd83-4d8f-87d8-1b5713f1fe4f req-bb0a6d20-56f5-4667-8edd-dd3ff189cb9e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:16.504272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8f6791c-fd83-4d8f-87d8-1b5713f1fe4f req-bb0a6d20-56f5-4667-8edd-dd3ff189cb9e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:16.505168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8f6791c-fd83-4d8f-87d8-1b5713f1fe4f req-bb0a6d20-56f5-4667-8edd-dd3ff189cb9e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:16.520675 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d8f6791c-fd83-4d8f-87d8-1b5713f1fe4f req-bb0a6d20-56f5-4667-8edd-dd3ff189cb9e service nova] Creating event network-changed:02fdd17d-834c-4946-a15e-652cc4faf437 for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:57:16.526475 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d8f6791c-fd83-4d8f-87d8-1b5713f1fe4f req-bb0a6d20-56f5-4667-8edd-dd3ff189cb9e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053376 Oct 12 08:57:16.527360 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1490/3217] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:16.620545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1732292544", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3dfaf69e-9114-463f-af48-2e013b44a4e8"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:16.754138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] validate_networks() for [('3dfaf69e-9114-463f-af48-2e013b44a4e8', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:57:16.940363 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dfe31588-46e9-4318-b4ca-8fdf5d08e188 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/action" status: 202 len: 0 microversion: 2.1 time: 2.984810 Oct 12 08:57:16.941107 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1728/3218] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:57:13 2022] POST /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/action => generated 0 bytes in 2986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:57:16.951191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:16.954183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:16.981828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:16.982385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:16.982821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:16.983547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:16.984306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:16.987211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:17.318503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:17.328863 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ea38f65-5e0b-4af4-ae78-d22d4b20fb08 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.385979 Oct 12 08:57:17.343512 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1729/3219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:16 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:17.351817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:17.353118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:17.359852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:17.360254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:17.361204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:17.363642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:17.364670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:17.365341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:17.730469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:17.738439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:17.747181 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2278f04-db44-4100-9f4d-71b8e1b56d95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.398370 Oct 12 08:57:17.747849 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1730/3220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:17 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:17.767916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:17.769283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:17.784542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:17.785097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:17.785778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:17.786725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:17.788832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:17.789464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:17.895245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:57:17.897016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:57:17.897016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:57:17.897016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:57:17.897980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:57:17.918854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:17.919347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:17.919987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:17.920740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:17.921201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:17.921960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:17.959662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Getting quotas for project fa3a965bdb884e0eb4f37650c30cb3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:57:17.971200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Getting quotas for user 69f6da267d5248518650775b52ca9488 and project fa3a965bdb884e0eb4f37650c30cb3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:57:17.993830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:57:17.996587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:57:18.051978 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8c3de382-66dc-4c1f-810b-afaaea4be306 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522678 Oct 12 08:57:18.060330 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1491/3221] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:57:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:57:18.065552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3539efc0-b6ac-4706-8c08-cae13d244590 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:18.066381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3539efc0-b6ac-4706-8c08-cae13d244590 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:18.240222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3539efc0-b6ac-4706-8c08-cae13d244590 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:18.264910 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3539efc0-b6ac-4706-8c08-cae13d244590 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1208 microversion: 2.1 time: 0.203182 Oct 12 08:57:18.266437 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1492/3222] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:18 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1208 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:18.356229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:18.357031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:18.367892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:18.368694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:18.371183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:18.372220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:18.373771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:18.375078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:19.019641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:19.036048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:19.064064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:19.071884 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-16acdb44-06c3-4254-a440-b59c355b4d59 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 1.322926 Oct 12 08:57:19.075537 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1731/3223] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:17 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:19.104011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a0b8f780-6320-445e-8260-8bf732b98613 req-0e83e43c-71e8-4727-adb7-b0387bd3846b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "tag": "610a858d-7018-4592-868c-3b15b37557fa"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:19.140056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a0b8f780-6320-445e-8260-8bf732b98613 req-0e83e43c-71e8-4727-adb7-b0387bd3846b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:19.143204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a0b8f780-6320-445e-8260-8bf732b98613 req-0e83e43c-71e8-4727-adb7-b0387bd3846b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:19.144998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a0b8f780-6320-445e-8260-8bf732b98613 req-0e83e43c-71e8-4727-adb7-b0387bd3846b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:19.157837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:19.171127 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0d4b41c-77bf-4884-8d7e-e8b9671c4817 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.819500 Oct 12 08:57:19.172061 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1493/3224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:18 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:19.183095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:19.185354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:19.186213 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a0b8f780-6320-445e-8260-8bf732b98613 req-0e83e43c-71e8-4727-adb7-b0387bd3846b service nova] Creating event network-changed:610a858d-7018-4592-868c-3b15b37557fa for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:57:19.193919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a0b8f780-6320-445e-8260-8bf732b98613 req-0e83e43c-71e8-4727-adb7-b0387bd3846b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114941 Oct 12 08:57:19.194998 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1732/3225] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:19.203336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:19.204816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:19.205324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:19.205787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:19.208622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:19.209093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:19.209573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:19.296940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:19.297954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:19.350825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:19.351853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:19.353926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:19.354718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:19.357105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:19.357584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:19.610425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:19.630169 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8be31f6c-713e-4696-a04e-2fd072c73476 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1204 microversion: 2.1 time: 0.338862 Oct 12 08:57:19.630919 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1733/3226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:19 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1204 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:20.106283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:20.106985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:20.133722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:20.134400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:20.134859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:20.143864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:20.144862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:20.147955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:20.840787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:20.858303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cdca30cd-435d-491d-ba89-d196ad2a729f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 1.685155 Oct 12 08:57:20.861100 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1494/3227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:19 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:20.862280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:20.875893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:20.889917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:20.890640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:20.891469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:20.892849 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f70d12f6-f720-4cee-ba95-b2fd6900a0a7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.790585 Oct 12 08:57:20.896004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1734/3228] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:20 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:20.900851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:20.905294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:20.906003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:20.906643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:20.907491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:20.908449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:20.910188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:20.911719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:20.923602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:20.926361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:20.928608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:20.929629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:20.931723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:20.933822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:21.205826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:21.220814 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-11f4a1b4-6473-421f-8de6-e936ef12f0cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1278 microversion: 2.1 time: 0.323570 Oct 12 08:57:21.221547 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1735/3229] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:20 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1278 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:21.229134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:21.246153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:21.247385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Searching by: {'deleted': False, 'project_id': '0a452fe170084e50bdfdb383b0e4f788'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:57:21.271587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:21.274091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:21.274802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:21.275915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:21.280948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:21.281615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:21.338304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:21.351028 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ffd02f28-84e0-4182-b1d8-5ad9c1a0f56b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.486800 Oct 12 08:57:21.357182 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1495/3230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:20 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:21.359757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:57:21.402815 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7757171-18d1-4e8d-b12e-dae5ab0e979f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.177381 Oct 12 08:57:21.412598 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1736/3231] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 08:57:21 2022] GET /compute/v2.1/servers => generated 340 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:21.434038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:21.449662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:21.449833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Searching by: {'deleted': False, 'project_id': '0a452fe170084e50bdfdb383b0e4f788'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 08:57:21.474264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:21.474754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:21.475192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:21.476113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:21.476750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:21.477338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:21.529261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7463cabe-97d0-4e13-8aef-eef6705e6eb0 req-e1ba967d-0c12-4846-ba24-e06d050c4eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "tag": "1e0ec976-98af-4526-abda-2f9da49a001d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:21.542080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 08:57:21.549779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7463cabe-97d0-4e13-8aef-eef6705e6eb0 req-e1ba967d-0c12-4846-ba24-e06d050c4eeb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:21.552740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7463cabe-97d0-4e13-8aef-eef6705e6eb0 req-e1ba967d-0c12-4846-ba24-e06d050c4eeb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:21.553366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7463cabe-97d0-4e13-8aef-eef6705e6eb0 req-e1ba967d-0c12-4846-ba24-e06d050c4eeb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:21.585268 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7463cabe-97d0-4e13-8aef-eef6705e6eb0 req-e1ba967d-0c12-4846-ba24-e06d050c4eeb service nova] Creating event network-changed:1e0ec976-98af-4526-abda-2f9da49a001d for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:57:21.601862 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7463cabe-97d0-4e13-8aef-eef6705e6eb0 req-e1ba967d-0c12-4846-ba24-e06d050c4eeb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077140 Oct 12 08:57:21.602483 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1737/3232] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:57:21.613112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:21.629677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:21.630462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:21.636697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:21.890890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:21.891591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:21.904693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:21.905484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:21.906098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:21.906977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:21.907429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:21.907851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:22.075651 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b86633f5-be5e-455b-bb29-8a8a06d9507c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.662588 Oct 12 08:57:22.077642 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1496/3233] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 08:57:21 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:22.082557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:22.083413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:22.101062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:22.101877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:22.102498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:22.103417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:22.104121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:22.104804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:22.599659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:22.616144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:22.623033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:22.624742 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a1e150b-dc58-4a8b-beac-f1cda7fd3da6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.545869 Oct 12 08:57:22.625382 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1497/3234] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:22 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:22.636362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a833edb3-26ef-4a4e-a2f0-3b08489ffd2e tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:22.652188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a833edb3-26ef-4a4e-a2f0-3b08489ffd2e tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025419 Oct 12 08:57:22.653286 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1498/3235] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:57:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:22.658785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:22.659613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:22.668802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:22.669632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:22.670436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:22.671333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:22.672003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:22.672649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:22.783162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:22.793984 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fdd93d39-b360-4582-a7f4-a01ffa5571ba tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1266 microversion: 2.1 time: 0.137786 Oct 12 08:57:22.795019 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1499/3236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:22 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:22.801396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:22.802765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:22.810982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:22.811802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:22.812571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:22.813734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:22.814460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:22.815785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:22.819158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:22.834424 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-94bace43-e020-440c-b452-2a9ed1a3df26 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.947636 Oct 12 08:57:22.849294 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1738/3237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:21 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:23.071539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:23.071969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:23.084962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.085506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.085956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:23.086665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.087131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.087541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:23.153925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:57:23.255401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:23.271397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12f8f6f6-3758-44ff-906e-6eb18baa4fd5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.474907 Oct 12 08:57:23.274395 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1500/3238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:22 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:23.319696 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ae53771-d9b8-437c-bb22-35679ee32a2f tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 204 len: 0 microversion: 2.1 time: 0.251770 Oct 12 08:57:23.321178 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1739/3239] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:57:23 2022] DELETE /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:57:23.332755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:23.333949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:23.359401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.360184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.360866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:23.362185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.363012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.363674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:23.652892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:23.653629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:23.667209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.668077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.672721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:23.674083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.674908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.675567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:23.904391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:23.913996 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e571a25c-ca38-425a-b32d-d2242a1707c5 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1713 microversion: 2.1 time: 0.588088 Oct 12 08:57:23.915162 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1501/3240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:23 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1713 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:23.920264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1fabec91-fb5d-48fc-82f9-d54ba7356caa req-19e51b83-8510-46e3-bf52-76ef27ea22e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "tag": "3b29526e-1c95-43fd-acbc-c4e8746e941a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:23.932049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1fabec91-fb5d-48fc-82f9-d54ba7356caa req-19e51b83-8510-46e3-bf52-76ef27ea22e3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.933191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1fabec91-fb5d-48fc-82f9-d54ba7356caa req-19e51b83-8510-46e3-bf52-76ef27ea22e3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.934081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1fabec91-fb5d-48fc-82f9-d54ba7356caa req-19e51b83-8510-46e3-bf52-76ef27ea22e3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:23.947496 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1fabec91-fb5d-48fc-82f9-d54ba7356caa req-19e51b83-8510-46e3-bf52-76ef27ea22e3 service nova] Creating event network-changed:3b29526e-1c95-43fd-acbc-c4e8746e941a for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:57:23.955955 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1fabec91-fb5d-48fc-82f9-d54ba7356caa req-19e51b83-8510-46e3-bf52-76ef27ea22e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038735 Oct 12 08:57:23.959629 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1502/3241] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:23.968490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:23.969647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:23.977728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.978723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.979398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:23.980319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:23.981028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:23.981970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:24.242084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:24.254072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6eacf370-23a2-4f57-b80c-24202cc82d59 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1308 microversion: 2.1 time: 0.292247 Oct 12 08:57:24.274356 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1503/3242] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:23 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:24.284007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:24.288738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:24.300554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:24.319939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:24.321000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:24.322884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:24.323323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:24.324161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:24.325183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:24.327735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:24.328913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:24.329600 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bd280e42-eba5-49fe-a1be-5970ba46ea0b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.678314 Oct 12 08:57:24.331834 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1740/3243] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:23 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:24.342693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:24.345151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:24.360226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:24.363182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:24.363775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:24.364627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:24.367040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:24.367583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:24.644210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:24.653252 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6bff211b-7b80-4948-b8ac-1f5c2b8deeba tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.376556 Oct 12 08:57:24.666231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1504/3244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:24 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:24.755486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:24.779975 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e29b102b-879d-44fd-a116-c5c06add6e55 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1507 microversion: 2.1 time: 0.445693 Oct 12 08:57:24.795336 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1741/3245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:24 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:24.946748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:24.947715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:24.963004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:24.967026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:24.967691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:24.968539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:24.969724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:24.970255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:25.280150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:25.280795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:25.287839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:25.288352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:25.288790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:25.289561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:25.297385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:25.304495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:25.478053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:25.494972 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d03f9566-d0e3-4030-8752-6deb329bdace tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1713 microversion: 2.1 time: 0.554094 Oct 12 08:57:25.495601 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1505/3246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:24 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1713 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:25.515794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-463665368", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e20b0bd-ac45-475e-baa9-733715fa2691"}], "security_groups": [{"name": "tempest-securitygroup--691413553"}], "key_name": "tempest-keypair-1537088355", "user_data": "}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:25.676361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:25.688174 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9344c135-464d-4513-9648-bcc23c541035 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1308 microversion: 2.1 time: 0.411760 Oct 12 08:57:25.689937 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1742/3247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:25 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:25.695836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:25.696832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:25.716781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:25.718037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:25.718886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:25.719847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:25.720532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:25.721177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:26.169023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:26.185020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:26.186547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:26.187788 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43795c1d-919e-480e-82f6-7332c1c8cdc2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.496601 Oct 12 08:57:26.188357 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1743/3248] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:25 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:26.205106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:26.205784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:26.208059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:26.215291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:26.215800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:26.216243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:26.217124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:26.217648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:26.218324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:26.400260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] validate_networks() for [('0e20b0bd-ac45-475e-baa9-733715fa2691', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:57:26.458661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:26.474539 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-27afb4cb-7ddd-45a1-ad0d-0a99a299be41 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.284898 Oct 12 08:57:26.478229 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1744/3249] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:26 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:26.485098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:26.486424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:26.496062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:26.497616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:26.499109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:26.500074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:26.502512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:26.505679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:26.800041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:26.811838 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c7246ce2-d59f-4bea-951e-d0568256bd84 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1528 microversion: 2.1 time: 0.331836 Oct 12 08:57:26.826461 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1745/3250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:26 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1528 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:26.830674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-59b63709-1787-4e85-98fb-ba77e8722832 req-753ce778-5830-4f0e-aded-8a32cba3d768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad53c17-0b1c-484e-8be6-187774d37cce", "tag": "b04bfce7-248c-49ac-8868-88aa52256bbd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:26.843919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-59b63709-1787-4e85-98fb-ba77e8722832 req-753ce778-5830-4f0e-aded-8a32cba3d768 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:26.844654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-59b63709-1787-4e85-98fb-ba77e8722832 req-753ce778-5830-4f0e-aded-8a32cba3d768 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:26.845336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-59b63709-1787-4e85-98fb-ba77e8722832 req-753ce778-5830-4f0e-aded-8a32cba3d768 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:26.865880 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-59b63709-1787-4e85-98fb-ba77e8722832 req-753ce778-5830-4f0e-aded-8a32cba3d768 service nova] Creating event network-changed:b04bfce7-248c-49ac-8868-88aa52256bbd for instance 0ad53c17-0b1c-484e-8be6-187774d37cce on n-h2-858383-10 Oct 12 08:57:26.871685 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-59b63709-1787-4e85-98fb-ba77e8722832 req-753ce778-5830-4f0e-aded-8a32cba3d768 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052816 Oct 12 08:57:26.873803 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1746/3251] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:26.882159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:26.883209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:26.893166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:26.894351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:26.895207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:26.896243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:26.897873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:26.899009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:26.927831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:27.249843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:57:27.251240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:57:27.251928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:57:27.252694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:57:27.253323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:57:27.275268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:27.276955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:27.277424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:27.280409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:27.280896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:27.281319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:27.310473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Getting quotas for project 21e58c2e8c6c4f06a55edf513222d10b. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:57:27.317865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Getting quotas for user c3acc9fef23b4066aaf89f766ff219f8 and project 21e58c2e8c6c4f06a55edf513222d10b. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:57:27.333715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:57:27.336758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:57:27.424599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:27.430375 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-593c8240-eabf-408f-b4d5-368ad9118608 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.933385 Oct 12 08:57:27.431612 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1506/3252] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:57:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:57:27.434459 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3968da8b-459d-467b-9c1e-4171f69e3616 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1713 microversion: 2.1 time: 0.558790 Oct 12 08:57:27.450552 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1747/3253] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:26 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1713 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:27.457995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:27.458937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:27.464762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:27.466221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:27.466928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:27.467536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:27.468433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:27.469109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:27.469802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:27.471882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:27.523144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:27.523650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:27.532985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:27.534009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:27.534499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:27.536179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:27.861274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:27.882796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:27.887051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:27.888280 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-00280de4-f176-43f4-9137-564502486dfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.436356 Oct 12 08:57:27.889235 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1748/3254] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:27 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:27.905680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43069a9c-c442-4ee1-89ea-ea05aa6c7ab9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:27.907082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43069a9c-c442-4ee1-89ea-ea05aa6c7ab9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:28.022440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43069a9c-c442-4ee1-89ea-ea05aa6c7ab9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:28.035958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43069a9c-c442-4ee1-89ea-ea05aa6c7ab9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:28.047089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43069a9c-c442-4ee1-89ea-ea05aa6c7ab9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:28.048323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43069a9c-c442-4ee1-89ea-ea05aa6c7ab9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1281 microversion: 2.20 time: 0.158054 Oct 12 08:57:28.048832 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1749/3255] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:27 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1281 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:28.070251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:28.070877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:28.087008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:28.087515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:28.087952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:28.089046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:28.089707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:28.090454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:28.399026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:28.408475 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e717017b-af46-4ec5-a10c-60835e313639 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.358401 Oct 12 08:57:28.411400 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1750/3256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:28 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:28.421820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:28.422655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:28.430448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:28.431131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:28.432085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:28.432980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:28.433653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:28.434395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:28.446389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:28.473247 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-49cbb1ca-6ed6-4376-b316-26a880a6cc8b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1308 microversion: 2.1 time: 1.040237 Oct 12 08:57:28.478119 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1507/3257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:27 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1308 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:28.501182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:28.503408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:28.538507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:28.544208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:28.551100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:28.555415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:28.560808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:28.561461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:28.790251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:28.804002 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3de1b024-0d43-445c-ac2a-8c322b0ad85d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.387036 Oct 12 08:57:28.805480 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1751/3258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:28 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:28.915336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:28.916615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:28.925689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:28.927564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:28.928245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:28.929266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:28.929758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:28.930357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.237162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:29.242629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:29.248960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:29.254744 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-63367d88-d70b-45b9-bac5-b0ae6f997ad6 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1645 microversion: 2.1 time: 0.772815 Oct 12 08:57:29.272220 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1508/3259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:28 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1645 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:29.275274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:29.275274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:29.276501 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a388184-2d8f-4101-97fe-f4da71f6ee08 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.365334 Oct 12 08:57:29.277065 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1752/3260] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:28 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:57:29.280667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:29.282751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:29.296894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.297743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.298386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.299822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.302382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.302933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.432053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:29.435694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:29.436314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:29.442098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:29.443834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.445452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.445900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.446772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.447884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.448492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.451361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:29.452511 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c496036-89de-4b49-a711-8aaae0834c3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1333 microversion: 2.20 time: 0.179039 Oct 12 08:57:29.455957 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1509/3261] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:29 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1333 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:29.504012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:29.505373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:29.514850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.516950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.519673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.520607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.521224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.523766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.782172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:29.792828 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6630907-c081-4570-ab6a-21a74b214988 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.361206 Oct 12 08:57:29.801985 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1753/3262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:29 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:29.821113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-edd338be-0fad-4bf8-8d54-27095a6fad20 req-9a048b52-a1ca-4767-8443-59794dc6dbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd619e37-8302-44d0-834b-ab2fec514440", "name": "network-vif-deleted", "tag": "ea1c025a-5f90-4cdd-87a2-602f5c216e8c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:29.850262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edd338be-0fad-4bf8-8d54-27095a6fad20 req-9a048b52-a1ca-4767-8443-59794dc6dbe4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.850821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edd338be-0fad-4bf8-8d54-27095a6fad20 req-9a048b52-a1ca-4767-8443-59794dc6dbe4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.851276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-edd338be-0fad-4bf8-8d54-27095a6fad20 req-9a048b52-a1ca-4767-8443-59794dc6dbe4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.895205 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-edd338be-0fad-4bf8-8d54-27095a6fad20 req-9a048b52-a1ca-4767-8443-59794dc6dbe4 service nova] Creating event network-vif-deleted:ea1c025a-5f90-4cdd-87a2-602f5c216e8c for instance bd619e37-8302-44d0-834b-ab2fec514440 on n-h2-858383-10 Oct 12 08:57:29.906521 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-edd338be-0fad-4bf8-8d54-27095a6fad20 req-9a048b52-a1ca-4767-8443-59794dc6dbe4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103132 Oct 12 08:57:29.909205 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1754/3263] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:29.918954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:29.932293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:29.946635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.947329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.953472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:29.954395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:29.954948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:29.955401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.174247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.187775 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6bbee00e-d7c3-4c93-b299-71024f32b29e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.274886 Oct 12 08:57:30.188999 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1755/3264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:29 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:30.237151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.254209 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-941d8329-383a-4203-a2d3-2586f2402005 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1308 microversion: 2.1 time: 0.754071 Oct 12 08:57:30.269811 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1510/3265] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:29 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1308 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:30.283884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:30.284747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:30.308956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.311726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.312175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.312902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.313297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:30.313416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.313798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.313924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:30.322505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.322996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.323430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.324240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.324685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.325288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.388423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.390223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.390945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.392784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lazy-loading 'fault' on Instance uuid bd619e37-8302-44d0-834b-ab2fec514440 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:57:30.512509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17da5b8cde3a49a5ab97b85a40de4b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a452fe170084e50bdfdb383b0e4f788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.544594 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae244ca2-942c-42c2-aeb7-aa947e144b7c tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 200 len: 1367 microversion: 2.1 time: 0.265454 Oct 12 08:57:30.548081 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1756/3266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:30 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:30.558622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ed346f5c-d9c3-485c-9cb7-71776ef0e091 req-a8daa955-8906-4c26-b9ea-f16908f1b7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06cee8-a199-43e0-b707-d7177639bcd6", "name": "network-vif-plugged", "status": "completed", "tag": "3091c101-3979-4de3-b96a-2ee038190880"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:30.570934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ed346f5c-d9c3-485c-9cb7-71776ef0e091 req-a8daa955-8906-4c26-b9ea-f16908f1b7ca service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.571753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ed346f5c-d9c3-485c-9cb7-71776ef0e091 req-a8daa955-8906-4c26-b9ea-f16908f1b7ca service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.572363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ed346f5c-d9c3-485c-9cb7-71776ef0e091 req-a8daa955-8906-4c26-b9ea-f16908f1b7ca service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.617067 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ed346f5c-d9c3-485c-9cb7-71776ef0e091 req-a8daa955-8906-4c26-b9ea-f16908f1b7ca service nova] Creating event network-vif-plugged:3091c101-3979-4de3-b96a-2ee038190880 for instance fe06cee8-a199-43e0-b707-d7177639bcd6 on n-h1-858383-10 Oct 12 08:57:30.626305 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ed346f5c-d9c3-485c-9cb7-71776ef0e091 req-a8daa955-8906-4c26-b9ea-f16908f1b7ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076920 Oct 12 08:57:30.626942 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1757/3267] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:30.667208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:30.668178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:30.696174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.696941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.697667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.698579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.699740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.701375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.803345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.814546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.826825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.828620 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-75ed4254-5bb5-4176-b8df-fd39689d716f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.528505 Oct 12 08:57:30.829420 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1511/3268] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:30 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:30.850645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:30.851612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:30.871643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.872813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.874905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.875865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:30.878161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:30.878833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:30.898906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.914940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.926934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:30.933185 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a14ba1fa-246f-4548-94d1-87ddfbdfa714 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1339 microversion: 2.20 time: 0.297693 Oct 12 08:57:30.934755 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1758/3269] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:30 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1339 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:31.211736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:31.212773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:31.224047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:31.230805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:31.233014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:31.233974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:31.236415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:31.239525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:31.332915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:31.343361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:31.355378 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c232a50-8a2a-4901-a226-78e21fff64af tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.524631 Oct 12 08:57:31.355973 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1512/3270] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:30 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:31.392363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:31.393010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:31.424630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:31.430335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:31.437277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:31.441228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:31.441781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:31.447908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:31.576512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:31.594789 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02a8e7e4-a3b7-45c2-8ddb-d755c0cc26ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.387457 Oct 12 08:57:31.612138 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1759/3271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:31 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:31.634346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:31.640850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] [instance: bd619e37-8302-44d0-834b-ab2fec514440] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:31.669749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:31.680317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:31.683715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:31.684618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:31.687415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:31.689372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:31.739773 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] HTTP exception thrown: Instance bd619e37-8302-44d0-834b-ab2fec514440 could not be found. Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Request method failure captured: Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 HTTP/1.1 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoEzFgJRhSpMddSivCDSPhuUMd0oTXztWWTmZ_MOQQYyf_xzL-nkjuuafV_SHEN35YjXlrK-1Kj6BI4FQz8Rnp_538ktgWZjkq35j9HClQcWlt7mYtIq7fpVGIsoHFv421Bco7frjzmlzr9JX4HhzOZP_E5YZ2--xeayLCAqHQWPDfI Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 0a452fe170084e50bdfdb383b0e4f788 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestManualDisk-2089892092 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a452fe170084e50bdfdb383b0e4f788"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a452fe170084e50bdfdb383b0e4f788"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a452fe170084e50bdfdb383b0e4f788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a452fe170084e50bdfdb383b0e4f788"}]}] Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestManualDisk-2089892092 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 0a452fe170084e50bdfdb383b0e4f788 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestManualDisk-2089892092 Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestManualDisk-2089892092-project Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 17da5b8cde3a49a5ab97b85a40de4b5c Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestManualDisk-2089892092-project Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance bd619e37-8302-44d0-834b-ab2fec514440 could not be found. Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'bd619e37-8302-44d0-834b-ab2fec514440'} Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd619e37-8302-44d0-834b-ab2fec514440 could not be found. Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd619e37-8302-44d0-834b-ab2fec514440 could not be found. Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:57:31.743614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:57:31.747784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:57:31.747784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:57:31.747784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:57:31.747784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:57:31.747784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:57:31.747784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd619e37-8302-44d0-834b-ab2fec514440 could not be found. Oct 12 08:57:31.747784 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:57:31.750787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Returning 404 to user: Instance bd619e37-8302-44d0-834b-ab2fec514440 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:57:31.752559 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ac15479-8213-4fbd-9423-caffa5bc8942 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440" status: 404 len: 111 microversion: 2.1 time: 0.131054 Oct 12 08:57:31.754309 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1760/3272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:31 2022] GET /compute/v2.1/servers/bd619e37-8302-44d0-834b-ab2fec514440 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:57:31.766660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-837f4ce8-49be-4dd0-9239-a6170800c6d2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] Calling method '.version_select at 0x7f9849405310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:31.807906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-837f4ce8-49be-4dd0-9239-a6170800c6d2 tempest-ServersTestManualDisk-2089892092 tempest-ServersTestManualDisk-2089892092-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437587936" status: 202 len: 0 microversion: 2.1 time: 0.044935 Oct 12 08:57:31.809121 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1761/3273] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 08:57:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437587936 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:57:31.870264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:31.871168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:31.897905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:31.900689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:31.905087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:31.909298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:31.912432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:31.913617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:32.579003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:32.607040 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2cc124bb-bd5c-4d06-80f3-f4c972085c9b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1308 microversion: 2.1 time: 1.249986 Oct 12 08:57:32.630028 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1513/3274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:31 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1308 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:32.638154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:32.639031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:32.647577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:32.648830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:32.649431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:32.650512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:32.651126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:32.651709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:32.683407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:32.694818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:32.696267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:32.697478 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-592848a9-3abd-4b3f-8424-816c1bf6c5a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.837462 Oct 12 08:57:32.712211 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1762/3275] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:31 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:57:32.729691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:32.732382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:32.764456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:32.765166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:32.766659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:32.770315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:32.771024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:32.771646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:32.970671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:32.984627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:32.986503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:32.987893 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3823b347-89e8-4fbc-851d-5889cce62820 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1406 microversion: 2.20 time: 0.356441 Oct 12 08:57:32.989106 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1514/3276] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:32 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:33.008590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:33.009552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:33.023657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:33.024524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:33.025165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:33.025932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:33.026546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:33.027130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:33.253867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:33.267805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6777d52e-0025-45de-9e21-b6dc8a33cf3f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.552327 Oct 12 08:57:33.269287 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1763/3277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:32 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:33.641794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:33.643897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:33.644537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:33.651743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:33.652194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:33.652645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:33.653346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:33.656994 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-495232ed-9567-4bbc-a8e0-400898fe2655 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.666572 Oct 12 08:57:33.662694 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1515/3278] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:32 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:33.663522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:33.664153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:33.726957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:33.727684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:33.740276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:33.741359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:33.742106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:33.743364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:33.744052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:33.746490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:34.420985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:34.459348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f53684e-9f9d-4750-af1d-06abb700393c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1308 microversion: 2.1 time: 0.818815 Oct 12 08:57:34.460564 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1764/3279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:33 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1308 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:34.476614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:34.478547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:34.480221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:34.499480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:34.502725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:34.504771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:34.507563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:34.508016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:34.508740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:34.509757 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7463d303-7578-484d-8733-675f1fbc7447 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.785640 Oct 12 08:57:34.510021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:34.513716 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1516/3280] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:33 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:57:34.519323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:34.524235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:34.533533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:34.539388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:34.542776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:34.543435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:34.544341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:34.546882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:34.547324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:34.959400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:34.977525 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0dda1197-1c95-46a2-95df-0d4d542a60dc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.462179 Oct 12 08:57:34.998949 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1517/3281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:34 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:35.008812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a35f4275-f59e-45af-9766-e768d8a21111 req-28b25cca-94d2-473c-b1e6-72a3a0a3a4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad53c17-0b1c-484e-8be6-187774d37cce", "name": "network-vif-plugged", "status": "completed", "tag": "b04bfce7-248c-49ac-8868-88aa52256bbd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:35.032332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a35f4275-f59e-45af-9766-e768d8a21111 req-28b25cca-94d2-473c-b1e6-72a3a0a3a4cd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:35.033647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a35f4275-f59e-45af-9766-e768d8a21111 req-28b25cca-94d2-473c-b1e6-72a3a0a3a4cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:35.034352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a35f4275-f59e-45af-9766-e768d8a21111 req-28b25cca-94d2-473c-b1e6-72a3a0a3a4cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:35.050304 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a35f4275-f59e-45af-9766-e768d8a21111 req-28b25cca-94d2-473c-b1e6-72a3a0a3a4cd service nova] Creating event network-vif-plugged:b04bfce7-248c-49ac-8868-88aa52256bbd for instance 0ad53c17-0b1c-484e-8be6-187774d37cce on n-h2-858383-10 Oct 12 08:57:35.069016 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a35f4275-f59e-45af-9766-e768d8a21111 req-28b25cca-94d2-473c-b1e6-72a3a0a3a4cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056038 Oct 12 08:57:35.078970 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1518/3282] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:35.087175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:35.089373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:35.097146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:35.099862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:35.100664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:35.101338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:35.102504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:35.103037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:35.103528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:35.116624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:35.123522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:35.131945 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6776965-3af2-4d57-ba88-d860a6847ec7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1406 microversion: 2.20 time: 0.669996 Oct 12 08:57:35.147608 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1765/3283] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:34 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1406 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:35.158902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ae6a04e2-f63c-460a-a559-feb57f966bae req-e8b36223-b159-4869-86da-b553d8f30550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1acdb6-1970-410c-a904-67636bdc3d68", "tag": "6e76f914-e39e-4490-8567-4fcc14247a71"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:35.178071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ae6a04e2-f63c-460a-a559-feb57f966bae req-e8b36223-b159-4869-86da-b553d8f30550 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:35.182104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ae6a04e2-f63c-460a-a559-feb57f966bae req-e8b36223-b159-4869-86da-b553d8f30550 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:35.182805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ae6a04e2-f63c-460a-a559-feb57f966bae req-e8b36223-b159-4869-86da-b553d8f30550 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:35.200529 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ae6a04e2-f63c-460a-a559-feb57f966bae req-e8b36223-b159-4869-86da-b553d8f30550 service nova] Creating event network-changed:6e76f914-e39e-4490-8567-4fcc14247a71 for instance 4d1acdb6-1970-410c-a904-67636bdc3d68 on n-h1-858383-10 Oct 12 08:57:35.207729 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ae6a04e2-f63c-460a-a559-feb57f966bae req-e8b36223-b159-4869-86da-b553d8f30550 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057462 Oct 12 08:57:35.208955 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1766/3284] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:35.496555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:35.499693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:35.512728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:35.513667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:35.514345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:35.515747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:35.516369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:35.517791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:35.705071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:35.734157 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4fa809be-4deb-4b26-a20d-21592ac133cd tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.652998 Oct 12 08:57:35.756942 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1519/3285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:35 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:35.764986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:35.766019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:35.774267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:35.775023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:35.775728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:35.776608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:35.777316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:35.777971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:36.249682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:36.264140 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c491d84f-e8d9-4e99-9e73-de057344937e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1308 microversion: 2.1 time: 0.772189 Oct 12 08:57:36.279966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1767/3286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:35 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1308 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:36.304086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:36.305063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:36.334815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:36.340996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:36.344728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:36.353037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:36.353979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:36.358130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:36.410108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:36.527896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:36.563234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:36.571358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:36.572587 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-96adb071-a8a4-4253-94d4-4cbff2f2623a tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.813426 Oct 12 08:57:36.621645 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1520/3287] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:35 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:36.628343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:36.641326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:36.662233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:36.663467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:36.664555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:36.666242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:36.668003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:36.671630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.176915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:37.190017 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a346441-70dd-44e0-bd08-5ecf2a958c39 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.906103 Oct 12 08:57:37.196576 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1768/3288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:36 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:37.205790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:37.206420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:37.217649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:37.229554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:37.235166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:37.236388 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e38eb48d-9e88-4528-a583-25a4fc9af14d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1406 microversion: 2.20 time: 0.611973 Oct 12 08:57:37.245299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.245871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.246326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.247052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.247517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.247946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.255594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1521/3289] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:36 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1406 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:37.274992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e3a6ce0e-c71b-4462-82f7-07f64f2d962b req-ca070d94-4ef4-4f2b-91b0-25e297029e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617dc413-650f-4340-933d-6fbf879240bf", "name": "network-vif-unplugged", "status": "completed", "tag": "238873e3-bf59-47b5-bfd5-f3b69a1232cd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:37.297658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:37.306100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e3a6ce0e-c71b-4462-82f7-07f64f2d962b req-ca070d94-4ef4-4f2b-91b0-25e297029e60 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.306871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e3a6ce0e-c71b-4462-82f7-07f64f2d962b req-ca070d94-4ef4-4f2b-91b0-25e297029e60 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.307656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e3a6ce0e-c71b-4462-82f7-07f64f2d962b req-ca070d94-4ef4-4f2b-91b0-25e297029e60 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.339277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=20 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:37.343131 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e3a6ce0e-c71b-4462-82f7-07f64f2d962b req-ca070d94-4ef4-4f2b-91b0-25e297029e60 service nova] Creating event network-vif-unplugged:238873e3-bf59-47b5-bfd5-f3b69a1232cd for instance 617dc413-650f-4340-933d-6fbf879240bf on n-h1-858383-10 Oct 12 08:57:37.349164 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e3a6ce0e-c71b-4462-82f7-07f64f2d962b req-ca070d94-4ef4-4f2b-91b0-25e297029e60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078129 Oct 12 08:57:37.350515 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1522/3290] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:37.356883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:37.363518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:37.371938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.372676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.374101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.375476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.376204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.376815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.572050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:37.588182 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10774535-22a7-41d6-9572-bb99644b0e05 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1488 microversion: 2.1 time: 0.236222 Oct 12 08:57:37.589377 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1523/3291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:37 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1488 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:37.611034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:37.612071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:37.619062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:37.619564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.620283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.623058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.624892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.625620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.626274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.627655 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec5689cf-f54c-448e-82bb-ec93b8908651 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.429679 Oct 12 08:57:37.641616 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1769/3292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:37 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:37.646846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:37.647399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:37.666419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.666917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.667367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.668079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.668536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.668969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.787249 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa586b65-1a50-4c3d-8f8e-6115d16fd338 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce/action" status: 202 len: 0 microversion: 2.1 time: 0.144047 Oct 12 08:57:37.791028 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1770/3293] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:57:37 2022] POST /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:57:37.796924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:37.806618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:37.823629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.825227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.825964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:37.826907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:37.827563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:37.828207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:38.027857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:38.425742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:38.434055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:38.436796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9bcd174c-8453-4dd7-ac41-a0df6dde2cda tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1493 microversion: 2.1 time: 0.644172 Oct 12 08:57:38.446414 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1771/3294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:37 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1493 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:38.451641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:38.459815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:38.460074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:38.467409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:38.468652 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aedf3b63-c6f3-4888-90a4-5fbc2ad82dfd tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.862465 Oct 12 08:57:38.477218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:38.478084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:38.478743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:38.479681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:38.480353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:38.480977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:38.491707 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1524/3295] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:37 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:38.511773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:38.512782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:38.521665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:38.522428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:38.523067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:38.528177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:38.528875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:38.529503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:38.861064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:38.875670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:38.877462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:38.878845 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86df8ebc-37b0-407f-84f6-3857af7eefb4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1406 microversion: 2.20 time: 0.385463 Oct 12 08:57:38.882240 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1525/3296] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:38 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:38.894834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:38.899265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:38.910764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:38.913293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:38.914140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:38.919452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:38.920143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:38.920927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:38.924213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:38.934569 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3cc86082-bb65-4f1f-8165-464214758e95 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.486739 Oct 12 08:57:38.938891 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1772/3297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:38 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:39.318565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:39.321298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:39.339175 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6efcf00-2d6a-4c23-b2c9-8ddd51dd7f29 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.455122 Oct 12 08:57:39.340380 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1526/3298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:38 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:39.417427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-97fca10c-17ce-4044-9a2d-2aca3445c9a7 req-98ab333c-34e2-497b-9d4e-b3465b25c1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617dc413-650f-4340-933d-6fbf879240bf", "tag": "238873e3-bf59-47b5-bfd5-f3b69a1232cd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:39.434599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-97fca10c-17ce-4044-9a2d-2aca3445c9a7 req-98ab333c-34e2-497b-9d4e-b3465b25c1e7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:39.437767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-97fca10c-17ce-4044-9a2d-2aca3445c9a7 req-98ab333c-34e2-497b-9d4e-b3465b25c1e7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:39.438499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-97fca10c-17ce-4044-9a2d-2aca3445c9a7 req-98ab333c-34e2-497b-9d4e-b3465b25c1e7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:39.464739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-97fca10c-17ce-4044-9a2d-2aca3445c9a7 req-98ab333c-34e2-497b-9d4e-b3465b25c1e7 service nova] Creating event network-changed:238873e3-bf59-47b5-bfd5-f3b69a1232cd for instance 617dc413-650f-4340-933d-6fbf879240bf on n-h1-858383-10 Oct 12 08:57:39.468448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:39.469289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:39.478405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:39.480401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:39.481095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:39.482093 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-97fca10c-17ce-4044-9a2d-2aca3445c9a7 req-98ab333c-34e2-497b-9d4e-b3465b25c1e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068291 Oct 12 08:57:39.482957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:39.483230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1773/3299] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:39.485978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:39.486594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:39.500747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:39.501923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:39.513385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:39.514064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:39.520627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:39.521712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:39.522331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:39.522883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:39.953599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:39.967537 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-484a086d-7fa7-45b2-9d11-8a048648ef49 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 200 len: 1473 microversion: 2.1 time: 0.503163 Oct 12 08:57:39.968444 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1527/3300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:39 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 1473 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:39.976644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:39.987682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:40.009865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:40.012525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:40.014976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:40.015937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:40.017886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:40.018487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:40.150491 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f2172d75-8ffa-401e-866a-ec0d3edc4901 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.180735 Oct 12 08:57:40.151865 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1528/3301] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:57:39 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:57:40.175187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:40.178398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:40.230712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:40.232552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:40.235760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:40.236890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:40.240369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:40.242168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:40.728632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:40.740957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:40.743283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:40.745494 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3dc89e9a-6ef3-4f7c-9794-b067485b8751 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1406 microversion: 2.20 time: 0.591804 Oct 12 08:57:40.774270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:40.781950 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1529/3302] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:40 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1406 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:40.798980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:40.799552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:40.802684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:40.803595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:40.807200 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-adc0db6e-a0a9-4bb6-bb18-eb5c59935cfa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 1.310740 Oct 12 08:57:40.810220 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1774/3303] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:39 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:40.827645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:40.829686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:40.830971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:40.832178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:40.832786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1860252568"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:40.836016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:40.837203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:40.841583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:40.863079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:40.863760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:40.864348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:40.870169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:40.871154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:40.871759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:41.216145 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c824a8fe-ff64-4449-ae64-0a91f37ef3c2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce/action" status: 202 len: 0 microversion: 2.1 time: 0.403704 Oct 12 08:57:41.217665 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1775/3304] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:57:40 2022] POST /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:57:41.231702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:41.232814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:41.265570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:41.268721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:41.271882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:41.275903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:41.278274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:41.279871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:41.328871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:41.351222 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b8c995d-9e85-4c93-a465-3a60fea0069f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.567830 Oct 12 08:57:41.351848 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1530/3305] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:40 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:41.360882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:41.367081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:41.390755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:41.401113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:41.403130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:41.406535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:41.408304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:41.409056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:41.925107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:41.940302 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db565208-33c4-48e0-a726-9072a88ad142 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.587260 Oct 12 08:57:41.950476 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1531/3306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:41 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:41.957240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f8dca0aa-c295-4e62-b4fa-39cd06d05f8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843ee0d30>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:42.036559 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f8dca0aa-c295-4e62-b4fa-39cd06d05f8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.094185 Oct 12 08:57:42.044767 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1532/3307] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:41 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:42.056743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:42.057369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:42.074369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:42.076318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:42.077301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:42.079317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:42.085648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:42.086381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:42.205637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:42.222503 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c8ba929d-c1fb-4201-849d-756afdd8bad5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1672 microversion: 2.1 time: 1.002408 Oct 12 08:57:42.242575 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1776/3308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:41 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1672 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:42.250919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:42.252837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:42.261523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:42.262946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:42.263592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:42.264497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:42.265791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:42.266444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:42.504961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:42.518439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:42.520134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:42.524036 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-367b5945-cc80-418a-9907-441dcc5e429b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1406 microversion: 2.20 time: 0.475547 Oct 12 08:57:42.537556 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1533/3309] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:42 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:42.537556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:42.537556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:42.546352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:42.546352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:42.546352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:42.546352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:42.546352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:42.546352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:42.845015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:42.880131 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fcf641d0-d65c-427d-bd04-ea4a8144e3ca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.352346 Oct 12 08:57:42.882954 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1534/3310] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:42 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:42.981021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:42.985953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:42.995106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:42.995884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:42.996505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:42.997375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:42.998000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:42.998572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:43.008440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:43.035716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:43.038114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:43.041978 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b37f4806-c8f7-4cc8-8851-4501c6b1b72c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.797854 Oct 12 08:57:43.050291 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1777/3311] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:42 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:43.074217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e10bdab5-e31f-4fa8-be8b-1a048717c8c3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984cc00af0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:43.190755 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e10bdab5-e31f-4fa8-be8b-1a048717c8c3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.127676 Oct 12 08:57:43.191532 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1778/3312] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:43 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:43.258974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:43.261801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:43.272664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:43.277313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:43.280336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:43.281510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:43.283887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:43.286079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:43.535401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:43.546532 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e9daa109-405c-4969-80b0-1a164f551b45 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.291576 Oct 12 08:57:43.561617 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1779/3313] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:43 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:43.576640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:43.577524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:43.590137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:43.590896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:43.591885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:43.592754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:43.593603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:43.594197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:43.699044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:43.717920 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b0325d1e-797c-4e29-8841-c425c54739f8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.748660 Oct 12 08:57:43.720110 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1535/3314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:42 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:43.908569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:43.909742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:43.919295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:43.922948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:43.924665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:43.926647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:43.929031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:43.930144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:43.931956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:44.273900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:44.287459 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f22d654-65ff-4129-81af-f9a0533dd675 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.380252 Oct 12 08:57:44.288712 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1536/3315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:43 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:44.299142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-573234e0-be47-42b2-b269-a27440f4e0b7 req-281e0e78-4009-4755-8cc4-60fec06e36f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1acdb6-1970-410c-a904-67636bdc3d68", "name": "network-vif-plugged", "status": "completed", "tag": "6e76f914-e39e-4490-8567-4fcc14247a71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:44.318714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-573234e0-be47-42b2-b269-a27440f4e0b7 req-281e0e78-4009-4755-8cc4-60fec06e36f3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:44.319474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-573234e0-be47-42b2-b269-a27440f4e0b7 req-281e0e78-4009-4755-8cc4-60fec06e36f3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:44.320073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-573234e0-be47-42b2-b269-a27440f4e0b7 req-281e0e78-4009-4755-8cc4-60fec06e36f3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:44.360376 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-573234e0-be47-42b2-b269-a27440f4e0b7 req-281e0e78-4009-4755-8cc4-60fec06e36f3 service nova] Creating event network-vif-plugged:6e76f914-e39e-4490-8567-4fcc14247a71 for instance 4d1acdb6-1970-410c-a904-67636bdc3d68 on n-h1-858383-10 Oct 12 08:57:44.377726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:44.379401 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-573234e0-be47-42b2-b269-a27440f4e0b7 req-281e0e78-4009-4755-8cc4-60fec06e36f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084690 Oct 12 08:57:44.380084 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1537/3316] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:44.395937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:44.397216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:44.397356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:44.398272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:44.398606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3cdc921b-3699-40d3-92c9-bf3d64e4fe94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1406 microversion: 2.20 time: 0.835697 Oct 12 08:57:44.410627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:44.411415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:44.412010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:44.412885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:44.413567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:44.414182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:44.422990 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1780/3317] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:43 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1406 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:44.435478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4225fd4d-6bdd-44e2-97de-22516e37641b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984804aaf0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:44.518422 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4225fd4d-6bdd-44e2-97de-22516e37641b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.094118 Oct 12 08:57:44.519386 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1781/3318] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:44 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:44.746615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:44.747392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:44.765639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:44.766140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:44.770912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:44.771779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:44.772266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:44.775000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:45.319774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:45.336250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:45.341762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:45.345196 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ead3506-063e-404a-a10b-f5cc8398cd47 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.963281 Oct 12 08:57:45.347347 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1538/3319] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:44 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:45.357415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:45.358839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:45.366792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:45.367743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:45.368502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:45.369666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:45.370486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:45.371166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:45.643592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:45.656553 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f404f601-a2d2-4909-be41-9816193ae7b9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.305986 Oct 12 08:57:45.658800 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1539/3320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:45 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:45.670031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:45.670925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:45.700030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:45.700549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:45.701224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:45.703498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:45.704347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:45.704970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:45.953205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:45.968568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd4ca27f-2f90-44ba-8efa-90725c2cdd65 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 1.226023 Oct 12 08:57:45.974713 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1782/3321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:44 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:45.983566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2f0c776-c8df-4db8-91aa-7301c5f1faa1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984cc374c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:46.092887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:46.101863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:46.103290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:46.130641 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efb8921b-e977-4d9c-93b2-d29120643a13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1406 microversion: 2.20 time: 0.469193 Oct 12 08:57:46.131568 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1540/3322] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:45 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:46.372129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:46.372795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:46.381646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:46.382140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:46.397581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:46.398451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:46.398935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:46.399474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:46.794628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:46.818696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:46.841250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:46.846435 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c37e3acc-5d07-445e-bc2c-3e52ce3bc324 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.478097 Oct 12 08:57:46.850904 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1541/3323] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:46 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:46.858615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:46.865824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:46.891388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:46.907667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:46.908646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:46.910018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:46.910707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:46.911457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:47.432445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:47.452718 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9df3be90-4e71-425c-8f10-26de46ec11f5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.591354 Oct 12 08:57:47.470607 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1542/3324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:46 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:47.494729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:47.495854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:47.523050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:47.532495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:47.534146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:47.535137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:47.538923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:47.539581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:47.889563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:47.898972 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-edd77e29-5b0c-4ed1-9530-3ddb74ecc8f9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.420428 Oct 12 08:57:47.901696 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1543/3325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:47 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:47.918743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:47.919630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:47.935342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:47.936249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:47.936902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:47.939706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:47.940425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:47.942233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:47.948812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:48.319891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:48.337977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:48.342611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:48.344566 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c39cc4e5-52c1-4ae6-bace-51509e7ec3cb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1599 microversion: 2.20 time: 0.441718 Oct 12 08:57:48.380645 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1544/3326] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:47 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1599 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:48.396772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:48.397636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:48.429338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:48.435145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:48.436231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:48.438188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:48.440470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:48.441228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:48.820263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:48.830585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:48.839428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:48.842266 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc201a74-742a-493b-99ca-009909b8733e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.460117 Oct 12 08:57:48.864935 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1545/3327] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:48 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:48.880544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:48.881328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:48.887769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:48.888822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:48.889413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:48.891171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:48.895205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:48.895867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:49.076984 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0cf6c933-ffc3-46ac-ac8c-7af30eac52ac tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.210631 Oct 12 08:57:49.087484 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1546/3328] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 12 08:57:48 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:57:49.496075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1644049613", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:51.713410 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2f0c776-c8df-4db8-91aa-7301c5f1faa1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 5.737445 Oct 12 08:57:51.723304 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1783/3329] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:45 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 5748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:51.749797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:51.751335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:51.759217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:51.764090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:51.764874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:51.765870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:51.768107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:51.768831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:51.787116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] validate_networks() for [('5e1465ee-0d75-4b69-86e4-f265ae631c06', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:57:52.695705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:52.704962 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69992757-aa1d-46bb-a736-8bd229f7ff45 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1716 microversion: 2.1 time: 0.979586 Oct 12 08:57:52.708421 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1784/3330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:51 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1716 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:52.719944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:52.721196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:52.753389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:52.753939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:52.754426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:52.755242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:52.755709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:52.756146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:53.301241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:57:53.301925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:57:53.302241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:57:53.302836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:57:53.303419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:57:53.328198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:53.336139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:53.338786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:53.341035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:53.341495 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-571be6e9-920b-465a-88fd-e1ea73f03e5e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1523 microversion: 2.1 time: 0.629156 Oct 12 08:57:53.343791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:53.344261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:53.344494 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1785/3331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:52 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1523 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:53.344893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:53.353178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:53.358256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:53.399613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:53.401550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:53.406664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:53.408425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:53.409278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:53.410631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:53.414842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Getting quotas for project e09f0eadea244ac2aef5d9f014cb3892. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:57:53.428816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Getting quotas for user 07268ce32b9446c981f83e6e92bee533 and project e09f0eadea244ac2aef5d9f014cb3892. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:57:53.461726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:57:53.464640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:57:53.502618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:53.614591 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dcd44fda-deb4-407b-a4d7-d423a52c1267 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.525651 Oct 12 08:57:53.615585 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1547/3332] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:57:53.625726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a055b6a4-5d8b-4bb1-9428-42429805837a req-95e1f14c-f2ee-4fd9-a20d-ad33f610933e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad53c17-0b1c-484e-8be6-187774d37cce", "name": "network-vif-plugged", "status": "completed", "tag": "b04bfce7-248c-49ac-8868-88aa52256bbd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:53.647954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a055b6a4-5d8b-4bb1-9428-42429805837a req-95e1f14c-f2ee-4fd9-a20d-ad33f610933e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:53.666261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a055b6a4-5d8b-4bb1-9428-42429805837a req-95e1f14c-f2ee-4fd9-a20d-ad33f610933e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:53.667037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a055b6a4-5d8b-4bb1-9428-42429805837a req-95e1f14c-f2ee-4fd9-a20d-ad33f610933e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:53.693516 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a055b6a4-5d8b-4bb1-9428-42429805837a req-95e1f14c-f2ee-4fd9-a20d-ad33f610933e service nova] Creating event network-vif-plugged:b04bfce7-248c-49ac-8868-88aa52256bbd for instance 0ad53c17-0b1c-484e-8be6-187774d37cce on n-h2-858383-10 Oct 12 08:57:53.707229 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a055b6a4-5d8b-4bb1-9428-42429805837a req-95e1f14c-f2ee-4fd9-a20d-ad33f610933e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090373 Oct 12 08:57:53.708467 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1548/3333] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:53.718576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d219689c-ba20-4187-aa57-3cba06bb6f0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843ecd8b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:53.826794 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d219689c-ba20-4187-aa57-3cba06bb6f0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.116898 Oct 12 08:57:53.827463 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1549/3334] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:53 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:53.832228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-6ca98ded-388c-4528-9030-23e1d42b0e6a req-9f225054-8320-4692-8a93-ec053beaa1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1acdb6-1970-410c-a904-67636bdc3d68", "tag": "6e76f914-e39e-4490-8567-4fcc14247a71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:57:53.862529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ca98ded-388c-4528-9030-23e1d42b0e6a req-9f225054-8320-4692-8a93-ec053beaa1d0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:53.869685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ca98ded-388c-4528-9030-23e1d42b0e6a req-9f225054-8320-4692-8a93-ec053beaa1d0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:53.870395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6ca98ded-388c-4528-9030-23e1d42b0e6a req-9f225054-8320-4692-8a93-ec053beaa1d0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:53.902662 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-6ca98ded-388c-4528-9030-23e1d42b0e6a req-9f225054-8320-4692-8a93-ec053beaa1d0 service nova] Creating event network-changed:6e76f914-e39e-4490-8567-4fcc14247a71 for instance 4d1acdb6-1970-410c-a904-67636bdc3d68 on n-h1-858383-10 Oct 12 08:57:53.910566 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-6ca98ded-388c-4528-9030-23e1d42b0e6a req-9f225054-8320-4692-8a93-ec053beaa1d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081749 Oct 12 08:57:53.911656 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1550/3335] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:53.954407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-38e8fd8a-cb72-468f-8c38-c369e9752881 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:53.958702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-38e8fd8a-cb72-468f-8c38-c369e9752881 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:54.109419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:54.126249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:54.131210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:54.133551 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1bdae8e7-4029-40de-aee9-3735cc04708c tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.787432 Oct 12 08:57:54.134700 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1786/3336] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:53 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:54.160287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:54.162109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:54.183561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:54.184408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:54.185317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:54.186767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:54.187439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:54.188935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:54.516265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:54.527652 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3bf3aa8d-7651-4b61-a228-47c11768c518 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1706 microversion: 2.1 time: 0.391247 Oct 12 08:57:54.535865 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1787/3337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:54 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1706 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:54.542301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:54.542465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-38e8fd8a-cb72-468f-8c38-c369e9752881 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:54.553304 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-38e8fd8a-cb72-468f-8c38-c369e9752881 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1217 microversion: 2.1 time: 0.640311 Oct 12 08:57:54.559553 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1551/3338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:53 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1217 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:54.560260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:54.575263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54e3d861-ca6a-4ade-bf5a-5d0a9311e0d3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '.version_select at 0x7f9843f04820>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:54.582252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:54.584249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:54.587530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:54.588746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:54.589634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:54.593136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:54.600901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54e3d861-ca6a-4ade-bf5a-5d0a9311e0d3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:54.603260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54e3d861-ca6a-4ade-bf5a-5d0a9311e0d3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:54.603816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54e3d861-ca6a-4ade-bf5a-5d0a9311e0d3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:54.652046 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54e3d861-ca6a-4ade-bf5a-5d0a9311e0d3 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1180 microversion: 2.1 time: 0.085848 Oct 12 08:57:54.656036 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1552/3339] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:57:54 2022] GET /compute/v2.1/os-migrations => generated 1180 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:54.679210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:54.684340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:54.708669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:54.714263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:54.718101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:54.722092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:54.725233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:54.726971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:55.015503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:55.028857 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-131838d1-553b-4c89-bcd8-e2b644b0d765 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1505 microversion: 2.1 time: 0.488077 Oct 12 08:57:55.030213 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1788/3340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:54 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:55.041590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c20ae160-c384-4498-b616-d6058e3e0bd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984cc7d700>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:55.147930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c20ae160-c384-4498-b616-d6058e3e0bd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.116283 Oct 12 08:57:55.148821 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1789/3341] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:55 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:55.168168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:55.182158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:55.222442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:55.223061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:55.224647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:55.226309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:55.227693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:55.228977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:55.494670 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-00ec0b4e-15f4-430d-9eb0-6cb0dcd12e04 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1859 microversion: 2.1 time: 0.829122 Oct 12 08:57:55.496065 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1553/3342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:54 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1859 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:55.521258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:55.522881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:55.533737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:55.534272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:55.534705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:55.535410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:55.541958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:55.541958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:56.355480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:56.395711 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-625be155-c6ad-480c-8bb9-0bfbc7666db8 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1859 microversion: 2.1 time: 0.879182 Oct 12 08:57:56.396621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:56.415110 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1554/3343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:55 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1859 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:57:56.421799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:56.430728 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc7c924c-2720-49ac-a863-cce694b60878 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 1.268311 Oct 12 08:57:56.449192 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1790/3344] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:55 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:56.468294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:56.468984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:56.487902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:56.488807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:56.506296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:57:56.513382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:56.518005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:56.519469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:56.523779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:56.530373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:56.541461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:56.541671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:56.541671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:56.541671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:56.541671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:56.542958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:56.544079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:56.721761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:56.740348 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3736e848-8805-4816-a054-c07926d58dd0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1287 microversion: 2.1 time: 0.322795 Oct 12 08:57:56.741770 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1555/3345] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:56 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1287 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:56.748235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-80e41e57-20f8-4d7e-9786-a5bc33e7b887 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843ed3160>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:56.845878 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-80e41e57-20f8-4d7e-9786-a5bc33e7b887 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.102693 Oct 12 08:57:56.848176 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1556/3346] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:56 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:56.864272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:56.865024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:56.879953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:56.880520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:56.880964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:56.881754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:56.882205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:56.882636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:56.985907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:57.000083 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b4acccf2-1a52-443b-bd7d-4b8dba0f96c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1505 microversion: 2.1 time: 0.548246 Oct 12 08:57:57.018112 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1791/3347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:56 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:57.127163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lazy-loading 'services' on Instance uuid 617dc413-650f-4340-933d-6fbf879240bf {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:57:57.315282 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8096dff1-15a8-4ec1-b77b-49e24f3d1ba7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "DELETE /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments/030ac370-5a58-4d71-bbf1-6423d42f2cf8" status: 202 len: 0 microversion: 2.1 time: 0.463969 Oct 12 08:57:57.319284 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1557/3348] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 08:57:56 2022] DELETE /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments/030ac370-5a58-4d71-bbf1-6423d42f2cf8 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:57:57.326633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:57.329582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:57.343926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:57.344459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:57.360158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:57.363411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:57.363966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:57.368401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:57.452683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2bc611a6-5657-434f-910c-2953ce85ec0a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130657 Oct 12 08:57:57.455356 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1792/3349] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:57:57 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:57:57.469327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:57.470560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:57.483315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:57.488107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:57.488877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:57.490088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:57.490699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:57.492863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:57.770855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:57.771759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:57.794213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:57.794710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:57.795146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:57.795876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:57.796328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:57.796752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:57.968055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:57.991621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:57.993095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:57.994456 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed66a984-4f36-442c-b3a2-e1b780eb7737 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.531053 Oct 12 08:57:58.013492 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1558/3350] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:57 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:58.032820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66116819-fb44-40f7-9b89-f2785252a4ab tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843ee0e50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:58.068560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:58.102539 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-44055877-e211-4221-a5fc-6eb05a064a72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1275 microversion: 2.1 time: 0.338514 Oct 12 08:57:58.106925 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1793/3351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:57 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:58.126653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:58.127987 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-66116819-fb44-40f7-9b89-f2785252a4ab tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.112550 Oct 12 08:57:58.128133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:58.129755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1559/3352] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:58 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:58.158526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:58.158904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:58.161824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:58.162617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:58.163085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:58.167405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:58.469996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:58.475046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:58.502345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:58.503369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:58.511139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:58.511876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:58.514620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:58.514760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9d211a5-2554-4d14-a8b8-24a30572c0b5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1505 microversion: 2.1 time: 0.403041 Oct 12 08:57:58.515306 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1794/3353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:58 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:57:58.518713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:58.519541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:58.632992 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d4b2bdc-a260-4c02-9741-c861bcaef512 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170386 Oct 12 08:57:58.634965 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1560/3354] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:57:58 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:57:59.029086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:59.029686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:59.064208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:59.064727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:59.065217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:59.078007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:59.078502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:59.085812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:59.134184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:59.135135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:57:59.154548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:59.155410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:59.156215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:59.157179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:57:59.159577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:57:59.160536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:57:59.881507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:59.897116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:59.898608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:57:59.904008 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0e2fc62-2fb7-48d3-b1d9-f71fb6886778 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.880556 Oct 12 08:57:59.904965 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1795/3355] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:57:59 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:57:59.913862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f598575d-6547-44bf-8727-708934ba0ca5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843fcbd30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:57:59.991181 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f598575d-6547-44bf-8727-708934ba0ca5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.084622 Oct 12 08:57:59.992425 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1796/3356] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:57:59 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:00.006188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:00.008744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:00.027427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:00.028435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:00.029051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:00.029967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:00.030580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:00.031170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:00.044452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:00.057378 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d9140be-9a1d-41a8-aff8-da5f55138519 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.927743 Oct 12 08:58:00.076285 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1561/3357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:59 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:00.081951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:00.084499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:00.092392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:00.093147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:00.093797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:00.094752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:00.095369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:00.095959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:00.182779 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6cd6175e-56c2-4ba0-a4c2-aef449908597 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104889 Oct 12 08:58:00.198005 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1562/3358] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:58:00 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:00.373109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:00.385972 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-575a3f3c-4299-4794-a75a-cf7f1664c1b2 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 200 len: 1448 microversion: 2.1 time: 0.390798 Oct 12 08:58:00.389549 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1797/3359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:57:59 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 1448 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:00.416463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:00.417305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:00.427772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:00.428452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:00.429134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:00.434938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:00.435639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:00.436733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:00.501956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:58:00.523973 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.compute.api [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Working on deleting snapshot 062de729-fa22-4077-995c-3daca61e1b50 from shelved instance... Oct 12 08:58:00.937680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:00.938527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:00.951576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:00.958291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:00.961129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:00.963515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:00.964322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:00.965063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:01.579273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:01.596320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:01.598420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:01.602896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8ffbbfd0-7f7c-4dd9-bd44-b7250743330b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.669564 Oct 12 08:58:01.603474 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1798/3360] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:00 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:01.618527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0233f718-bb9a-4fe6-a62a-80645a3dc21a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984cbc3f70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:02.065596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Doing local delete in cell 0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) {{(pid=127007) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 12 08:58:02.070990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:02.071752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:02.072270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:02.072785 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.compute.api [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 12 08:58:02.073370 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0233f718-bb9a-4fe6-a62a-80645a3dc21a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.462899 Oct 12 08:58:02.074012 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1799/3361] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:58:01 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:02.085416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] deallocate_for_instance() {{(pid=127007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 12 08:58:02.104234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:02.117000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:02.131015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:02.140668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:02.142931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:02.143883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:02.145896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:02.148541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:02.366610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:02.374926 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-65155e26-cd99-4edc-9331-9afc8d58cc32 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.294548 Oct 12 08:58:02.377384 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1800/3362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:02 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:02.382402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:02.386252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:02.393513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:02.394239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:02.394843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:02.395724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:02.396333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:02.396928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:02.471343 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb988a6e-3d2b-4ac2-8f70-b530671c694a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092498 Oct 12 08:58:02.481705 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1801/3363] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:58:02 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:02.636267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:02.636907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:02.648139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:02.648536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:02.648981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:02.649727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:02.650182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:02.650604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:02.945108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:02.957619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:02.959652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:02.961119 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c9c59bae-6e70-4fda-a71b-afbdd84e26b5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.328754 Oct 12 08:58:02.963000 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1802/3364] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:02 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:03.090426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36e07e06-3256-4ad6-978b-9a450115621f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848bb9d30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:03.157803 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-36e07e06-3256-4ad6-978b-9a450115621f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.071234 Oct 12 08:58:03.159507 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1803/3365] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:58:03 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:03.384956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:03.402520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:03.403263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:03.411289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:03.411805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:03.412255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:03.420963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:03.421408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:03.422618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:03.765246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:03.779933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-191f81d6-846b-4517-ad79-7750cadfc9ef tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.381219 Oct 12 08:58:03.782252 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1804/3366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:03 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:03.794514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:03.797049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:03.810933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:03.813514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:03.817546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:03.818498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:03.819119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:03.819863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:03.893833 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-facc1c82-be55-4fac-9d75-381945d9455a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107625 Oct 12 08:58:03.899283 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1805/3367] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:58:03 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:03.904179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-751a0127-dd38-4de8-b671-f545131d89d4 req-d048331f-aa62-4171-84d7-8c053725e0fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a870435b-8aa5-456d-b0ca-477ee2201dbb", "tag": "100f519d-4457-4d8b-acb1-e0e088317a35"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:03.933746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-751a0127-dd38-4de8-b671-f545131d89d4 req-d048331f-aa62-4171-84d7-8c053725e0fd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:03.934540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-751a0127-dd38-4de8-b671-f545131d89d4 req-d048331f-aa62-4171-84d7-8c053725e0fd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:03.935176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-751a0127-dd38-4de8-b671-f545131d89d4 req-d048331f-aa62-4171-84d7-8c053725e0fd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:03.955855 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-751a0127-dd38-4de8-b671-f545131d89d4 req-d048331f-aa62-4171-84d7-8c053725e0fd service nova] Creating event network-changed:100f519d-4457-4d8b-acb1-e0e088317a35 for instance a870435b-8aa5-456d-b0ca-477ee2201dbb on n-h2-858383-10 Oct 12 08:58:03.970236 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-751a0127-dd38-4de8-b671-f545131d89d4 req-d048331f-aa62-4171-84d7-8c053725e0fd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069336 Oct 12 08:58:03.973485 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1806/3368] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:03.993622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:03.994680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:04.005531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:04.007945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:04.008475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:04.009302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:04.009856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:04.010359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:04.305327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Updating instance_info_cache with network_info: [] {{(pid=127007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 08:58:04.453248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:04.457714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:04.481851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:04.483317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:04.487857 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-abd8e3e3-1ab6-4385-8ce9-55ccd6fd9632 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.498009 Oct 12 08:58:04.490722 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1807/3369] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:03 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:04.505153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8c13f05-fa35-457b-88dd-9896a4db99ab tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848ee20d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:04.552578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:04.611890 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8c13f05-fa35-457b-88dd-9896a4db99ab tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.117701 Oct 12 08:58:04.622044 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1808/3370] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:58:04 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:04.754361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:04.808584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:04.811191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:04.872191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:04.880844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:04.882279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:04.885483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:04.888681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:04.890899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:05.033859 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a17b7d4f-ed88-487d-86c3-79e1d12c3200 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 204 len: 0 microversion: 2.1 time: 4.620831 Oct 12 08:58:05.037761 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1563/3371] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:58:00 2022] DELETE /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 0 bytes in 4623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:58:05.044239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:05.049476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:05.069860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:05.073349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:05.074668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:05.078639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:05.082890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:05.082890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:05.194734 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-800bb334-f253-4e36-9c68-2d01fc900046 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158354 Oct 12 08:58:05.197648 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1564/3372] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:58:05 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:05.202709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:05.205415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:05.219743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:05.224222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:05.225150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:05.226180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:05.227382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:05.228930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:05.257116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:05.270698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a4cfa20-36f8-4892-b660-c53b7db5cdeb tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.466712 Oct 12 08:58:05.272834 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 HTTP/1.1 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'fe06cee8-a199-43e0-b707-d7177639bcd6'} Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:05.275529 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:05.279753 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:05.279753 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:05.279753 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:05.279753 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:05.279753 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:05.279753 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:58:05.279753 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:05.282970 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1809/3373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:04 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:05.285319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:05.290746 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e97abcbc-1514-42b1-bf59-143849f98a4b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 404 len: 111 microversion: 2.1 time: 0.091816 Oct 12 08:58:05.291990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1565/3374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:05 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:58:05.415823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-952f64f5-dfb5-4a35-8ce8-2de1e3d70b63 req-e0107b67-2eb1-404c-bba4-927dcb1430e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-plugged", "status": "completed", "tag": "732ae85e-6222-4561-8af6-1183c673884b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:05.430262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-952f64f5-dfb5-4a35-8ce8-2de1e3d70b63 req-e0107b67-2eb1-404c-bba4-927dcb1430e9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:05.435848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-952f64f5-dfb5-4a35-8ce8-2de1e3d70b63 req-e0107b67-2eb1-404c-bba4-927dcb1430e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:05.437108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-952f64f5-dfb5-4a35-8ce8-2de1e3d70b63 req-e0107b67-2eb1-404c-bba4-927dcb1430e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:05.463059 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-952f64f5-dfb5-4a35-8ce8-2de1e3d70b63 req-e0107b67-2eb1-404c-bba4-927dcb1430e9 service nova] Creating event network-vif-plugged:732ae85e-6222-4561-8af6-1183c673884b for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:58:05.480305 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-952f64f5-dfb5-4a35-8ce8-2de1e3d70b63 req-e0107b67-2eb1-404c-bba4-927dcb1430e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068203 Oct 12 08:58:05.484754 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1566/3375] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:58:05.495032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-42009888", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "1a3d825f-25ea-4200-80fd-dbc304c434d4"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:05.519025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:05.520077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:05.545302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:05.545967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:05.546658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:05.547593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:05.548329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:05.548944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:05.605428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] validate_networks() for [('1a3d825f-25ea-4200-80fd-dbc304c434d4', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:05.961947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:05.972984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:05.981475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:05.983019 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-47985220-6b6a-4791-8fd8-8901896678a5 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.468813 Oct 12 08:58:05.986813 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1567/3376] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:05 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:06.002536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-339225402", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "2f204459-03a5-4e90-a59a-2dbecd872d0d"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:06.092330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] validate_networks() for [('2f204459-03a5-4e90-a59a-2dbecd872d0d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:06.191214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:58:06.192842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:58:06.193795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:58:06.194444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:58:06.195279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:58:06.208567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:06.209484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:06.210168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:06.211294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:06.211983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:06.213037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:06.235192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Getting quotas for project 71412c221bc3483b80a3988c78e40c71. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:58:06.242627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Getting quotas for user 8156f9604eae490f9206747f6d119f74 and project 71412c221bc3483b80a3988c78e40c71. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:58:06.259092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:58:06.262278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:58:06.321663 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d11ba15b-a4c7-45b6-a853-014a973a53bf tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.037030 Oct 12 08:58:06.330098 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1810/3377] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:58:06.336134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ceaa0bd4-99e1-461f-947c-4f5d24322908 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984ccdf4c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:06.408756 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ceaa0bd4-99e1-461f-947c-4f5d24322908 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.076387 Oct 12 08:58:06.410462 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1811/3378] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:58:06 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:06.416688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e39def34-7f7f-4a83-846e-2f3da8e90eae req-e1205a0f-1017-4f57-a4c9-551beaf21a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06cee8-a199-43e0-b707-d7177639bcd6", "name": "network-vif-deleted", "tag": "3091c101-3979-4de3-b96a-2ee038190880"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:06.429879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e39def34-7f7f-4a83-846e-2f3da8e90eae req-e1205a0f-1017-4f57-a4c9-551beaf21a8b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:06.430936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e39def34-7f7f-4a83-846e-2f3da8e90eae req-e1205a0f-1017-4f57-a4c9-551beaf21a8b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:06.431607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e39def34-7f7f-4a83-846e-2f3da8e90eae req-e1205a0f-1017-4f57-a4c9-551beaf21a8b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:06.463262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.server_external_events [req-e39def34-7f7f-4a83-846e-2f3da8e90eae req-e1205a0f-1017-4f57-a4c9-551beaf21a8b service nova] Unable to find a host for instance fe06cee8-a199-43e0-b707-d7177639bcd6. Dropping event network-vif-deleted {{(pid=127006) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 08:58:06.465632 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e39def34-7f7f-4a83-846e-2f3da8e90eae req-e1205a0f-1017-4f57-a4c9-551beaf21a8b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053868 Oct 12 08:58:06.469083 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1812/3379] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 08:58:06.485120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:06.495292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:06.510550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:06.513250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:06.514730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:06.518519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:06.525800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:06.527119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:06.576619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2e75c90-1f50-4d06-9b23-6c146b52bb83 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104694 Oct 12 08:58:06.581741 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1813/3380] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:58:06 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:06.590232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:06.591031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:06.598477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:06.599096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:06.599639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:06.600696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:06.601260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:06.601949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:06.816009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:06.834561 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b5b0c71-9d71-415d-abe6-a81609e9f40d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.255337 Oct 12 08:58:06.835554 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1814/3381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:06 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:06.842828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4e039f2-f3c3-4ba6-8dad-bfb1e4e8dc59 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:06.843756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b4e039f2-f3c3-4ba6-8dad-bfb1e4e8dc59 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:06.944780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b4e039f2-f3c3-4ba6-8dad-bfb1e4e8dc59 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:06.955156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b4e039f2-f3c3-4ba6-8dad-bfb1e4e8dc59 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:06.964826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b4e039f2-f3c3-4ba6-8dad-bfb1e4e8dc59 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:06.967270 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b4e039f2-f3c3-4ba6-8dad-bfb1e4e8dc59 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1257 microversion: 2.21 time: 0.130273 Oct 12 08:58:06.969796 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1815/3382] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:06 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1257 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:07.014662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:07.015392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:07.027635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:07.029916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:07.031229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:07.034898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:07.035061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:07.035560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:07.318733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:07.332605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:07.335397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:07.336598 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1e016d99-bbcc-4a96-9471-cc00c9cd8366 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.327963 Oct 12 08:58:07.337415 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1816/3383] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:07 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:07.427533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bc37b9af-fce9-4887-92e4-747148f08c69 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984cc218b0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:07.508638 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bc37b9af-fce9-4887-92e4-747148f08c69 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.087937 Oct 12 08:58:07.517068 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1817/3384] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:58:07 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:07.560567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6e51cd97-b5a8-4f84-985d-41d3923fbe8a req-3c40497b-00c1-4003-8f0f-9518268aa498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-plugged", "status": "completed", "tag": "dd89cf22-dd9d-43c6-acf1-e972ac33ae09"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:07.578456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6e51cd97-b5a8-4f84-985d-41d3923fbe8a req-3c40497b-00c1-4003-8f0f-9518268aa498 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:07.578941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6e51cd97-b5a8-4f84-985d-41d3923fbe8a req-3c40497b-00c1-4003-8f0f-9518268aa498 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:07.579359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6e51cd97-b5a8-4f84-985d-41d3923fbe8a req-3c40497b-00c1-4003-8f0f-9518268aa498 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:07.611977 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6e51cd97-b5a8-4f84-985d-41d3923fbe8a req-3c40497b-00c1-4003-8f0f-9518268aa498 service nova] Creating event network-vif-plugged:dd89cf22-dd9d-43c6-acf1-e972ac33ae09 for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:58:07.619898 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6e51cd97-b5a8-4f84-985d-41d3923fbe8a req-3c40497b-00c1-4003-8f0f-9518268aa498 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063394 Oct 12 08:58:07.621392 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1818/3385] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:58:07.627700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:07.630481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:07.638671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:07.639655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:07.640306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:07.641502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:07.642886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:07.643574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:07.687970 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9537bd78-002a-4713-bcfd-08c7d6c2dd36 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065001 Oct 12 08:58:07.689415 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1819/3386] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 08:58:07 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 08:58:07.860655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:07.861843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:07.875330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:07.875799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:07.876238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:07.882535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:07.883028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:07.883464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:08.128426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:08.128813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:58:08.129263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:58:08.129365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:58:08.130255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:58:08.130675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:58:08.141770 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a25b520e-0040-422b-a2a5-1a172b3dcce4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.285241 Oct 12 08:58:08.142521 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1820/3387] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:07 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:08.148534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:08.149270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:08.158898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:08.163525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:08.164039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:08.164510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:08.165307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:08.165793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:08.166262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:08.170737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:08.202345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:58:08.210146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for user 3571292391094d83901f21ccb18ec2d8 and project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:58:08.220958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:08.221853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:08.222346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:08.223188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:08.240197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:58:08.242681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:58:08.348304 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-90edc506-65d4-40fc-8af8-bb2e20b799ef tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.359266 Oct 12 08:58:08.359180 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1568/3388] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:58:08.374560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:08.375719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:08.409901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:08.411985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:08.413190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:08.416352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:08.417201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:08.418088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:08.567392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:08.582327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:08.585018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:08.587645 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-450c713c-73a0-452d-9884-3a34842ed463 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1309 microversion: 2.21 time: 0.443266 Oct 12 08:58:08.612288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1821/3389] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:08 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1309 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:08.618418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67cd3f59-388b-432e-9e5b-95b726c5c115 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:08.620482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67cd3f59-388b-432e-9e5b-95b726c5c115 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:08.711133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-67cd3f59-388b-432e-9e5b-95b726c5c115 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:08.720808 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67cd3f59-388b-432e-9e5b-95b726c5c115 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1214 microversion: 2.1 time: 0.105855 Oct 12 08:58:08.755133 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1822/3390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:08 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:08.780757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b1660bb-df33-44a8-b299-b29f77493989 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984cbc3d30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:08.885114 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b1660bb-df33-44a8-b299-b29f77493989 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1412 microversion: 2.1 time: 0.128034 Oct 12 08:58:08.887801 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1823/3391] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:58:08 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:08.996397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:09.011843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:09.013612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:09.014997 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-69039ccd-144f-4e17-8fd9-7d270467feff tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.648281 Oct 12 08:58:09.017754 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1569/3392] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:08 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:09.165682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:09.166304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:09.181284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:09.188363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:09.191542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:09.192351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:09.193000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:09.198082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:09.591116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:09.603864 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ff899b86-2a9d-41fe-bb97-5160b8c5b6a7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.442167 Oct 12 08:58:09.604451 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1824/3393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:09 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:09.623541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:09.625285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:09.652314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:09.652958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:09.654145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:09.656813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:09.658677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:09.659191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:09.747226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:09.748231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:09.763403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:09.767804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:09.768645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:09.773318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:09.777094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:09.777896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:09.990846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:10.006743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:10.025642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:10.027615 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0613259-26aa-435c-968c-c33b63e63081 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1210 microversion: 2.1 time: 0.283841 Oct 12 08:58:10.029888 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1825/3394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:09 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1210 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:10.031869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:10.045226 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5151aab-86df-419a-b590-07271a223133 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1315 microversion: 2.21 time: 0.416162 Oct 12 08:58:10.046209 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1570/3395] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:09 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:10.052726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b29b2562-92d2-45ad-8175-34fd8ef3f4b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843fcb940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:10.058638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:10.061722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:10.083887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:10.087039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:10.087805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:10.088543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:10.089526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:10.090210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:10.104454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:10.410691 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b29b2562-92d2-45ad-8175-34fd8ef3f4b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1421 microversion: 2.1 time: 0.379260 Oct 12 08:58:10.413650 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1826/3396] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:58:10 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1421 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:10.423345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d09eb647-be27-45a0-b9b7-aeaf2b23b5c6 req-0f478840-5b89-48de-b54d-7de9f1924d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-plugged", "status": "completed", "tag": "610a858d-7018-4592-868c-3b15b37557fa"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-plugged", "status": "completed", "tag": "02fdd17d-834c-4946-a15e-652cc4faf437"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:10.468724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d09eb647-be27-45a0-b9b7-aeaf2b23b5c6 req-0f478840-5b89-48de-b54d-7de9f1924d23 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:10.481253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d09eb647-be27-45a0-b9b7-aeaf2b23b5c6 req-0f478840-5b89-48de-b54d-7de9f1924d23 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:10.481856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d09eb647-be27-45a0-b9b7-aeaf2b23b5c6 req-0f478840-5b89-48de-b54d-7de9f1924d23 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:10.514838 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d09eb647-be27-45a0-b9b7-aeaf2b23b5c6 req-0f478840-5b89-48de-b54d-7de9f1924d23 service nova] Creating event network-vif-plugged:610a858d-7018-4592-868c-3b15b37557fa for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:58:10.516362 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d09eb647-be27-45a0-b9b7-aeaf2b23b5c6 req-0f478840-5b89-48de-b54d-7de9f1924d23 service nova] Creating event network-vif-plugged:02fdd17d-834c-4946-a15e-652cc4faf437 for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:58:10.527058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:10.541870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:10.543323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:10.544121 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d09eb647-be27-45a0-b9b7-aeaf2b23b5c6 req-0f478840-5b89-48de-b54d-7de9f1924d23 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.127916 Oct 12 08:58:10.544487 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ab25ccb8-b768-4203-be1c-d6aefd965144 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.497086 Oct 12 08:58:10.545043 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1571/3397] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:10 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:10.546812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1827/3398] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:10.554321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb650ba8-bbec-47e3-8d29-a7d43b39e477 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843fcb670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:10.632376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:10.633300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:10.651913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:10.654949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:10.663335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:10.664320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:10.664851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:10.665003 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb650ba8-bbec-47e3-8d29-a7d43b39e477 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 200 len: 1421 microversion: 2.1 time: 0.116742 Oct 12 08:58:10.665523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:10.679408 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1828/3399] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:58:10 2022] GET /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 1421 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:10.715169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-971d64f9-65dd-4339-ba17-6aa3e050ccde tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984cbd8430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:11.228451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:11.242012 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5c9d7c88-6532-44e7-9fde-c2e26ac3c642 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.613896 Oct 12 08:58:11.245259 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1572/3400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:10 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:11.266850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:11.270153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:11.295293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:11.295704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:11.299300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:11.302236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:11.303593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:11.304281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:11.533552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:11.548264 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-48fdef47-b21d-4a8d-a8a0-3e0cd478a916 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1272 microversion: 2.1 time: 0.296526 Oct 12 08:58:11.548960 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1573/3401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:11 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:11.571520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:11.572193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:11.593004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:11.593573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:11.594626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:11.598301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:11.599073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:11.600412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:11.612367 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-971d64f9-65dd-4339-ba17-6aa3e050ccde tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 204 len: 0 microversion: 2.1 time: 0.931314 Oct 12 08:58:11.613361 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1829/3402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:10 2022] DELETE /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 0 bytes in 933 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:58:11.619598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:11.620349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:11.644491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:11.645161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:11.645717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:11.646638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:11.648098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:11.649202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:11.936564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:11.955440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:11.957157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:11.963048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-710d03b7-570b-4048-9a74-2e1790a2568e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.346356 Oct 12 08:58:11.964748 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1830/3403] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:11 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:11.974958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:11.976361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:11.985046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:11.986062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:11.986565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:11.987363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:11.988219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:11.988219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:12.032856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:58:12.083134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:12.096671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:12.098410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:12.099728 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b9e7441-8df3-41d3-9322-e7b9aca255eb tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1357 microversion: 2.21 time: 0.545969 Oct 12 08:58:12.100880 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1574/3404] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:11 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1357 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:12.142074 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a601fbed-f5b6-4b29-a3c0-e3ecbffc1ea3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 204 len: 0 microversion: 2.1 time: 0.174218 Oct 12 08:58:12.142821 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1831/3405] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:58:11 2022] DELETE /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:58:12.276030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-726871335", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3dfaf69e-9114-463f-af48-2e013b44a4e8"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:12.282339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:12.282956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:12.289473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:12.295145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:12.295813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:12.296733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:12.297191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:12.297647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:12.367103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] validate_networks() for [('3dfaf69e-9114-463f-af48-2e013b44a4e8', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:12.594219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:12.608781 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-653416bd-400d-4dcd-9248-c366b7b174ea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.341029 Oct 12 08:58:12.643052 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1575/3406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:12 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:12.651316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-plugged", "status": "completed", "tag": "3a324a9b-e152-4288-b469-6bc1dd04ee7e"}, {"server_uuid": "a870435b-8aa5-456d-b0ca-477ee2201dbb", "name": "network-vif-plugged", "status": "completed", "tag": "100f519d-4457-4d8b-acb1-e0e088317a35"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-plugged", "status": "completed", "tag": "3b29526e-1c95-43fd-acbc-c4e8746e941a"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-plugged", "status": "completed", "tag": "1e0ec976-98af-4526-abda-2f9da49a001d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:12.682236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:12.683949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:12.684656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.048774 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] Creating event network-vif-plugged:3a324a9b-e152-4288-b469-6bc1dd04ee7e for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:58:13.049459 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] Creating event network-vif-plugged:100f519d-4457-4d8b-acb1-e0e088317a35 for instance a870435b-8aa5-456d-b0ca-477ee2201dbb on n-h2-858383-10 Oct 12 08:58:13.051331 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] Creating event network-vif-plugged:3b29526e-1c95-43fd-acbc-c4e8746e941a for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:58:13.052124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] Creating event network-vif-plugged:1e0ec976-98af-4526-abda-2f9da49a001d for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:58:13.063190 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4618b200-83b1-447f-b571-1e9c4d977916 req-74d92ab5-ecba-4852-862d-710a7252953c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.418505 Oct 12 08:58:13.064652 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1576/3407] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:13.070083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:13.071058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:13.084074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.084843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.085063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.085751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.086414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.086863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.369965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:58:13.370724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:58:13.371318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:58:13.372456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:58:13.373370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:58:13.383916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.385037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.385703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.386751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.387407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.388084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.416058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Getting quotas for project fa3a965bdb884e0eb4f37650c30cb3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:58:13.422648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Getting quotas for user 69f6da267d5248518650775b52ca9488 and project fa3a965bdb884e0eb4f37650c30cb3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:58:13.438449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:58:13.442504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:58:13.445606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:13.455233 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02ef26d5-664b-4178-86e7-ac8ec69f0580 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.389335 Oct 12 08:58:13.469525 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1577/3408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:13 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:13.474410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:13.480701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8796d8e9-a29b-4e8a-a71a-23f3d348a207 req-84b74726-1b00-42be-9a99-18d3e5ffd05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b28010-5072-4c42-9cad-054aef774212", "tag": "ff66571d-540b-442f-b5e5-31b0dd99c00e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:13.502145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8796d8e9-a29b-4e8a-a71a-23f3d348a207 req-84b74726-1b00-42be-9a99-18d3e5ffd05b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.502634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8796d8e9-a29b-4e8a-a71a-23f3d348a207 req-84b74726-1b00-42be-9a99-18d3e5ffd05b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.503075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8796d8e9-a29b-4e8a-a71a-23f3d348a207 req-84b74726-1b00-42be-9a99-18d3e5ffd05b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.513984 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29a697d7-02a5-4c57-99b7-3913ae48fbb2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242202 Oct 12 08:58:13.514873 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1832/3409] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 08:58:13.528099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:13.528796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:13.541120 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8796d8e9-a29b-4e8a-a71a-23f3d348a207 req-84b74726-1b00-42be-9a99-18d3e5ffd05b service nova] Creating event network-changed:ff66571d-540b-442f-b5e5-31b0dd99c00e for instance f8b28010-5072-4c42-9cad-054aef774212 on n-h1-858383-10 Oct 12 08:58:13.546890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.548184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.551041 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8796d8e9-a29b-4e8a-a71a-23f3d348a207 req-84b74726-1b00-42be-9a99-18d3e5ffd05b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085508 Oct 12 08:58:13.551637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.559063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.569992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.570421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.572798 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1578/3410] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:13.578107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:13.578802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:13.603485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.603983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.604426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.605142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.605634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.606071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.831659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:13.846966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:13.848361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:13.849735 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a0704ff-aacf-4072-968a-2d5c2b31a240 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.333642 Oct 12 08:58:13.857601 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1833/3411] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:13 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:13.870481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34572901-ebfe-49d4-b392-1ee12957ad04 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:13.871363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34572901-ebfe-49d4-b392-1ee12957ad04 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:13.947045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34572901-ebfe-49d4-b392-1ee12957ad04 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:13.969883 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34572901-ebfe-49d4-b392-1ee12957ad04 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1207 microversion: 2.1 time: 0.117529 Oct 12 08:58:13.971779 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1834/3412] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:13 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1207 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:13.977158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:13.978236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:13.984702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.985287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.986088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:13.987050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:13.987736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:13.988518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:14.588743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:14.610807 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dff2a730-0449-4ca5-b7e8-e8596c0a72f6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.637668 Oct 12 08:58:14.611590 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1835/3413] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:13 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:14.627643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:14.627643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:14.642433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:14.642940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:14.643376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:14.644082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:14.644531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:14.645009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:14.662585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:14.704099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:14.721370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:14.723043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:14.726852 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02adb556-7a96-4f69-a7a5-118604557bf3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1357 microversion: 2.21 time: 1.152328 Oct 12 08:58:14.728052 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1579/3414] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:13 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1357 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:14.879174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:14.880592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:14.897846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:14.899980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:14.901382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:14.902146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:14.902575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:14.903031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:14.966048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:14.975805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0722bc53-39f2-4f48-a1be-f0cb68f3f9a3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.360458 Oct 12 08:58:14.990124 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1836/3415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:14 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:14.998094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2a750a52-a6e0-4c47-8aa7-8e6226b5c71e req-e7adc106-6ae1-44d2-b8ba-8fb5d1a5daa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad53c17-0b1c-484e-8be6-187774d37cce", "name": "network-vif-deleted", "tag": "b04bfce7-248c-49ac-8868-88aa52256bbd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:15.009965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2a750a52-a6e0-4c47-8aa7-8e6226b5c71e req-e7adc106-6ae1-44d2-b8ba-8fb5d1a5daa9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.010729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2a750a52-a6e0-4c47-8aa7-8e6226b5c71e req-e7adc106-6ae1-44d2-b8ba-8fb5d1a5daa9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.011382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2a750a52-a6e0-4c47-8aa7-8e6226b5c71e req-e7adc106-6ae1-44d2-b8ba-8fb5d1a5daa9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.026470 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-2a750a52-a6e0-4c47-8aa7-8e6226b5c71e req-e7adc106-6ae1-44d2-b8ba-8fb5d1a5daa9 service nova] Creating event network-vif-deleted:b04bfce7-248c-49ac-8868-88aa52256bbd for instance 0ad53c17-0b1c-484e-8be6-187774d37cce on n-h2-858383-10 Oct 12 08:58:15.031992 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2a750a52-a6e0-4c47-8aa7-8e6226b5c71e req-e7adc106-6ae1-44d2-b8ba-8fb5d1a5daa9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040127 Oct 12 08:58:15.033328 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1837/3416] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:15.039627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:15.041343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:15.049511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.050574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.051204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.051933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.052426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.053037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.120416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:15.131204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e5d5057-00b7-49fa-a3c6-4af45385491d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1259 microversion: 2.1 time: 0.096358 Oct 12 08:58:15.132230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1838/3417] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:15 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1259 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:15.137128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e2025091-9e75-4cf3-a1b1-2fa90defd886 req-31ef2d95-4371-4bf1-8a59-e00effa4ec75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad53c17-0b1c-484e-8be6-187774d37cce", "name": "network-vif-unplugged", "status": "completed", "tag": "b04bfce7-248c-49ac-8868-88aa52256bbd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:15.150131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2025091-9e75-4cf3-a1b1-2fa90defd886 req-31ef2d95-4371-4bf1-8a59-e00effa4ec75 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.150536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2025091-9e75-4cf3-a1b1-2fa90defd886 req-31ef2d95-4371-4bf1-8a59-e00effa4ec75 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.150971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2025091-9e75-4cf3-a1b1-2fa90defd886 req-31ef2d95-4371-4bf1-8a59-e00effa4ec75 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.163570 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e2025091-9e75-4cf3-a1b1-2fa90defd886 req-31ef2d95-4371-4bf1-8a59-e00effa4ec75 service nova] Creating event network-vif-unplugged:b04bfce7-248c-49ac-8868-88aa52256bbd for instance 0ad53c17-0b1c-484e-8be6-187774d37cce on n-h2-858383-10 Oct 12 08:58:15.169752 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e2025091-9e75-4cf3-a1b1-2fa90defd886 req-31ef2d95-4371-4bf1-8a59-e00effa4ec75 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036089 Oct 12 08:58:15.170694 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1839/3418] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:15.205925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:15.208483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:UPDATE=12,nova_cell1:SELECT=86,nova_cell1:DELETE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:15.216869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:15.218649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:15.219801 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9dcb2cae-91a5-419b-926a-affca023b477 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1873 microversion: 2.42 time: 0.347452 Oct 12 08:58:15.220403 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1580/3419] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:14 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1873 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:15.598952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3d688d6c-a6d5-4571-bc6d-ec2b1a47c2e7 req-e79cbee3-bc31-48c9-bef7-23d857454147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3858302-5978-4e93-974d-ae435371d519", "tag": "a41fa3a3-7ace-4016-8395-1f70fa3487ba"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:15.608878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d688d6c-a6d5-4571-bc6d-ec2b1a47c2e7 req-e79cbee3-bc31-48c9-bef7-23d857454147 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.609353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d688d6c-a6d5-4571-bc6d-ec2b1a47c2e7 req-e79cbee3-bc31-48c9-bef7-23d857454147 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.609835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d688d6c-a6d5-4571-bc6d-ec2b1a47c2e7 req-e79cbee3-bc31-48c9-bef7-23d857454147 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.621854 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3d688d6c-a6d5-4571-bc6d-ec2b1a47c2e7 req-e79cbee3-bc31-48c9-bef7-23d857454147 service nova] Creating event network-changed:a41fa3a3-7ace-4016-8395-1f70fa3487ba for instance e3858302-5978-4e93-974d-ae435371d519 on n-h1-858383-10 Oct 12 08:58:15.626755 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3d688d6c-a6d5-4571-bc6d-ec2b1a47c2e7 req-e79cbee3-bc31-48c9-bef7-23d857454147 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Oct 12 08:58:15.627449 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1840/3420] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:15.637561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:15.638173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:15.645690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.646328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.646908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.647919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.648482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.649129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.755930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:15.756915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:15.767763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.768263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.768738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.773656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:15.774139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:15.774577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:15.905255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:15.925861 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-979acf8b-0043-44a0-8a5a-ba27ecb55425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1317 microversion: 2.1 time: 0.284989 Oct 12 08:58:15.943228 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1581/3421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:15 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:16.002804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:16.003657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:16.015495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.016120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.016654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.017531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.018086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.018613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.288088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:16.300503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:16.302582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:16.304673 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5ce41c8-b369-4c80-9bf1-eff179c1e7b3 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1357 microversion: 2.21 time: 0.552983 Oct 12 08:58:16.305251 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1841/3422] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:15 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1357 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:16.318477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:16.319269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:16.333988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.334951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.335487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.337647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.338814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.339580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.459535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:16.470978 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-139d8736-f56d-4c1d-9e8f-7cb6a73b194b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1265 microversion: 2.1 time: 0.159361 Oct 12 08:58:16.486416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:16.487230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1842/3423] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:16 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:16.488507 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05a2a1f9-76e9-4d06-ade9-d258a1af174d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.490270 Oct 12 08:58:16.489238 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1582/3424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:15 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:16.495654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:16.496301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:16.503213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.503770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.504211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.504962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.505618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.506228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.778917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:16.795576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:16.797415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:16.798777 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-175b0b12-8bdd-4516-8512-a10bd0569ee2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2833 microversion: 2.42 time: 0.310270 Oct 12 08:58:16.803047 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1843/3425] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:16 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2833 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:16.832777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:16.835226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:16.844596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.845642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.846256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.847145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.847810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.848389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.954592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:16.955388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:16.966313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.968067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.969803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:16.970865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:16.971824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:16.972505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:17.131500 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6883f14b-60fb-4050-8cb0-2b46c45c1ffe tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.304950 Oct 12 08:58:17.141867 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1583/3426] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 12 08:58:16 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9/os-interface => generated 1832 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:17.331089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:17.331709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:17.339304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:17.339783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:17.341198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:17.341943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:17.342403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:17.342821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:17.382468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:17.409794 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3865913e-66ae-4d64-98e5-f8b3e9726cfe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.459865 Oct 12 08:58:17.412329 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1844/3427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:16 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:17.498818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1218146956", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:17.519123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:17.529479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:17.532697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:17.534027 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71ef213d-cec0-4011-aad5-602233439a8d tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1357 microversion: 2.21 time: 0.208146 Oct 12 08:58:17.534967 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1584/3428] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:17 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:17.539909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:17.540518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:17.547631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:17.548056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:17.548568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:17.549301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:17.549828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:17.550571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:17.574433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] validate_networks() for [('5e1465ee-0d75-4b69-86e4-f265ae631c06', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:17.711961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:17.725269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d090f6c7-1d49-4c74-bc19-97fe2a884c3f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1307 microversion: 2.1 time: 0.189093 Oct 12 08:58:17.726564 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1585/3429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:17 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:17.732616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:17.733485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:17.741912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:17.742677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:17.743305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:17.744702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:17.745328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:17.745951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:17.929706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:17.942643 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3a0ce38f-bbf4-4c91-a387-35001e5590ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.214074 Oct 12 08:58:17.943585 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1586/3430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:17 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:18.559957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:18.561478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:18.563698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:18.565176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:18.571547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:18.572408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:18.573093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:18.574076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:18.574754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:18.575402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:18.760745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:18.771962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:18.773415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:18.774598 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dc588ad6-1304-4029-8ba4-47edbeefa71b tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1357 microversion: 2.21 time: 0.218646 Oct 12 08:58:18.775347 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1587/3431] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:18 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:18.779905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:18.780686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:18.787691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:18.788375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:18.789183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:18.790754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:18.791428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:18.792021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:18.940133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:18.948448 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-486d5074-1246-4aab-a2db-d40f5720d831 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1307 microversion: 2.1 time: 0.171927 Oct 12 08:58:18.949029 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1588/3432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:18 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:18.960238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:58:18.960838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:58:18.961431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:58:18.961431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:58:18.961431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:58:18.980168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:18.981331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:18.982101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:18.982957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:18.983622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:18.986045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:18.989122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:18.989856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:19.004065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:19.007997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:19.009836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:19.012595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:19.013282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:19.015083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:19.046465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Getting quotas for project e09f0eadea244ac2aef5d9f014cb3892. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:58:19.061229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Getting quotas for user 07268ce32b9446c981f83e6e92bee533 and project e09f0eadea244ac2aef5d9f014cb3892. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:58:19.093137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:58:19.099346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:58:19.209711 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd3f151e-2a5a-47c9-b603-1e8949a651e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715953 Oct 12 08:58:19.216184 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1845/3433] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:58:19.223040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5ba9934f-db2b-411b-bb31-4e55837cc137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:19.227813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5ba9934f-db2b-411b-bb31-4e55837cc137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:19.346095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:19.356909 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2e55be84-fa54-4c39-a173-3d4609b0e6c5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.385957 Oct 12 08:58:19.357516 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1589/3434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:18 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:19.362135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5ba9934f-db2b-411b-bb31-4e55837cc137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:19.373926 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5ba9934f-db2b-411b-bb31-4e55837cc137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1217 microversion: 2.1 time: 0.151822 Oct 12 08:58:19.374576 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1846/3435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:19 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:19.461581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5ef73ab5-f23b-458f-b45d-5cc7a1e77235 req-5ff0c9ad-0109-4b28-8499-0146d5728f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b28010-5072-4c42-9cad-054aef774212", "name": "network-vif-plugged", "status": "completed", "tag": "ff66571d-540b-442f-b5e5-31b0dd99c00e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:19.473719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ef73ab5-f23b-458f-b45d-5cc7a1e77235 req-5ff0c9ad-0109-4b28-8499-0146d5728f5a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:19.474380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ef73ab5-f23b-458f-b45d-5cc7a1e77235 req-5ff0c9ad-0109-4b28-8499-0146d5728f5a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:19.474988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ef73ab5-f23b-458f-b45d-5cc7a1e77235 req-5ff0c9ad-0109-4b28-8499-0146d5728f5a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:19.499898 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5ef73ab5-f23b-458f-b45d-5cc7a1e77235 req-5ff0c9ad-0109-4b28-8499-0146d5728f5a service nova] Creating event network-vif-plugged:ff66571d-540b-442f-b5e5-31b0dd99c00e for instance f8b28010-5072-4c42-9cad-054aef774212 on n-h1-858383-10 Oct 12 08:58:19.509203 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5ef73ab5-f23b-458f-b45d-5cc7a1e77235 req-5ff0c9ad-0109-4b28-8499-0146d5728f5a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052169 Oct 12 08:58:19.510068 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1590/3436] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:19.615475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5c6f28f2-e6f2-4fb7-904b-501c22f295b8 req-912d6445-652d-40f1-af7a-314e8356f879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3cd57c-b10d-449c-bee3-9d0435916ad7", "tag": "937dc5cb-ca92-4a63-a170-7231a52d6927"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:19.650504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5c6f28f2-e6f2-4fb7-904b-501c22f295b8 req-912d6445-652d-40f1-af7a-314e8356f879 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:19.653221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5c6f28f2-e6f2-4fb7-904b-501c22f295b8 req-912d6445-652d-40f1-af7a-314e8356f879 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:19.654283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5c6f28f2-e6f2-4fb7-904b-501c22f295b8 req-912d6445-652d-40f1-af7a-314e8356f879 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:19.673215 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5c6f28f2-e6f2-4fb7-904b-501c22f295b8 req-912d6445-652d-40f1-af7a-314e8356f879 service nova] Creating event network-changed:937dc5cb-ca92-4a63-a170-7231a52d6927 for instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 on n-h2-858383-10 Oct 12 08:58:19.686082 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5c6f28f2-e6f2-4fb7-904b-501c22f295b8 req-912d6445-652d-40f1-af7a-314e8356f879 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074343 Oct 12 08:58:19.686628 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1847/3437] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:19.802312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:19.803180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:19.815779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:19.820218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:19.820712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:19.821492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:19.821976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:19.822410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:19.974238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:19.975056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:19.991223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:19.993568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:19.994116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:19.995441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:19.998153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:19.998883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:20.190505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:20.201025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:20.208713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:20.210393 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3496841d-20fb-4176-91e6-d2a3157b1194 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1357 microversion: 2.21 time: 0.413767 Oct 12 08:58:20.211000 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1591/3438] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:19 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1357 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:20.372392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:20.380276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:20.380796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:20.395682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:20.396635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:20.397247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:20.398152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:20.398764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:20.399367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:20.410758 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14790f12-23ff-4c9e-ad41-8481a1244fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1307 microversion: 2.1 time: 0.438036 Oct 12 08:58:20.413288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1848/3439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:19 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1307 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:20.441579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:20.441579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:20.447363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:20.449619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:20.450163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:20.456999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:20.457790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:20.458327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:20.597918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:20.610847 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dcb4a652-4921-4012-ae1b-9ea2ea049d65 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1269 microversion: 2.1 time: 0.192289 Oct 12 08:58:20.611741 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1849/3440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:20 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:20.644599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:20.655175 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-caa6ff24-6b4b-4d32-b5f0-af31646a7fae tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.278804 Oct 12 08:58:20.656347 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1592/3441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:20 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:21.235253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:21.235897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:21.252825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.253576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.254398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.255662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.256210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.256861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.426091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:21.435545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:21.437081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:21.440026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:21.441496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:21.442872 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d284c02a-30a3-4a1e-b156-747e988d2d98 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1549 microversion: 2.21 time: 0.211347 Oct 12 08:58:21.446598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.447632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.448400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.449182 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1850/3442] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:21 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:21.449742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.450720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.451623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.470745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:21.471311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:21.479141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.479867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.480498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.481217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.481697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.482419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.547774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:58:21.661407 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39840e4f-ba6d-48b0-b528-ec15df7d6d12 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 204 len: 0 microversion: 2.21 time: 0.195051 Oct 12 08:58:21.665630 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1851/3443] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:58:21 2022] DELETE /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 08:58:21.666213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:21.672576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b9946403-f882-4f55-9938-f73e75688774 req-465e1a56-9c65-4905-b7b0-346e6c120f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3858302-5978-4e93-974d-ae435371d519", "name": "network-vif-plugged", "status": "completed", "tag": "a41fa3a3-7ace-4016-8395-1f70fa3487ba"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:21.677851 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-04862eda-6f20-4ed0-9936-121251cdd8dd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1307 microversion: 2.1 time: 0.246093 Oct 12 08:58:21.678440 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1593/3444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:21 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:21.684584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b9946403-f882-4f55-9938-f73e75688774 req-465e1a56-9c65-4905-b7b0-346e6c120f6b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.685087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:21.685644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b9946403-f882-4f55-9938-f73e75688774 req-465e1a56-9c65-4905-b7b0-346e6c120f6b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.685781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:21.686433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b9946403-f882-4f55-9938-f73e75688774 req-465e1a56-9c65-4905-b7b0-346e6c120f6b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.700187 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b9946403-f882-4f55-9938-f73e75688774 req-465e1a56-9c65-4905-b7b0-346e6c120f6b service nova] Creating event network-vif-plugged:a41fa3a3-7ace-4016-8395-1f70fa3487ba for instance e3858302-5978-4e93-974d-ae435371d519 on n-h1-858383-10 Oct 12 08:58:21.706510 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b9946403-f882-4f55-9938-f73e75688774 req-465e1a56-9c65-4905-b7b0-346e6c120f6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038963 Oct 12 08:58:21.708150 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1852/3445] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:21.714656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:21.715542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:21.722506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.723259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.723873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.724746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.725356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.725975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.728945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.729472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.729913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.730622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.731078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.731504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.822654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:21.831624 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7fa2f278-9f03-409b-b802-2d511d7d63d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1269 microversion: 2.1 time: 0.152147 Oct 12 08:58:21.832498 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1594/3446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:21 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:21.846396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:21.847033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:21.853337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.853884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.860570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.861377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.861904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.862334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:21.955257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:21.964881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:21.966918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:21.969170 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f24d263-a850-416e-a967-2134b4712e8a tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1555 microversion: 2.21 time: 0.259431 Oct 12 08:58:21.987273 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1853/3447] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:21 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1555 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:21.987273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d1d3f256-fc29-4b8e-9868-4f8e21bcf587 req-841545ec-aeb2-4571-ac6f-719d94c3b01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "tag": "3a324a9b-e152-4288-b469-6bc1dd04ee7e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:21.990131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d1d3f256-fc29-4b8e-9868-4f8e21bcf587 req-841545ec-aeb2-4571-ac6f-719d94c3b01a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:21.990606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d1d3f256-fc29-4b8e-9868-4f8e21bcf587 req-841545ec-aeb2-4571-ac6f-719d94c3b01a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:21.991030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d1d3f256-fc29-4b8e-9868-4f8e21bcf587 req-841545ec-aeb2-4571-ac6f-719d94c3b01a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:22.001405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:22.002767 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d1d3f256-fc29-4b8e-9868-4f8e21bcf587 req-841545ec-aeb2-4571-ac6f-719d94c3b01a service nova] Creating event network-changed:3a324a9b-e152-4288-b469-6bc1dd04ee7e for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 08:58:22.008256 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d1d3f256-fc29-4b8e-9868-4f8e21bcf587 req-841545ec-aeb2-4571-ac6f-719d94c3b01a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036247 Oct 12 08:58:22.008860 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1854/3448] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:22.010197 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c72f6545-05cf-4eb2-bdc2-3edb05473070 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.176584 Oct 12 08:58:22.011277 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1595/3449] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:21 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:22.207181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:22.207959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:22.218662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:22.221133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:22.222470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:22.229746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:22.231616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:22.234515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:22.548043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:22.557727 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-925d1b82-8dae-4203-8ae4-469bad47b1b5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.356955 Oct 12 08:58:22.570177 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1855/3450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:22 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:22.584569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:22.586471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:22.593933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:22.594792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:22.595603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:22.596545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:22.597155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:22.597779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:22.701186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:22.701830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:22.708713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:22.708872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:22.709219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:22.709935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:22.710386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:22.710814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:22.894593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:22.898489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:22.908199 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-829a6b57-a603-4512-832a-c03fde206cf1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1307 microversion: 2.1 time: 0.210843 Oct 12 08:58:22.908981 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1856/3451] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:22 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:22.917110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:22.917821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:22.926704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:22.927319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:22.927766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:22.929028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:22.929499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:22.929925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.007814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:23.019457 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1b76cf9-bb17-4f13-bf19-fdfefeb5542c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1275 microversion: 2.1 time: 0.108414 Oct 12 08:58:23.020421 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1857/3452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:22 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:23.026708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:23.027320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:23.033330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:23.033840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:23.034274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.035133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:23.035418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:23.036523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.252408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:23.267861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:23.271210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:23.272468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fda5ae24-cb79-4ae0-87de-1db79bde6766 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1555 microversion: 2.21 time: 0.251098 Oct 12 08:58:23.290968 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1858/3453] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:23 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:23.299245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:23.300348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:23.307288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:23.308646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:23.309327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.310308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:23.314363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:23.315379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.452846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:23.469022 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33809b0f-51e9-4471-837a-eadbad1f05e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.889970 Oct 12 08:58:23.469648 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1596/3454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:22 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:23.498309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:23.499260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:23.506501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:23.508005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:23.508640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.509643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:23.510259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:23.510855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.632203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:23.646877 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-751449c6-00e6-4d70-bd4a-8e26999b64ac tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.354266 Oct 12 08:58:23.648375 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1859/3455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:23 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:23.933326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:23.934339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:23.943266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:23.944776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:23.945910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.947870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:23.948515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:23.949213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:23.950685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:23.965208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42d8d24f-b6f4-4e68-aa08-2bff4b29fa0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.472353 Oct 12 08:58:23.967656 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1597/3456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:23 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:23.996316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:23.997243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:24.013453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.023611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.025261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.026737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.027207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.027640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.068703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:24.208621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:24.220771 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-77c086d2-de7e-48a6-a36f-23dd24020958 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1307 microversion: 2.1 time: 0.291683 Oct 12 08:58:24.222019 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1860/3457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:23 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1307 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:24.227281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4cb0c0c9-9ef7-4e7b-a2e8-2192d504f65e req-1edaa153-a48c-466f-828d-664d1c1a1594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b28010-5072-4c42-9cad-054aef774212", "name": "network-vif-deleted", "tag": "ff66571d-540b-442f-b5e5-31b0dd99c00e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:24.237666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4cb0c0c9-9ef7-4e7b-a2e8-2192d504f65e req-1edaa153-a48c-466f-828d-664d1c1a1594 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.238187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4cb0c0c9-9ef7-4e7b-a2e8-2192d504f65e req-1edaa153-a48c-466f-828d-664d1c1a1594 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.238686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4cb0c0c9-9ef7-4e7b-a2e8-2192d504f65e req-1edaa153-a48c-466f-828d-664d1c1a1594 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.266182 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4cb0c0c9-9ef7-4e7b-a2e8-2192d504f65e req-1edaa153-a48c-466f-828d-664d1c1a1594 service nova] Creating event network-vif-deleted:ff66571d-540b-442f-b5e5-31b0dd99c00e for instance f8b28010-5072-4c42-9cad-054aef774212 on n-h1-858383-10 Oct 12 08:58:24.272035 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4cb0c0c9-9ef7-4e7b-a2e8-2192d504f65e req-1edaa153-a48c-466f-828d-664d1c1a1594 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048463 Oct 12 08:58:24.272778 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1861/3458] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:24.280608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:24.281635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:24.290587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.292120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.292782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.293777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.294426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.295065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.419957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:24.430397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9eb665f-a01b-440c-a9f7-d299c8f49f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.439208 Oct 12 08:58:24.445485 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1598/3459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:23 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:24.445485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:24.446108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:24.473029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.473566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.474017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.474740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.475192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.475613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.528609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.528930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.529467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.530356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lazy-loading 'fault' on Instance uuid f8b28010-5072-4c42-9cad-054aef774212 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:58:24.623375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:24.623526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:24.632308 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-20cfa329-119d-4095-b74f-c96cd8fb6b03 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1317 microversion: 2.1 time: 0.358510 Oct 12 08:58:24.633552 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1862/3460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:24 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:24.639582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:24.641019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8156f9604eae490f9206747f6d119f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71412c221bc3483b80a3988c78e40c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:24.645594 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed16cce6-9e8d-4b66-b6d2-2a7a3c1bdf66 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 200 len: 1347 microversion: 2.21 time: 0.203778 Oct 12 08:58:24.658051 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1599/3461] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:24 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 1347 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:24.671802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:24.672714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:24.683045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.685306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.687131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.690024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.691450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.692876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.703599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5050ec86-7c0d-4d7c-87e8-d97a131d0933 req-0187fbee-75fd-4137-9e2b-54a1d4c14003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3cd57c-b10d-449c-bee3-9d0435916ad7", "name": "network-vif-plugged", "status": "completed", "tag": "937dc5cb-ca92-4a63-a170-7231a52d6927"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:24.723465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5050ec86-7c0d-4d7c-87e8-d97a131d0933 req-0187fbee-75fd-4137-9e2b-54a1d4c14003 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:24.723928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5050ec86-7c0d-4d7c-87e8-d97a131d0933 req-0187fbee-75fd-4137-9e2b-54a1d4c14003 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:24.726939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5050ec86-7c0d-4d7c-87e8-d97a131d0933 req-0187fbee-75fd-4137-9e2b-54a1d4c14003 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:24.755100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5050ec86-7c0d-4d7c-87e8-d97a131d0933 req-0187fbee-75fd-4137-9e2b-54a1d4c14003 service nova] Creating event network-vif-plugged:937dc5cb-ca92-4a63-a170-7231a52d6927 for instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 on n-h2-858383-10 Oct 12 08:58:24.772957 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5050ec86-7c0d-4d7c-87e8-d97a131d0933 req-0187fbee-75fd-4137-9e2b-54a1d4c14003 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074835 Oct 12 08:58:24.776610 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1600/3462] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 08:58:24.782209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-45077119", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "d30a231a-ae95-4ebb-90c8-46232d6674b8"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:24.919248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] validate_networks() for [('d30a231a-ae95-4ebb-90c8-46232d6674b8', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:24.988301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:25.004706 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aaa6734c-15c4-4562-a18a-4194858f160b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1314 microversion: 2.1 time: 0.336800 Oct 12 08:58:25.008340 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1863/3463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:24 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:25.244771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:25.245538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:25.252322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:25.252930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:25.253431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:25.254258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:25.254790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:25.255275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:25.402726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:25.414604 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b70da78d-5114-43d7-a544-2acc5c82990e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1307 microversion: 2.1 time: 0.174002 Oct 12 08:58:25.415230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1864/3464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:25 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:25.658880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:25.659553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:25.690519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:25.702923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:25.704033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:25.704759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:25.705573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:25.710700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:25.881581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:25.890543 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-530aa54a-474a-4a61-996d-cf990669ce44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1317 microversion: 2.1 time: 0.235783 Oct 12 08:58:25.891205 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1865/3465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:25 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:25.897524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:25.898545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:25.905088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:25.905980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:25.906751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:25.907988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:25.908648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:25.909077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:25.924690 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] HTTP exception thrown: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Request method failure captured: Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 HTTP/1.1 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGccpQsSKSAXcNpNrkrAc-MKZS4bsPzaSgKPYo7SVUvD2-PYOWe_jlTzfn-YPZ6qFjaGtlu5QG2KijUD1WHoCiIW3FlUSMkW53bKIztddFMxALXgE8rkFvSkzFWMWlveaEftAVKltzLG3C1S2y0cXjCjAcO0yUd3hSp8Xf4kS8ZpiA Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 71412c221bc3483b80a3988c78e40c71 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71412c221bc3483b80a3988c78e40c71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/71412c221bc3483b80a3988c78e40c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_71412c221bc3483b80a3988c78e40c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71412c221bc3483b80a3988c78e40c71"}]}] Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 71412c221bc3483b80a3988c78e40c71 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-InstanceActionsV221TestJSON-767597779-project Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 8156f9604eae490f9206747f6d119f74 Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-InstanceActionsV221TestJSON-767597779-project Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'f8b28010-5072-4c42-9cad-054aef774212'} Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:25.927079 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Returning 404 to user: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d398f60-0c37-4e43-bc3b-2df2277db5d9 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 404 len: 111 microversion: 2.21 time: 0.036084 Oct 12 08:58:25.933651 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1866/3466] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:25 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:25.939544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '.version_select at 0x7f984804a820>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:25.940371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:25.946785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:25.947294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:25.947713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:25.948413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:25.948904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:25.949382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.021772 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc9a78c5-2845-45b0-99c0-3b47e5371f19 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.085995 Oct 12 08:58:26.022962 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1867/3467] 10.222.0.40 () {60 vars in 1337 bytes} [Wed Oct 12 08:58:25 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212/os-instance-actions => generated 611 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 08:58:26.023796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:58:26.024867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:58:26.025600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:58:26.027111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:58:26.027364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:58:26.037169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:26.037801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:26.039813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.040664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.041723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.042893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.043620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.044276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.044556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.045661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.046177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.046928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.047401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.047896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.070700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:58:26.077495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for user 54fad01e2e6e41d0887895b131051ee1 and project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:58:26.094743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:58:26.097801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:58:26.148225 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eec275cd-136d-4e01-958e-df3f303c9445 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.370332 Oct 12 08:58:26.148808 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1601/3468] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:58:26.153937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:26.154654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:26.162821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.168612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.168612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.168612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.168612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.168612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.194897 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] HTTP exception thrown: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Request method failure captured: Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 HTTP/1.1 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGccpQsSKSAXcNpNrkrAc-MKZS4bsPzaSgKPYo7SVUvD2-PYOWe_jlTzfn-YPZ6qFjaGtlu5QG2KijUD1WHoCiIW3FlUSMkW53bKIztddFMxALXgE8rkFvSkzFWMWlveaEftAVKltzLG3C1S2y0cXjCjAcO0yUd3hSp8Xf4kS8ZpiA Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 71412c221bc3483b80a3988c78e40c71 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71412c221bc3483b80a3988c78e40c71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/71412c221bc3483b80a3988c78e40c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_71412c221bc3483b80a3988c78e40c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71412c221bc3483b80a3988c78e40c71"}]}] Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 71412c221bc3483b80a3988c78e40c71 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-InstanceActionsV221TestJSON-767597779-project Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 8156f9604eae490f9206747f6d119f74 Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-InstanceActionsV221TestJSON-767597779-project Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'f8b28010-5072-4c42-9cad-054aef774212'} Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:58:26.196640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Returning 404 to user: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-621eacc2-84c2-4e19-84b5-0959201aeef5 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 404 len: 111 microversion: 2.21 time: 0.048123 Oct 12 08:58:26.200913 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1602/3469] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 08:58:26 2022] DELETE /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:26.204480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f29d667a-c06f-4353-9f04-501b069166f7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:26.205101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f29d667a-c06f-4353-9f04-501b069166f7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:26.252070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:26.263362 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8b34100d-1015-4cd6-b548-64d85a6d4050 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1500 microversion: 2.1 time: 0.228831 Oct 12 08:58:26.264072 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1868/3470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:26 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1500 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:26.275069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:26.275813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] [instance: f8b28010-5072-4c42-9cad-054aef774212] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:26.282454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.283039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.283548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.284328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.284984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.285672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.307649 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] HTTP exception thrown: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Request method failure captured: Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 HTTP/1.1 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGccpQsSKSAXcNpNrkrAc-MKZS4bsPzaSgKPYo7SVUvD2-PYOWe_jlTzfn-YPZ6qFjaGtlu5QG2KijUD1WHoCiIW3FlUSMkW53bKIztddFMxALXgE8rkFvSkzFWMWlveaEftAVKltzLG3C1S2y0cXjCjAcO0yUd3hSp8Xf4kS8ZpiA Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.21 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 71412c221bc3483b80a3988c78e40c71 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71412c221bc3483b80a3988c78e40c71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/71412c221bc3483b80a3988c78e40c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_71412c221bc3483b80a3988c78e40c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71412c221bc3483b80a3988c78e40c71"}]}] Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 71412c221bc3483b80a3988c78e40c71 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-767597779 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-InstanceActionsV221TestJSON-767597779-project Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 8156f9604eae490f9206747f6d119f74 Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-InstanceActionsV221TestJSON-767597779-project Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'f8b28010-5072-4c42-9cad-054aef774212'} Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.309212 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:26.314086 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.314086 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:26.314086 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:26.314086 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:26.314086 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:26.314086 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:26.314086 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. Oct 12 08:58:26.314086 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:26.314867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f29d667a-c06f-4353-9f04-501b069166f7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:26.316789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] Returning 404 to user: Instance f8b28010-5072-4c42-9cad-054aef774212 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:26.317683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e964dad1-40c7-4d9f-9d71-69c8b7262704 tempest-InstanceActionsV221TestJSON-767597779 tempest-InstanceActionsV221TestJSON-767597779-project] 10.222.0.40 "GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212" status: 404 len: 111 microversion: 2.21 time: 0.052570 Oct 12 08:58:26.318254 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1869/3471] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:26 2022] GET /compute/v2.1/servers/f8b28010-5072-4c42-9cad-054aef774212 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:26.331689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85b11ca5-8148-411f-a083-f8e7214e52d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:26.341793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:26.342654 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f29d667a-c06f-4353-9f04-501b069166f7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1213 microversion: 2.1 time: 0.142173 Oct 12 08:58:26.347793 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1603/3472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:26 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:26.353830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b11ca5-8148-411f-a083-f8e7214e52d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.358355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b11ca5-8148-411f-a083-f8e7214e52d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.359465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b11ca5-8148-411f-a083-f8e7214e52d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.360175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-042d6961-ad31-4307-a3e4-a536bd7c94fb req-cd065f30-9c8b-491e-9b47-dab0a45a6769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6551d7-31a6-478d-a552-44f2ab930227", "tag": "e14ddd23-f367-4eca-83d4-0d247e99f94d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:26.389259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-042d6961-ad31-4307-a3e4-a536bd7c94fb req-cd065f30-9c8b-491e-9b47-dab0a45a6769 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.396808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-042d6961-ad31-4307-a3e4-a536bd7c94fb req-cd065f30-9c8b-491e-9b47-dab0a45a6769 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.397294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-042d6961-ad31-4307-a3e4-a536bd7c94fb req-cd065f30-9c8b-491e-9b47-dab0a45a6769 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.412945 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-042d6961-ad31-4307-a3e4-a536bd7c94fb req-cd065f30-9c8b-491e-9b47-dab0a45a6769 service nova] Creating event network-changed:e14ddd23-f367-4eca-83d4-0d247e99f94d for instance 3c6551d7-31a6-478d-a552-44f2ab930227 on n-h2-858383-10 Oct 12 08:58:26.419517 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-042d6961-ad31-4307-a3e4-a536bd7c94fb req-cd065f30-9c8b-491e-9b47-dab0a45a6769 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069981 Oct 12 08:58:26.422411 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1604/3473] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:26.431981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-85b11ca5-8148-411f-a083-f8e7214e52d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Going to try to stop instance {{(pid=127006) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 08:58:26.438341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:26.439131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:26.448074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.448569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.449012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.449751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.454395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.456870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.512488 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85b11ca5-8148-411f-a083-f8e7214e52d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519/action" status: 202 len: 0 microversion: 2.1 time: 0.192705 Oct 12 08:58:26.513352 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1870/3474] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:58:26 2022] POST /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:58:26.523419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:26.535807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:26.550071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.550912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.551831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.553005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.553754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.554463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.725643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:26.747638 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ff558606-5f2b-44f6-899a-7ab155b450ae tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1307 microversion: 2.1 time: 0.313642 Oct 12 08:58:26.764064 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1605/3475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:26 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:26.914404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:26.914930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:26.930105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.930600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.931035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:26.931758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:26.932224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:26.932642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:27.315482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:27.326480 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d052f05-3cf9-4803-b8d5-33fb3f42935d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1317 microversion: 2.1 time: 0.416048 Oct 12 08:58:27.328632 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1606/3476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:26 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:27.344128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:27.352252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2f2ef23-0338-4663-9329-a8d599f9562f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.832978 Oct 12 08:58:27.353866 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1871/3477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:26 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:27.375428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:27.376476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:27.383428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:27.383986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:27.384491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:27.385254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:27.385844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:27.386352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:27.473424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:27.481872 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c19ef2c0-eb44-42f7-98a4-97f8fb682c16 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1265 microversion: 2.1 time: 0.110223 Oct 12 08:58:27.482455 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1607/3478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:27 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:27.771890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:27.772513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:27.786946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:27.787790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:27.788464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:27.789564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:27.790233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:27.790882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.023279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:28.039353 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-901b13d1-2d79-48ea-bed3-31974950c365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1487 microversion: 2.1 time: 0.270611 Oct 12 08:58:28.040104 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1872/3479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:27 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1487 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:28.065348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5e3bca7-b890-41ed-8dc8-32c3d7e1ed68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:28.075584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5e3bca7-b890-41ed-8dc8-32c3d7e1ed68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.076075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5e3bca7-b890-41ed-8dc8-32c3d7e1ed68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.076517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5e3bca7-b890-41ed-8dc8-32c3d7e1ed68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.140429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5e3bca7-b890-41ed-8dc8-32c3d7e1ed68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Going to try to stop instance {{(pid=127007) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 08:58:28.224013 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5e3bca7-b890-41ed-8dc8-32c3d7e1ed68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.163130 Oct 12 08:58:28.231114 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1608/3480] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:58:28 2022] POST /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:58:28.240474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:28.241086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:28.250479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.255238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.255922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.256905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.258751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.259589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.353807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:28.355560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:28.377880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.379503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.380228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.381246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.381996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.383154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.522242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:28.534439 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9217fa85-07df-496d-8747-4fd3ef3aaff1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.296044 Oct 12 08:58:28.535729 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1873/3481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:28 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:28.549203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:28.550278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:28.564219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.564813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.567621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.568457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.571120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.571757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.622568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:28.898561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:28.912181 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2e605d93-2980-415b-a2e8-56a165ee47b7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.375213 Oct 12 08:58:28.913907 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1874/3482] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:28 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:28.926142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:28.929758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:28.943039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.946310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.947062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:28.948544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:28.952512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:28.953265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:29.028585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:29.029414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:29.056667 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c236607-0687-4279-a9e9-82c505693e7a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1317 microversion: 2.1 time: 0.700933 Oct 12 08:58:29.065479 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1609/3483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:28 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:29.072128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:29.072128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:29.094868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:29.095376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:29.099650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:29.100773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:29.101505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:29.104075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:29.110366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:29.124793 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9b09ae44-f8ae-4e8c-996d-b7860abd6cba tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1271 microversion: 2.1 time: 0.207883 Oct 12 08:58:29.125727 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1875/3484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:28 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:29.148822 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-47371a2c-8106-4277-a51c-b5ab6d4dd7ad tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/ips" status: 200 len: 153 microversion: 2.20 time: 0.090262 Oct 12 08:58:29.149528 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1610/3485] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Oct 12 08:58:29 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/ips => generated 153 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:58:29.564419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:29.565708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:29.579093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=26 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:29.581021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:29.581754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:29.582362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:29.583273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:29.585177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:29.588754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:29.862595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:29.874726 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca4e8651-bdd7-4167-ab79-1c565e7b07f3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.311260 Oct 12 08:58:29.876756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1876/3486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:29 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:29.939949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:29.940561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:29.953671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:29.954526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:29.955968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:29.956867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:29.957514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:29.958218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:30.083930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:30.084545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:30.096602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:30.097093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:30.097730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:30.099437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:30.108242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:30.108898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:30.342421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:30.355051 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d5d2e937-5f3d-40ee-97f4-abd51db5fdf3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1317 microversion: 2.1 time: 0.276030 Oct 12 08:58:30.356220 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1877/3487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:30 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:30.376420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:30.377488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:30.384651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:30.401760 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d531e756-de30-44b2-8e25-3ffe539f83a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.465500 Oct 12 08:58:30.402379 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1611/3488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:29 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:30.417959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:30.417959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:30.417959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:30.417959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:30.417959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:30.417959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:30.726994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:30.737258 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e13cb59-3192-4aad-a110-d9026a1e7229 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1313 microversion: 2.1 time: 0.379649 Oct 12 08:58:30.742528 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1878/3489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:30 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:30.906196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:30.906857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:30.909006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:30.917311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:30.921334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:30.922017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:30.924030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:30.925125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:30.926948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:31.379427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:31.380029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:31.410858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:31.411370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:31.411812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:31.412540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:31.413021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:31.413452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:31.454608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:31.463863 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e8044e8-643b-4632-a43c-2ea046f34006 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.561632 Oct 12 08:58:31.488361 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1612/3490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:30 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:31.502351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:31.506172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:31.546080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:31.547658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:31.549118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:31.551167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:31.557426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:31.564732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:31.710729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:31.734672 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8d5393e2-f7f8-4f8d-96a2-ec80e4852e02 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1317 microversion: 2.1 time: 0.350158 Oct 12 08:58:31.741516 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1879/3491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:31 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:31.768650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:31.778624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:31.790814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:31.791720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:31.792384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:31.793670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:31.794747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:31.795207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:32.007545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:32.018435 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-759934b2-6dfb-4ef3-9ce7-8bf80402f551 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1313 microversion: 2.1 time: 0.253581 Oct 12 08:58:32.035401 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1880/3492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:31 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:32.154669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:32.165604 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ea617654-5ebb-4bf9-85fa-53cf05022867 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.681697 Oct 12 08:58:32.168184 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1613/3493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:31 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:32.500432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:32.500987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:32.507907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:32.508392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:32.508828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:32.509553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:32.510009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:32.510431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:32.601689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:32.602828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:32.611063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:32.611902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:32.612492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:32.613366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:32.614009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:32.614608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:32.658312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lazy-loading 'flavor' on Instance uuid 4d1acdb6-1970-410c-a904-67636bdc3d68 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:58:32.714447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:32.725716 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9b0691f5-f531-4cc5-9f47-9b92ce366063 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.229166 Oct 12 08:58:32.726311 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1881/3494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:32 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:32.758652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:32.771006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:32.789602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:32.790523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:32.791144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:32.792041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:32.792560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:32.794515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:32.999766 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65bdcb8b-2bfb-4364-90b7-21c660818642 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/action" status: 202 len: 0 microversion: 2.20 time: 0.401856 Oct 12 08:58:33.000372 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1614/3495] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:58:32 2022] POST /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:58:33.011691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-982aa320-5378-47fc-85b9-9555f844c0dd req-c9e6bbe1-f76c-4bd4-9233-c3bddbd87627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dddf8ec5-32c7-43b3-87f3-b00275edc4a2", "tag": "3346424d-8fa9-4d5c-9d38-e57d9f8d800b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:33.030171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-982aa320-5378-47fc-85b9-9555f844c0dd req-c9e6bbe1-f76c-4bd4-9233-c3bddbd87627 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.030925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-982aa320-5378-47fc-85b9-9555f844c0dd req-c9e6bbe1-f76c-4bd4-9233-c3bddbd87627 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.031602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-982aa320-5378-47fc-85b9-9555f844c0dd req-c9e6bbe1-f76c-4bd4-9233-c3bddbd87627 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.043505 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-982aa320-5378-47fc-85b9-9555f844c0dd req-c9e6bbe1-f76c-4bd4-9233-c3bddbd87627 service nova] Creating event network-changed:3346424d-8fa9-4d5c-9d38-e57d9f8d800b for instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 on n-h1-858383-10 Oct 12 08:58:33.049792 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-982aa320-5378-47fc-85b9-9555f844c0dd req-c9e6bbe1-f76c-4bd4-9233-c3bddbd87627 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047373 Oct 12 08:58:33.051087 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1615/3496] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:33.057350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-69cdde29-7577-4fa1-8342-d0f95742cfe7 req-7745969d-cd65-44c4-b584-387efd510ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6551d7-31a6-478d-a552-44f2ab930227", "name": "network-vif-plugged", "status": "completed", "tag": "e14ddd23-f367-4eca-83d4-0d247e99f94d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:33.067660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-69cdde29-7577-4fa1-8342-d0f95742cfe7 req-7745969d-cd65-44c4-b584-387efd510ad4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.068510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-69cdde29-7577-4fa1-8342-d0f95742cfe7 req-7745969d-cd65-44c4-b584-387efd510ad4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.069171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-69cdde29-7577-4fa1-8342-d0f95742cfe7 req-7745969d-cd65-44c4-b584-387efd510ad4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.081943 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-69cdde29-7577-4fa1-8342-d0f95742cfe7 req-7745969d-cd65-44c4-b584-387efd510ad4 service nova] Creating event network-vif-plugged:e14ddd23-f367-4eca-83d4-0d247e99f94d for instance 3c6551d7-31a6-478d-a552-44f2ab930227 on n-h2-858383-10 Oct 12 08:58:33.088646 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-69cdde29-7577-4fa1-8342-d0f95742cfe7 req-7745969d-cd65-44c4-b584-387efd510ad4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035936 Oct 12 08:58:33.089942 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1616/3497] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:33.097426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:33.098253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:33.105243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.106030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.106919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.107654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.108180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.108689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.139348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:33.259770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:33.275318 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b73949b3-3b50-46af-9186-e771d901f768 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1317 microversion: 2.1 time: 0.520608 Oct 12 08:58:33.290053 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1882/3498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:32 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:33.298525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:33.310775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:33.317340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.318028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.318612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.319588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.327376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.327928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.577304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:33.587234 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4771646d-4dde-4acc-aa90-90ca6bf068f0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1313 microversion: 2.1 time: 0.293639 Oct 12 08:58:33.599226 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1883/3499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:33 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:33.611274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:33.612132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:33.619310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:33.629426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:33.632482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:33.633053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.634070 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fed3d6d2-6777-40bc-a4ac-ac90f7fdaa36 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.542807 Oct 12 08:58:33.634963 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1617/3500] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:33 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:33.635711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.636202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.636938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.637409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.637858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.651864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-669981235", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a89cb8de-3356-4d1b-a516-3c348eab6ff9"}], "block_device_mapping_v2": [{"uuid": "77012d5d-6d1a-4c90-901e-598ac88f35b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:33.733491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] validate_networks() for [('a89cb8de-3356-4d1b-a516-3c348eab6ff9', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:33.896815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:33.911040 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c2e3528f-2494-4cb6-99c0-8e81b0484353 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.301169 Oct 12 08:58:33.912837 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1884/3501] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:33 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:33.928950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:33.932099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:33.940347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.941016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.941479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:33.942175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:33.942623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:33.943045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.124642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:34.134079 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39198511-f06c-4159-b1a2-afd51742abd2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.219318 Oct 12 08:58:34.134978 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1885/3502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:33 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:34.206262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:58:34.206756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:58:34.207459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:58:34.207934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:58:34.208591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:58:34.218320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.218936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.219449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.220286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.220806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.221301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.239130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for project f77355ddeba541b189e41cb089a07eba. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:58:34.243956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Getting quotas for user 3662e9666cc14f80a5ea16670a6f1595 and project f77355ddeba541b189e41cb089a07eba. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:58:34.300846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:34.301394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:34.308941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.309330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:58:34.311547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77012d5d-6d1a-4c90-901e-598ac88f35b1',volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:58:34.315871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.316477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.317347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.317995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.318524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.467431 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-92f6d0e8-f816-42b6-a7ba-47146ab4b84f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831090 Oct 12 08:58:34.474739 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1618/3503] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:58:34.481939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b41d082-5d06-443a-926e-c01436d53930 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:34.482829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b41d082-5d06-443a-926e-c01436d53930 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:34.488599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:34.500396 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-583ecd73-8d86-4c51-bf86-3492a3e80397 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1317 microversion: 2.1 time: 0.203997 Oct 12 08:58:34.501049 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1886/3504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:34 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:34.541558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5b41d082-5d06-443a-926e-c01436d53930 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:34.550537 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b41d082-5d06-443a-926e-c01436d53930 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1052 microversion: 2.1 time: 0.074016 Oct 12 08:58:34.553628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1619/3505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:34 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1052 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:34.615119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:34.615771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:34.623440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.623927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.624369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.625273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.625925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.626431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.663468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:34.664372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:34.685366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.685366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.689290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.691710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.692798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.693138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.819491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:34.829995 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89a65e7e-c756-431e-9873-0b01fc042101 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1313 microversion: 2.1 time: 0.218588 Oct 12 08:58:34.830592 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1887/3506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:34 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:34.939545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:34.941488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:34.958599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:34.973420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.975557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.976011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.977802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:34.978261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:34.978685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:34.982101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:34.983606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:34.984851 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8efb2f5d-f746-4dc7-9a85-630ddb5a4f10 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.326301 Oct 12 08:58:34.993325 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1620/3507] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:34 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:35.147446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:35.158668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:35.162428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:35.172132 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9b31b0ae-73f4-42dd-a6f9-62aa3ace48b3 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.239724 Oct 12 08:58:35.176528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.176927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.177383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.178260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.178729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.179161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.197835 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1888/3508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:34 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:35.443867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:35.452266 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c7858289-44a2-4a5f-8430-ee527550e82b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.297488 Oct 12 08:58:35.453689 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1621/3509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:35 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:35.524552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:35.525743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:35.531987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.532767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.533336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.534326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.536289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.536856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.574468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:35.575543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:35.582578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.583146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.583630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.584331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.584787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.585210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.662732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:35.672827 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eda7f5b7-0bdb-4a2c-aab9-51fac4707e9f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1150 microversion: 2.1 time: 0.102146 Oct 12 08:58:35.677521 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1622/3510] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:35 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:35.783018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:35.791477 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fdc634a0-c8af-45d5-9a65-6404114a7fa6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1505 microversion: 2.1 time: 0.271334 Oct 12 08:58:35.792269 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1889/3511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:35 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:35.815886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:35.816388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:35.823682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.824159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.824869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.825482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.825937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.826357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.857136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:35.858194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:35.871497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:58:35.876652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.878087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.880711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:35.883077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:35.883654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:35.886064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.020154 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8aec79b-1be2-48bd-9c3d-5d579cfc41ba tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 204 len: 0 microversion: 2.1 time: 0.208576 Oct 12 08:58:36.023611 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1623/3512] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:58:35 2022] DELETE /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:58:36.033126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:36.033860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:36.050320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.053005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.055111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.055846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.056306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.056736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.061991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:36.070114 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a979ae6b-71c5-4151-aa87-c28f3551200e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1313 microversion: 2.1 time: 0.218580 Oct 12 08:58:36.071420 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1890/3513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:35 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:36.076102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:36.076748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:36.082800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.083358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.084034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.084824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.085355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.085873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.090112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:36.234879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:36.244724 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ab691937-f548-4551-ad96-05f9aea3b590 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1511 microversion: 2.1 time: 0.172197 Oct 12 08:58:36.245315 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1891/3514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:36 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:36.249950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:36.251019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:36.257605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.258096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.258711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.259579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.260034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.260459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.410395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:36.418859 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-995fb763-f2c6-4665-b1d9-bbf8672c3423 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.172337 Oct 12 08:58:36.435753 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1892/3515] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:36 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:36.462831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:36.477868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:36.478219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:36.479490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:36.479619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:36.482133 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6a99f71-99a4-4795-aa47-38321d844ebe tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.456487 Oct 12 08:58:36.482915 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1624/3516] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:36 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:36.487282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.487801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.488236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.489099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.489730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.490045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.662121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:36.677701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b06f82b-d305-425c-a0a0-ccc865f8dba0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.201089 Oct 12 08:58:36.678406 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1893/3517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:36 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:36.702255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:36.703900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:36.710983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.711785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.712376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.713237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:36.713890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:36.714469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:36.817027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:36.829899 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b4f58019-96cd-4815-832e-f9756d3385d7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1168 microversion: 2.1 time: 0.131312 Oct 12 08:58:36.830709 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1625/3518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:36 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1168 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:37.099975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:37.101607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:37.112959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:37.117424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:37.118225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:37.120601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:37.122025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:37.123835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:37.268296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:37.269312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:37.280306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:37.286208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:37.287758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:37.288691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:37.289840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:37.290467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:37.705054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:37.720145 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f2b08791-3bc1-4c46-80bd-0f07ee41c047 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1511 microversion: 2.1 time: 0.456474 Oct 12 08:58:37.724804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1626/3519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:37 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:37.736884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:37.739353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:37.756031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:37.757221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:37.759589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:37.761047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:37.762811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:37.764098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:37.893748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:37.910096 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e479cf4b-656f-425c-9abd-be247596568b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1313 microversion: 2.1 time: 0.814295 Oct 12 08:58:37.911893 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1894/3520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:37 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1313 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:37.919501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:37.923880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:37.940366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:37.941229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:37.941879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:37.942609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:37.943068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:37.943489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:38.178640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:38.202517 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3096245f-97c8-45d5-9984-e9905d9f040f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.475251 Oct 12 08:58:38.203129 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1627/3521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:37 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:38.217223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:38.219839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:38.227986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:38.228768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:38.229677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:38.230640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:38.231245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:38.231832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:38.365425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:38.382871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:38.384490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:38.390332 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-401ad776-62c2-4ce0-b653-d29e8a343fba tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.476267 Oct 12 08:58:38.390978 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1895/3522] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:37 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:38.399390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b486a246-86f1-4a26-82b6-571b54fc3f64 req-c3501aac-3a60-4a4f-a50b-74e57a1055c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddf8ec5-32c7-43b3-87f3-b00275edc4a2", "name": "network-vif-plugged", "status": "completed", "tag": "3346424d-8fa9-4d5c-9d38-e57d9f8d800b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:38.422665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b486a246-86f1-4a26-82b6-571b54fc3f64 req-c3501aac-3a60-4a4f-a50b-74e57a1055c6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:38.423467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b486a246-86f1-4a26-82b6-571b54fc3f64 req-c3501aac-3a60-4a4f-a50b-74e57a1055c6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:38.424633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b486a246-86f1-4a26-82b6-571b54fc3f64 req-c3501aac-3a60-4a4f-a50b-74e57a1055c6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:38.445351 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b486a246-86f1-4a26-82b6-571b54fc3f64 req-c3501aac-3a60-4a4f-a50b-74e57a1055c6 service nova] Creating event network-vif-plugged:3346424d-8fa9-4d5c-9d38-e57d9f8d800b for instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 on n-h1-858383-10 Oct 12 08:58:38.450728 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b486a246-86f1-4a26-82b6-571b54fc3f64 req-c3501aac-3a60-4a4f-a50b-74e57a1055c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058430 Oct 12 08:58:38.455804 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1896/3523] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:38.461493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:38.474805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:38.483877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:38.484684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:38.485299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:38.486774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:38.487396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:38.488194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:38.877194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:38.894564 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c55b2e90-1762-422c-bdc6-964173e5b42a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1210 microversion: 2.1 time: 0.435944 Oct 12 08:58:38.899209 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1897/3524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:38 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1210 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:38.913101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:38.916829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:38.937473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:38.939484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:38.941086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:38.943185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:38.943869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:38.946795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:38.949220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:38.960137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bbf3c502-eaa2-4fb0-a9e2-4b0a9dc3e32b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.752869 Oct 12 08:58:38.965874 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1628/3525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:38 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:38.971590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:38.979276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:38.994168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.002627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.003473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:39.004470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.005144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.005805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:39.223944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:39.236516 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8ecea17a-0af8-4768-bdd4-c057db9dbf72 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 200 len: 1469 microversion: 2.1 time: 0.334774 Oct 12 08:58:39.251697 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1898/3526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:38 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:39.262055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:39.273353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:39.286859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.288541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.289216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:39.290197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.290852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.291470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:39.468724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:39.480689 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4f5892f9-75a6-4b3f-9acc-0674df5f13a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1313 microversion: 2.1 time: 0.512279 Oct 12 08:58:39.498679 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1629/3527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:38 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:39.505151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-315340b3-a967-41d2-a049-e20fde1bc15d req-986cd6b5-2a41-411c-8323-8c4208837f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6551d7-31a6-478d-a552-44f2ab930227", "name": "network-vif-deleted", "tag": "e14ddd23-f367-4eca-83d4-0d247e99f94d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:39.531331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-315340b3-a967-41d2-a049-e20fde1bc15d req-986cd6b5-2a41-411c-8323-8c4208837f38 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.532115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-315340b3-a967-41d2-a049-e20fde1bc15d req-986cd6b5-2a41-411c-8323-8c4208837f38 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.532797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-315340b3-a967-41d2-a049-e20fde1bc15d req-986cd6b5-2a41-411c-8323-8c4208837f38 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:39.552588 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-315340b3-a967-41d2-a049-e20fde1bc15d req-986cd6b5-2a41-411c-8323-8c4208837f38 service nova] Creating event network-vif-deleted:e14ddd23-f367-4eca-83d4-0d247e99f94d for instance 3c6551d7-31a6-478d-a552-44f2ab930227 on n-h2-858383-10 Oct 12 08:58:39.568671 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-315340b3-a967-41d2-a049-e20fde1bc15d req-986cd6b5-2a41-411c-8323-8c4208837f38 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067891 Oct 12 08:58:39.572666 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1630/3528] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:39.587566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:39.590652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:39.608256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.609029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.612916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:39.614086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.614727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.615759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:39.771851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:39.788296 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f782e71-3da6-4607-a2e1-e298e86d928b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.530293 Oct 12 08:58:39.789236 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1899/3529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:39 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:39.928241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:39.928788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:39.938249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.938736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.943069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:39.944025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:39.947043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:39.947789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.006567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:40.031049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:40.037451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:40.053188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-43c94ded-3597-4b47-91c4-f427c66ff1e8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.467750 Oct 12 08:58:40.054332 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1631/3530] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:39 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:40.089479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:40.090526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:40.106576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.110228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.110954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.114637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.115984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.118168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.442997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:40.455227 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4dc435aa-715e-4fc8-9693-a2a60c5adcac tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1210 microversion: 2.1 time: 0.529845 Oct 12 08:58:40.457915 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1900/3531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:39 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1210 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:40.468372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:40.470694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:40.489582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.494609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.495715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.496620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.497240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.498270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.540043 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 HTTP/1.1 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3c6551d7-31a6-478d-a552-44f2ab930227'} Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:40.541938 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:40.547048 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:40.547048 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:40.547048 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:40.547048 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:40.547048 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:40.547048 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:58:40.547048 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:40.547048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:40.551196 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f7bce55-fb5d-4dfe-9e58-a0a1016f1ce9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 404 len: 111 microversion: 2.1 time: 0.091492 Oct 12 08:58:40.553003 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1901/3532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:40 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:58:40.560545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:40.561872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:40.570548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.571381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.572041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.573023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.574056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.574796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.672857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:40.689263 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f92074a3-a785-4980-8337-541e4e8aad1d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.612306 Oct 12 08:58:40.690465 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1632/3533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:40 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:40.698278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:40.699200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:40.706388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.707155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.707862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.709862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.710550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.711335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.939055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:40.947635 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b4506824-7d27-47e2-a2e2-5e47f19128c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.253266 Oct 12 08:58:40.951529 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1633/3534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:40 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:40.956594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:40.957205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:40.960984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:40.963591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.965216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.966849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.968169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:40.968994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:40.969653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:40.992748 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-50500780-482c-435e-99af-6f1c3777df0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1501 microversion: 2.1 time: 0.425647 Oct 12 08:58:40.996657 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1902/3535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:40 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1501 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:41.015315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:41.020204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:41.021076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:41.027866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.028648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.029272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.030334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.030978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.031705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.241987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:41.255352 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f2f0d296-9197-4ca1-abfd-ed7f67b7f524 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.302488 Oct 12 08:58:41.257231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1634/3536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:40 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:41.268902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:41.273237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:41.280680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.281176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.281743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.282542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.282996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.283452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.345774 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.network.security_group_api [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Removing security group a9681234-13da-4a1a-aed3-620d9623d321 from port 3346424d-8fa9-4d5c-9d38-e57d9f8d800b Oct 12 08:58:41.510191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:41.520885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:41.525141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:41.526410 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-70c87553-aac5-41c6-b9b7-8033758ee3f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.267444 Oct 12 08:58:41.531005 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1635/3537] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:41 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:41.544558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34a05064-5db6-465c-8f79-f4f72af7b6af tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34a05064-5db6-465c-8f79-f4f72af7b6af tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 163 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": 12345, "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 12345 Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:58:41.557553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34a05064-5db6-465c-8f79-f4f72af7b6af tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-34a05064-5db6-465c-8f79-f4f72af7b6af tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.026897 Oct 12 08:58:41.564569 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1636/3538] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:41 2022] POST /compute/v2.1/servers => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:41.567003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:41.567639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:41.576819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.577401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.577899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.578715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.579917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.580381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.771545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:41.783519 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c8889bfb-5967-48ea-9e73-58c78dc8ca6b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1210 microversion: 2.1 time: 0.222511 Oct 12 08:58:41.787633 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1637/3539] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:41 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1210 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:41.798145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:41.799031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:41.814167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.815083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.815865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.817650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.818564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.819282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.924676 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45267793-3ca3-4fd9-a036-a86c3b454f19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2/action" status: 202 len: 0 microversion: 2.1 time: 0.909101 Oct 12 08:58:41.925293 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1903/3540] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:58:41 2022] POST /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2/action => generated 0 bytes in 911 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 08:58:41.932358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ee6d1d84-f4a2-472f-8ca5-23eacb219ea4 req-0cbc9cc8-8f18-41aa-906d-f7968df13f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe7c36b-9501-4250-9dab-4ab9ad8d154b", "tag": "52b62051-41ae-464b-bac3-daff927171dd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:41.959459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ee6d1d84-f4a2-472f-8ca5-23eacb219ea4 req-0cbc9cc8-8f18-41aa-906d-f7968df13f17 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:41.962392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ee6d1d84-f4a2-472f-8ca5-23eacb219ea4 req-0cbc9cc8-8f18-41aa-906d-f7968df13f17 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:41.963525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ee6d1d84-f4a2-472f-8ca5-23eacb219ea4 req-0cbc9cc8-8f18-41aa-906d-f7968df13f17 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:41.997595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ee6d1d84-f4a2-472f-8ca5-23eacb219ea4 req-0cbc9cc8-8f18-41aa-906d-f7968df13f17 service nova] Creating event network-changed:52b62051-41ae-464b-bac3-daff927171dd for instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b on n-h1-858383-10 Oct 12 08:58:42.010247 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ee6d1d84-f4a2-472f-8ca5-23eacb219ea4 req-0cbc9cc8-8f18-41aa-906d-f7968df13f17 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083134 Oct 12 08:58:42.014102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:42.015923 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1904/3541] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:42.026506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3dcde005-2749-4e68-83a1-d29b9769a0da tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.236655 Oct 12 08:58:42.029745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:42.034574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:42.046651 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1638/3542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:41 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:42.054529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:42.055501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:42.057275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.059353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.059724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.060451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.060926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.061350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.063889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.064743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.065486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.066665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.067441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.067958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.224571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:42.234686 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71035a07-48d6-46db-bdb4-f91756308e27 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1459 microversion: 2.1 time: 0.185775 Oct 12 08:58:42.239895 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1639/3543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:42 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1459 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:42.267265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e85b4f93-edb7-4d7a-88a3-695be7553d14 req-c5bc98ac-6d01-43c7-a1ef-be4645281c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dddf8ec5-32c7-43b3-87f3-b00275edc4a2", "tag": "3346424d-8fa9-4d5c-9d38-e57d9f8d800b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:42.294335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e85b4f93-edb7-4d7a-88a3-695be7553d14 req-c5bc98ac-6d01-43c7-a1ef-be4645281c83 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.298924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e85b4f93-edb7-4d7a-88a3-695be7553d14 req-c5bc98ac-6d01-43c7-a1ef-be4645281c83 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.299774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e85b4f93-edb7-4d7a-88a3-695be7553d14 req-c5bc98ac-6d01-43c7-a1ef-be4645281c83 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.327574 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e85b4f93-edb7-4d7a-88a3-695be7553d14 req-c5bc98ac-6d01-43c7-a1ef-be4645281c83 service nova] Creating event network-changed:3346424d-8fa9-4d5c-9d38-e57d9f8d800b for instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 on n-h1-858383-10 Oct 12 08:58:42.346458 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e85b4f93-edb7-4d7a-88a3-695be7553d14 req-c5bc98ac-6d01-43c7-a1ef-be4645281c83 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079891 Oct 12 08:58:42.347330 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1640/3544] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:42.367060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:42.367788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:42.384133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.384630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.385077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.385857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.386321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.386755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.644928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:42.657400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c4f58997-4376-4c00-84ae-b186e2fe7990 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.308937 Oct 12 08:58:42.658034 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1641/3545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:42 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:42.666108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:42.666719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:42.699162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:42.705412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.708905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.710084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.713339 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-201cbd3d-436d-40a6-9b39-050c1d1dbdc0 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.691759 Oct 12 08:58:42.715289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.716825 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1905/3546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:42 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:42.716956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.718372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.729638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:42.730738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:42.749254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.750082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.750685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:42.753209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:42.753955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:42.755522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.148142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:43.158713 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e0cc19f2-bf36-4caa-bf0c-728d63f79e1f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.497307 Oct 12 08:58:43.159371 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1642/3547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:42 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:43.187675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:43.188553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:43.195263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:43.196056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:43.196733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.197826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:43.198582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:43.199253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.446079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:43.457484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:43.459326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:43.460703 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-51ed5a71-e7f5-485b-8336-8da565cad28e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.282034 Oct 12 08:58:43.462402 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1643/3548] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:43 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:43.468272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:43.469357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:43.476024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:43.476823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:43.477528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.478406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:43.479003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:43.479572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.714665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:43.724880 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-666a7b06-ec08-43a9-a9b6-00bf4c7015b7 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1210 microversion: 2.1 time: 0.260962 Oct 12 08:58:43.729884 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1644/3549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:43 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1210 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:43.731663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:43.737144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:43.738059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:43.745565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:43.746750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:43.747368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.748376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:43.748842 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-429cc30d-30e6-46b9-819a-5592e02b2ca8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 1.024886 Oct 12 08:58:43.749517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:43.750420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.757632 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1906/3550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:42 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:43.770704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:43.771362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:43.777907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:43.778393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:43.779270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.779509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:43.780097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:43.781885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:43.974057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:43.986756 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-29321338-80c3-4d76-bda8-c7d765b9c370 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.255178 Oct 12 08:58:43.987427 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1645/3551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:43 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:44.016392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:44.017994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:44.028458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.029334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.030497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.031793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.032727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.033786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.228526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:44.243385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:44.257171 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-deb67abb-6957-46c8-85d6-a9b4233c047a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.498348 Oct 12 08:58:44.258678 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1907/3552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:43 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:44.282705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:44.295428 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc41664d-d040-4b04-bdae-4a4d8b0bc93f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.284440 Oct 12 08:58:44.298623 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1646/3553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:44 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:44.326879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:44.328221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:44.335833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.336693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.337489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.338730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.339467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.340179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.489865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:44.492049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:44.501530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.502691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.503143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.504182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.504696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.505139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.556141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=16 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:44.640907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:44.664140 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9c3d2b63-84be-4d25-bbff-122459f01d6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.342084 Oct 12 08:58:44.670618 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1908/3554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:44 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:44.730194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:44.741500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:44.743351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:44.744687 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc539b71-bef7-4c9a-a8f1-fd419292c712 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.260981 Oct 12 08:58:44.753511 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1647/3555] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:44 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:44.753750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:44.753750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:44.762449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.769834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.769834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.769834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.769834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.769834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.778902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:44.779894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:44.796076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.799589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.800131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:44.801028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:44.801361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:44.804137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:45.008116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:45.018266 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-53931e24-e083-4593-9ddb-3d86734bfbc8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.246111 Oct 12 08:58:45.018943 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1648/3556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:44 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:45.024271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1698663976", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "d30a231a-ae95-4ebb-90c8-46232d6674b8"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:45.101844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] validate_networks() for [('d30a231a-ae95-4ebb-90c8-46232d6674b8', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:45.146666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:45.158505 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5625c72-68c4-483a-9b2b-d23c58038151 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1198 microversion: 2.1 time: 0.411552 Oct 12 08:58:45.160021 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1909/3557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:44 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1198 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:45.282187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:45.282867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:45.290070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:45.291518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:45.291518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:45.292201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:45.294056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:45.294531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:45.323355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:45.484729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:45.497054 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-102cf72d-2fd7-4fb4-a329-6544317d4549 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.218849 Oct 12 08:58:45.506658 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1910/3558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:45 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:45.609828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:58:45.611029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:58:45.611624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:58:45.612140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:58:45.612649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:58:45.627697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:45.629241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:45.630772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:45.633675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:45.634397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:45.635153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:45.663868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:58:45.669791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:45.671859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Getting quotas for user 54fad01e2e6e41d0887895b131051ee1 and project f1cad6e327a84a128250f945ec1444ac. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:58:45.701845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:58:45.704658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:58:45.722761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2194430", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "acf688a7-480c-488d-9d43-96fb160d60bc"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:45.766906 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d65bf94-cb3d-46a4-bec3-0ca887010895 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746521 Oct 12 08:58:45.767814 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1649/3559] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:58:45.773382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55a9c7a9-10c1-4377-be80-b7d15eda37ab tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-710574179", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bd06bc30-baf8-4479-8de1-71145ad9f674", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:45.820138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] validate_networks() for [('acf688a7-480c-488d-9d43-96fb160d60bc', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:45.915965 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-55a9c7a9-10c1-4377-be80-b7d15eda37ab tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Block Device bd06bc30-baf8-4479-8de1-71145ad9f674 is not bootable. Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55a9c7a9-10c1-4377-be80-b7d15eda37ab tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 357 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-710574179", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bd06bc30-baf8-4479-8de1-71145ad9f674", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: exception: Block Device bd06bc30-baf8-4479-8de1-71145ad9f674 is not bootable. Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-710574179', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'bd06bc30-baf8-4479-8de1-71145ad9f674'}], 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device bd06bc30-baf8-4479-8de1-71145ad9f674 is not bootable. Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:45.928707 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device bd06bc30-baf8-4479-8de1-71145ad9f674 is not bootable. Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device bd06bc30-baf8-4479-8de1-71145ad9f674 is not bootable. Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:45.933946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55a9c7a9-10c1-4377-be80-b7d15eda37ab tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Block Device bd06bc30-baf8-4479-8de1-71145ad9f674 is not bootable. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:45.936238 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-55a9c7a9-10c1-4377-be80-b7d15eda37ab tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.166962 Oct 12 08:58:45.937098 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1650/3560] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:45.943402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bff6835-8187-4b8a-a75e-7ae070ec5f61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:45.944035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5bff6835-8187-4b8a-a75e-7ae070ec5f61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:46.007780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5bff6835-8187-4b8a-a75e-7ae070ec5f61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:46.016399 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5bff6835-8187-4b8a-a75e-7ae070ec5f61 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1215 microversion: 2.1 time: 0.077826 Oct 12 08:58:46.017309 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1651/3561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:45 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:46.025043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:46.026396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:46.035580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.036088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.036488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.037186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.037674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.038092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.220147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:46.230631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:46.232221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:46.233740 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3e31611-0487-44df-a885-bff7f9aecafb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.214960 Oct 12 08:58:46.234364 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1652/3562] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:46 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:46.251521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:46.252475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:46.266886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.267669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.268550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.271034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.271838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.272589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.420010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:58:46.420618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:58:46.421217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:58:46.422167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:58:46.422789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:58:46.435005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.435948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.436681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.438011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.438716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.439455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.448179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:46.459343 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b52636f-8536-419d-880e-7c100ac77dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.223502 Oct 12 08:58:46.460634 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1653/3563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:46 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:46.466654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:46.467380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Getting quotas for project 2fafe5bb6c2d4ac1a7f80847d29f1dc8. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:58:46.467801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:46.475014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.475995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.476602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.477575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.478418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.481893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.488539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Getting quotas for user 2d75592241e041ffabfec3154e4d09d5 and project 2fafe5bb6c2d4ac1a7f80847d29f1dc8. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:58:46.509241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:58:46.513476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:58:46.582626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-766e2ebb-2741-44c5-9160-aceb74dba713 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067932 Oct 12 08:58:46.589530 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1911/3564] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:58:46.599466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:46.600562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:46.609229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.610255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.610938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.612250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.612985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.613744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.691418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:46.710100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-96649fc3-1c32-43bb-87c5-e65c02f794d1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.246794 Oct 12 08:58:46.712258 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1654/3565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:46 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:46.745541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:46.747450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:46.760031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.760688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.761353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.762506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:46.763370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:46.763874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:46.788903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:46.955240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:46.967590 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-800465f8-c30a-4b34-9095-853538c2199f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1198 microversion: 2.1 time: 0.375854 Oct 12 08:58:46.983903 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1912/3566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:46 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1198 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:46.996406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:46.997552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:47.007572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:47.009937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:47.011078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:47.011747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:47.013246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:47.014050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:47.014988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:47.021970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:47.034988 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d88619b7-b55d-4dad-a688-a959d7cb797e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.321160 Oct 12 08:58:47.035592 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1655/3567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:46 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:47.043736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f33fb981-3ebf-4ba0-9a85-6e0774c708ae tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:47.044580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f33fb981-3ebf-4ba0-9a85-6e0774c708ae tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:47.132722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f33fb981-3ebf-4ba0-9a85-6e0774c708ae tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:47.140935 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f33fb981-3ebf-4ba0-9a85-6e0774c708ae tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1222 microversion: 2.1 time: 0.103377 Oct 12 08:58:47.153955 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1656/3568] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:47 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:47.165006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:47.165679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:47.178831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:47.180006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:47.180669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:47.182301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:47.185054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:47.186926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:47.227778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:47.239710 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b21da463-ab76-4ece-9dbc-584801398625 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.249144 Oct 12 08:58:47.241002 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1913/3569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:46 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:47.265820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:47.266441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:47.275129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:47.275697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:47.276195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:47.276919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:47.277995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:47.278642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:47.298873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:47.311134 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4d2a36c-197f-434e-833e-f9d473f8a420 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1267 microversion: 2.1 time: 0.167171 Oct 12 08:58:47.311865 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1657/3570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:47 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:47.482535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:47.495208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:47.496920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:47.499065 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c615fdbd-f368-4088-a63b-c4d9e75d734b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.237727 Oct 12 08:58:47.500279 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1914/3571] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:47 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:47.744769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:47.745398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:47.768957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:47.774561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:47.775172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:47.775941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:47.776421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:47.782623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:47.998791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:48.002924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:48.017883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.019242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.019704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.020457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.020922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.021351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.125212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:48.135290 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5194a644-4f1e-40f9-9f53-4b2860af89f7 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.394631 Oct 12 08:58:48.149585 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1658/3572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:47 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:48.167665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:48.168889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:48.188373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.189415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.190453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.193276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.194413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.196433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.345341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:48.356827 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7445a3ae-2065-4d09-8c6f-01216a237784 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1198 microversion: 2.1 time: 0.364370 Oct 12 08:58:48.358483 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1915/3573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:47 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1198 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:48.363665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:48.365326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:48.372395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:48.384714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a55f553e-71e2-4368-8693-bb2dcca4689a tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1274 microversion: 2.1 time: 0.221609 Oct 12 08:58:48.388250 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1659/3574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:48 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:48.391541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.392291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.393661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.394627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.395391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.396885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.402346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:48.403252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:48.415261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.420373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.421055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.422178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.424837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.425494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.661264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:48.670874 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f70d7a89-784d-4e7e-9f8a-bb56c2e33137 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.311066 Oct 12 08:58:48.671463 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1916/3575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:48 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:48.676990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:48.677805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:48.684948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.685703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.686330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.687260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:48.687876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:48.688464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:48.963211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:48.979505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:48.981305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:48.982837 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2f48382-5a54-4a8e-99e6-235569ed86f1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1745 microversion: 2.20 time: 0.310169 Oct 12 08:58:48.986989 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1917/3576] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:48 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1745 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:49.039499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:49.049996 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-87b966b2-899f-433f-9d44-a7fec1ffba80 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1273 microversion: 2.1 time: 0.659915 Oct 12 08:58:49.050594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1660/3577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:48 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1273 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:49.172976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:49.174869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:49.193968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.194905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.195511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.196397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.202145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.203175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.395184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:49.396099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:49.409847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.410789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.411526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.415126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.415764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.416369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.529349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:49.544746 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dca2953e-c89e-4500-b5dc-de69506821a5 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.376413 Oct 12 08:58:49.546588 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1918/3578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:49 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:49.552269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:49.553132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:49.559909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.560769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.561521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.562592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.563313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.563979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.689130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:49.707213 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-154a9456-f9d5-4659-b933-2541be14aa32 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1280 microversion: 2.1 time: 0.158482 Oct 12 08:58:49.708494 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1919/3579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:49 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:49.714174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:49.714929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:49.724634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.725760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.727165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.728288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.729355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.730982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.864435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:49.872886 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7effaefd-b3fa-46ba-b868-d1048a925617 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1198 microversion: 2.1 time: 0.488505 Oct 12 08:58:49.883584 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1661/3580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:49 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1198 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:49.910889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c81b435-f876-47bf-8f94-78aff2821d30 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1976892304", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3816cc90-eecd-445f-9498-be8ec212c308", "destination_type": "local"}, {"source_type": "volume", "uuid": "399e2753-fb7f-407d-834b-41fd5a856ecf", "destination_type": "invalid"}], "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c81b435-f876-47bf-8f94-78aff2821d30 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 495 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1976892304", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3816cc90-eecd-445f-9498-be8ec212c308", "destination_type": "local"}, {"source_type": "volume", "uuid": "399e2753-fb7f-407d-834b-41fd5a856ecf", "destination_type": "invalid"}], "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1976892304', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '3816cc90-eecd-445f-9498-be8ec212c308', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '399e2753-fb7f-407d-834b-41fd5a856ecf', 'destination_type': 'invalid'}], 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'invalid' Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:49.915513 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c81b435-f876-47bf-8f94-78aff2821d30 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:49.924307 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c81b435-f876-47bf-8f94-78aff2821d30 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010123 Oct 12 08:58:49.927651 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1662/3581] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:49 2022] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:49.934490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:49.934490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:49.946615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.947105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.952374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.953363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:49.959115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:49.959579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:49.977339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:49.989502 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-00c70b0e-ed8e-400a-a16e-8bdbf1266784 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.279565 Oct 12 08:58:50.005572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1920/3582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:49 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:50.014551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:50.015189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:50.022609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.024011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.024460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.026392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.026392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.026590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.180962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:50.190033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:50.191765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:50.193130 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0fe2b477-dba8-403b-8558-3263b1510e40 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1745 microversion: 2.20 time: 0.183489 Oct 12 08:58:50.193727 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1921/3583] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:50 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:58:50.199041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:50.199897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:50.206217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.206976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.207821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.208749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.209945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.210586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.317688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:50.330052 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-da095a2c-ba2d-426b-86e1-d0bad6a879c3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.401093 Oct 12 08:58:50.339610 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1663/3584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:49 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:50.355063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:50.355926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:50.362471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.362952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.363677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.364378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.365022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.365655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.385877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:50.395414 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-94887b2a-6dee-49fc-9a67-1d7065cc35c2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1315 microversion: 2.1 time: 0.200192 Oct 12 08:58:50.402792 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1922/3585] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:50 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:50.573284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:50.573991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:50.580986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.581504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.581939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.582630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.583072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.583495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.722750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:50.732012 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac5e274e-8843-4d28-b7cc-83dfb8a9f7ec tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.162610 Oct 12 08:58:50.733028 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1923/3586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:50 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:50.738263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:50.739508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:50.746220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.747245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.747955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.748982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.749651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.750328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.822261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:50.832566 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f22c32f-2be4-4827-af90-c63a33e45bee tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1280 microversion: 2.1 time: 0.098085 Oct 12 08:58:50.833288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1924/3587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:50 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1280 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:50.899076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:50.899602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:50.905906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.906405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.906842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.907555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:50.908008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:50.908431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:50.942638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:50.951504 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-62c75f45-832c-41c5-bdc2-b26aa04e8fc6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.600362 Oct 12 08:58:50.952691 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1664/3588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:50 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:51.019199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:51.019920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:51.026597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.027306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.028452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.029399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.030185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.030803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.074407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:51.084451 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c9d456e0-1b33-4aec-ae2f-83f7da604777 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1198 microversion: 2.1 time: 0.189763 Oct 12 08:58:51.086196 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1925/3589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:50 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1198 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:51.093193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39e60077-4804-4701-ba8f-b1241fdb52d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-304795018", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39e60077-4804-4701-ba8f-b1241fdb52d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 491 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-304795018", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-304795018', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:51.099727 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 12 08:58:51.103451 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:51.107078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39e60077-4804-4701-ba8f-b1241fdb52d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:51.108320 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39e60077-4804-4701-ba8f-b1241fdb52d5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.020924 Oct 12 08:58:51.110315 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1926/3590] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:51 2022] POST /compute/v2.1/servers => generated 624 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:51.118824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:51.119474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:51.130257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.133227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.133926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.135605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.136251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.136876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.316910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:51.328814 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2db9ead-4007-4dc7-b0a0-d81604543578 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.212712 Oct 12 08:58:51.333492 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1927/3591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:51 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:51.355764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:51.356375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:51.366009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.366744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.367689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.369406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.370065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.370643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.395254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:51.396855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:51.416764 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0061e4af-2a24-4678-8524-3f30f2b36599 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.399244 Oct 12 08:58:51.418394 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1665/3592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:51 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:51.431339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:51.435097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:51.444508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.445015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.446877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.452588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.453081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.455825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.570059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:51.581710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:51.583808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:51.585315 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2159aef5-f6b3-47b6-b7dd-f098dde8cb57 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.253927 Oct 12 08:58:51.601984 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1928/3593] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:51 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:51.610264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:51.611828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:51.618684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.619529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.620182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.621392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.622257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.622899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.791129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:51.812080 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71b026b5-42dd-4aaa-be04-9d73575e33b0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1315 microversion: 2.1 time: 0.208539 Oct 12 08:58:51.819705 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1929/3594] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:51 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:51.832770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:51.833396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:51.850500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.851267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.851862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.852809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:51.853592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:51.854189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:51.956469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:51.971086 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bf2f7fa9-e2ef-4b3a-90ae-8e380003e533 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.551381 Oct 12 08:58:51.973862 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1666/3595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:51 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:51.979474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:51.980291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:52.009231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.013690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.014399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.015269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.016833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.017710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.129778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:52.141764 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42d9febc-66d9-4652-ae42-ed583e355fea tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.318489 Oct 12 08:58:52.142371 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1930/3596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:51 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:52.148148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-44af541d-43ea-4460-b8b2-0c10d460c104 req-bb620f48-8400-4bfa-a574-bf1985aff49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39abadf0-5184-42fe-8f70-e8a48cb15b7a", "tag": "07f0f3d3-dbae-4ad3-aca8-61b79115134b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:52.159068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-44af541d-43ea-4460-b8b2-0c10d460c104 req-bb620f48-8400-4bfa-a574-bf1985aff49a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.159983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-44af541d-43ea-4460-b8b2-0c10d460c104 req-bb620f48-8400-4bfa-a574-bf1985aff49a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.160577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-44af541d-43ea-4460-b8b2-0c10d460c104 req-bb620f48-8400-4bfa-a574-bf1985aff49a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.176995 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-44af541d-43ea-4460-b8b2-0c10d460c104 req-bb620f48-8400-4bfa-a574-bf1985aff49a service nova] Creating event network-changed:07f0f3d3-dbae-4ad3-aca8-61b79115134b for instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a on n-h2-858383-10 Oct 12 08:58:52.182830 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-44af541d-43ea-4460-b8b2-0c10d460c104 req-bb620f48-8400-4bfa-a574-bf1985aff49a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038143 Oct 12 08:58:52.183922 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1931/3597] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:52.191520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5a319afb-97ae-4af8-b7df-5db02597314c req-45d13116-c8e3-476a-af14-7aa75441065e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1acdb6-1970-410c-a904-67636bdc3d68", "name": "network-vif-plugged", "status": "completed", "tag": "6e76f914-e39e-4490-8567-4fcc14247a71"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:52.206510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5a319afb-97ae-4af8-b7df-5db02597314c req-45d13116-c8e3-476a-af14-7aa75441065e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.207408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5a319afb-97ae-4af8-b7df-5db02597314c req-45d13116-c8e3-476a-af14-7aa75441065e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.208000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5a319afb-97ae-4af8-b7df-5db02597314c req-45d13116-c8e3-476a-af14-7aa75441065e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.223286 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5a319afb-97ae-4af8-b7df-5db02597314c req-45d13116-c8e3-476a-af14-7aa75441065e service nova] Creating event network-vif-plugged:6e76f914-e39e-4490-8567-4fcc14247a71 for instance 4d1acdb6-1970-410c-a904-67636bdc3d68 on n-h1-858383-10 Oct 12 08:58:52.229732 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5a319afb-97ae-4af8-b7df-5db02597314c req-45d13116-c8e3-476a-af14-7aa75441065e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043813 Oct 12 08:58:52.230695 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1932/3598] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:52.237357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6eeb960d-422b-4b4a-ba83-993969e32168 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6eeb960d-422b-4b4a-ba83-993969e32168 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 416 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:52.242205 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6eeb960d-422b-4b4a-ba83-993969e32168 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6eeb960d-422b-4b4a-ba83-993969e32168 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011937 Oct 12 08:58:52.246704 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1933/3599] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:52 2022] POST /compute/v2.1/servers => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:52.256812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:52.257905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:52.266244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.266792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.267232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.267954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.268384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.269007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.435599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:52.446703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:52.452814 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7d33f2ac-d83d-4404-9391-2f0d0e44353d tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1322 microversion: 2.1 time: 0.475601 Oct 12 08:58:52.455519 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1667/3600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:51 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:52.462893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:52.464713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:52.477382 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89f4e936-8a09-49a4-8973-255d54208079 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1198 microversion: 2.1 time: 0.226563 Oct 12 08:58:52.477769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.478783 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1934/3601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:52 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1198 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:52.479122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.479732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.480632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.481708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.482331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.502776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:52.503542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:52.510195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.510715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.511232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.512053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.512579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.513090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.677754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:52.690601 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c86d64b-b943-4691-9755-0807f1674001 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.198417 Oct 12 08:58:52.691829 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1935/3602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:52 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:52.698530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:52.699485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:52.712795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.713655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.714277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.715749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.716389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.716985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.858578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:52.871933 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ab9cae7-2875-4798-aea2-254241602ed5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.413166 Oct 12 08:58:52.873082 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1668/3603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:52 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:52.878792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:52.879613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:52.900251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.902673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.903311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.906450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:52.906934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:52.907381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:52.957176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:52.969253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:52.971418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:52.973217 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3fd0e7ed-b238-421b-a058-138283e4f468 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.278999 Oct 12 08:58:52.974337 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1936/3604] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:52 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:52.999072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:52.999648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:53.006485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.006989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.007676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.008610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.009221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.009864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.180137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:53.189261 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b00531c-d613-46c9-b3df-0b230e5bd2fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.213694 Oct 12 08:58:53.190115 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1937/3605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:52 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:53.197636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:53.198820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:53.199422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:53.209202 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86c0ae88-b26b-411e-ae83-0fe1bea5469c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1315 microversion: 2.1 time: 0.334791 Oct 12 08:58:53.215011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.215824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.216834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.218666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.221759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.222457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.230305 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1669/3606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:52 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:53.265983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c11028df-61a2-4618-af40-bc3dc06ec46a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-904860508", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": -1, "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:53.279180 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-c11028df-61a2-4618-af40-bc3dc06ec46a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Flavor -1 could not be found. Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c11028df-61a2-4618-af40-bc3dc06ec46a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 205 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-904860508", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": -1, "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: exception: Flavor -1 could not be found. Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-904860508', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': -1, 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:53.284379 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:53.289232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c11028df-61a2-4618-af40-bc3dc06ec46a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:53.291625 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c11028df-61a2-4618-af40-bc3dc06ec46a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032178 Oct 12 08:58:53.292605 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1670/3607] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:53 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 08:58:53.302682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:53.303298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:53.309878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.310374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.310815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.311523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.312254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.312834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.389125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:53.399586 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4965ce0-1b3e-4e83-8c91-d8a3e9098f1c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.208251 Oct 12 08:58:53.400164 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1938/3608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:53 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:53.478698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:53.480012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:53.486759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.487266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.487690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.488654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.489109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.489561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.515233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:53.523265 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1de829cf-3d9d-40fe-9530-9f3668fcd314 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.226367 Oct 12 08:58:53.523937 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1671/3609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:53 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:53.529654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:53.530662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:53.539672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.540409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.541187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.542084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.542702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.543598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.689286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:53.699924 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb17c041-844a-4baa-843d-a262e376e52f tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1322 microversion: 2.1 time: 0.225466 Oct 12 08:58:53.700880 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1939/3610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:53 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:53.703885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:53.706382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:53.708978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:53.715651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.716635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.717470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.718886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.719509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.720246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.726011 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d93b853-d543-4765-b01c-14615c0cb8cc tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1198 microversion: 2.1 time: 0.200070 Oct 12 08:58:53.726749 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1672/3611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:53 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1198 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:53.735612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:53.736274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:53.743622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.744930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.745704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.747073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:53.748037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:53.748931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:53.903400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:53.915134 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a320643-6ed3-480e-bef8-bc02a4fcf0d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.212860 Oct 12 08:58:53.915729 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1940/3612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:53 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:53.927317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:53.932804 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-87b9793f-999c-430e-bd81-2757b5c90067 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.203161 Oct 12 08:58:53.933556 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1673/3613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:53 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:54.001385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:54.002326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:54.011135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.011756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.012288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.013934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.014543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.015175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.024230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf865163-8c01-48ed-aea0-275c57b27d9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1774049135", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf865163-8c01-48ed-aea0-275c57b27d9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 173 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1774049135", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1774049135', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi -1 Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:58:54.029860 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 12 08:58:54.035060 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:58:54.037555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf865163-8c01-48ed-aea0-275c57b27d9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:54.038812 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf865163-8c01-48ed-aea0-275c57b27d9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020186 Oct 12 08:58:54.040893 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1941/3614] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:54 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:54.052758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:54.055420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:54.293572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:54.309418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:54.314001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:54.321076 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b068a08a-e462-4f22-b784-3dca45282089 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.325301 Oct 12 08:58:54.325151 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1674/3615] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:53 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:54.332514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:54.342785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:54.355992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.356397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.356839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.357581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.358037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.358466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.374555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:54.421580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.422244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.422778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.423708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.424607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.425139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.600895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:54.612618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d3ca2fa-383b-4bbb-8206-f8275215811c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.566904 Oct 12 08:58:54.613607 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1942/3616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:54 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:54.618207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c935f7bd-59ff-4905-a9fc-527647d41c31 req-e645e787-72bc-499b-a80f-28d29a9bcc4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c472b59-03c9-419e-8e8e-437d600dfc1f", "tag": "c5a0dfea-14ec-4217-976a-2b7ea186e8a9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:54.629417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c935f7bd-59ff-4905-a9fc-527647d41c31 req-e645e787-72bc-499b-a80f-28d29a9bcc4c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.629837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c935f7bd-59ff-4905-a9fc-527647d41c31 req-e645e787-72bc-499b-a80f-28d29a9bcc4c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.630460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c935f7bd-59ff-4905-a9fc-527647d41c31 req-e645e787-72bc-499b-a80f-28d29a9bcc4c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.644021 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c935f7bd-59ff-4905-a9fc-527647d41c31 req-e645e787-72bc-499b-a80f-28d29a9bcc4c service nova] Creating event network-changed:c5a0dfea-14ec-4217-976a-2b7ea186e8a9 for instance 0c472b59-03c9-419e-8e8e-437d600dfc1f on n-h2-858383-10 Oct 12 08:58:54.652056 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c935f7bd-59ff-4905-a9fc-527647d41c31 req-e645e787-72bc-499b-a80f-28d29a9bcc4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037197 Oct 12 08:58:54.654125 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1943/3617] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:54.661678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-42ff80c9-e673-4642-837a-26d1d90b4b19 req-52ec583f-e42c-41af-b270-4674edde873a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe7c36b-9501-4250-9dab-4ab9ad8d154b", "name": "network-vif-plugged", "status": "completed", "tag": "52b62051-41ae-464b-bac3-daff927171dd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:54.675271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-42ff80c9-e673-4642-837a-26d1d90b4b19 req-52ec583f-e42c-41af-b270-4674edde873a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.676016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-42ff80c9-e673-4642-837a-26d1d90b4b19 req-52ec583f-e42c-41af-b270-4674edde873a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.676639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-42ff80c9-e673-4642-837a-26d1d90b4b19 req-52ec583f-e42c-41af-b270-4674edde873a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.693990 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-42ff80c9-e673-4642-837a-26d1d90b4b19 req-52ec583f-e42c-41af-b270-4674edde873a service nova] Creating event network-vif-plugged:52b62051-41ae-464b-bac3-daff927171dd for instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b on n-h1-858383-10 Oct 12 08:58:54.699675 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-42ff80c9-e673-4642-837a-26d1d90b4b19 req-52ec583f-e42c-41af-b270-4674edde873a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044061 Oct 12 08:58:54.701711 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1944/3618] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:54.710873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:54.726042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:54.753184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:54.755716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.756601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.757239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.763670 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b18fa80-ff2a-416a-be4e-bbd9a4fc3e78 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1315 microversion: 2.1 time: 0.435376 Oct 12 08:58:54.764482 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1675/3619] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:54 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:54.770152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.773601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.774585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.781528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:54.782311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:54.824986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.826416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.829338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:54.831491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:54.832494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:54.833784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.038008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.048214 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-17d1801d-ae8f-4bc4-b9e6-8e0aa0108964 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.344914 Oct 12 08:58:55.050647 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1945/3620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:54 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:55.055853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:55.056743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:55.063892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.064692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.065361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.066356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.067018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.067745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.223323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.232812 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-727385a2-36ec-46a9-a91f-cd3feeae7c9b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1322 microversion: 2.1 time: 0.180862 Oct 12 08:58:55.234048 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1946/3621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:55 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:55.243996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:55.244877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:55.252213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.253711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.254399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.255351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.259193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.263225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.266254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.272197 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-263a91fa-0f26-427e-a9c2-1585f8e3a54c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.497745 Oct 12 08:58:55.272947 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1676/3622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:54 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:55.278483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:55.279214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:55.285397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.286170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.286803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.289292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.289884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.290427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.479206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.489323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4afa4da8-9068-4dd8-b915-bd2ff0dcfd64 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1198 microversion: 2.1 time: 0.253952 Oct 12 08:58:55.505852 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1947/3623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:55 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1198 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:55.511215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:55.513627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:55.520964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.522212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.523565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.524879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.525602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.526879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.614416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.623657 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ee2bd5b-0bc1-4b83-99dc-a1bda282dcf4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.349116 Oct 12 08:58:55.624242 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1677/3624] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:55 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:55.637753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49592111-945d-4172-9aa8-73f69ab29a71 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1263231966", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:55.653378 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-49592111-945d-4172-9aa8-73f69ab29a71 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49592111-945d-4172-9aa8-73f69ab29a71 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 216 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1263231966", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1263231966', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:55.660325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:55.665085 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:55.665085 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:55.665085 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:55.665085 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:55.665085 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:55.665085 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:55.665085 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 12 08:58:55.665085 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:55.666854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49592111-945d-4172-9aa8-73f69ab29a71 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:55.667885 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-49592111-945d-4172-9aa8-73f69ab29a71 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.041454 Oct 12 08:58:55.668807 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1678/3625] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:55 2022] POST /compute/v2.1/servers => generated 123 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:55.680816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:55.683898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:55.692767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:55.705067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.706011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.706835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.708354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.709126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.711284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.740218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.752829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.757874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.759449 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e2f90b7e-6f37-4c88-8606-26a3e54412a0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.252485 Oct 12 08:58:55.777596 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1948/3626] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:55 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:55.793697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:55.794318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:55.801518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.802010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.802477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.803237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.804538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.805130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.904487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.915001 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54d57d1b-06a9-4052-b795-091030d94373 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.241194 Oct 12 08:58:55.934605 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1679/3627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:55 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:55.940579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:55.941198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:55.947265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.947991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.948610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.949540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:55.950156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:55.950749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:55.973868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:55.977687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:55.986478 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6bcf0885-3280-4864-8ce7-5919e8979140 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1315 microversion: 2.1 time: 0.200725 Oct 12 08:58:55.987141 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1949/3628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:55 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:56.073532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:56.074491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:56.084898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:56.085489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:56.085936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:56.086686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:56.087146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:56.087574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:56.101759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:56.112370 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45fcc393-3976-4af7-b280-aad772109dc5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.175555 Oct 12 08:58:56.113225 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1680/3629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:55 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:56.188419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-935e5553-1c26-4e65-8e0f-2e8d5ad6dc6c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-975944011", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-key-2074507349", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:56.259524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-935e5553-1c26-4e65-8e0f-2e8d5ad6dc6c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] validate_networks() for [('5e1465ee-0d75-4b69-86e4-f265ae631c06', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:58:56.264107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:56.272363 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7b519305-cda0-45a8-b473-bbe97b92c104 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1510 microversion: 2.1 time: 0.203106 Oct 12 08:58:56.273214 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1950/3630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:56 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:58:56.280438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:56.281573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:56.288351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:56.288351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:56.291531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:56.291531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:56.291531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:56.291531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:56.453159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:56.500225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:56.511310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:56.520298 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-712ca1bd-bfc3-4276-90ff-191e563d323b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1322 microversion: 2.1 time: 0.245592 Oct 12 08:58:56.522575 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1951/3631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:56 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:56.527857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:56.528795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:56.535981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:56.536791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:56.537490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:56.538417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:56.539085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:56.539723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:56.694373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:56.705676 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3e54dd17-290c-4c5c-b50a-218c776a616d tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1381 microversion: 2.1 time: 0.181339 Oct 12 08:58:56.706971 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1952/3632] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:56 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1381 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:56.712029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:56.712939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:56.720494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:56.721417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:56.722238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:56.723317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:56.724145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:56.724929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.044271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:57.060442 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ff49f813-33ef-40f5-b058-e4be44675618 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.349141 Oct 12 08:58:57.061563 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1953/3633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:56 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:57.073537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:57.074901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:57.098785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.099410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.099974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.103384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.103935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.104482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.136584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:57.287794 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-935e5553-1c26-4e65-8e0f-2e8d5ad6dc6c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Invalid key_name provided. Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-935e5553-1c26-4e65-8e0f-2e8d5ad6dc6c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 246 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-975944011", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-key-2074507349", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid key_name provided. Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-975944011', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'key_name': 'tempest-key-2074507349', 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2074507349 not found for user 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:57.290388 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 12 08:58:57.296494 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:57.303706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-935e5553-1c26-4e65-8e0f-2e8d5ad6dc6c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid key_name provided. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:57.306393 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-935e5553-1c26-4e65-8e0f-2e8d5ad6dc6c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.122669 Oct 12 08:58:57.316437 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1681/3634] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:56 2022] POST /compute/v2.1/servers => generated 70 bytes in 1133 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 12 08:58:57.326348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b27a3c86-afdd-459a-8568-11565a0434b1 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1534 microversion: 2.1 time: 0.263420 Oct 12 08:58:57.327858 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1954/3635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:57 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1534 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:57.341876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:57.341876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:57.345855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.346698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.347757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.349813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.350342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.350782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.352154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:57.353508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:57.362970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.363983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.364904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.366007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.366693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.367451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.563743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:57.575359 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e16f589f-e01e-4065-81ff-8c08d519f000 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1315 microversion: 2.1 time: 0.233602 Oct 12 08:58:57.586172 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1955/3636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:57 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:57.600795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1db5251c-5c59-4fda-afbf-1bd54b27701c req-6f82b97f-0362-4faa-a311-b7a9eb3284e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39abadf0-5184-42fe-8f70-e8a48cb15b7a", "name": "network-vif-plugged", "status": "completed", "tag": "07f0f3d3-dbae-4ad3-aca8-61b79115134b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:57.613451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1db5251c-5c59-4fda-afbf-1bd54b27701c req-6f82b97f-0362-4faa-a311-b7a9eb3284e9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.614335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1db5251c-5c59-4fda-afbf-1bd54b27701c req-6f82b97f-0362-4faa-a311-b7a9eb3284e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.615344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1db5251c-5c59-4fda-afbf-1bd54b27701c req-6f82b97f-0362-4faa-a311-b7a9eb3284e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.633141 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1db5251c-5c59-4fda-afbf-1bd54b27701c req-6f82b97f-0362-4faa-a311-b7a9eb3284e9 service nova] Creating event network-vif-plugged:07f0f3d3-dbae-4ad3-aca8-61b79115134b for instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a on n-h2-858383-10 Oct 12 08:58:57.639218 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1db5251c-5c59-4fda-afbf-1bd54b27701c req-6f82b97f-0362-4faa-a311-b7a9eb3284e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046839 Oct 12 08:58:57.640713 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1956/3637] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:57.650014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:57.654489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:57.663776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:57.664498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.665292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.666286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.668434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.669322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.670817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.685359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:57.687483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:57.702573 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ffd441b2-e3dd-4052-95fc-753a031dce23 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.370960 Oct 12 08:58:57.715868 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1682/3638] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:57 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:57.733171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:57.734158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:57.757076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.758078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.759366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.760855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.763745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.764629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.890308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:57.902677 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9afd71d1-c65d-4e85-b297-8d29ae8c56b8 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1487 microversion: 2.1 time: 0.260309 Oct 12 08:58:57.917467 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1957/3639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:57 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1487 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:57.917467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:57.917467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:57.917923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.921734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.921734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:57.921734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:57.921734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:57.921734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.090670 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a088875-7114-4709-875b-21500dfdce3b tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1534 microversion: 2.1 time: 0.184695 Oct 12 08:58:58.091131 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1958/3640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:57 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1534 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:58.098657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:58.111332 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7cb372cf-777d-4548-88f0-e1c873119928 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.390728 Oct 12 08:58:58.114841 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1683/3641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:57 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:58.115023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:58.115819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:58.121271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:58.122096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:58.123809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.124453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.125080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.126220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.126603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.127193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.131004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.131704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.132334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.133373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.134100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.134615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.169755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:58:58.270074 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10089b47-6dbb-45f2-b568-7f832afe737e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 204 len: 0 microversion: 2.1 time: 0.152289 Oct 12 08:58:58.271421 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1684/3642] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:58:58 2022] DELETE /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:58:58.279658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:58.281581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:58.290212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.291065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.291707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.292645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.293390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.294672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.313830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:58.324528 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5bfb9c21-683e-487c-9192-3f88a892ad7c tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1322 microversion: 2.1 time: 0.214258 Oct 12 08:58:58.326605 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1959/3643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:58 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:58.332865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c17d1754-54dc-4fb2-ac43-914fd112ab93 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:58.339031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17d1754-54dc-4fb2-ac43-914fd112ab93 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.339162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17d1754-54dc-4fb2-ac43-914fd112ab93 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.341108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17d1754-54dc-4fb2-ac43-914fd112ab93 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.342151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17d1754-54dc-4fb2-ac43-914fd112ab93 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.342809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17d1754-54dc-4fb2-ac43-914fd112ab93 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.343736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c17d1754-54dc-4fb2-ac43-914fd112ab93 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.373932 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c17d1754-54dc-4fb2-ac43-914fd112ab93 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.045547 Oct 12 08:58:58.382851 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1960/3644] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 08:58:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:58:58.388328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:58.388996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:58.397180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.397180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.397550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.398086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.399501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.399501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.504452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:58.514563 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a6694b5-948c-46b3-b84a-b8133d995c90 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1497 microversion: 2.1 time: 0.240664 Oct 12 08:58:58.514563 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1685/3645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:58 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1497 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:58.519416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:58.520026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:58.535478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.538708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.538708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.539306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.539717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.540723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.587648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:58.596308 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5185e9ef-1922-4858-9b55-1adff609d4a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.211800 Oct 12 08:58:58.605508 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1961/3646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:58 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:58.605508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-10", "block_migration": false, "disk_over_commit": false}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:58.605508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:58.612517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.613013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.613469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.614181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.614640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.615073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.658387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lazy-loading 'flavor' on Instance uuid 6fe7c36b-9501-4250-9dab-4ab9ad8d154b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:58:58.674955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Going to try to live migrate instance to n-h2-858383-10 {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 08:58:58.720897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:58.734342 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b60fc1e6-0d44-4ab6-bba4-895375488008 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1493 microversion: 2.1 time: 0.218596 Oct 12 08:58:58.735054 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1686/3647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:58 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1493 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:58.740791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:58.741527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:58.748412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.749365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.749926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:58.750900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:58.751627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:58.752192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:59.051098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:59.065816 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-be244941-77cd-410e-8b4c-bf272bef9664 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1315 microversion: 2.1 time: 0.329596 Oct 12 08:58:59.071484 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1687/3648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:58 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:59.079317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8037533-e0d4-4cb6-bbb6-984e75e0cdc9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1416258831", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:58:59.217326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.security_group_api [None req-e8037533-e0d4-4cb6-bbb6-984e75e0cdc9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Neutron security group does_not_exist not found {{(pid=127007) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 12 08:58:59.218115 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e8037533-e0d4-4cb6-bbb6-984e75e0cdc9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8037533-e0d4-4cb6-bbb6-984e75e0cdc9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 258 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1416258831", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1416258831', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 12 08:58:59.232828 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:58:59.239260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8037533-e0d4-4cb6-bbb6-984e75e0cdc9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:58:59.246552 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8037533-e0d4-4cb6-bbb6-984e75e0cdc9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.163002 Oct 12 08:58:59.246552 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1688/3649] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:58:59 2022] POST /compute/v2.1/servers => generated 106 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:58:59.251377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:59.252390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:59.259202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:59.259916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:59.260541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:59.261600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:59.262261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:59.262874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:59.423182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:59.432422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:59.433778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:59.434968 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-93822df9-e088-448e-83b2-5b9e02f5f444 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.194013 Oct 12 08:58:59.449727 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1689/3650] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:58:59 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:58:59.449727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:59.449727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:59.449727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:59.449727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:59.450551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:59.450815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:59.451271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:59.451880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:59.619463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:59.648359 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-604ee72c-d9ef-48ef-ad13-56192f711f80 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.210257 Oct 12 08:58:59.658218 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1690/3651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:59 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:59.658218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:59.658218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:59.680845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:58:59.685063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:59.685788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:59.687774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:59.688816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:59.690123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:59.690638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:59.893897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:58:59.906759 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9d482d1-269a-42d1-80a8-a6b17b8ba97b tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1322 microversion: 2.1 time: 0.255852 Oct 12 08:58:59.914147 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1691/3652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:59 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:58:59.927073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:58:59.927894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:58:59.938670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:59.939395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:59.939944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:58:59.940860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:58:59.941785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:58:59.942419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.119707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:00.128719 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d17f1e2e-5c06-4ce9-8e7a-ebcdf1eb8d28 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 200 len: 1474 microversion: 2.1 time: 0.211273 Oct 12 08:59:00.142301 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1692/3653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:58:59 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 1474 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:00.157602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:00.158376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:00.166669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.166669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.167225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.168288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.168818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.169321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.175334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:00.420423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:00.437413 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1501aacc-c8d5-48f8-9e53-c2d65eb4290a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.293949 Oct 12 08:59:00.451195 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1693/3654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:00 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:00.451195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8c7a85b3-c1e4-4592-8891-c083ee5757c5 req-ef0a0f2a-50ca-417c-89bc-cbbce7348d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c472b59-03c9-419e-8e8e-437d600dfc1f", "name": "network-vif-plugged", "status": "completed", "tag": "c5a0dfea-14ec-4217-976a-2b7ea186e8a9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:00.462288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8c7a85b3-c1e4-4592-8891-c083ee5757c5 req-ef0a0f2a-50ca-417c-89bc-cbbce7348d11 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.462955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8c7a85b3-c1e4-4592-8891-c083ee5757c5 req-ef0a0f2a-50ca-417c-89bc-cbbce7348d11 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.463617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8c7a85b3-c1e4-4592-8891-c083ee5757c5 req-ef0a0f2a-50ca-417c-89bc-cbbce7348d11 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.476746 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8c7a85b3-c1e4-4592-8891-c083ee5757c5 req-ef0a0f2a-50ca-417c-89bc-cbbce7348d11 service nova] Creating event network-vif-plugged:c5a0dfea-14ec-4217-976a-2b7ea186e8a9 for instance 0c472b59-03c9-419e-8e8e-437d600dfc1f on n-h2-858383-10 Oct 12 08:59:00.483570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8c7a85b3-c1e4-4592-8891-c083ee5757c5 req-ef0a0f2a-50ca-417c-89bc-cbbce7348d11 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043722 Oct 12 08:59:00.484839 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1694/3655] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:00.491975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:00.505256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:00.523544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.524142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.524816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.525645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.526199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.526630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.801718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:00.811243 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fc9a90b9-d2ea-4fc5-ab6c-83af262919aa tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1493 microversion: 2.1 time: 0.325468 Oct 12 08:59:00.825964 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1695/3656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:00 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1493 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:00.835345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:00.836447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:00.877486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.877486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.877486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.877486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.877486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.877486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.905511 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6819f841-1a21-4801-99fc-715c1678a19e tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b/action" status: 202 len: 0 microversion: 2.1 time: 2.306016 Oct 12 08:59:00.910738 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1962/3657] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:58:58 2022] POST /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b/action => generated 0 bytes in 2312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:00.916350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-869126095"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:00.930180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:00.946725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.947324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.948009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:00.948974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:00.949375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:00.950102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.218706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:01.242613 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-13e8fd94-e177-4451-9604-d80aaf4d9d00 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1502 microversion: 2.1 time: 0.415385 Oct 12 08:59:01.255924 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1696/3658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:00 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1502 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:01.270194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:01.270888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:01.279033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.279719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.280223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.280991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.281758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.282404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.382376 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a2ea7a3-15a2-4d25-a44c-30ea4def8160 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.470124 Oct 12 08:59:01.390308 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1963/3659] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:00 2022] POST /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:59:01.396933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0a2a234-0c36-4aab-b689-b93d0e9cc56f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:01.397675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f0a2a234-0c36-4aab-b689-b93d0e9cc56f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3baa168b-c3ff-4e09-a5d7-dd92f013ac0b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:01.404322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:01.405880 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-f0a2a234-0c36-4aab-b689-b93d0e9cc56f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 3baa168b-c3ff-4e09-a5d7-dd92f013ac0b could not be found. Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0a2a234-0c36-4aab-b689-b93d0e9cc56f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/3baa168b-c3ff-4e09-a5d7-dd92f013ac0b HTTP/1.1 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3baa168b-c3ff-4e09-a5d7-dd92f013ac0b could not be found. Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3baa168b-c3ff-4e09-a5d7-dd92f013ac0b'} Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3baa168b-c3ff-4e09-a5d7-dd92f013ac0b could not be found. Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3baa168b-c3ff-4e09-a5d7-dd92f013ac0b could not be found. Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:01.407648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:01.412700 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:01.412700 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:01.412700 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:01.412700 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:01.412700 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:01.412700 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:01.412700 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3baa168b-c3ff-4e09-a5d7-dd92f013ac0b could not be found. Oct 12 08:59:01.412700 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:01.414832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0a2a234-0c36-4aab-b689-b93d0e9cc56f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 3baa168b-c3ff-4e09-a5d7-dd92f013ac0b could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:01.415927 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f0a2a234-0c36-4aab-b689-b93d0e9cc56f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3baa168b-c3ff-4e09-a5d7-dd92f013ac0b" status: 404 len: 111 microversion: 2.1 time: 0.024130 Oct 12 08:59:01.422024 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1964/3660] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:01 2022] DELETE /compute/v2.1/servers/3baa168b-c3ff-4e09-a5d7-dd92f013ac0b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:01.444541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:01.448599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:01.461068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.461798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.462493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.463389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.464053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.464953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.489720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:01.539262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:01.560725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:01.567348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:01.571326 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f11b1278-60b2-4f47-8b7c-d46a5be5c1b0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.312360 Oct 12 08:59:01.572121 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1697/3661] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:01 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:01.584001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:01.584851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:01.606184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.607093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.607397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.608116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.608594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.609017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.712650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:01.730753 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c2aabf30-9ef9-4dd8-944e-2970af7e4c28 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.296421 Oct 12 08:59:01.731696 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1965/3662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:01 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:01.737820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-bc56c912-94e9-49b3-b8ab-d96a6bd96530 req-7f874ac2-f980-43af-91db-2b79839a2abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3858302-5978-4e93-974d-ae435371d519", "name": "network-vif-deleted", "tag": "a41fa3a3-7ace-4016-8395-1f70fa3487ba"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:01.749567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bc56c912-94e9-49b3-b8ab-d96a6bd96530 req-7f874ac2-f980-43af-91db-2b79839a2abc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.750710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bc56c912-94e9-49b3-b8ab-d96a6bd96530 req-7f874ac2-f980-43af-91db-2b79839a2abc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.751196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bc56c912-94e9-49b3-b8ab-d96a6bd96530 req-7f874ac2-f980-43af-91db-2b79839a2abc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.777941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-bc56c912-94e9-49b3-b8ab-d96a6bd96530 req-7f874ac2-f980-43af-91db-2b79839a2abc service nova] Creating event network-vif-deleted:a41fa3a3-7ace-4016-8395-1f70fa3487ba for instance e3858302-5978-4e93-974d-ae435371d519 on n-h1-858383-10 Oct 12 08:59:01.789410 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-bc56c912-94e9-49b3-b8ab-d96a6bd96530 req-7f874ac2-f980-43af-91db-2b79839a2abc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055516 Oct 12 08:59:01.790407 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1966/3663] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:01.797593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:01.797772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:01.805464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.806132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.806580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.807433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:01.808611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:01.808611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:01.940170 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b5e39e1-cd2f-4f0e-aad6-cb54c01202ec tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a/action" status: 202 len: 0 microversion: 2.1 time: 0.145973 Oct 12 08:59:01.944445 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1967/3664] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:01 2022] POST /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:01.956513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a7b292c-542b-49ff-927d-40f49adc78a5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843cbe670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:01.973826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:01.987864 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7a6931ac-6002-4638-bd07-b4b678a163ba tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1322 microversion: 2.1 time: 0.412288 Oct 12 08:59:02.002052 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1698/3665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:01 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:02.011136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:02.011751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:02.018229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.018755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.019145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.019928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.020600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.021037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.068942 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a7b292c-542b-49ff-927d-40f49adc78a5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21" status: 200 len: 1411 microversion: 2.1 time: 0.123609 Oct 12 08:59:02.073147 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1968/3666] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:01 2022] GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:02.083857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:02.084817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:02.099843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.102438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.103063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.106398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.107081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.108072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.150079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.151250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.152107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.152730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lazy-loading 'fault' on Instance uuid e3858302-5978-4e93-974d-ae435371d519 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:59:02.226858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:02.242435 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fceff92e-ef1b-4efa-970c-47b8f8751a94 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 200 len: 1304 microversion: 2.1 time: 0.167469 Oct 12 08:59:02.243376 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1969/3667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:02 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:02.248765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:02.249694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:02.262749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.263660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.264117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.264912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.265408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.266047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.377157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:02.388770 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4394ebb0-6935-42f5-be26-16914e6b8984 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.385540 Oct 12 08:59:02.393536 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1699/3668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:02 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:02.415914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:02.416535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:02.430534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.431249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.431844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.432799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.433404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.434012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.452771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:02.463058 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c147d2e-093a-42f1-aa3d-0e443a4eab98 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1507 microversion: 2.1 time: 0.216975 Oct 12 08:59:02.464004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1970/3669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:02 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:02.598653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:02.599751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:02.608147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.608960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.609755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.610908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.611699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.612290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.692844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:02.706205 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-273b3994-7bf8-490f-ac2e-1cab67398872 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.294176 Oct 12 08:59:02.709996 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1700/3670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:02 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:02.739014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-992750d0-131d-4110-8851-3c38e4136d4d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:02.740224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-992750d0-131d-4110-8851-3c38e4136d4d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 08:59:02.740908 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-992750d0-131d-4110-8851-3c38e4136d4d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-992750d0-131d-4110-8851-3c38e4136d4d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 9223372036854775808 could not be found. Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '9223372036854775808'} Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:02.744553 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:02.751063 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:02.751063 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:02.751063 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:02.751063 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 12 08:59:02.751063 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:02.752368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-992750d0-131d-4110-8851-3c38e4136d4d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:02.753322 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-992750d0-131d-4110-8851-3c38e4136d4d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.024844 Oct 12 08:59:02.758476 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1701/3671] 10.222.0.40 () {58 vars in 1188 bytes} [Wed Oct 12 08:59:02 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:59:02.767581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:02.768208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:02.788263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.788796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.789222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.789987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.790449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.790920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.825937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:02.836732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:02.838216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:02.839466 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-92c4af4f-7958-4e3b-bc84-a9ea1dfcf5a2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.244971 Oct 12 08:59:02.854429 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1971/3672] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:02 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:02.869227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:02.870213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:02.883640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.884197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.884635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:02.885392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:02.885933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:02.889237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.114667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:03.124255 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89a71a10-a0fc-4abc-a75c-657c2bf39e5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.261599 Oct 12 08:59:03.126499 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1972/3673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:02 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:03.140240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.141594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:03.158003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.158929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.160198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.161162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.166238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.167286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.244791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:03.254879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-28612d8e-e9de-4abb-9b84-36c472db1e8f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.495184 Oct 12 08:59:03.255758 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1702/3674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:02 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:03.262277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-44ab2a7e-98d5-4fa3-8d22-e227d09ee6f1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848922280>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.316092 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-44ab2a7e-98d5-4fa3-8d22-e227d09ee6f1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21" status: 200 len: 1411 microversion: 2.1 time: 0.059010 Oct 12 08:59:03.317079 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1703/3675] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:03 2022] GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21 => generated 1411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:03.324112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.325149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:03.332684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.333620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.334293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.335446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.336778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.337336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.374409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:03.384925 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b42aa9d5-184a-4278-93a3-816176314081 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1519 microversion: 2.1 time: 0.257206 Oct 12 08:59:03.386660 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1973/3676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:03 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:03.514808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:03.524818 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a742be3-74b3-4605-a5ea-5b2eea0481df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.204990 Oct 12 08:59:03.526089 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1704/3677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:03 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:03.531139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.531912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:03.538747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.539518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.540212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.541176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.541887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.542573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.580657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.581278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:03.587785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.588284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.588725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.589457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.590039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.590600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.595763 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] HTTP exception thrown: Instance is not a member of specified network Oct 12 08:59:03.606069 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 HTTP/1.1 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'e3858302-5978-4e93-974d-ae435371d519'} Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:03.607738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3bcde4f7-8b06-4e51-ab03-96609243d844 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 404 len: 111 microversion: 2.1 time: 0.220778 Oct 12 08:59:03.615386 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1974/3678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:03 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:03.631752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.632466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Request method failure captured: Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f/ips/invalid HTTP/1.1 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoHF14WOK6UvSEdVT5i3QLPaQ0UdohPE4JXAkmTdZ8nemFkenlBiAolJpNq7cPx3mdVuXrSoiWKiDnOylz0sb_PmGYN2OKqSx7HFDTKZa_G85oPaWocpIqmc4Dp6q5uoo1i82eW033e_6H7HTRH86iHxx7idFwjmuOPOA0pe-FxiJBQ Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2fafe5bb6c2d4ac1a7f80847d29f1dc8 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}] Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2fafe5bb6c2d4ac1a7f80847d29f1dc8 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerAddressesNegativeTestJSON-376354850-project Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2d75592241e041ffabfec3154e4d09d5 Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-376354850-project Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance is not a member of specified network Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': '0c472b59-03c9-419e-8e8e-437d600dfc1f', 'id': 'invalid'} Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 12 08:59:03.635825 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.640315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.640315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.640315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.640709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.641163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.641701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.642563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:03.643614 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ec37311c-8ab8-4b63-95c2-629791233b34 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.116389 Oct 12 08:59:03.648074 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1705/3679] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 08:59:03 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f/ips/invalid => generated 91 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:59:03.668027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4decbb0a-63de-4d99-b546-5433fb96df63 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.668537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4decbb0a-63de-4d99-b546-5433fb96df63 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Failed to fetch instance by id -1 {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 08:59:03.669054 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-4decbb0a-63de-4d99-b546-5433fb96df63 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance -1 could not be found. Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4decbb0a-63de-4d99-b546-5433fb96df63 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance -1 could not be found. Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '-1'} Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:03.671163 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:03.679515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:03.679515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:03.679515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 12 08:59:03.679515 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.679515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4decbb0a-63de-4d99-b546-5433fb96df63 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:03.679515 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4decbb0a-63de-4d99-b546-5433fb96df63 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023718 Oct 12 08:59:03.679515 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1706/3680] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 08:59:03 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:59:03.679515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-619e7039-930b-4ce0-b511-c665377f7124 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.680177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-619e7039-930b-4ce0-b511-c665377f7124 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Failed to fetch instance by id 999 {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 12 08:59:03.680271 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-619e7039-930b-4ce0-b511-c665377f7124 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] HTTP exception thrown: Instance 999 could not be found. Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-619e7039-930b-4ce0-b511-c665377f7124 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Request method failure captured: Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoHF14WOK6UvSEdVT5i3QLPaQ0UdohPE4JXAkmTdZ8nemFkenlBiAolJpNq7cPx3mdVuXrSoiWKiDnOylz0sb_PmGYN2OKqSx7HFDTKZa_G85oPaWocpIqmc4Dp6q5uoo1i82eW033e_6H7HTRH86iHxx7idFwjmuOPOA0pe-FxiJBQ Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2fafe5bb6c2d4ac1a7f80847d29f1dc8 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}] Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2fafe5bb6c2d4ac1a7f80847d29f1dc8 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerAddressesNegativeTestJSON-376354850-project Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2d75592241e041ffabfec3154e4d09d5 Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-376354850-project Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 999 could not be found. Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': '999'} Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 12 08:59:03.682507 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:03.687483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-619e7039-930b-4ce0-b511-c665377f7124 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:03.687483 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-619e7039-930b-4ce0-b511-c665377f7124 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008257 Oct 12 08:59:03.689487 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1707/3681] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 08:59:03 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:59:03.696749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1195016140", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "2f204459-03a5-4e90-a59a-2dbecd872d0d"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:03.775348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] validate_networks() for [('2f204459-03a5-4e90-a59a-2dbecd872d0d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:59:03.799421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:03.808326 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4467c4e-04bf-47c8-ba86-1a44d5d23f02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1487 microversion: 2.1 time: 0.196955 Oct 12 08:59:03.808910 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1975/3682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:03 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1487 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:03.813972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:03.814517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:03.834575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.836247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.846583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:03.848036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:03.848535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:03.848978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.048256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:04.060300 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43927f03-e052-477d-9884-194e7566a42e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.250107 Oct 12 08:59:04.062865 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1976/3683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:03 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:04.068148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:04.068914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:04.075639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.076418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.077195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.078190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.078870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.081135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.111267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:59:04.231467 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-28d332c8-ad4e-4138-847a-b3b8f46863cb tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 204 len: 0 microversion: 2.1 time: 0.166615 Oct 12 08:59:04.233102 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1977/3684] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:04 2022] DELETE /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:59:04.248450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:04.249416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:04.259758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.265336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.265977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.266875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.267460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.268022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.306233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:59:04.306661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:59:04.308617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:59:04.309051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:59:04.310054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:59:04.315482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lazy-loading 'flavor' on Instance uuid 39abadf0-5184-42fe-8f70-e8a48cb15b7a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:59:04.322098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.322637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.329031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.329990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.330525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.331142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.353094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:59:04.358047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Getting quotas for user 3571292391094d83901f21ccb18ec2d8 and project bb4c1d72dbd4402b8240521c30cdd740. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:59:04.372573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:59:04.375535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:59:04.438478 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d15fb9c3-1355-447b-ab89-53299b6bd039 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749185 Oct 12 08:59:04.440798 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1708/3685] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:59:04.452435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:04.453355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:04.466875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.467674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.468322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.469301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.469949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.470828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.782556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:04.793733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:04.816430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:04.826783 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f7b216c-2ea7-4c16-8c87-fb179258cbf3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.374527 Oct 12 08:59:04.828210 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1709/3686] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:04 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:04.835555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:04.836397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:04.850241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.850847 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6ba7272-96fb-4974-b2e6-a8c379f7521b tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a/action" status: 202 len: 0 microversion: 2.1 time: 0.614184 Oct 12 08:59:04.851584 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1978/3687] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:04 2022] POST /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:04.851918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.852643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.855336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.857518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.858900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.875224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:04.876287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:04.899710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.902761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.903870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.906403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:04.910671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:04.911311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:04.994935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:05.084305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:05.094467 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c823e24-b18e-4010-b58c-565b9ae1e1fe tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.264857 Oct 12 08:59:05.096298 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1710/3688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:04 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:05.118784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:05.119526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:05.127768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.128271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.128772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:05.129547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.130527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.130999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:05.323981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:05.337568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6416b9c1-8d53-412b-ab35-7894d14c1309 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1525 microversion: 2.1 time: 0.482854 Oct 12 08:59:05.340600 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1979/3689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:04 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1525 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:05.357829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3bcb91a-197c-458c-b4a0-338fad6be5a7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843cbe670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:05.378899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:05.395769 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e9bfe37-dc0c-4744-8f45-3553392e2068 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.280812 Oct 12 08:59:05.408357 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1711/3690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:05 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:05.427775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:05.434000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:05.450748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.450991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.455042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:05.455898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.458062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.458712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:05.539057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:05.547981 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-df099e1a-7b0f-4e39-9b79-8562b5e69321 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1219 microversion: 2.1 time: 0.137877 Oct 12 08:59:05.549593 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1712/3691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:05 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:05.554616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:05.555214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:05.562752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.564171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.564852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:05.565688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.566363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.567004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:05.759244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:05.767849 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-186106c8-8ea5-46fc-b0d7-cb0817731686 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1493 microversion: 2.1 time: 0.216979 Oct 12 08:59:05.769030 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1713/3692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:05 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1493 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:05.773942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10287980-3088-405c-af24-5775be80d30a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:05.774589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10287980-3088-405c-af24-5775be80d30a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: d05bcaff-446e-4404-969b-478146c1d665] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:05.780726 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-10287980-3088-405c-af24-5775be80d30a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance d05bcaff-446e-4404-969b-478146c1d665 could not be found. Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10287980-3088-405c-af24-5775be80d30a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/d05bcaff-446e-4404-969b-478146c1d665/action HTTP/1.1 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 19 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: {"forceDelete": {}} Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance d05bcaff-446e-4404-969b-478146c1d665 could not be found. Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'd05bcaff-446e-4404-969b-478146c1d665', 'body': {'forceDelete': {}}} Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05bcaff-446e-4404-969b-478146c1d665 could not be found. Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05bcaff-446e-4404-969b-478146c1d665 could not be found. Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:05.790294 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:05.796057 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:05.796057 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:05.796057 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05bcaff-446e-4404-969b-478146c1d665 could not be found. Oct 12 08:59:05.796057 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:05.796057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10287980-3088-405c-af24-5775be80d30a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance d05bcaff-446e-4404-969b-478146c1d665 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:05.796057 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10287980-3088-405c-af24-5775be80d30a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/d05bcaff-446e-4404-969b-478146c1d665/action" status: 404 len: 111 microversion: 2.1 time: 0.021645 Oct 12 08:59:05.796057 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1714/3693] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:05 2022] POST /compute/v2.1/servers/d05bcaff-446e-4404-969b-478146c1d665/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:05.808721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1576f13d-733f-47b9-9179-c3e402204afb req-ab08f4cd-882f-4c5b-a629-ce65c05fb414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3cd57c-b10d-449c-bee3-9d0435916ad7", "name": "network-vif-plugged", "status": "completed", "tag": "937dc5cb-ca92-4a63-a170-7231a52d6927"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:05.835345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1576f13d-733f-47b9-9179-c3e402204afb req-ab08f4cd-882f-4c5b-a629-ce65c05fb414 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.836007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1576f13d-733f-47b9-9179-c3e402204afb req-ab08f4cd-882f-4c5b-a629-ce65c05fb414 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.836876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1576f13d-733f-47b9-9179-c3e402204afb req-ab08f4cd-882f-4c5b-a629-ce65c05fb414 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:05.875391 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1576f13d-733f-47b9-9179-c3e402204afb req-ab08f4cd-882f-4c5b-a629-ce65c05fb414 service nova] Creating event network-vif-plugged:937dc5cb-ca92-4a63-a170-7231a52d6927 for instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 on n-h2-858383-10 Oct 12 08:59:05.884504 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1576f13d-733f-47b9-9179-c3e402204afb req-ab08f4cd-882f-4c5b-a629-ce65c05fb414 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090484 Oct 12 08:59:05.888373 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1715/3694] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:05.897428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:05.905345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:05.927358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.927867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.928315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:05.931237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:05.931721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:05.932170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:06.192261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:06.201926 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa1c2e7d-a14e-4638-8960-442174a8479a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.311394 Oct 12 08:59:06.218437 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1716/3695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:05 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:06.228854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:06.230367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:06.240740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:06.241323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:06.241850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:06.242754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:06.243296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:06.245029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:06.246991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:06.531511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:06.552554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:06.556101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:06.571122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ccb5ea53-0d56-48f4-8d33-7b0f68dfd0f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.351298 Oct 12 08:59:06.572338 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1717/3696] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:06 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:06.577492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:06.578395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:06.585784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:06.586656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:06.587284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:06.588246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:06.588885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:06.589551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:06.805666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:06.826537 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e369a547-0b30-43d7-9f89-a5c4a1bf19cc tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.252759 Oct 12 08:59:06.832150 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1718/3697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:06 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:06.862472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:06.863358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:06.880590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:06.881749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:06.882358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:06.883253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:06.883870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:06.884463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:07.099573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d75592241e041ffabfec3154e4d09d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fafe5bb6c2d4ac1a7f80847d29f1dc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:07.108704 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f8125266-5e30-40b9-9cb3-4aead678f801 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 200 len: 1483 microversion: 2.1 time: 0.274562 Oct 12 08:59:07.115913 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1719/3698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:06 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 1483 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:07.135617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:07.137858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:07.159171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:07.159696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:07.160144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:07.160870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:07.161327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:07.177006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:07.727458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:07.742299 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-776b6e3a-fde5-4914-ab29-cc000f1413eb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.624492 Oct 12 08:59:07.748012 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1720/3699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:07 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:07.778974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:07.779636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:07.803685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:07.809845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:07.812309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:07.814152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:07.818424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:07.821354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:08.013471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:08.020552 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1d7a915e-5829-4c76-86c7-8bc6c6994e52 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1273 microversion: 2.1 time: 0.256821 Oct 12 08:59:08.034858 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1721/3700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:07 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:08.043370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:08.044011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:08.066232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:08.067898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:08.069970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:08.071091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:08.073397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:08.075170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:08.352817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:08.479158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:08.492767 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0dfbc07e-d99e-4b38-a74a-3393b72713c4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1514 microversion: 2.1 time: 0.452643 Oct 12 08:59:08.493658 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1722/3701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:08 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1514 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:08.521060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-81032287-ebeb-4d18-82fe-6f763ae7a811 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:08.524764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-81032287-ebeb-4d18-82fe-6f763ae7a811 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a9e4e6f9-e331-4582-820b-379a5ce9bc58] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:08.546422 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-81032287-ebeb-4d18-82fe-6f763ae7a811 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance a9e4e6f9-e331-4582-820b-379a5ce9bc58 could not be found. Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-81032287-ebeb-4d18-82fe-6f763ae7a811 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/a9e4e6f9-e331-4582-820b-379a5ce9bc58/action HTTP/1.1 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 39 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: {"os-getConsoleOutput": {"length": 10}} Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance a9e4e6f9-e331-4582-820b-379a5ce9bc58 could not be found. Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a9e4e6f9-e331-4582-820b-379a5ce9bc58', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e4e6f9-e331-4582-820b-379a5ce9bc58 could not be found. Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e4e6f9-e331-4582-820b-379a5ce9bc58 could not be found. Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:08.572636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:08.577758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:08.577758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:08.577758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:08.577758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:08.577758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e4e6f9-e331-4582-820b-379a5ce9bc58 could not be found. Oct 12 08:59:08.577758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:08.579835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-81032287-ebeb-4d18-82fe-6f763ae7a811 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance a9e4e6f9-e331-4582-820b-379a5ce9bc58 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:08.580738 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-81032287-ebeb-4d18-82fe-6f763ae7a811 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a9e4e6f9-e331-4582-820b-379a5ce9bc58/action" status: 404 len: 111 microversion: 2.1 time: 0.064807 Oct 12 08:59:08.581386 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1723/3702] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:08 2022] POST /compute/v2.1/servers/a9e4e6f9-e331-4582-820b-379a5ce9bc58/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:08.592371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a3a3bfe3-e115-4235-afa0-7cf944af8d0f req-c7ebb897-1b95-4a0f-95aa-b80498c30b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c472b59-03c9-419e-8e8e-437d600dfc1f", "name": "network-vif-deleted", "tag": "c5a0dfea-14ec-4217-976a-2b7ea186e8a9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:08.642872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a3a3bfe3-e115-4235-afa0-7cf944af8d0f req-c7ebb897-1b95-4a0f-95aa-b80498c30b13 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:08.644329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a3a3bfe3-e115-4235-afa0-7cf944af8d0f req-c7ebb897-1b95-4a0f-95aa-b80498c30b13 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:08.644952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a3a3bfe3-e115-4235-afa0-7cf944af8d0f req-c7ebb897-1b95-4a0f-95aa-b80498c30b13 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:08.705629 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a3a3bfe3-e115-4235-afa0-7cf944af8d0f req-c7ebb897-1b95-4a0f-95aa-b80498c30b13 service nova] Creating event network-vif-deleted:c5a0dfea-14ec-4217-976a-2b7ea186e8a9 for instance 0c472b59-03c9-419e-8e8e-437d600dfc1f on n-h2-858383-10 Oct 12 08:59:08.718314 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a3a3bfe3-e115-4235-afa0-7cf944af8d0f req-c7ebb897-1b95-4a0f-95aa-b80498c30b13 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132378 Oct 12 08:59:08.719222 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1724/3703] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:08.734815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:08.735947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:08.753410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:08.754253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:08.756697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:08.760229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:08.761128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:08.762139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:08.956312 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3bcb91a-197c-458c-b4a0-338fad6be5a7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21" status: 200 len: 1411 microversion: 2.1 time: 3.613790 Oct 12 08:59:08.959385 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1980/3704] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:05 2022] GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21 => generated 1411 bytes in 3617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:08.966976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:08.979660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] [instance: 0c472b59-03c9-419e-8e8e-437d600dfc1f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:08.999676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:09.005332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:09.007040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:09.008953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:09.011434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:09.015125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:09.065481 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] HTTP exception thrown: Instance 0c472b59-03c9-419e-8e8e-437d600dfc1f could not be found. Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Request method failure captured: Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f HTTP/1.1 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoHF14WOK6UvSEdVT5i3QLPaQ0UdohPE4JXAkmTdZ8nemFkenlBiAolJpNq7cPx3mdVuXrSoiWKiDnOylz0sb_PmGYN2OKqSx7HFDTKZa_G85oPaWocpIqmc4Dp6q5uoo1i82eW033e_6H7HTRH86iHxx7idFwjmuOPOA0pe-FxiJBQ Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2fafe5bb6c2d4ac1a7f80847d29f1dc8 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fafe5bb6c2d4ac1a7f80847d29f1dc8"}]}] Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2fafe5bb6c2d4ac1a7f80847d29f1dc8 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-376354850 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerAddressesNegativeTestJSON-376354850-project Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 2d75592241e041ffabfec3154e4d09d5 Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-376354850-project Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 0c472b59-03c9-419e-8e8e-437d600dfc1f could not be found. Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '0c472b59-03c9-419e-8e8e-437d600dfc1f'} Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c472b59-03c9-419e-8e8e-437d600dfc1f could not be found. Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c472b59-03c9-419e-8e8e-437d600dfc1f could not be found. Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:09.068825 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:09.072940 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:09.072940 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:09.072940 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:09.072940 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:09.072940 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:09.072940 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:09.072940 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c472b59-03c9-419e-8e8e-437d600dfc1f could not be found. Oct 12 08:59:09.072940 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:09.076188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] Returning 404 to user: Instance 0c472b59-03c9-419e-8e8e-437d600dfc1f could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:09.077700 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4d9418fe-4ff4-48d5-b94c-0fdda524ed77 tempest-ServerAddressesNegativeTestJSON-376354850 tempest-ServerAddressesNegativeTestJSON-376354850-project] 10.222.0.40 "GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f" status: 404 len: 111 microversion: 2.1 time: 0.116992 Oct 12 08:59:09.083387 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1981/3705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:08 2022] GET /compute/v2.1/servers/0c472b59-03c9-419e-8e8e-437d600dfc1f => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:09.093679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:09.094514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:09.102823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:09.103705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:09.104487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:09.106387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:09.107210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:09.107980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:09.198785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:09.218576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:09.224875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:09.226211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-44081b1b-c432-4802-88a0-d1c8bcb1b61b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1740 microversion: 2.20 time: 0.504130 Oct 12 08:59:09.235021 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1725/3706] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:08 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1740 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:09.247225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:09.247843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:09.275213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:09.278587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:09.281154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:09.282271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:09.283873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:09.284491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:09.645581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:09.658321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d1ebc2fb-fce9-49ef-a330-7b6fb7f70543 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.421688 Oct 12 08:59:09.669828 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1726/3707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:09 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:09.707598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:09.708640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:09.722377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:09.726983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:09.729954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:09.731247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:09.731960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:09.734989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:10.427779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:10.439441 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-06f92343-cfd1-487a-8ec2-89c60d3d26dc tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1315 microversion: 2.1 time: 0.752687 Oct 12 08:59:10.458101 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1727/3708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:09 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:10.472760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b6bbdf69-c37d-47af-8e47-a06ec6c2ab99 req-2cdd3923-8b9c-4c63-ad36-e944b296cf01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39abadf0-5184-42fe-8f70-e8a48cb15b7a", "name": "network-vif-plugged", "status": "completed", "tag": "07f0f3d3-dbae-4ad3-aca8-61b79115134b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:10.500591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6bbdf69-c37d-47af-8e47-a06ec6c2ab99 req-2cdd3923-8b9c-4c63-ad36-e944b296cf01 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:10.500819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:10.501511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6bbdf69-c37d-47af-8e47-a06ec6c2ab99 req-2cdd3923-8b9c-4c63-ad36-e944b296cf01 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:10.501840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6bbdf69-c37d-47af-8e47-a06ec6c2ab99 req-2cdd3923-8b9c-4c63-ad36-e944b296cf01 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:10.512921 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-902b33f8-5bbe-4f00-accd-f4a1906bce43 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 1.423053 Oct 12 08:59:10.527274 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1982/3709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:09 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:10.531825 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b6bbdf69-c37d-47af-8e47-a06ec6c2ab99 req-2cdd3923-8b9c-4c63-ad36-e944b296cf01 service nova] Creating event network-vif-plugged:07f0f3d3-dbae-4ad3-aca8-61b79115134b for instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a on n-h2-858383-10 Oct 12 08:59:10.546845 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b6bbdf69-c37d-47af-8e47-a06ec6c2ab99 req-2cdd3923-8b9c-4c63-ad36-e944b296cf01 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084967 Oct 12 08:59:10.549850 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1728/3710] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:10.561214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:10.563272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed6bb1a0-6bca-4966-8e6a-ce1e0da8e295 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848774a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:10.567756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:10.595487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:10.596038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:10.596533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:10.597279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:10.597790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:10.598211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:11.486593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:11.499345 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b7cf03cc-9f98-4874-b615-b685a15f6884 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.958476 Oct 12 08:59:11.510876 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1983/3711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:10 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:11.524240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:11.526303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:11.544757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:11.546056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:11.546993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:11.549180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:11.554796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:11.558197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:12.166522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:12.190783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:12.192746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:12.194242 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9eea5fe6-5a09-455f-ae49-ad529d4bc1d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1722 microversion: 2.20 time: 0.678622 Oct 12 08:59:12.231486 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1984/3712] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:11 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1722 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:12.243408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:12.244416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:12.262337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:12.263196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:12.263843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:12.264982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:12.269857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:12.272083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:13.235303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:13.252557 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-46ba590c-a478-4d7c-9beb-ea2f2aa01b9d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 1.018679 Oct 12 08:59:13.253550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1985/3713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:12 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:13.259525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:13.269782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:13.277004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:13.277877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:13.278544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:13.279902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:13.280587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:13.289870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:13.720447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:13.729897 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca072362-a297-4896-a561-6e1ee5618f23 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.474903 Oct 12 08:59:13.737289 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1986/3714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:13 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:13.755384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:13.757365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:13.774095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:13.776902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:13.777403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:13.778209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:13.780048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:13.781425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:14.175506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:14.186778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0bba1af6-ba7f-4455-910b-182f33ecfa62 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1315 microversion: 2.1 time: 0.446228 Oct 12 08:59:14.205572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1987/3715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:13 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:14.214953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:14.220713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:14.232006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:14.232354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:14.232860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:14.233654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:14.240144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:14.240869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:14.344237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:14.365805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:14.607199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:14.619745 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c114edc-52a2-41ad-8bbc-9885803069aa tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.411366 Oct 12 08:59:14.623534 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1988/3716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:14 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:14.632659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9a781424-989d-4cd5-9ea4-451ce7a2aabf req-2d3f9805-4444-4a8d-90ed-4506b4ad096a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ec129c-6e9e-49ea-ac15-1ad810bd88aa", "tag": "5f681847-4ad5-47bf-9a0c-8336ec3c0288"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:14.655175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9a781424-989d-4cd5-9ea4-451ce7a2aabf req-2d3f9805-4444-4a8d-90ed-4506b4ad096a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:14.658856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9a781424-989d-4cd5-9ea4-451ce7a2aabf req-2d3f9805-4444-4a8d-90ed-4506b4ad096a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:14.659644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9a781424-989d-4cd5-9ea4-451ce7a2aabf req-2d3f9805-4444-4a8d-90ed-4506b4ad096a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:14.696231 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9a781424-989d-4cd5-9ea4-451ce7a2aabf req-2d3f9805-4444-4a8d-90ed-4506b4ad096a service nova] Creating event network-changed:5f681847-4ad5-47bf-9a0c-8336ec3c0288 for instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa on n-h1-858383-10 Oct 12 08:59:14.713288 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9a781424-989d-4cd5-9ea4-451ce7a2aabf req-2d3f9805-4444-4a8d-90ed-4506b4ad096a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088087 Oct 12 08:59:14.723019 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1989/3717] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:14.745123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:14.746964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:14.766190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:14.767084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:14.767751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:14.768707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:14.769530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:14.771795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:15.232484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:15.248434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:15.250932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:15.255170 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c46f9cc-9cc8-4a8a-9959-b1831684a245 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2951 microversion: 2.42 time: 0.530076 Oct 12 08:59:15.257933 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1990/3718] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:14 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2951 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:15.267392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:15.274369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:15.285572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:15.286504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:15.287249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:15.293106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:15.294125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:15.294979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:15.836670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:15.865307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:15.868545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:15.872132 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8dea7ad2-8bee-4e30-9e91-2414707ea7f7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1665 microversion: 2.20 time: 0.612906 Oct 12 08:59:15.874162 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1991/3719] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:15 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1665 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:15.886591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f795478f-c906-41ec-91ed-ca699f9cd52f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:15.890722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f795478f-c906-41ec-91ed-ca699f9cd52f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: ec6550a9-8651-421a-997d-0f4efa4426ed] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:15.905420 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-f795478f-c906-41ec-91ed-ca699f9cd52f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance ec6550a9-8651-421a-997d-0f4efa4426ed could not be found. Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f795478f-c906-41ec-91ed-ca699f9cd52f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/ec6550a9-8651-421a-997d-0f4efa4426ed HTTP/1.1 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance ec6550a9-8651-421a-997d-0f4efa4426ed could not be found. Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'ec6550a9-8651-421a-997d-0f4efa4426ed'} Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6550a9-8651-421a-997d-0f4efa4426ed could not be found. Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6550a9-8651-421a-997d-0f4efa4426ed could not be found. Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:15.912327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:15.920800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:15.920800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:15.920800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:15.920800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6550a9-8651-421a-997d-0f4efa4426ed could not be found. Oct 12 08:59:15.920800 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:15.930362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f795478f-c906-41ec-91ed-ca699f9cd52f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance ec6550a9-8651-421a-997d-0f4efa4426ed could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:15.931238 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f795478f-c906-41ec-91ed-ca699f9cd52f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/ec6550a9-8651-421a-997d-0f4efa4426ed" status: 404 len: 111 microversion: 2.1 time: 0.055394 Oct 12 08:59:15.931881 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1992/3720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:15 2022] GET /compute/v2.1/servers/ec6550a9-8651-421a-997d-0f4efa4426ed => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:15.957069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b7ae2a53-aa77-4208-a638-9cb3e79098d2 req-cdd6543e-dfd6-4801-8e17-1d1e6f10d14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1acdb6-1970-410c-a904-67636bdc3d68", "name": "network-vif-unplugged", "status": "completed", "tag": "6e76f914-e39e-4490-8567-4fcc14247a71"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:16.018471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b7ae2a53-aa77-4208-a638-9cb3e79098d2 req-cdd6543e-dfd6-4801-8e17-1d1e6f10d14e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:16.023141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b7ae2a53-aa77-4208-a638-9cb3e79098d2 req-cdd6543e-dfd6-4801-8e17-1d1e6f10d14e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:16.023634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b7ae2a53-aa77-4208-a638-9cb3e79098d2 req-cdd6543e-dfd6-4801-8e17-1d1e6f10d14e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:16.053384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.server_external_events [req-b7ae2a53-aa77-4208-a638-9cb3e79098d2 req-cdd6543e-dfd6-4801-8e17-1d1e6f10d14e service nova] Unable to find a host for instance 4d1acdb6-1970-410c-a904-67636bdc3d68. Dropping event network-vif-unplugged {{(pid=127006) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 08:59:16.054355 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b7ae2a53-aa77-4208-a638-9cb3e79098d2 req-cdd6543e-dfd6-4801-8e17-1d1e6f10d14e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.113441 Oct 12 08:59:16.069478 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1993/3721] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 129 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 08:59:16.088679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:16.089430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:16.105904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:16.106655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:16.107130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:16.109209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:16.109728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:16.110169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:16.433154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:16.447738 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2dd07b1d-7072-4fdf-b4b2-129271f68463 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.376063 Oct 12 08:59:16.454507 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1994/3722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:16 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:16.469612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:16.470252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:16.497406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:16.505498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:16.506071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:16.506854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:16.507335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:16.507769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:17.304997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:17.328540 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2b61cc1f-e8e2-40db-8c9c-15d61554d1a1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1315 microversion: 2.1 time: 0.869941 Oct 12 08:59:17.330338 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1995/3723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:16 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:17.338190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:17.338689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:17.347905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:17.348595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:17.360669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:17.364329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:17.365025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:17.365638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:17.672640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-731b11a3-e664-46a6-8cfe-0ffda4c535b1 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.339860 Oct 12 08:59:17.674287 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1996/3724] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 12 08:59:17 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9/os-interface => generated 1832 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:17.689293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:17.690151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:17.710007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:17.710603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:17.716112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:17.717387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:17.717915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:17.718354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:17.890146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:17.899686 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c26db2c2-c8b4-4beb-8160-e580658cf8d1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.223942 Oct 12 08:59:17.900613 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1997/3725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:17 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:17.920473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb02e88d-0b7c-4941-91e4-32e28312d6f5"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:17.923949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:17.938971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:17.939378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:17.939818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:17.943655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:17.944666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:17.945355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:18.376397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:18.532625 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a9e432d-c637-4dac-ac54-a387c9794246 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.630357 Oct 12 08:59:18.533330 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1998/3726] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Oct 12 08:59:17 2022] POST /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 188 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 08:59:18.562176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:18.563180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:18.569946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:18.570756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:18.571388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:18.572266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:18.573009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:18.573662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:18.828688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:18.848704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-046b5a48-dcdd-4e18-8ee1-e4b936ae356e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.302359 Oct 12 08:59:18.880348 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 1999/3727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:18 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:18.888753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:18.889421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:18.901801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:18.902331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:18.902759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:18.903475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:18.903941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:18.904440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:19.432032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:19.442448 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ecdb5f9e-479d-4bf5-ad28-0b9f3842ae42 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.560942 Oct 12 08:59:19.452915 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2000/3728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:18 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:19.473763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:19.474581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:19.494342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:19.495367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:19.496433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:19.497453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:19.498282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:19.501263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:19.853127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:19.863741 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-82a11545-a10b-4e08-b8cb-e1049d0b6106 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1315 microversion: 2.1 time: 0.409679 Oct 12 08:59:19.865356 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2001/3729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:19 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:19.870799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:19.871685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:19.880969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:19.881862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:19.882565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:19.883494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:19.884253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:19.884917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:19.943445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127006) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 12 08:59:20.101095 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59c6c3ca-fdfc-49a4-9da2-d59f33cef106 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/action" status: 202 len: 0 microversion: 2.20 time: 0.233794 Oct 12 08:59:20.103247 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2002/3730] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 08:59:19 2022] POST /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:59:20.120922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:20.126961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:20.145500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:20.148245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:20.150517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:20.153101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:20.153283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:20.156618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:20.496786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:20.528285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:20.533976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=57 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:20.558692 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06c0feaa-85b0-4b29-ad74-2f41e22547c8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.451659 Oct 12 08:59:20.584189 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2003/3731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:20 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:20.627068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:20.627818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:20.672426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:20.673503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:20.673977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:20.674742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:20.678298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:20.683762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:21.155052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:21.165195 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8cb75d37-2fb3-4809-b319-3dcc04979b35 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.574800 Oct 12 08:59:21.174758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2004/3732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:20 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:21.185490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-26f8a7dd-0b3d-4d3a-8505-f7da2f38f0a3 req-82a74fae-554a-4700-8f3b-7fead2ced47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe7c36b-9501-4250-9dab-4ab9ad8d154b", "name": "network-vif-unplugged", "status": "completed", "tag": "52b62051-41ae-464b-bac3-daff927171dd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:21.213079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-26f8a7dd-0b3d-4d3a-8505-f7da2f38f0a3 req-82a74fae-554a-4700-8f3b-7fead2ced47c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:21.213654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-26f8a7dd-0b3d-4d3a-8505-f7da2f38f0a3 req-82a74fae-554a-4700-8f3b-7fead2ced47c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:21.214094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-26f8a7dd-0b3d-4d3a-8505-f7da2f38f0a3 req-82a74fae-554a-4700-8f3b-7fead2ced47c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:21.242635 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-26f8a7dd-0b3d-4d3a-8505-f7da2f38f0a3 req-82a74fae-554a-4700-8f3b-7fead2ced47c service nova] Creating event network-vif-unplugged:52b62051-41ae-464b-bac3-daff927171dd for instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b on n-h1-858383-10 Oct 12 08:59:21.258727 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-26f8a7dd-0b3d-4d3a-8505-f7da2f38f0a3 req-82a74fae-554a-4700-8f3b-7fead2ced47c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091047 Oct 12 08:59:21.259862 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2005/3733] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:21.272869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:21.274047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:21.295076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:21.295076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:21.295076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:21.300232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:21.300839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:21.301380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:21.648378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:21.661113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:21.663787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:21.666023 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f4cbcf8e-d353-4eaf-862c-43aa107cbb7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1751 microversion: 2.20 time: 0.400371 Oct 12 08:59:21.667294 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2006/3734] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:21 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1751 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:21.709317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3aa070e5-c159-48a2-a1af-e8da2613d595 req-d27f4a40-19dd-4ffe-ac12-5449b9f2f38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ec129c-6e9e-49ea-ac15-1ad810bd88aa", "name": "network-vif-plugged", "status": "completed", "tag": "5f681847-4ad5-47bf-9a0c-8336ec3c0288"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:21.742291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3aa070e5-c159-48a2-a1af-e8da2613d595 req-d27f4a40-19dd-4ffe-ac12-5449b9f2f38f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:21.743681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3aa070e5-c159-48a2-a1af-e8da2613d595 req-d27f4a40-19dd-4ffe-ac12-5449b9f2f38f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:21.748287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3aa070e5-c159-48a2-a1af-e8da2613d595 req-d27f4a40-19dd-4ffe-ac12-5449b9f2f38f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:21.789301 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3aa070e5-c159-48a2-a1af-e8da2613d595 req-d27f4a40-19dd-4ffe-ac12-5449b9f2f38f service nova] Creating event network-vif-plugged:5f681847-4ad5-47bf-9a0c-8336ec3c0288 for instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa on n-h1-858383-10 Oct 12 08:59:21.799933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3aa070e5-c159-48a2-a1af-e8da2613d595 req-d27f4a40-19dd-4ffe-ac12-5449b9f2f38f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129513 Oct 12 08:59:21.810111 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2007/3735] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:21.861647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:21.862808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:21.889234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:21.890067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:21.890780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:21.896860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:21.897384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:21.897859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:22.381497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:22.400496 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d57d75cf-848d-4239-98fa-169aaa00423c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.588261 Oct 12 08:59:22.414291 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2008/3736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:21 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:22.414291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-99ee35d8-0136-483c-b657-a9e5f24b7542 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1339947800", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-99ee35d8-0136-483c-b657-a9e5f24b7542 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 238 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1339947800", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1339947800', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.435912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 12 08:59:22.441309 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:22.444899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-99ee35d8-0136-483c-b657-a9e5f24b7542 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:22.446089 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-99ee35d8-0136-483c-b657-a9e5f24b7542 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.044036 Oct 12 08:59:22.446821 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2009/3737] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:59:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:59:22.455690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:22.456564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:22.460037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:22.474281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:22.476255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:22.477824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:22.478655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:22.482760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:22.483466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:22.783228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:22.801733 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45cf66fa-bc59-4eeb-be48-db828fccf145 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1315 microversion: 2.1 time: 0.353457 Oct 12 08:59:22.804027 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2010/3738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:22 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:22.810852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:22.817190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:22.832651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:22.833483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:22.834786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:22.840249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:22.841030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:22.841761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:23.064665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:23.072728 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e22ded21-86e6-43ac-90e6-d0be86d110f8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.267382 Oct 12 08:59:23.093802 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2011/3739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:22 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:23.098984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:23.099606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:23.112506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:23.113008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:23.113798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:23.114252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:23.114621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:23.126434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:23.310816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:23.320886 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a98340d9-4f5e-48f6-a6f7-c3436f1d81d3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.225705 Oct 12 08:59:23.322042 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2012/3740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:23 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:23.330643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:23.331369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:23.338082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:23.338703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:23.339313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:23.349782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:23.349782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:23.349782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:23.709646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:23.722041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:23.725869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:23.732079 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b262f27f-123b-4c90-a626-dfa0bb830d09 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1751 microversion: 2.20 time: 0.408878 Oct 12 08:59:23.733198 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2013/3741] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:23 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1751 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:23.749026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6fc8e164-4e7e-4b97-b4e6-ae22d2ba639d req-051c4dba-0800-4ff1-ac9c-cfbc52748ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe7c36b-9501-4250-9dab-4ab9ad8d154b", "tag": "52b62051-41ae-464b-bac3-daff927171dd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:23.768684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6fc8e164-4e7e-4b97-b4e6-ae22d2ba639d req-051c4dba-0800-4ff1-ac9c-cfbc52748ae4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:23.769531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6fc8e164-4e7e-4b97-b4e6-ae22d2ba639d req-051c4dba-0800-4ff1-ac9c-cfbc52748ae4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:23.770160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6fc8e164-4e7e-4b97-b4e6-ae22d2ba639d req-051c4dba-0800-4ff1-ac9c-cfbc52748ae4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:23.790749 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6fc8e164-4e7e-4b97-b4e6-ae22d2ba639d req-051c4dba-0800-4ff1-ac9c-cfbc52748ae4 service nova] Creating event network-changed:52b62051-41ae-464b-bac3-daff927171dd for instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b on n-h1-858383-10 Oct 12 08:59:23.799344 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6fc8e164-4e7e-4b97-b4e6-ae22d2ba639d req-051c4dba-0800-4ff1-ac9c-cfbc52748ae4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064685 Oct 12 08:59:23.800283 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2014/3742] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:23.834834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:23.842695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:23.860817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:23.868817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:23.869578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:23.870329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:23.875671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:23.876265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:24.317862 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed6bb1a0-6bca-4966-8e6a-ce1e0da8e295 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21" status: 200 len: 1420 microversion: 2.1 time: 13.765143 Oct 12 08:59:24.320451 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1729/3743] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:10 2022] GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21 => generated 1420 bytes in 13770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:24.328775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:24.329550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:24.352611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:24.356316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:24.356875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:24.369857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:24.370613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:24.371179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:24.586727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:24.595505 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5c8d8d7b-2d11-4bc2-9a98-091c5ff2cc5f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.273965 Oct 12 08:59:24.596106 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1730/3744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:24 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:24.614501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:24.615133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:24.621607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:24.622547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:24.623212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:24.624343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:24.624957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:24.625560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:24.636641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:24.658421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe6bba31-d56d-4faf-89f8-ecb80e43ad4a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.856678 Oct 12 08:59:24.659036 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2015/3745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:23 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:24.931426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:24.945947 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6762283f-c91b-4f83-9b8a-a224753d532a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1501 microversion: 2.1 time: 0.342335 Oct 12 08:59:24.962018 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1731/3746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:24 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:24.970611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:24.971455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:24.978841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:24.979989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:24.980599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:24.981510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:24.982235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:24.982836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:25.055273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-438823621", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": "none"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:25.211513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:59:25.212225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:59:25.213454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:59:25.214237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:59:25.214836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:59:25.237609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:25.239262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:25.242009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:25.242874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:25.243430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:25.243861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:25.293966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Getting quotas for project 15cfa18632e44512a4622e78975c6de3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:59:25.299194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:25.306619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Getting quotas for user c389163f10194d7c9c44fbf66b3853ee and project 15cfa18632e44512a4622e78975c6de3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:59:25.318764 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2fbe3090-9b2a-4514-908c-12f00555c363 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.355283 Oct 12 08:59:25.337562 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1732/3747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:24 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:25.337562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ca12cfb-dee1-4c5e-b5cc-460af62d5c2f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f98489f6940>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:25.360678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:59:25.364546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:59:25.418219 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ca12cfb-dee1-4c5e-b5cc-460af62d5c2f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21" status: 200 len: 1420 microversion: 2.1 time: 0.092900 Oct 12 08:59:25.430851 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1733/3748] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:25 2022] GET /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21 => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:25.450660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:25.453096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:25.474332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:25.474843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:25.475669 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02e6f905-9da9-4d30-8cc3-b6156f91ea95 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.812793 Oct 12 08:59:25.475947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:25.476749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:25.483456 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2016/3749] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 08:59:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 08:59:25.484660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-714452df-8229-4f57-92fb-f48b71a31a7c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1961915312", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:25.486686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:25.487358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-714452df-8229-4f57-92fb-f48b71a31a7c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 235 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1961915312", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1961915312', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.503453 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-714452df-8229-4f57-92fb-f48b71a31a7c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-714452df-8229-4f57-92fb-f48b71a31a7c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.024641 Oct 12 08:59:25.508738 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2017/3750] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:59:25 2022] POST /compute/v2.1/servers => generated 133 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:59:25.521349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:25.521938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:25.536789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:25.537307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:25.537809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:25.538908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:25.539531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:25.540384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:25.551797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:25.600557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lazy-loading 'flavor' on Instance uuid 58ec129c-6e9e-49ea-ac15-1ad810bd88aa {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:59:25.788208 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb1bbf76-010b-4c7d-a280-874919d4dc0e tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "POST /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa/action" status: 202 len: 0 microversion: 2.1 time: 0.281139 Oct 12 08:59:25.791904 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2018/3751] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:25 2022] POST /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:25.807981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-576c6f7e-b120-4016-adab-247af7182df2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843fcbf70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:25.918077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:25.938450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:25.944038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:25.948375 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-36544db6-028b-4ef0-ba24-8200ff493d4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1751 microversion: 2.20 time: 0.515895 Oct 12 08:59:25.950936 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1734/3752] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:25 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1751 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:25.961024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1409902-415e-46bf-a9e3-0aadf3bae91a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:25.961668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1409902-415e-46bf-a9e3-0aadf3bae91a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:26.177199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1409902-415e-46bf-a9e3-0aadf3bae91a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:26.188772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1409902-415e-46bf-a9e3-0aadf3bae91a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:26.190245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1409902-415e-46bf-a9e3-0aadf3bae91a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:26.191587 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1409902-415e-46bf-a9e3-0aadf3bae91a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1277 microversion: 2.54 time: 0.238964 Oct 12 08:59:26.205880 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1735/3753] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:25 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:26.215479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:26.216392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:26.222817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:26.223550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:26.224175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:26.225039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:26.226257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:26.227091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:26.462484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:26.472193 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5fc33235-abb6-42df-a4a3-e16b89c01190 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.264881 Oct 12 08:59:26.481845 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1736/3754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:26 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:26.487887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:26.489319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:26.524404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:26.526283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:26.526772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:26.530769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:26.536482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:26.537847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:26.814847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:26.827063 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9bed57c2-767b-45b3-86d2-d0115cf1fa0e tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.343806 Oct 12 08:59:26.829126 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1737/3755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:26 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:26.850719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:26.851256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:26.871738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:26.875577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:26.877089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:26.879111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:26.880092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:26.884300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.125212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:27.138505 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-abf4d48d-5dbe-4a15-8f5c-f7f6f80d5b7c tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1492 microversion: 2.1 time: 0.304595 Oct 12 08:59:27.139727 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1738/3756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:26 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1492 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:27.152804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:27.154682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:27.174400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.175517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.176448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.178764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.181654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.182345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.231180 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-576c6f7e-b120-4016-adab-247af7182df2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21" status: 204 len: 0 microversion: 2.1 time: 1.437857 Oct 12 08:59:27.232451 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2019/3757] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:25 2022] DELETE /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21 => generated 0 bytes in 1440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:59:27.241845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:27.243200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:27.264846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.268619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.271838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.272647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.277668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.278946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.520786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:27.536023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc0e3b95-27e4-4b66-a4b7-a331aedf2df5 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.392474 Oct 12 08:59:27.538518 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1739/3758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:27 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:27.553674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:27.554443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:27.567879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.569703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.570288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.571457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.574129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.574697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.595037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:27.604597 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-07e8ceee-a292-4fe2-b91d-b88259b677c1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.367907 Oct 12 08:59:27.621401 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2020/3759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:27 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:27.621401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:27.621401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:27.621401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.621401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.621937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.623051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.623689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.624295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.669746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:59:27.830922 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-54d2ad3e-c99b-418f-bbc1-3088875ea0ce tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 204 len: 0 microversion: 2.1 time: 0.223068 Oct 12 08:59:27.835224 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2021/3760] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:27 2022] DELETE /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:59:27.850750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:27.851457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:27.889410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.889973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.890415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.898453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.898964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.899417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.910303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:27.928399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:27.934244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:27.936996 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4f3c855f-2266-4c85-a2ed-c0b1f328892b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1753 microversion: 2.20 time: 0.397432 Oct 12 08:59:27.949590 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1740/3761] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:27 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1753 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:27.949590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:27.949590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:27.966504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.967040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.971399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:27.972320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:27.972806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:27.973254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.030376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:59:28.144572 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f351fc72-d851-4975-a71d-7060a048f3cd tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 204 len: 0 microversion: 2.1 time: 0.203815 Oct 12 08:59:28.145206 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1741/3762] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:27 2022] DELETE /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:59:28.158541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dacc7401-8ce4-4c2f-8f99-046df2c0add7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:28.159175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dacc7401-8ce4-4c2f-8f99-046df2c0add7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 1ba0b868-6295-4725-ad30-95947364c634] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:28.162705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:28.174460 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-dacc7401-8ce4-4c2f-8f99-046df2c0add7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 1ba0b868-6295-4725-ad30-95947364c634 could not be found. Oct 12 08:59:28.175462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:28.178215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:28.180882 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e04f1609-ff51-4946-958c-28c9588642de tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1337 microversion: 2.54 time: 0.344090 Oct 12 08:59:28.181399 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2022/3763] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:27 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1337 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dacc7401-8ce4-4c2f-8f99-046df2c0add7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/1ba0b868-6295-4725-ad30-95947364c634/action HTTP/1.1 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 13 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: {"pause": {}} Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 1ba0b868-6295-4725-ad30-95947364c634 could not be found. Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1ba0b868-6295-4725-ad30-95947364c634', 'body': {'pause': {}}} Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba0b868-6295-4725-ad30-95947364c634 could not be found. Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba0b868-6295-4725-ad30-95947364c634 could not be found. Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:28.185077 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:28.190365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:28.190365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:28.190365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba0b868-6295-4725-ad30-95947364c634 could not be found. Oct 12 08:59:28.190365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:28.194319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dacc7401-8ce4-4c2f-8f99-046df2c0add7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 1ba0b868-6295-4725-ad30-95947364c634 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:28.195436 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dacc7401-8ce4-4c2f-8f99-046df2c0add7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/1ba0b868-6295-4725-ad30-95947364c634/action" status: 404 len: 111 microversion: 2.1 time: 0.042857 Oct 12 08:59:28.198093 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1742/3764] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:28 2022] POST /compute/v2.1/servers/1ba0b868-6295-4725-ad30-95947364c634/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:28.201853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:28.202598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:28.208497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:28.209108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:28.215813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.217107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.218155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.219249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.220061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.221119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.237335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.239672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.240228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.241015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.241524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.244812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.409513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:28.417012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:28.418287 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a119f620-6a05-432b-8569-1994a0732c01 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.218778 Oct 12 08:59:28.431267 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1743/3765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:28 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:28.431267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:28.431267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:28.431658 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6dc3dde-064e-46d8-860b-ce082b6eaa43 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1498 microversion: 2.1 time: 0.244835 Oct 12 08:59:28.431658 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2023/3766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:28 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:28.441315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-816569641", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3dfaf69e-9114-463f-af48-2e013b44a4e8"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:28.444274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.444887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.445420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.446245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.446792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.447310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.500607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] validate_networks() for [('3dfaf69e-9114-463f-af48-2e013b44a4e8', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 08:59:28.610804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:28.621313 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bbd5741d-951e-4594-b508-936677e4e447 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.200712 Oct 12 08:59:28.621941 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1744/3767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:28 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:28.628799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:28.629731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:28.638977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.639654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.640273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.641177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.641924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.642783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.781098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:28.801221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ae4cfb9-6a68-443a-b8e6-63ddc3f712a3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.177763 Oct 12 08:59:28.802043 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1745/3768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:28 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:28.806493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:28.807673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:28.814154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.814638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.815070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.815768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.816214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.816644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.958790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:28.968805 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dce9f4d8-5ce6-4c4c-a2f3-c917fa7e15ce tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.165847 Oct 12 08:59:28.969828 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1746/3769] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:28 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:28.975340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:28.976184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:28.980963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:59:28.981859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:59:28.982744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:59:28.983382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.983715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:59:28.984005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.984628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:28.985012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:59:28.985626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:28.986357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:28.986978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.006120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.007300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.009306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.013493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.014592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.015797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.045207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Getting quotas for project fa3a965bdb884e0eb4f37650c30cb3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:59:29.053115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Getting quotas for user 69f6da267d5248518650775b52ca9488 and project fa3a965bdb884e0eb4f37650c30cb3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:59:29.068380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 08:59:29.072165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 08:59:29.134361 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-edb1cb31-7ac1-4613-b2fa-f14dca843ed8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704434 Oct 12 08:59:29.135024 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2024/3770] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 08:59:29.155876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.160179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:29.161327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:29.162615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:29.166120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.167576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.169334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.169911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.170432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.171156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.171646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.172082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.174729 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7ca4dd6a-9666-4085-8e11-6c93121ba3d2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1753 microversion: 2.20 time: 0.203288 Oct 12 08:59:29.175727 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1747/3771] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:28 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:29.215271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75ce777c-a268-49af-b28b-83d7489a0323 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:29.219509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-75ce777c-a268-49af-b28b-83d7489a0323 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:29.295558 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-113ca18c-3185-4fca-91e8-985662e0f0d0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.151716 Oct 12 08:59:29.299763 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2025/3772] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:29 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:29.306158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:29.307018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:29.316848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.317479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.318039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.318430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75ce777c-a268-49af-b28b-83d7489a0323 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.318644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.319143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.319641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.333424 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-75ce777c-a268-49af-b28b-83d7489a0323 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1207 microversion: 2.1 time: 0.132301 Oct 12 08:59:29.345529 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1748/3773] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:29 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1207 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:29.345529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:29.345529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:29.353073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.353073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.353073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.353699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.354253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.355391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.448498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.462779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.466286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.474168 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-649dde5f-4bef-4c01-b254-6e10ac0e34f2 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1335 microversion: 2.54 time: 0.169557 Oct 12 08:59:29.475154 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2026/3774] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:29 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1335 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:29.486005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-462e84c5-68fb-4597-81de-1b6bc8d9e7b1 req-c110319b-8978-48ae-b9e1-fe18606a98e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3cd57c-b10d-449c-bee3-9d0435916ad7", "name": "network-vif-unplugged", "status": "completed", "tag": "937dc5cb-ca92-4a63-a170-7231a52d6927"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:29.504919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-462e84c5-68fb-4597-81de-1b6bc8d9e7b1 req-c110319b-8978-48ae-b9e1-fe18606a98e4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.507002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-462e84c5-68fb-4597-81de-1b6bc8d9e7b1 req-c110319b-8978-48ae-b9e1-fe18606a98e4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.507469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-462e84c5-68fb-4597-81de-1b6bc8d9e7b1 req-c110319b-8978-48ae-b9e1-fe18606a98e4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.525882 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-462e84c5-68fb-4597-81de-1b6bc8d9e7b1 req-c110319b-8978-48ae-b9e1-fe18606a98e4 service nova] Creating event network-vif-unplugged:937dc5cb-ca92-4a63-a170-7231a52d6927 for instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 on n-h2-858383-10 Oct 12 08:59:29.531824 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-462e84c5-68fb-4597-81de-1b6bc8d9e7b1 req-c110319b-8978-48ae-b9e1-fe18606a98e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055232 Oct 12 08:59:29.532681 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2027/3775] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:29.539222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:29.540157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:29.550303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.551522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.553513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.555322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.558079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.558534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.621548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.641600 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c2d2ea4-aa3f-4f96-b7e9-a81f5886b1b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1511 microversion: 2.1 time: 0.304736 Oct 12 08:59:29.644519 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1749/3776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:29 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:29.656004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:29.657040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:29.679208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.679879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.680418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.681370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.684495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.687935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.873624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:29.906102 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-448d7b78-409b-447f-b043-4e0bd1beedb6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.371763 Oct 12 08:59:29.921901 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2028/3777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:29 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:29.934745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:29.935780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:29.942763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.943489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.944131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:29.945108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:29.945965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:29.946586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.234791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.249880 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-35356045-a4f3-4458-bdc6-760f5855d7db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.325877 Oct 12 08:59:30.251055 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2029/3778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:29 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:30.282144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:30.284009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:30.300048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.310423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.314094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.322042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.323622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.324047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.324982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.341767 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-17edf801-379c-4ff2-bd22-e9a16bd81ee1 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1498 microversion: 2.1 time: 0.694028 Oct 12 08:59:30.342397 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1750/3779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:29 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1498 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:30.370108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:30.372803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:30.388833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.391250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.392208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.393187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.393880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.397376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.520346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.526256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.535502 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-deb01243-4498-421d-b589-3f148e62e69a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1259 microversion: 2.1 time: 0.178692 Oct 12 08:59:30.545250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.546811 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1751/3780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:30 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:30.549695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.551704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4756a6f0-69e7-402a-b40d-deca2614e6d5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1753 microversion: 2.20 time: 0.298892 Oct 12 08:59:30.554572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2030/3781] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:30 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1753 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:30.559456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:30.560442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:30.567550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.568331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.568962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.569990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.570620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.571211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.674776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:30.675740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:30.683380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.694274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.696247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.697775 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9262a46-5037-47b8-a393-2623d30bdc1a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1335 microversion: 2.54 time: 0.149917 Oct 12 08:59:30.698952 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1752/3782] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:30 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1335 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:30.705215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.705941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.707200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.709200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.709933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.711765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.768637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3dd1e33b-bbac-44e6-ae2f-b9a82746eec4 req-9668c31a-8949-4903-a1da-1481fc76d0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ec129c-6e9e-49ea-ac15-1ad810bd88aa", "name": "network-vif-deleted", "tag": "5f681847-4ad5-47bf-9a0c-8336ec3c0288"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:30.781257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3dd1e33b-bbac-44e6-ae2f-b9a82746eec4 req-9668c31a-8949-4903-a1da-1481fc76d0c6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.781917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3dd1e33b-bbac-44e6-ae2f-b9a82746eec4 req-9668c31a-8949-4903-a1da-1481fc76d0c6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.782426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3dd1e33b-bbac-44e6-ae2f-b9a82746eec4 req-9668c31a-8949-4903-a1da-1481fc76d0c6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.795286 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3dd1e33b-bbac-44e6-ae2f-b9a82746eec4 req-9668c31a-8949-4903-a1da-1481fc76d0c6 service nova] Creating event network-vif-deleted:5f681847-4ad5-47bf-9a0c-8336ec3c0288 for instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa on n-h1-858383-10 Oct 12 08:59:30.803354 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3dd1e33b-bbac-44e6-ae2f-b9a82746eec4 req-9668c31a-8949-4903-a1da-1481fc76d0c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038881 Oct 12 08:59:30.808623 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1753/3783] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:30.920452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:30.929106 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71828b6e-a001-487d-9b38-43d1f55691ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1491 microversion: 2.1 time: 0.265676 Oct 12 08:59:30.929916 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2031/3784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:30 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1491 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:30.937990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:30.938915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:30.947769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.948330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.948936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.950159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.950774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.951274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.960792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:30.961657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:30.968518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.970064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.970681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:30.971585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:30.972206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:30.973125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.000438 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Cannot 'pause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state paused Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action HTTP/1.1 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 13 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: {"pause": {}} Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: exception: Cannot 'pause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state paused Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'pause': {}}} Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb in vm_state paused. Cannot pause while the instance is in this state. Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state paused Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:31.002342 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:31.008068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:31.008068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:31.008068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:31.008068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state paused Oct 12 08:59:31.008068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:31.008068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 409 to user: Cannot 'pause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state paused {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:31.008068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86007f31-e48e-406f-b2e9-7a36a2c78db6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 409 len: 143 microversion: 2.1 time: 0.048978 Oct 12 08:59:31.008068 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2032/3785] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:30 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 143 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 08:59:31.012797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:31.013467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:31.020433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.021048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.021711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.022465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.022935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.023367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.027574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:31.111695 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6e7ecc30-1ac5-42f5-ba5c-ed221911d627 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.101301 Oct 12 08:59:31.113626 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2033/3786] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:31 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:31.114787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:31.121315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:31.122370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:31.128173 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a8982d99-4c69-4c86-abd7-2f6ec50e5dca tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.195415 Oct 12 08:59:31.128779 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1754/3787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:30 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:31.129087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.129684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.130269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.131112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.131913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.132488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.278375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:31.279454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:31.307350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.308506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.311706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.313301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.314005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.317478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.348244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:31.356639 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7190dfa9-faa4-47f1-885e-c651f19ec78b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1498 microversion: 2.1 time: 0.239701 Oct 12 08:59:31.357573 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2034/3788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:31 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:31.398388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:31.399335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:31.406742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.407386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.408009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.409176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.409886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.410367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.451648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.452247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.452877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.453495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lazy-loading 'fault' on Instance uuid 58ec129c-6e9e-49ea-ac15-1ad810bd88aa {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:59:31.539123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3571292391094d83901f21ccb18ec2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c1d72dbd4402b8240521c30cdd740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:31.563530 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-10180651-4f0a-49c1-aeec-8631d89f21ca tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 200 len: 1305 microversion: 2.1 time: 0.167912 Oct 12 08:59:31.565296 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2035/3789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:31 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 1305 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:31.583555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:31.585698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:31.620369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.623359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.627093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.628715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.632171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.634958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.701492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:31.718976 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7caa6075-b657-4c76-be4e-eccadd17503e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.445672 Oct 12 08:59:31.721373 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1755/3790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:31 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:31.731372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:31.732265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:31.741659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.742435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.743073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.743975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.744857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.746765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.766440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:31.775094 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be693e18-a825-4363-8ccc-87292d844668 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1265 microversion: 2.1 time: 0.208470 Oct 12 08:59:31.786727 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2036/3791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:31 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:31.798770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:31.799395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:31.806197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.806698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.807346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.808245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:31.808877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:31.809315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:31.895292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:31.905684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:31.907142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:31.908287 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90f57217-e668-470d-ba84-0ba16782d03b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1335 microversion: 2.54 time: 0.120241 Oct 12 08:59:31.908855 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2037/3792] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:31 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:32.152436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:32.152964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:32.160003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.160505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.160947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.161686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.162149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.162577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.307706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:32.316297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dab07e88-db38-4cf1-8ee8-5076e959b483 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.167871 Oct 12 08:59:32.322209 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2038/3793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:32 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:32.380422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:32.381033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:32.388786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.389312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.390194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.391103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.392174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.392174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.398599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:32.411376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:32.414343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:32.415792 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-634a84d3-8b47-4cfb-8f1d-49c09ba73f38 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1753 microversion: 2.20 time: 0.692911 Oct 12 08:59:32.434190 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1756/3794] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:31 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1753 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:32.567062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:32.575919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dfa6f8a0-c97c-48ea-818e-1c739337576a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.199430 Oct 12 08:59:32.590665 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2039/3795] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:32 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:32.596183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:32.597428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:32.601101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:32.601985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:32.608644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.609387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.610046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.610922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.611536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.612124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.621936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.623939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.625988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.628310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.629168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.629977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.666030 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa HTTP/1.1 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '58ec129c-6e9e-49ea-ac15-1ad810bd88aa'} Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:32.669164 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.674745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.674745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:32.674745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:32.674745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:32.674745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:32.674745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.674745 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.676900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:32.678068 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e380d9c-d92f-471d-ab3b-998f33447d7d tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 404 len: 111 microversion: 2.1 time: 0.088661 Oct 12 08:59:32.683499 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1757/3796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:32 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:32.689114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:32.689956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:32.715297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.717105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.717818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.719135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.720260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.720901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.743583 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa HTTP/1.1 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '58ec129c-6e9e-49ea-ac15-1ad810bd88aa'} Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:32.748306 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.753696 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.756567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:32.758135 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d7d92075-bc2b-4409-83b4-f0a16d2cfea9 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 404 len: 111 microversion: 2.1 time: 0.072840 Oct 12 08:59:32.758923 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1758/3797] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:32 2022] DELETE /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:32.768791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:32.769679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:32.776368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.777051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.777693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.780685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.783257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.783996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.792155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:32.806955 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-454b43ad-dc29-4893-ba40-8b1a8d28ad6e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.207403 Oct 12 08:59:32.822189 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2040/3798] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:32 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:32.833199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:32.833853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58ec129c-6e9e-49ea-ac15-1ad810bd88aa] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:32.852795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.853363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.853853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.865232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.865232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.865709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.883868 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa HTTP/1.1 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '58ec129c-6e9e-49ea-ac15-1ad810bd88aa'} Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:32.885614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.890542 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:32.890542 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:32.890542 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:32.890542 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:32.890542 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:32.890542 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. Oct 12 08:59:32.890542 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:32.893113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 58ec129c-6e9e-49ea-ac15-1ad810bd88aa could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:32.894436 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a8f8bba-7418-468d-ba59-d708f7a86ebf tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa" status: 404 len: 111 microversion: 2.1 time: 0.071187 Oct 12 08:59:32.895545 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2041/3799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:32 2022] GET /compute/v2.1/servers/58ec129c-6e9e-49ea-ac15-1ad810bd88aa => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:32.906168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:32.908398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:32.947460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.947973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.948417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:32.949135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:32.949627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:32.950053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.072114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:33.080667 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5141a711-89b9-4ab4-95e9-ce191b5494c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1265 microversion: 2.1 time: 0.183745 Oct 12 08:59:33.081259 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2042/3800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:32 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:33.091551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:33.093961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:33.109282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.109811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.110439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.111330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.111850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.112235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.135164 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227/action HTTP/1.1 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 28 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: {"reboot": {"type": "SOFT"}} Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3c6551d7-31a6-478d-a552-44f2ab930227', 'body': {'reboot': {'type': 'SOFT'}}} Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:33.136801 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9a0fb48-5ad8-422d-9192-f24a867b1d95 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227/action" status: 404 len: 111 microversion: 2.1 time: 0.056094 Oct 12 08:59:33.143495 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2043/3801] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:33 2022] POST /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:33.144857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:33.144993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:33.148421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:33.152310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.153189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.153752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.154647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.155084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.155905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.172827 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 HTTP/1.1 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'e3858302-5978-4e93-974d-ae435371d519'} Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:33.174739 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.179308 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.180854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:33.181930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e07f5c0-b224-465f-9277-a893c0f8060b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 404 len: 111 microversion: 2.1 time: 0.041787 Oct 12 08:59:33.182683 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2044/3802] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:33 2022] DELETE /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:33.193495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:33.197127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:33.212900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.216167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.217973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.218895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.224340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.225008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.346725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:33.366030 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ede2594a-4411-438b-b219-4a71824635d6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1506 microversion: 2.1 time: 0.602014 Oct 12 08:59:33.368717 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1759/3803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:32 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:33.378488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-995ad24d-02cb-44a5-8010-f41cda22a6ba req-e45ef6e5-44f7-4e11-b134-1d0e5f5cb3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3cd57c-b10d-449c-bee3-9d0435916ad7", "name": "network-vif-deleted", "tag": "937dc5cb-ca92-4a63-a170-7231a52d6927"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:33.405052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-995ad24d-02cb-44a5-8010-f41cda22a6ba req-e45ef6e5-44f7-4e11-b134-1d0e5f5cb3a8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.406299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-995ad24d-02cb-44a5-8010-f41cda22a6ba req-e45ef6e5-44f7-4e11-b134-1d0e5f5cb3a8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.407704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-995ad24d-02cb-44a5-8010-f41cda22a6ba req-e45ef6e5-44f7-4e11-b134-1d0e5f5cb3a8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.418021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:33.433036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:33.435536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:33.439536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f8dde25-9b00-4f2c-bb53-48e4fb47f231 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1356 microversion: 2.54 time: 0.252994 Oct 12 08:59:33.441167 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2045/3804] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:33 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1356 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:33.444531 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-995ad24d-02cb-44a5-8010-f41cda22a6ba req-e45ef6e5-44f7-4e11-b134-1d0e5f5cb3a8 service nova] Creating event network-vif-deleted:937dc5cb-ca92-4a63-a170-7231a52d6927 for instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 on n-h2-858383-10 Oct 12 08:59:33.464032 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-995ad24d-02cb-44a5-8010-f41cda22a6ba req-e45ef6e5-44f7-4e11-b134-1d0e5f5cb3a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090637 Oct 12 08:59:33.467860 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1760/3805] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:33.468469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:33.469861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:33.487502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:33.491043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: e3858302-5978-4e93-974d-ae435371d519] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:33.499938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.500435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.500872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.501627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.502242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.502850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.507664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.508325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.509727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.510629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.511270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.514729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.547679 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 HTTP/1.1 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e3858302-5978-4e93-974d-ae435371d519'} Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:33.551353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.555916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:33.555916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:33.555916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:33.555916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:33.555916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:33.555916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. Oct 12 08:59:33.555916 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:33.557334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance e3858302-5978-4e93-974d-ae435371d519 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:33.558403 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d96e7e8e-727a-4db3-9de6-23b705f2399f tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519" status: 404 len: 111 microversion: 2.1 time: 0.087465 Oct 12 08:59:33.559424 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1761/3806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:33 2022] GET /compute/v2.1/servers/e3858302-5978-4e93-974d-ae435371d519 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:33.588951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:33.589807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:33.596669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.597419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.598087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.599167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.599774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.600357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.848451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:33.859917 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-84f74dd3-954d-4c55-9f8a-5e0502da5948 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.416368 Oct 12 08:59:33.872590 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2046/3807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:33 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:33.878454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:33.879068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:33.894105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.895898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.896907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.898129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:33.898826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:33.899292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:33.982037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:33.990125 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-36e98704-9c50-4494-82be-0a1fd06f75cf tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1391 microversion: 2.1 time: 0.429305 Oct 12 08:59:34.001508 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1762/3808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:33 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1391 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:34.001508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a0af8ff-f29d-4032-bffc-743e7f3f76b7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Action: 'create', calling method: .version_select at 0x7f984894e670>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1225122847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb8Duq9cQXsMmxN3uPFEMPPKl71UkJyIKA9KjVdHm4XW3LckuLdQRUWn6UdZpbgsWrZ8dK38t71C7NCoKnralBRK0UO84lKE1aooeJNW51B8mLGlUkhAuKeJ0VKTOh2aA=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:34.012060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-7a0af8ff-f29d-4032-bffc-743e7f3f76b7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Getting quotas for project 15cfa18632e44512a4622e78975c6de3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 08:59:34.017532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-7a0af8ff-f29d-4032-bffc-743e7f3f76b7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Getting quotas for user c389163f10194d7c9c44fbf66b3853ee and project 15cfa18632e44512a4622e78975c6de3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 08:59:34.067487 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7a0af8ff-f29d-4032-bffc-743e7f3f76b7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.072899 Oct 12 08:59:34.071190 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1763/3809] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 08:59:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 08:59:34.085031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.087837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.106856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.112842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.113859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.114553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.115567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.116249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.117324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.119965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.121654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.124614 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-852ef79f-5af6-4528-9630-df2e46bbe0b6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1753 microversion: 2.20 time: 0.250113 Oct 12 08:59:34.127978 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2047/3810] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:33 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1753 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:34.137370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.140129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.146786 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.148303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.148801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.149255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.150010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.150451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.150878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 HTTP/1.1 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'fe06cee8-a199-43e0-b707-d7177639bcd6'} Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:34.151336 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.156415 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.158199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:34.159247 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eae2bbe3-1fbc-462a-be16-8c1ad71da809 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 404 len: 111 microversion: 2.1 time: 0.084968 Oct 12 08:59:34.161052 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1764/3811] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:34 2022] DELETE /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:34.168554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1225122847", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:34.176467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.186454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.187428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.188418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.189561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.190324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.191109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.339315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.348303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 08:59:34.350213 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ef7ff7be-c2e9-47d1-b014-cb501495cb8e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.220932 Oct 12 08:59:34.350789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 08:59:34.351464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 08:59:34.351952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 08:59:34.352111 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2048/3812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:34 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:34.357179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.358023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 08:59:34.358215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.366556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.367352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.368076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.369278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.370178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.371686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.490785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.499454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.500155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.500928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.501824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.502415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.503218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.542186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a144989d-1542-4923-a3c3-cf6004a0c821 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "POST /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee/action" status: 202 len: 1139 microversion: 2.54 time: 0.379258 Oct 12 08:59:34.553059 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1765/3813] 10.222.0.40 () {62 vars in 1320 bytes} [Wed Oct 12 08:59:34 2022] POST /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee/action => generated 1139 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 08:59:34.566958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.567626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: fe06cee8-a199-43e0-b707-d7177639bcd6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.582160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.582767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.585589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.586382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.589203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.591435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.626555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.627316 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 HTTP/1.1 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'fe06cee8-a199-43e0-b707-d7177639bcd6'} Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.629509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.634590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.634590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.634590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.634590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:34.634590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:34.634590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. Oct 12 08:59:34.634590 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.635154 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-81d6010c-8814-43e0-80d9-49372e832e8c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1307 microversion: 2.1 time: 0.281114 Oct 12 08:59:34.635154 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2049/3814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:34 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:34.636782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance fe06cee8-a199-43e0-b707-d7177639bcd6 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:34.638374 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8cd1c190-c840-4249-9124-80b1c3446d5a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6" status: 404 len: 111 microversion: 2.1 time: 0.090070 Oct 12 08:59:34.639140 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1766/3815] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:34 2022] GET /compute/v2.1/servers/fe06cee8-a199-43e0-b707-d7177639bcd6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:34.647664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f8d4bfcb-7d30-4a43-a298-515a2d455cc4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:34.649990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f8d4bfcb-7d30-4a43-a298-515a2d455cc4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: fb835680-1e58-4287-849b-477ee144959a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.652983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.654087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.655731 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-f8d4bfcb-7d30-4a43-a298-515a2d455cc4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance fb835680-1e58-4287-849b-477ee144959a could not be found. Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f8d4bfcb-7d30-4a43-a298-515a2d455cc4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/fb835680-1e58-4287-849b-477ee144959a/action HTTP/1.1 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 28 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: {"reboot": {"type": "SOFT"}} Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance fb835680-1e58-4287-849b-477ee144959a could not be found. Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'fb835680-1e58-4287-849b-477ee144959a', 'body': {'reboot': {'type': 'SOFT'}}} Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb835680-1e58-4287-849b-477ee144959a could not be found. Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb835680-1e58-4287-849b-477ee144959a could not be found. Oct 12 08:59:34.657517 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb835680-1e58-4287-849b-477ee144959a could not be found. Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f8d4bfcb-7d30-4a43-a298-515a2d455cc4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance fb835680-1e58-4287-849b-477ee144959a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:34.662987 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f8d4bfcb-7d30-4a43-a298-515a2d455cc4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/fb835680-1e58-4287-849b-477ee144959a/action" status: 404 len: 111 microversion: 2.1 time: 0.023485 Oct 12 08:59:34.663788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:34.663896 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2050/3816] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:34 2022] POST /compute/v2.1/servers/fb835680-1e58-4287-849b-477ee144959a/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:34.667622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.668242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.668823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.669463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.670201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.670957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.671642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.672115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.676483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.677175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.678038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.679322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.679942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.680629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.704032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:34.755329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.764571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.766049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.767226 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42d1fc1a-a3de-47ef-8112-298f39a1953b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.105540 Oct 12 08:59:34.767784 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2051/3817] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:34 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:34.772552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.773046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.780063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.780822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.781415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.782387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.783103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.783692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.798223 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 HTTP/1.1 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '58d37e5f-33d5-40be-ae87-199d11002df1'} Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:34.799932 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:34.804774 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b91a02cb-bf33-4058-819f-2cb1bf1d5f80 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 404 len: 111 microversion: 2.1 time: 0.032502 Oct 12 08:59:34.805836 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2052/3818] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:34 2022] DELETE /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:34.809794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.810407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.816313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.817001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.817619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.818323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.818856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.819276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.867250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:34.877723 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d7f5d87d-eb38-4450-b1d5-8160553f8096 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1506 microversion: 2.1 time: 0.237287 Oct 12 08:59:34.878412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1767/3819] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:34 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:34.883731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.884490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 58d37e5f-33d5-40be-ae87-199d11002df1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.894020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.894656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.895928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.896354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.896988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.898489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.918996 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 HTTP/1.1 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '58d37e5f-33d5-40be-ae87-199d11002df1'} Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.921750 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 58d37e5f-33d5-40be-ae87-199d11002df1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:34.927800 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8c82deb5-9733-4ae4-8f81-9cd76f56b19b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1" status: 404 len: 111 microversion: 2.1 time: 0.046370 Oct 12 08:59:34.929002 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1768/3820] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:34 2022] GET /compute/v2.1/servers/58d37e5f-33d5-40be-ae87-199d11002df1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:34.936743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.937366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.944827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.945415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.946276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.947454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.948279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.948858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.965685 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 HTTP/1.1 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '78aad808-0e14-4eb1-87bb-b103b86b5079'} Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:34.967459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:34.972880 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94ea82b9-7dcb-42ee-85b2-5d1b2307a119 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 404 len: 111 microversion: 2.1 time: 0.036494 Oct 12 08:59:34.974938 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1769/3821] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:34 2022] DELETE /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 08:59:34.978650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:34.979540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 78aad808-0e14-4eb1-87bb-b103b86b5079] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:34.988361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.989610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.990224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.991154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:34.991851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:34.992443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:34.997673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:35.016439 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 HTTP/1.1 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '78aad808-0e14-4eb1-87bb-b103b86b5079'} Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:35.019211 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 78aad808-0e14-4eb1-87bb-b103b86b5079 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:35.025095 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d289d1f5-9097-4268-86df-d54cdb2bc328 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079" status: 404 len: 111 microversion: 2.1 time: 0.046583 Oct 12 08:59:35.026256 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1770/3822] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:34 2022] GET /compute/v2.1/servers/78aad808-0e14-4eb1-87bb-b103b86b5079 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:35.026423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.040011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.041180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.051047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.051796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.052408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.053482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.054107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.054239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86ce43af-b1a7-429b-9b7d-d33aa141c4e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.248088 Oct 12 08:59:35.055656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.068605 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2053/3823] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:34 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:35.088173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.089028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.101735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.102543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.103249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.104140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.104881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.106953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.321716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.332228 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca3bf7f0-2008-420e-90b4-19640de58658 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.250000 Oct 12 08:59:35.333216 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2054/3824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:35.346389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.347222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.348921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.358583 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9810c2fc-3914-472c-8169-9cc1550480e8 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1381 microversion: 2.1 time: 0.331863 Oct 12 08:59:35.359227 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1771/3825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1381 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:35.361818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.361818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.362200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.362912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.363428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.363855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.384841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-dafe96cf-e54c-49fe-b5c3-3f1d01b296c6 req-8f827454-36a3-4185-9801-3b549124b08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39abadf0-5184-42fe-8f70-e8a48cb15b7a", "name": "network-vif-unplugged", "status": "completed", "tag": "07f0f3d3-dbae-4ad3-aca8-61b79115134b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:35.399110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dafe96cf-e54c-49fe-b5c3-3f1d01b296c6 req-8f827454-36a3-4185-9801-3b549124b08f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.399617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dafe96cf-e54c-49fe-b5c3-3f1d01b296c6 req-8f827454-36a3-4185-9801-3b549124b08f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.400038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dafe96cf-e54c-49fe-b5c3-3f1d01b296c6 req-8f827454-36a3-4185-9801-3b549124b08f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.432298 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-dafe96cf-e54c-49fe-b5c3-3f1d01b296c6 req-8f827454-36a3-4185-9801-3b549124b08f service nova] Creating event network-vif-unplugged:07f0f3d3-dbae-4ad3-aca8-61b79115134b for instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a on n-h2-858383-10 Oct 12 08:59:35.439518 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-dafe96cf-e54c-49fe-b5c3-3f1d01b296c6 req-8f827454-36a3-4185-9801-3b549124b08f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064047 Oct 12 08:59:35.440498 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1772/3826] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:35.462074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:35.465011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.478597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.479104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.481328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.483789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.484190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.484637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.510314 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227/action HTTP/1.1 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 65 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '3c6551d7-31a6-478d-a552-44f2ab930227', 'body': {'rebuild': {'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308'}}} Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 08:59:35.512137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a1d86da3-5734-440b-bc90-9ccb5573c68e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227/action" status: 404 len: 111 microversion: 2.1 time: 0.072034 Oct 12 08:59:35.517365 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1773/3827] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:35 2022] POST /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:35.518848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae114418-b15d-428f-8414-43cc0be0cb09 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '.version_select at 0x7f9848774c10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.522237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae114418-b15d-428f-8414-43cc0be0cb09 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.522726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae114418-b15d-428f-8414-43cc0be0cb09 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.523407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae114418-b15d-428f-8414-43cc0be0cb09 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.534458 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae114418-b15d-428f-8414-43cc0be0cb09 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1569 microversion: 2.1 time: 0.018858 Oct 12 08:59:35.535651 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1774/3828] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/os-migrations => generated 1569 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:35.541188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-46cff5ba-69b7-4fbc-8dff-e40f5d9ac9bd req-cad6d41a-d3c1-420f-bf8d-91a45b9fd62d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760dbd63-4283-457c-838e-a2898d1c8a0d", "tag": "c0536b06-bc86-4031-924a-fa90f1ccc7aa"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:35.555046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46cff5ba-69b7-4fbc-8dff-e40f5d9ac9bd req-cad6d41a-d3c1-420f-bf8d-91a45b9fd62d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.555804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46cff5ba-69b7-4fbc-8dff-e40f5d9ac9bd req-cad6d41a-d3c1-420f-bf8d-91a45b9fd62d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.556437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46cff5ba-69b7-4fbc-8dff-e40f5d9ac9bd req-cad6d41a-d3c1-420f-bf8d-91a45b9fd62d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.570162 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-46cff5ba-69b7-4fbc-8dff-e40f5d9ac9bd req-cad6d41a-d3c1-420f-bf8d-91a45b9fd62d service nova] Creating event network-changed:c0536b06-bc86-4031-924a-fa90f1ccc7aa for instance 760dbd63-4283-457c-838e-a2898d1c8a0d on n-h1-858383-10 Oct 12 08:59:35.577311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.582344 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-46cff5ba-69b7-4fbc-8dff-e40f5d9ac9bd req-cad6d41a-d3c1-420f-bf8d-91a45b9fd62d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045258 Oct 12 08:59:35.583264 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1775/3829] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:35.588680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.589797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.591077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.594543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.596826 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1259b1ce-5d6b-43ee-b7e1-fe5dc2ef987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.261664 Oct 12 08:59:35.597535 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2055/3830] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:35.598023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.598684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.599300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.600259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.600722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.601150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.620056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.620832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.627650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.628262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.628917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.629775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.630476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.631100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.792612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.801007 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3245ebac-65d8-4f1a-8fb4-92e6ef53adea tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.216593 Oct 12 08:59:35.801608 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1776/3831] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:35.806375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.806984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.811354 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2320573f-d6ff-4f8c-9cdb-881f3bd4d246 tempest-LiveMigrationTest-1941402599 tempest-LiveMigrationTest-1941402599-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1534 microversion: 2.1 time: 0.211287 Oct 12 08:59:35.812203 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2056/3832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1534 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:35.813558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.814219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.814850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.815557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.816004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.816430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.824234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.825026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.832694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.833492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.834105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.835018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.835655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.836095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.928144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.938492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.940086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.942094 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-249269ad-4163-4cbb-8300-081b59b6bef4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.128237 Oct 12 08:59:35.943005 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2057/3833] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:35.947983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.948821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.958819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.959614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.960248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.961151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.961874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.962491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.967419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:35.977168 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a433bb5b-7dd5-4833-8501-4c1cd8638828 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1307 microversion: 2.1 time: 0.174372 Oct 12 08:59:35.977771 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1777/3834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:35.983941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:35.984868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:35.992661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.993826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.994423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:35.995500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:35.995994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:35.996423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.023822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:59:36.105698 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3a019dbd-abf5-4ced-b4b3-0129c8757fd9 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 204 len: 0 microversion: 2.1 time: 0.126426 Oct 12 08:59:36.106623 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1778/3835] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:35 2022] DELETE /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 08:59:36.112215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:36.113081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.119569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.120472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.121129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.122027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.122576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.123222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.139898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.150846 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d5cd0a32-bc6f-4156-9730-617f492ed37a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.206347 Oct 12 08:59:36.151441 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2058/3836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:35 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:36.156497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:36.157640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.173727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.174243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.174690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.175437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.175902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.176335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.288427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.297732 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8938884-d74b-4a4a-98b3-d5eb6a0de1b2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1506 microversion: 2.1 time: 0.189325 Oct 12 08:59:36.298315 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1779/3837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:36 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:36.303096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99b7a9b4-08bf-47d4-9a91-892878b57029 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:36.306542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-99b7a9b4-08bf-47d4-9a91-892878b57029 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: aecfcd76-f2b0-45b1-9853-9c84c981d35f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.312466 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-99b7a9b4-08bf-47d4-9a91-892878b57029 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance aecfcd76-f2b0-45b1-9853-9c84c981d35f could not be found. Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99b7a9b4-08bf-47d4-9a91-892878b57029 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/aecfcd76-f2b0-45b1-9853-9c84c981d35f/action HTTP/1.1 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 65 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance aecfcd76-f2b0-45b1-9853-9c84c981d35f could not be found. Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'aecfcd76-f2b0-45b1-9853-9c84c981d35f', 'body': {'rebuild': {'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308'}}} Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecfcd76-f2b0-45b1-9853-9c84c981d35f could not be found. Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 12 08:59:36.314262 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecfcd76-f2b0-45b1-9853-9c84c981d35f could not be found. Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecfcd76-f2b0-45b1-9853-9c84c981d35f could not be found. Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99b7a9b4-08bf-47d4-9a91-892878b57029 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance aecfcd76-f2b0-45b1-9853-9c84c981d35f could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-99b7a9b4-08bf-47d4-9a91-892878b57029 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/aecfcd76-f2b0-45b1-9853-9c84c981d35f/action" status: 404 len: 111 microversion: 2.1 time: 0.016293 Oct 12 08:59:36.319891 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1780/3838] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:36 2022] POST /compute/v2.1/servers/aecfcd76-f2b0-45b1-9853-9c84c981d35f/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:36.324521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:36.325213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.332613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.333112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.333591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.334302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.334761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.335194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.363803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.372310 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f741fd00-7f5a-4eeb-9619-8384e051d2b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1387 microversion: 2.1 time: 0.219548 Oct 12 08:59:36.373002 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2059/3839] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:36 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1387 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:36.511575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.521408 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d4cc2a2d-0854-4ed4-9728-645c91f0229c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.200847 Oct 12 08:59:36.522323 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1781/3840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:36 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:36.549831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:36.550607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.557679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.558339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.558876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.559794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.560354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.561269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.624141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:36.624973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.631247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.632126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.632669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.633512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.634141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.634733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.697817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.722318 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3cc29e4c-6b3b-42bb-baba-14eaad39bc8c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.177762 Oct 12 08:59:36.736010 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2060/3841] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:36 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:36.751365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9beb1502-a97e-4ce2-b4ed-dc899d6a5a0a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:36.751979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9beb1502-a97e-4ce2-b4ed-dc899d6a5a0a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: c7e4addd-b2f4-4f56-b6de-10f0563e94ba] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.758928 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9beb1502-a97e-4ce2-b4ed-dc899d6a5a0a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance c7e4addd-b2f4-4f56-b6de-10f0563e94ba could not be found. Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9beb1502-a97e-4ce2-b4ed-dc899d6a5a0a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/c7e4addd-b2f4-4f56-b6de-10f0563e94ba/action HTTP/1.1 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 15 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: {"restore": {}} Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance c7e4addd-b2f4-4f56-b6de-10f0563e94ba could not be found. Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'c7e4addd-b2f4-4f56-b6de-10f0563e94ba', 'body': {'restore': {}}} Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e4addd-b2f4-4f56-b6de-10f0563e94ba could not be found. Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e4addd-b2f4-4f56-b6de-10f0563e94ba could not be found. Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:36.761352 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:36.766604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:36.766604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:36.766604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e4addd-b2f4-4f56-b6de-10f0563e94ba could not be found. Oct 12 08:59:36.766604 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:36.766604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9beb1502-a97e-4ce2-b4ed-dc899d6a5a0a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance c7e4addd-b2f4-4f56-b6de-10f0563e94ba could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:36.766604 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9beb1502-a97e-4ce2-b4ed-dc899d6a5a0a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/c7e4addd-b2f4-4f56-b6de-10f0563e94ba/action" status: 404 len: 111 microversion: 2.1 time: 0.018856 Oct 12 08:59:36.767848 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2061/3842] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:36 2022] POST /compute/v2.1/servers/c7e4addd-b2f4-4f56-b6de-10f0563e94ba/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:36.784081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:36.784850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.791973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.792632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.793167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.794048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.794609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.795156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.799148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.809542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.811270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.812542 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32624b5c-354b-4605-993f-60d1c9b4f631 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.192871 Oct 12 08:59:36.813173 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1782/3843] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:36 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:59:36.962484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:36.973994 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02eeaba5-7e2b-4550-9aa7-49e939024613 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.205049 Oct 12 08:59:36.974724 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2062/3844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:36 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:36.977129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:36.977129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:36.983483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.984045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.984829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.985783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:36.986310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:36.986805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:36.997050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:36.998193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:37.004724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.005468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.006080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.006948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.007559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.008167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.065744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:37.075352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:37.077011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:37.078263 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a6e3ab47-c817-4e93-9d79-777b9e334a9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.107070 Oct 12 08:59:37.078990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1783/3845] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:36 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:59:37.084802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:37.085648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:37.092499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.093161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.093787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.094668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.095282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.095881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.181929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:37.207238 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c0d7517b-fc77-4ec0-a442-1e33e37fd5b8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.213995 Oct 12 08:59:37.213360 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2063/3846] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:36 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:37.235283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:37.236119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:37.243657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.244340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.244982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.245910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.246526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.247181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.277764 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Cannot 'restore' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action HTTP/1.1 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 15 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: {"restore": {}} Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: exception: Cannot 'restore' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'restore': {}}} Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb in vm_state active. Cannot restore while the instance is in this state. Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:37.280084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:37.286289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:37.286289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:37.286289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:37.286289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 08:59:37.286289 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:37.287834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 409 to user: Cannot 'restore' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:37.289127 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-54b187ff-6560-4d36-be21-760836a17b86 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 409 len: 145 microversion: 2.1 time: 0.057786 Oct 12 08:59:37.294056 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2064/3847] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:37 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 08:59:37.300186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:37.301039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:37.307458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.308193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.308812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.309787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.310404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.310995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.492328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:37.500761 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a3a7362-e27d-4c93-9858-2f1bd371f38b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.205364 Oct 12 08:59:37.512362 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2065/3848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:37 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:37.513169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:37.516581 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bbd5290e-7d05-4a3f-a644-4b31d90cf497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1307 microversion: 2.1 time: 0.436390 Oct 12 08:59:37.517167 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1784/3849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:37 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1307 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:37.518687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:37.519496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:37.527451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:37.531107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.531948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:37.534211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.537131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.538326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.539732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.543059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.543569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.544068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.544783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.545255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.545705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.546479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.791829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:37.804113 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89c61095-7144-4222-8289-0fc94cb19242 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 200 len: 1509 microversion: 2.1 time: 0.301310 Oct 12 08:59:37.808742 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2066/3850] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:37 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 1509 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:37.815291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:37.818867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:37.835124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.835652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.836105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.836832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.837301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.837766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:37.949383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:37.964619 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-79299ea0-cd49-4ff5-a0bb-c2af7efe2feb tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1387 microversion: 2.1 time: 0.441094 Oct 12 08:59:37.976022 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1785/3851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:37 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1387 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:37.976022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:37.976022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:37.995409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:37.996154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:37.997170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.002799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.003923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.005760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.185967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:38.198771 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-471bdf0d-268b-4893-8a3e-c344d90543e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.388791 Oct 12 08:59:38.214138 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2067/3852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:37 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:38.222984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:38.223992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:38.232349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.233171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.233619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.234652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.235111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.235715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.503191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:38.514726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:38.515724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:38.516929 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ccd7563-6f79-4d0b-b7ea-58a24046e3af tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.301448 Oct 12 08:59:38.517730 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2068/3853] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:38 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:38.537691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:38.538339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:38.545981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.546498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.546945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.547969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.548428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.549111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.641373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:38.654307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:38.656251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:38.657664 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6f5fce2-e9a2-4364-9487-561175cddc14 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.139132 Oct 12 08:59:38.658514 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2069/3854] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:38 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:38.664182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72b4df2a-b806-4c59-b258-13bcddc94972 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:38.664841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-72b4df2a-b806-4c59-b258-13bcddc94972 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 9179f578-c8c1-43bd-bcc5-aeb0d7222570] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:38.671068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-72b4df2a-b806-4c59-b258-13bcddc94972 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 9179f578-c8c1-43bd-bcc5-aeb0d7222570 could not be found. Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72b4df2a-b806-4c59-b258-13bcddc94972 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/9179f578-c8c1-43bd-bcc5-aeb0d7222570/action HTTP/1.1 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 14 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: {"resume": {}} Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 9179f578-c8c1-43bd-bcc5-aeb0d7222570 could not be found. Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '9179f578-c8c1-43bd-bcc5-aeb0d7222570', 'body': {'resume': {}}} Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9179f578-c8c1-43bd-bcc5-aeb0d7222570 could not be found. Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9179f578-c8c1-43bd-bcc5-aeb0d7222570 could not be found. Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:38.686364 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:38.693109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:38.693109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:38.693109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9179f578-c8c1-43bd-bcc5-aeb0d7222570 could not be found. Oct 12 08:59:38.693109 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:38.693109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72b4df2a-b806-4c59-b258-13bcddc94972 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 9179f578-c8c1-43bd-bcc5-aeb0d7222570 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:38.693109 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-72b4df2a-b806-4c59-b258-13bcddc94972 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/9179f578-c8c1-43bd-bcc5-aeb0d7222570/action" status: 404 len: 111 microversion: 2.1 time: 0.028343 Oct 12 08:59:38.693109 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2070/3855] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:38 2022] POST /compute/v2.1/servers/9179f578-c8c1-43bd-bcc5-aeb0d7222570/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:38.695131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:38.695801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:38.698060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:38.704904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.705475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.706245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.706695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.707377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.707872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.712859 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4291b107-395d-4107-9b4e-e882fb7069fe tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.746585 Oct 12 08:59:38.713558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:38.715376 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1786/3856] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:37 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:38.722962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:38.723861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:38.730972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.731790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.732511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:38.733408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:38.734063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:38.734649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.034236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:39.046839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:39.064487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=12 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:39.069416 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b79803a-178a-41ea-9ff2-681a61710833 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.349956 Oct 12 08:59:39.070515 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1787/3857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:38 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:39.076170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:39.077076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:39.086611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.087459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.088047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.090397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.091105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.092074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.330314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:39.345221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ac4b767-abd6-4b44-b3c1-95a3a8065a6f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.272947 Oct 12 08:59:39.357474 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1788/3858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:39 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:39.367418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:39.367418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:39.375611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.376124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.377473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.377473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.377773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.378340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.440167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:39.475249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:39.489967 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-066ce281-5cd8-4faf-b227-0ed84d7b20d1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1307 microversion: 2.1 time: 0.794645 Oct 12 08:59:39.490827 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2071/3859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:38 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1307 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:39.509350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-05f48c0e-6977-4336-b8cb-19da7b24e6b2 req-cf8abcc0-e055-42c4-855a-846ddd8e5583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe7c36b-9501-4250-9dab-4ab9ad8d154b", "name": "network-vif-deleted", "tag": "52b62051-41ae-464b-bac3-daff927171dd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:39.519680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-05f48c0e-6977-4336-b8cb-19da7b24e6b2 req-cf8abcc0-e055-42c4-855a-846ddd8e5583 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.533151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:39.534995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-05f48c0e-6977-4336-b8cb-19da7b24e6b2 req-cf8abcc0-e055-42c4-855a-846ddd8e5583 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.537993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-05f48c0e-6977-4336-b8cb-19da7b24e6b2 req-cf8abcc0-e055-42c4-855a-846ddd8e5583 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.548596 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ca7dec0-b6f0-4c98-8a71-c17d15f3d885 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1183 microversion: 2.1 time: 0.195813 Oct 12 08:59:39.549258 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1789/3860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:39 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:39.558338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:39.559391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:39.572016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.572774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.573388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.574494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.575194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.575792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.577811 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-05f48c0e-6977-4336-b8cb-19da7b24e6b2 req-cf8abcc0-e055-42c4-855a-846ddd8e5583 service nova] Creating event network-vif-deleted:52b62051-41ae-464b-bac3-daff927171dd for instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b on n-h2-858383-10 Oct 12 08:59:39.596670 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-05f48c0e-6977-4336-b8cb-19da7b24e6b2 req-cf8abcc0-e055-42c4-855a-846ddd8e5583 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100708 Oct 12 08:59:39.602768 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2072/3861] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:39.617480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:39.618593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:39.630812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.631568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.632192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.633071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.633722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.634314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.783585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:39.795343 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-06f7af5a-0203-409f-95ec-12450e43b139 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.243768 Oct 12 08:59:39.795945 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1790/3862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:39 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:39.818815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:39.819763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:39.826729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.827448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.828056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.829044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.829965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.830586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.851628 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a HTTP/1.1 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'c8defa84-3694-41e0-b0ea-4ec9d270a48a'} Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:39.855103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:39.859674 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3517cc9-ec12-412c-8c79-217ee0623cc0 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 404 len: 111 microversion: 2.1 time: 0.046938 Oct 12 08:59:39.860949 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1791/3863] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:39 2022] DELETE /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:39.873145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:39.874891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:39.889385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.892971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.893689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:39.894269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:39.894755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:39.895188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.075092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.081607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.092467 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f518ea17-8e9f-4261-9b1c-9400174fda69 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.479733 Oct 12 08:59:40.098004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.099776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.101740 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24082ff6-3e6e-4597-92de-e170e89d9204 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.238561 Oct 12 08:59:40.110774 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2073/3864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:39 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:40.117253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.118225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.119449 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1792/3865] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:39 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:40.126701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.127492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.128147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.129113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.129898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.130957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.132534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:40.133216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.155079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.155584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.156035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.156754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.157387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.157995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.212871 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Cannot 'resume' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action HTTP/1.1 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 14 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: {"resume": {}} Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'resume' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'resume': {}}} Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb in vm_state active. Cannot resume while the instance is in this state. Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.214703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.219906 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.219906 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.219906 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.219906 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:40.219906 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:40.219906 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 08:59:40.219906 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.221931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 409 to user: Cannot 'resume' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:40.225132 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58c147bf-88f4-4ea3-9d70-6501f2cf82e9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 409 len: 144 microversion: 2.1 time: 0.104532 Oct 12 08:59:40.227125 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1793/3866] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:40 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 144 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 08:59:40.234824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.236088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: c8defa84-3694-41e0-b0ea-4ec9d270a48a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.252285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.253530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.254079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.254962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.256030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.256583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.276475 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a HTTP/1.1 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'c8defa84-3694-41e0-b0ea-4ec9d270a48a'} Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.278541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.282930 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.282930 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.282930 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.282930 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:40.282930 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:40.282930 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. Oct 12 08:59:40.282930 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.284876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance c8defa84-3694-41e0-b0ea-4ec9d270a48a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:40.285833 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-66813215-bc2c-4898-b4e0-d139ce5fd35b tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a" status: 404 len: 111 microversion: 2.1 time: 0.057518 Oct 12 08:59:40.289713 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1794/3867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/c8defa84-3694-41e0-b0ea-4ec9d270a48a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:40.294363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c381973f-c4c9-4046-8559-aaf13ab9ab18 req-bcd321e0-280c-4f8a-98d7-baca7e616790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1acdb6-1970-410c-a904-67636bdc3d68", "tag": "6e76f914-e39e-4490-8567-4fcc14247a71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:40.305093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c381973f-c4c9-4046-8559-aaf13ab9ab18 req-bcd321e0-280c-4f8a-98d7-baca7e616790 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.305881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c381973f-c4c9-4046-8559-aaf13ab9ab18 req-bcd321e0-280c-4f8a-98d7-baca7e616790 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.306516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c381973f-c4c9-4046-8559-aaf13ab9ab18 req-bcd321e0-280c-4f8a-98d7-baca7e616790 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.318752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.329534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.331274 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c381973f-c4c9-4046-8559-aaf13ab9ab18 req-bcd321e0-280c-4f8a-98d7-baca7e616790 service nova] Creating event network-changed:6e76f914-e39e-4490-8567-4fcc14247a71 for instance 4d1acdb6-1970-410c-a904-67636bdc3d68 on n-h2-858383-10 Oct 12 08:59:40.334974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.336744 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b64832bb-37f9-4601-b353-7e5d9e6265db tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.224484 Oct 12 08:59:40.337857 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2074/3868] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:40.339097 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c381973f-c4c9-4046-8559-aaf13ab9ab18 req-bcd321e0-280c-4f8a-98d7-baca7e616790 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048095 Oct 12 08:59:40.340441 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1795/3869] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:40.343745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.344947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.346231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.346943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.356458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.359961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.360435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.363028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.366514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.367027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.367470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.368261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.368723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.369158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.373150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.373658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.534887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.543468 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97b49cf9-c640-4e1c-ab5c-c2bed92c115c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.201726 Oct 12 08:59:40.557460 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1796/3870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:40.557460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.557460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.557460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.557460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.557460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.558108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.558906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.559691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.578283 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 HTTP/1.1 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '43f1c5a2-257a-4fb3-8dd0-4062d0300446'} Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:40.580298 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-350219ba-bc4b-404b-a00b-a21cc8c6415a tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "DELETE /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 404 len: 111 microversion: 2.1 time: 0.036569 Oct 12 08:59:40.585532 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1797/3871] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:40 2022] DELETE /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:40.587608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.588073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.594543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.595101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.595544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.596254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.596710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.597137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.611883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.624918 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae19bc14-4b53-46eb-8e4a-eeb225649f89 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.285556 Oct 12 08:59:40.628849 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2075/3872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:40.639901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.641888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.652117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.652698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.653246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.654047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.654575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.655070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.752400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.760193 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a06105de-389f-44e5-addb-e3e60d3612f5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1307 microversion: 2.1 time: 0.176524 Oct 12 08:59:40.760772 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1798/3873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1307 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:40.768911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.773577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.780145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.780636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.781078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.781805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.782316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.782690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.840875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.850754 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa328369-c7b9-41da-9d96-1b1eaf3aceec tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.222912 Oct 12 08:59:40.851577 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2076/3874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:40.852884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:40.856615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.857225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] [instance: 43f1c5a2-257a-4fb3-8dd0-4062d0300446] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.865321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.865878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.866316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.867027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.867489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.867919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.868082 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-749b1d7d-e0a4-40b7-8922-3b8504d73492 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1183 microversion: 2.1 time: 0.105659 Oct 12 08:59:40.869739 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1799/3875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:40.875639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-28186f0c-cb70-4cd0-881e-76a584639b22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:40.897771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28186f0c-cb70-4cd0-881e-76a584639b22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.898310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28186f0c-cb70-4cd0-881e-76a584639b22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.898763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28186f0c-cb70-4cd0-881e-76a584639b22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.927730 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] HTTP exception thrown: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Request method failure captured: Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 HTTP/1.1 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCqUX9Gk7MymGzUB2PPEkK9C78fQ9osAkGgg36MAO2O_CNr4zVDcf1mdyv7s9C_nrNh4cajFfr29gQiN1YMtbHys_Ubm30hXkYHY3QCk7-7L8UfDG_-1L9sEUsKRrxLumlhnJuGJMKYG_oNWGp9V5Z81RtYfHYkDixuMwW67yia18c Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bb4c1d72dbd4402b8240521c30cdd740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bb4c1d72dbd4402b8240521c30cdd740"}]}] Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: bb4c1d72dbd4402b8240521c30cdd740 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058467462 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3571292391094d83901f21ccb18ec2d8 Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-DeleteServersTestJSON-1058467462-project Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '43f1c5a2-257a-4fb3-8dd0-4062d0300446'} Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.930114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.935433 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.935433 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.935433 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.935433 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:40.935433 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:40.935433 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. Oct 12 08:59:40.935433 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.935903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-28186f0c-cb70-4cd0-881e-76a584639b22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Going to try to stop instance {{(pid=127007) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 08:59:40.936003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] Returning 404 to user: Instance 43f1c5a2-257a-4fb3-8dd0-4062d0300446 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:40.936438 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0495df38-4e15-4219-a586-b8a58353be61 tempest-DeleteServersTestJSON-1058467462 tempest-DeleteServersTestJSON-1058467462-project] 10.222.0.40 "GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446" status: 404 len: 111 microversion: 2.1 time: 0.084098 Oct 12 08:59:40.937023 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2077/3876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/43f1c5a2-257a-4fb3-8dd0-4062d0300446 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:40.951395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf099780-d50d-4e55-90f1-ee3bb37e178d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf099780-d50d-4e55-90f1-ee3bb37e178d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 160 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5e1465ee-0d75-4b69-86e4-f265ae631c06"}]}} Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': '', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'networks': [{'uuid': '5e1465ee-0d75-4b69-86e4-f265ae631c06'}]}}} Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi '' Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 08:59:40.954122 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf099780-d50d-4e55-90f1-ee3bb37e178d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf099780-d50d-4e55-90f1-ee3bb37e178d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.016910 Oct 12 08:59:40.959454 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2078/3877] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 08:59:40 2022] POST /compute/v2.1/servers => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 08:59:40.970295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:40.971675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:40.982758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.983277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.983769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:40.984649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:40.985124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:40.985601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:41.038970 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-28186f0c-cb70-4cd0-881e-76a584639b22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.167790 Oct 12 08:59:41.042754 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1800/3878] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:40 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:41.050022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:41.056108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:41.063303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:41.064076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:41.064691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:41.065613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:41.066231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:41.066819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:41.539113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:41.555816 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-460d7f69-be9d-4baf-9c51-77eac8c58c4c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.590815 Oct 12 08:59:41.557303 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2079/3879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:40 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:41.570638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:41.571892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:41.579926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:41.590627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:41.591973 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2eba0d24-6d10-4640-9847-1835defc7665 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.547726 Oct 12 08:59:41.592347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:41.593046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:41.595962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:41.596944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:41.597750 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1801/3880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:41 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:41.600098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:41.616036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:41.617035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:41.646168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:41.647589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:41.650912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:41.655721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:41.659415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:41.660164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:41.900868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:41.915836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:41.919238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:41.920736 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bed3509a-2908-48a2-8862-bcc62b5d69dc tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.320627 Oct 12 08:59:41.921586 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1802/3881] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:41 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:41.945859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-15514f2d-0b6f-45b2-b4b7-573f2b3f32ac req-e9f672b9-5a30-4e80-9a72-f3172afcc197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760dbd63-4283-457c-838e-a2898d1c8a0d", "name": "network-vif-plugged", "status": "completed", "tag": "c0536b06-bc86-4031-924a-fa90f1ccc7aa"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:41.956901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-15514f2d-0b6f-45b2-b4b7-573f2b3f32ac req-e9f672b9-5a30-4e80-9a72-f3172afcc197 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:41.958302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-15514f2d-0b6f-45b2-b4b7-573f2b3f32ac req-e9f672b9-5a30-4e80-9a72-f3172afcc197 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:41.958962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-15514f2d-0b6f-45b2-b4b7-573f2b3f32ac req-e9f672b9-5a30-4e80-9a72-f3172afcc197 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:41.973176 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-15514f2d-0b6f-45b2-b4b7-573f2b3f32ac req-e9f672b9-5a30-4e80-9a72-f3172afcc197 service nova] Creating event network-vif-plugged:c0536b06-bc86-4031-924a-fa90f1ccc7aa for instance 760dbd63-4283-457c-838e-a2898d1c8a0d on n-h1-858383-10 Oct 12 08:59:41.979962 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-15514f2d-0b6f-45b2-b4b7-573f2b3f32ac req-e9f672b9-5a30-4e80-9a72-f3172afcc197 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044317 Oct 12 08:59:41.985815 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1803/3882] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:41.994316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:41.995920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:42.004465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.005223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.006921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.008034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.008706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.034881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.121580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:42.134879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:42.139618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:42.143450 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-83cc7a32-7e0a-4bcb-92ca-2c70cbea9cf4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.580854 Oct 12 08:59:42.144316 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2080/3883] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:41 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:42.150181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:42.151128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:42.158647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.159475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.160140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.161098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.162200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.162784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.454207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:42.469010 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8ed6683f-9c17-4b69-b13c-50b50285b3df tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1307 microversion: 2.1 time: 0.323169 Oct 12 08:59:42.470054 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2081/3884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:42 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:42.475797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:42.476786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:42.484485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.485202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.485970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.486843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.487609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.488199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.577635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:42.590725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ecdc873-f70f-4b93-a88d-42a31267c5c5 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1183 microversion: 2.1 time: 0.119031 Oct 12 08:59:42.592002 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2082/3885] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:42 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:42.626908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:42.627612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:42.636907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.640318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.641277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.642358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.644227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.645612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.738512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:42.753896 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa80192a-7b14-4589-af66-e77eab0ca3f2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.765970 Oct 12 08:59:42.769895 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1804/3886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:41 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:42.781240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ed4a08a-3674-4e3b-9de5-d8a1891b383e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:42.783885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ed4a08a-3674-4e3b-9de5-d8a1891b383e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 74aabe74-6b4e-4b14-bea7-e4680ecc1cd2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:42.801754 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-3ed4a08a-3674-4e3b-9de5-d8a1891b383e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 74aabe74-6b4e-4b14-bea7-e4680ecc1cd2 could not be found. Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ed4a08a-3674-4e3b-9de5-d8a1891b383e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/74aabe74-6b4e-4b14-bea7-e4680ecc1cd2/action HTTP/1.1 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 14 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: {"shelve": {}} Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 74aabe74-6b4e-4b14-bea7-e4680ecc1cd2 could not be found. Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '74aabe74-6b4e-4b14-bea7-e4680ecc1cd2', 'body': {'shelve': {}}} Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74aabe74-6b4e-4b14-bea7-e4680ecc1cd2 could not be found. Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74aabe74-6b4e-4b14-bea7-e4680ecc1cd2 could not be found. Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:42.805755 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:42.812021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:42.812021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:42.812021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74aabe74-6b4e-4b14-bea7-e4680ecc1cd2 could not be found. Oct 12 08:59:42.812021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 08:59:42.814906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ed4a08a-3674-4e3b-9de5-d8a1891b383e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 74aabe74-6b4e-4b14-bea7-e4680ecc1cd2 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:42.818685 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ed4a08a-3674-4e3b-9de5-d8a1891b383e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/74aabe74-6b4e-4b14-bea7-e4680ecc1cd2/action" status: 404 len: 111 microversion: 2.1 time: 0.041749 Oct 12 08:59:42.819836 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1805/3887] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:42 2022] POST /compute/v2.1/servers/74aabe74-6b4e-4b14-bea7-e4680ecc1cd2/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:42.834410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:42.836842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:42.879953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.880553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.881078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.882003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.882790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.883516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.950742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:42.959541 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-54982051-35a8-46c1-88cc-6c24cee01b4a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.337150 Oct 12 08:59:42.965589 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2083/3888] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:42 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:42.974408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:42.975268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:42.986733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.988454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.989145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:42.990062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:42.990671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:42.998596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.116132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.129029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.138219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.139465 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69c81420-1cd5-44a6-b29e-1a1b6935f979 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.172607 Oct 12 08:59:43.153481 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2084/3889] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:42 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:43.173360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:43.174009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:43.183378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:43.185585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:43.190207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.191046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:43.191544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:43.191991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.379571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.389255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.391028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.392099 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3d85e3f-134a-4a3c-a94c-30b42b511eff tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.223086 Oct 12 08:59:43.397489 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2085/3890] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:43 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:43.460598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.469051 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54fa8ba7-f716-4698-a408-65a58df0db48 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.643488 Oct 12 08:59:43.473521 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1806/3891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:42 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:43.495719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:43.495719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:43.502403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:43.503025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:43.511244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:43.511926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:43.512441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.513197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:43.513802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:43.514372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.515360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:43.517544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:43.517994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.519879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:43.520339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:43.520776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.744962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.755763 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d3487a1-d913-43c2-88e4-5d198ba64fa3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1307 microversion: 2.1 time: 0.264643 Oct 12 08:59:43.773789 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2086/3892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:43 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:43.780356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:43.781262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:43.789585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:43.790096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:43.790544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.792153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:43.792719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:43.793535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:43.894653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:43.904483 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1da77c46-edd3-4fde-807d-49d55e72e24f tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1183 microversion: 2.1 time: 0.129126 Oct 12 08:59:43.915614 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2087/3893] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:43 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:43.995671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:43.996743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:44.010524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.011038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.011646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.012248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.012710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.013145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.027153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:44.242799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:44.260269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e2fa293d-870b-4b75-a287-8c4cfbf652f5 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.760261 Oct 12 08:59:44.262035 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1807/3894] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:43 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:44.276642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:44.277703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:44.286869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:44.296541 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-25470a76-dcb6-4f55-9722-ced1e1c35580 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.304832 Oct 12 08:59:44.308636 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2088/3895] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:43 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:44.320541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:44.322250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:44.333028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.333242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.333819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.334216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.335001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.335487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.335942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.336126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.337974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.340506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.341262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.342178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.403688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lazy-loading 'flavor' on Instance uuid a870435b-8aa5-456d-b0ca-477ee2201dbb {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:59:44.471025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:44.484455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:44.498129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:44.502614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:44.505914 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1bec84cc-2beb-457a-a7d1-15df40f47fc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.241302 Oct 12 08:59:44.508556 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1808/3896] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:44 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:44.517811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:44.518431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:44.525519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.526188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.526667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.527486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.528352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.528875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.817920 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2aa37625-4e8b-49fd-909b-b15542d082d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.507915 Oct 12 08:59:44.819185 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2089/3897] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:44 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:44.833485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:44.834630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:44.856669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.858605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.859620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.859764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:44.861417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.863771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.864994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:44.865687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.892560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:44.896152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:44.897540 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-334a6564-2cc7-4f8c-a656-2e18b7a9d98e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.387814 Oct 12 08:59:44.904024 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1809/3898] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:44 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:44.921076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:44.921790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:44.945154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.947492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.948082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:44.965084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:44.974596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:44.975173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.191067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:45.201633 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2caa58d2-1e58-4d64-8b71-426a1654901b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1487 microversion: 2.1 time: 0.380697 Oct 12 08:59:45.206246 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2090/3899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:44 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1487 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:45.218974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:45.223509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:45.246203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.247561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.250289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.251289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.251926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.253778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.386150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:45.403862 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c34fffa6-658e-4675-8b89-921ec10653b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1183 microversion: 2.1 time: 0.195636 Oct 12 08:59:45.407737 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2091/3900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:45 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:45.419180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:45.420188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:45.435306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.438511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.439726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.440662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.442195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.443954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.518988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lazy-loading 'flavor' on Instance uuid 760dbd63-4283-457c-838e-a2898d1c8a0d {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 08:59:45.621260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:45.632500 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-558b1a08-1acb-4605-bd7c-9f07a20bb378 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.727319 Oct 12 08:59:45.635170 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1810/3901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:44 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:45.647387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:45.657206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:45.671550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.673282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.686524 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-18d9f84c-09c7-49f6-abe1-43f72aa70bfb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d/action" status: 202 len: 0 microversion: 2.1 time: 0.275958 Oct 12 08:59:45.687232 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2092/3902] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:45 2022] POST /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:45.687804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.703276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:45.712236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.715546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:45.728968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.735038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.736290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.736981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.737537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.740999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.741706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.743122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.896480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:45.907215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:45.917093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:45.920321 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c09d10c-adbb-405b-aaaf-31df19386f0a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.227905 Oct 12 08:59:45.935926 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2093/3903] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:45 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:45.946544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:45.947254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:45.963780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.965921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.966440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:45.967240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:45.970043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:45.970703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:46.262123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:46.276429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bc539a8e-2f7b-4bac-85de-c6ed85e6f616 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1495 microversion: 2.1 time: 0.337671 Oct 12 08:59:46.293684 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2094/3904] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:45 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1495 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:46.293684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:46.293684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:46.305485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:46.311283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:46.324839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:46.326835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:46.329562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:46.338534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:46.340945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:46.409937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:46.418082 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-712fa184-3b02-4b2f-9c59-6f0db2a319e3 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.781615 Oct 12 08:59:46.427412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1811/3905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:45 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:46.441822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:46.442850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:46.455853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:46.459171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:46.461342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:46.462400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:46.469994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:46.470728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:46.690863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:46.704664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:46.711561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:46.714304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:46.714985 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4e185824-16ed-44aa-80c9-f100a1522be7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.433777 Oct 12 08:59:46.717378 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2095/3906] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:46 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:46.741959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:46.743483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:46.746778 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8670e702-059f-404b-9e05-4dd20da997b2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 200 len: 1183 microversion: 2.1 time: 0.309889 Oct 12 08:59:46.762799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:46.765120 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1812/3907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:46 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 1183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:46.770472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:46.770970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:46.780177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:46.782252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:46.782870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:46.960141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:46.961465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:46.968448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:46.968936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:46.969381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:46.995449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.007969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.008561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:47.217677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:47.231010 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5502197d-f261-4557-9189-c10792276e99 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.511996 Oct 12 08:59:47.233814 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2096/3908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:46 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:47.302360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:47.303539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:47.317055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.317844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.318447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:47.319340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.319950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.320532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:47.625912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:47.648743 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3e2281f0-6236-4c60-a89b-198c2d45e649 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 200 len: 1478 microversion: 2.1 time: 0.352328 Oct 12 08:59:47.650479 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2097/3909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:47 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 1478 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:47.661020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:47.661672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:47.687683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.688207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.688632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:47.689336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.690769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.691609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:47.736627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:47.752455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:47.755349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:47.785673 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-edf77854-2a6d-48b2-b8bf-b03468d15c9d tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.817607 Oct 12 08:59:47.790833 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1813/3910] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:46 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:47.796687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1742056839"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:47.810109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:47.823941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.824706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.825493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:47.826365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.826974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.827576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:47.956219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:47.965600 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-27786d5c-1d06-4ae5-b2cb-15044c7e1be6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.313788 Oct 12 08:59:47.966542 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2098/3911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:47 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:47.971324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:47.972025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:47.978574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.979068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.979509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:47.980219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:47.980707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:47.981140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:48.194695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:48.226144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:48.229768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:48.231713 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a238d7f-f658-4fde-8b22-7a7d810328cf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.263786 Oct 12 08:59:48.233100 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2099/3912] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:47 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:48.240357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:48.241364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 6fe7c36b-9501-4250-9dab-4ab9ad8d154b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:48.257742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:48.259023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:48.259642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:48.289803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:48.290311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:48.293761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:48.368016 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] HTTP exception thrown: Instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b could not be found. Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Request method failure captured: Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b HTTP/1.1 Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCTxI4t1qncRXFzGF5cdw8IeNdTPvKSAWATYDyrR35N0KjEB1TuruyVxr-w5ntKLRyAGqD7fQUBbEFkd8AgciPKCDqrg6EoV7UBomokP6M0X4akHXp2rNV1RyaQDjskCKFN7YF1cUUeK2_VLkhkBveZerx39a0E9E5Pv9k4kzrzajg Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: f77355ddeba541b189e41cb089a07eba Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-LiveMigrationTest-1793301549 Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77355ddeba541b189e41cb089a07eba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f77355ddeba541b189e41cb089a07eba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f77355ddeba541b189e41cb089a07eba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77355ddeba541b189e41cb089a07eba"}]}] Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-LiveMigrationTest-1793301549 Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: f77355ddeba541b189e41cb089a07eba Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-LiveMigrationTest-1793301549 Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-LiveMigrationTest-1793301549-project Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3662e9666cc14f80a5ea16670a6f1595 Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-LiveMigrationTest-1793301549-project Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b could not be found. Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '6fe7c36b-9501-4250-9dab-4ab9ad8d154b'} Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b could not be found. Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b could not be found. Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 08:59:48.371581 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b could not be found. Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Returning 404 to user: Instance 6fe7c36b-9501-4250-9dab-4ab9ad8d154b could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 08:59:48.377402 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa5c9f4d-da60-4f3c-8df7-c4a3b64a5176 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b" status: 404 len: 111 microversion: 2.1 time: 0.142403 Oct 12 08:59:48.382140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2100/3913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:48 2022] GET /compute/v2.1/servers/6fe7c36b-9501-4250-9dab-4ab9ad8d154b => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 08:59:48.392668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:48.399622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:48.428577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:48.428577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:48.428577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:48.430511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:48.431004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:48.432613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:48.482226 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9cc2c378-fa2d-446d-8e64-55e6f18af835 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d/action" status: 202 len: 0 microversion: 2.1 time: 0.683208 Oct 12 08:59:48.486395 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1814/3914] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:47 2022] POST /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 08:59:48.503348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6927bbfa-4d60-4a8d-a175-933aa4fb5c16 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848cc9a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:48.613386 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6927bbfa-4d60-4a8d-a175-933aa4fb5c16 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.119362 Oct 12 08:59:48.617570 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1815/3915] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:48 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:48.821656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:48.830444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:48.837237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:48.840329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:48.841194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:48.841963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:48.843910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:48.848089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:48.848913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:48.970994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:48.986558 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a08a4c7c-e85c-4ca1-b52b-97caccc468b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.598364 Oct 12 08:59:48.989782 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2101/3916] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:48 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:49.000705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:49.001654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:49.030499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:49.039493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:49.042159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:49.044147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:49.045024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:49.046067 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-698c9aa7-9ca9-4113-bbc1-a819ed8f241b tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.232970 Oct 12 08:59:49.066614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:49.066614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:49.066614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:49.066614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:49.068525 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1816/3917] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:48 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:59:49.266994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:49.267888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:49.283125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:49.284040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:49.284733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:49.286247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:49.286948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:49.287499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:49.767458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:49.776156 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-afd73abe-765c-4167-9d8d-eb0e63b61041 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.784709 Oct 12 08:59:49.784890 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2102/3918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:48 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:49.797882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7bf5cfc1-5bdc-4840-8c00-51d6c3708c3b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848ee25e0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:49.912858 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7bf5cfc1-5bdc-4840-8c00-51d6c3708c3b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.126635 Oct 12 08:59:49.913461 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2103/3919] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:49 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:50.042041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:50.044357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:50.059396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:50.069330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:50.069927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:50.070382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:50.074189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:50.074706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:50.083578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:50.086529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:50.088524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:50.103014 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-48e6dfbd-98be-413c-926f-d586de57713b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.840017 Oct 12 08:59:50.104101 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1817/3920] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:49 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:59:50.109202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:50.110156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:50.123022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:50.123915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:50.124647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:50.125688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:50.127422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:50.128115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:50.424373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:50.430915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:50.434421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39720a8d-54d1-4be2-b20f-5eacc871069f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.413505 Oct 12 08:59:50.450573 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2104/3921] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:50 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:50.497709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:50.509335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:50.511577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:50.518384 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1848d49f-ea3c-441c-b43c-b437970727b1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.412872 Oct 12 08:59:50.519664 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1818/3922] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:50 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:50.801538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:50.802317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:50.823785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:50.830859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:50.831710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:50.841275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:50.842181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:50.842865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:50.934831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad6f4d77-e8b4-4d28-b670-c1af17c93dc1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848df5e50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:51.001074 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad6f4d77-e8b4-4d28-b670-c1af17c93dc1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.070942 Oct 12 08:59:51.002428 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1819/3923] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:50 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:51.136014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:51.137690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:51.150482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:51.153704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:51.154457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:51.155517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:51.163536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:51.164208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:51.168531 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db6a14bd-3545-405e-bb0d-43db83f67aa2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1680 microversion: 2.1 time: 0.371005 Oct 12 08:59:51.174089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:51.186635 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2105/3924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:50 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1680 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:51.460291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:51.461673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:51.480669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:51.488354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:51.489708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:51.491186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:51.494355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:51.498102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:51.730151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:51.751173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:51.754138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:51.759116 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b49c67bc-9b9d-450e-9c2a-4192b27dc12f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.628890 Oct 12 08:59:51.782203 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1820/3925] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:51 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 08:59:51.782203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:51.782203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:51.801173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:51.802667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:51.803389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:51.804390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:51.805024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:51.805838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:52.003557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:52.033208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:52.039968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:52.041637 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4987f01e-e02e-443d-b22a-581398fbfad1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.275934 Oct 12 08:59:52.059413 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1821/3926] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:51 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:52.077522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05e5e789-2482-46a3-b286-312aacf3354f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984cd7e3a0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:52.087757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:52.116753 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c06c51d4-24aa-4d8c-afbb-4b14b4c7c137 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.662915 Oct 12 08:59:52.117872 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2106/3927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:51 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:52.198743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:52.200415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:52.211703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:52.215759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:52.216561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:52.219798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:52.220571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:52.222755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:52.445560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:52.460948 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a876ee93-d610-4e1e-b60e-6cc413129175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1657 microversion: 2.1 time: 0.267165 Oct 12 08:59:52.462937 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2107/3928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:52 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1657 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:52.489181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4e6a8ac6-f20f-4ac5-a789-9658697a504c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:52.534921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e6a8ac6-f20f-4ac5-a789-9658697a504c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:52.535811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e6a8ac6-f20f-4ac5-a789-9658697a504c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:52.538243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e6a8ac6-f20f-4ac5-a789-9658697a504c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:52.645056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4e6a8ac6-f20f-4ac5-a789-9658697a504c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Going to try to start instance {{(pid=127006) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 08:59:52.769959 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4e6a8ac6-f20f-4ac5-a789-9658697a504c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.287074 Oct 12 08:59:52.775686 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2108/3929] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 08:59:52 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 08:59:52.785994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:52.786998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:52.798295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:52.799252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:52.799864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:52.803573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:52.804421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:52.805038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:53.558822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:53.569312 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1787df86-19e1-4553-9005-952433e18c68 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1666 microversion: 2.1 time: 0.791785 Oct 12 08:59:53.569934 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2109/3930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:52 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1666 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:53.637361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:53.641877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:53.708961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:53.708961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:53.708961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:53.711144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:53.716953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:53.722885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:54.247361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:54.258784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:54.267992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:54.272910 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6bcfc38-b37c-42d4-b104-5b3b8d0be522 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.647535 Oct 12 08:59:54.273756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2110/3931] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:53 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:54.288480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:54.297869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:54.326463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:54.327258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:54.329981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:54.330911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:54.331536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:54.336509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:54.513385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:54.526280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:54.534447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:54.535998 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-178efd6d-412f-4f7f-96d5-528c3ce22767 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.260992 Oct 12 08:59:54.536808 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2111/3932] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:54 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:54.544545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:54.548075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:54.563848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:54.565120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:54.565835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:54.566893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:54.567517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:54.573401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:54.779765 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05e5e789-2482-46a3-b286-312aacf3354f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 2.719166 Oct 12 08:59:54.788785 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1822/3933] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:52 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 2729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:54.794405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-046ee430-f20c-42e8-b559-32881f70e707 req-e5b9b732-8d3f-41b8-a828-ac6cfbe447b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760dbd63-4283-457c-838e-a2898d1c8a0d", "name": "network-vif-plugged", "status": "completed", "tag": "c0536b06-bc86-4031-924a-fa90f1ccc7aa"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 08:59:54.806213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-046ee430-f20c-42e8-b559-32881f70e707 req-e5b9b732-8d3f-41b8-a828-ac6cfbe447b8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:54.807233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-046ee430-f20c-42e8-b559-32881f70e707 req-e5b9b732-8d3f-41b8-a828-ac6cfbe447b8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:54.807875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-046ee430-f20c-42e8-b559-32881f70e707 req-e5b9b732-8d3f-41b8-a828-ac6cfbe447b8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:54.820173 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-046ee430-f20c-42e8-b559-32881f70e707 req-e5b9b732-8d3f-41b8-a828-ac6cfbe447b8 service nova] Creating event network-vif-plugged:c0536b06-bc86-4031-924a-fa90f1ccc7aa for instance 760dbd63-4283-457c-838e-a2898d1c8a0d on n-h1-858383-10 Oct 12 08:59:54.825936 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-046ee430-f20c-42e8-b559-32881f70e707 req-e5b9b732-8d3f-41b8-a828-ac6cfbe447b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 Oct 12 08:59:54.831837 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1823/3934] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 08:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 08:59:54.838069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:54.839105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:54.850159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:54.851250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:54.852173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:54.853546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:54.854838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:54.855681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:55.031704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:55.043616 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-11d594b2-c04f-4ef1-9948-063cb0154e8b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.503549 Oct 12 08:59:55.047871 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2112/3935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:54 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:55.180969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:55.191075 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9121221-e325-4da0-a6e6-3d6a5a94f6d4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1666 microversion: 2.1 time: 0.357770 Oct 12 08:59:55.210592 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1824/3936] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:54 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1666 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:55.301942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:55.303156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:55.314667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:55.315395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:55.316839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:55.318643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:55.319991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:55.320959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:55.567373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:55.568407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:55.603398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:55.603850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:55.604291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:55.610065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:55.610700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:55.611155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:55.748896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:55.774306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:55.784630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:55.788230 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-611b7d9e-546b-4c03-9c2c-7ba429f63f2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.490620 Oct 12 08:59:55.794102 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2113/3937] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:55 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:55.811652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d09ef92d-4a08-4c24-8877-60ac490dc365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f98494d8160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:55.896093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:55.900642 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d09ef92d-4a08-4c24-8877-60ac490dc365 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.101889 Oct 12 08:59:55.909672 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2114/3938] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:55 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:55.911365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:55.913102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:55.919664 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c99b3ce6-67cd-41e5-828c-3c64b1e63fa7 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.357256 Oct 12 08:59:55.921020 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1825/3939] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:55 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:56.073901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:56.075045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:56.082803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:56.083828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:56.084884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:56.085918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:56.087070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:56.089503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:56.216273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:56.217209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:56.231351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:56.234436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:56.242536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:56.244394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:56.249413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:56.250271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:56.398583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:56.408824 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c35a852d-dbe5-40ae-bcc0-30a5e66f597d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.341420 Oct 12 08:59:56.413225 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2115/3940] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:56 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:56.614633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:56.615791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:56.623586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:56.626033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:56.626750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:56.627644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:56.636314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:56.637106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:56.691886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 08:59:56.881953 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-49c50123-a697-4d93-95f5-325bb277ec1c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "DELETE /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 204 len: 0 microversion: 2.1 time: 0.270644 Oct 12 08:59:56.890487 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2116/3941] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 08:59:56 2022] DELETE /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 08:59:56.901562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:56.902707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:56.915088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:56.915835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:56.917501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:56.920428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:56.921237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:56.922179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:57.036658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:57.047121 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c20e2810-b1b3-4365-a29e-40f35e07e74e tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.835473 Oct 12 08:59:57.052855 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1826/3942] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:56 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:57.063172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:57.065725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:57.082428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:57.083347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:57.083883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:57.084854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:57.087918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:57.089472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:57.166113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:57.180120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:57.181842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:57.183297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f16ff0d-a781-4b59-ade3-35944eb0ce2d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.291264 Oct 12 08:59:57.194595 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2117/3943] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:56 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:57.208696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ea2d29b-b1bb-44ea-8f0c-db6f8504be04 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848c7ed30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:57.303854 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ea2d29b-b1bb-44ea-8f0c-db6f8504be04 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.107658 Oct 12 08:59:57.304452 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2118/3944] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:57 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:57.320739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:57.321366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:57.330045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:57.339665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:57.340404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:57.341361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:57.342013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:57.342637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:57.441365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:57.461012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:57.466408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:57.471650 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12f048a6-aec4-43f8-adb5-ae3056a61650 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.162463 Oct 12 08:59:57.472863 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2119/3945] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:57 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:57.480533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:57.481646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:57.492063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:57.494021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:57.495149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:57.497586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:57.498414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:57.503804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:57.871094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:57.883211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2fcf2b4f-90cd-42aa-897f-e90eacedb73c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1666 microversion: 2.1 time: 0.829059 Oct 12 08:59:57.905685 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1827/3946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:57 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1666 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:57.905685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:57.905685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:57.926503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:57.928704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:57.934551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:57.935619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:57.936275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:57.936889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:58.105471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:58.117967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:58.125868 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5abda1da-40d7-4af3-84d1-11f3deb102f2 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.649756 Oct 12 08:59:58.134620 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2120/3947] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:57 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:58.153666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:58.154297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:58.176255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:58.176759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:58.177208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:58.177968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:58.178618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:58.179218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:58.480480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:58.485059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 08:59:58.491693 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8695934-76a8-44e6-ba31-4b4767b10a9a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.606793 Oct 12 08:59:58.497728 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1828/3948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:57 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:58.506936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:58.511731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:58.537086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:58.537624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:58.538073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:58.538798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:58.539256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:58.539684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:58.814168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:58.831070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:58.834591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:58.836101 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c3737e0-0250-4c31-815f-2a74fadb2a88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.337082 Oct 12 08:59:58.837193 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1829/3949] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:58 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:58.845790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3987a3cc-cb97-49e8-bd43-baa7d57fe768 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848c1caf0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:58.914416 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3987a3cc-cb97-49e8-bd43-baa7d57fe768 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.075639 Oct 12 08:59:58.915653 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1830/3950] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 08:59:58 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:58.922615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:58.923401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:58.931465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:58.932268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:58.932862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:58.933843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:58.934454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:58.935036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:58.963886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:58.973575 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c747d63c-9ba4-4bf7-8a13-95b6543c6b02 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.825447 Oct 12 08:59:58.977281 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2121/3951] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:58 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:58.986275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:58.987782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:59.006785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.007475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.009259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.012633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.018512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.020435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.262874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:59.280100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:59.307498 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c69bcbe4-f35e-4cf8-8821-899b881338fa tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1666 microversion: 2.1 time: 0.317853 Oct 12 08:59:59.310195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:59.311089 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2122/3952] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:58 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1666 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:59.312959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:59.325650 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e14e7164-71cc-4073-858e-e3a960af43f6 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.407890 Oct 12 08:59:59.326804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1831/3953] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:58 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 08:59:59.327982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:59.330137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:59.350407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.351314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.352883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.356907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.358633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.360388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.520209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:59.521924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:59.533970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.534710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.535316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.536205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.537120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.538890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.724999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:59.735886 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-693d61ca-c426-420d-94ad-49b1076602b7 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.421494 Oct 12 08:59:59.736767 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2123/3954] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:59 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 08:59:59.760953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:59.761633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:59.771062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.771498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.771951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.772654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.773101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.773545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.872325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 08:59:59.886829 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c301b2de-9066-42ea-a758-b3ef4e2e9034 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.370517 Oct 12 08:59:59.901464 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1832/3955] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:59 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 08:59:59.901464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 08:59:59.903409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 08:59:59.918867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.919845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.919845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 08:59:59.920985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 08:59:59.920985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 08:59:59.921785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:00.357112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:00.370723 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc1af871-a347-431e-a1ce-fc76b58bac06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.610642 Oct 12 09:00:00.373103 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2124/3956] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 08:59:59 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:00.383781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b545ae32-8d0f-4787-8175-c021497397ff tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843fcbf70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:00.418164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:00.436547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:00.443961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:00.446472 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-009f0a3f-cd40-4a2b-844f-0094bcda2e93 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.557578 Oct 12 09:00:00.448943 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1833/3957] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 08:59:59 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:00.467960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:00.470168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:00.481253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b545ae32-8d0f-4787-8175-c021497397ff tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.106809 Oct 12 09:00:00.490355 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2125/3958] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:00 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:00.499522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:00.503295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:00.503648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:00.504314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:00.506491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:00.507447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:00.509989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:00.512947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:00.519747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:00.520620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:00.521426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:00.522344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:00.524167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:00.524807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:00.641233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:00.662191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:00.667219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:00.674068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a9ba55dc-7e9c-4aa9-850c-d676d4aa2d7a tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.181593 Oct 12 09:00:00.676223 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2126/3959] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:00 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:00.682968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:00.684448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:00.696289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:00.697128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:00.697798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:00.698751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:00.699383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:00.699989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:00.760508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lazy-loading 'flavor' on Instance uuid 77cfc40a-e74e-425f-9ff8-a23531e1f956 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:00.944589 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a194ab7-644b-4ffa-bec1-d75c797c72db tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.264659 Oct 12 09:00:00.949196 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2127/3960] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:00:00 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:00:00.961140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e300f189-05f3-4203-8507-623beee58280 req-50c5260c-886d-4bd0-83b3-24b2e60d24c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617dc413-650f-4340-933d-6fbf879240bf", "name": "network-vif-deleted", "tag": "238873e3-bf59-47b5-bfd5-f3b69a1232cd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:00.988568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e300f189-05f3-4203-8507-623beee58280 req-50c5260c-886d-4bd0-83b3-24b2e60d24c0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:00.989455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e300f189-05f3-4203-8507-623beee58280 req-50c5260c-886d-4bd0-83b3-24b2e60d24c0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:00.990088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e300f189-05f3-4203-8507-623beee58280 req-50c5260c-886d-4bd0-83b3-24b2e60d24c0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:01.018847 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e300f189-05f3-4203-8507-623beee58280 req-50c5260c-886d-4bd0-83b3-24b2e60d24c0 service nova] Creating event network-vif-deleted:238873e3-bf59-47b5-bfd5-f3b69a1232cd for instance 617dc413-650f-4340-933d-6fbf879240bf on n-h2-858383-10 Oct 12 09:00:01.030253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e300f189-05f3-4203-8507-623beee58280 req-50c5260c-886d-4bd0-83b3-24b2e60d24c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078982 Oct 12 09:00:01.048733 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2128/3961] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:01.066958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:01.072138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:01.087493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:01.087994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:01.088446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:01.089167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:01.094866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:01.096291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:01.177587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:01.187157 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0318f31-3332-4e7a-9b85-4e0c0724e6b1 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1317 microversion: 2.1 time: 0.728940 Oct 12 09:00:01.192211 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1834/3962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:00 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1317 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:01.197102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:01.203043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:01.221376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:01.222211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:01.222829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:01.223747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:01.224374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:01.224974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:01.457089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:01.465967 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd61f8d7-96d9-4125-963d-1096361d5e62 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.414364 Oct 12 09:00:01.470420 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2129/3963] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:01 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:01.483074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:01.485965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:01.496907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:01.497649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:01.498249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:01.499140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:01.499844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:01.500429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:01.757090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:01.766895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:01.768592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:01.769821 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-87199215-7d69-4556-bc05-4da7ebad07c0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.294030 Oct 12 09:00:01.770860 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2130/3964] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:01 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:01.776241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90314c95-e697-4a7f-acf0-0eb9f7cd5d10 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848c12ca0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:01.796165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:01.810905 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dbc0fd2a-625f-4dcb-8155-fdd87c64accb tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1678 microversion: 2.1 time: 0.617245 Oct 12 09:00:01.811524 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1835/3965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:01 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1678 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:01.823229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:01.823935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:01.835090 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90314c95-e697-4a7f-acf0-0eb9f7cd5d10 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.063012 Oct 12 09:00:01.836618 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2131/3966] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:01 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:01.840093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:01.840584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:01.841017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:01.841764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:01.842212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:01.842635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.030928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:02.048993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:02.050682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:02.055272 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7c7d51cc-cd75-4bce-943b-51aef603cdc4 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.240987 Oct 12 09:00:02.056460 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1836/3967] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:01 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:02.222510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:02.225063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:02.240454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.240977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.260012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.260850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.261381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.262039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.335378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.336513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.337843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.338876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lazy-loading 'fault' on Instance uuid 617dc413-650f-4340-933d-6fbf879240bf {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:02.404498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:02.414472 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3888202c-634e-4a80-a83a-a38989061f71 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 200 len: 1322 microversion: 2.1 time: 0.197682 Oct 12 09:00:02.417283 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2132/3968] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:02 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:02.498339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:02.498962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:02.511739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.513153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.515036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.517085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.519031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.532388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.801626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:02.802270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:02.821168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.821575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.822025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.822815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.823281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.824051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.825924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:02.840269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-47a671b3-663f-46a6-b3a5-80aa95d54956 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.351907 Oct 12 09:00:02.856667 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1837/3969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:02 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:02.862165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:02.868064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:02.883391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.884068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.884732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:02.885624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:02.886302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:02.889829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.042081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:03.054727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:03.056800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:03.058545 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec5cbcd7-0ca4-4f38-b466-7c12c65863c6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.264072 Oct 12 09:00:03.059607 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2133/3970] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:02 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:03.064485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38b62b25-969a-46cd-b91a-50b5cc9a4221 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9849203af0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:03.125193 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38b62b25-969a-46cd-b91a-50b5cc9a4221 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.064239 Oct 12 09:00:03.126227 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2134/3971] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:03 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:03.132808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:03.133687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:03.142270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.143214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.143827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.144709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.145423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.146056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.210015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:03.221097 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2dc3f57-cd9d-4ea1-b929-347d48bdb753 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1661 microversion: 2.1 time: 0.362923 Oct 12 09:00:03.222959 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1838/3972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:02 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1661 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:03.249473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:03.262540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:03.264009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:03.265249 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ae43d79-e3e7-4ca3-8985-f31d124a42d3 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.137766 Oct 12 09:00:03.265938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:03.268134 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2135/3973] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:03 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:03.271644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:03.286658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.287461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.288245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.289216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.289945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.290659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.413856 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f0e02902-a5b1-4dee-8269-c497adb787a6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action" status: 202 len: 0 microversion: 2.1 time: 0.168900 Oct 12 09:00:03.414821 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1839/3974] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:00:03 2022] POST /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:00:03.423781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:03.431066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:03.439552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:03.443149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 617dc413-650f-4340-933d-6fbf879240bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:03.452242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.453336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.455150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.455385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.456339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.457010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.457692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.469762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.471716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.472743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.473419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.474049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.539324 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] HTTP exception thrown: Instance 617dc413-650f-4340-933d-6fbf879240bf could not be found. Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Request method failure captured: Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf HTTP/1.1 Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCTxI4t1qncRXFzGF5cdw8IeNdTPvKSAWATYDyrR35N0KjEB1TuruyVxr-w5ntKLRyAGqD7fQUBbEFkd8AgciPKCDqrg6EoV7UBomokP6M0X4akHXp2rNV1RyaQDjskCKFN7YF1cUUeK2_VLkhkBveZerx39a0E9E5Pv9k4kzrzajg Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: f77355ddeba541b189e41cb089a07eba Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77355ddeba541b189e41cb089a07eba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f77355ddeba541b189e41cb089a07eba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f77355ddeba541b189e41cb089a07eba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77355ddeba541b189e41cb089a07eba"}]}] Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: f77355ddeba541b189e41cb089a07eba Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-LiveMigrationTest-1793301549-project Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3662e9666cc14f80a5ea16670a6f1595 Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-LiveMigrationTest-1793301549-project Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 617dc413-650f-4340-933d-6fbf879240bf could not be found. Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '617dc413-650f-4340-933d-6fbf879240bf'} Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617dc413-650f-4340-933d-6fbf879240bf could not be found. Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617dc413-650f-4340-933d-6fbf879240bf could not be found. Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:03.540962 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617dc413-650f-4340-933d-6fbf879240bf could not be found. Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Returning 404 to user: Instance 617dc413-650f-4340-933d-6fbf879240bf could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:03.546790 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac381f5a-ab35-40b8-b223-c1db3a620687 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf" status: 404 len: 111 microversion: 2.1 time: 0.107184 Oct 12 09:00:03.558078 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1840/3975] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:03 2022] GET /compute/v2.1/servers/617dc413-650f-4340-933d-6fbf879240bf => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:00:03.563285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe25cc51-ed1f-4689-b69f-d8a154ddc53a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '.version_select at 0x7f9848bfbaf0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:03.637284 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe25cc51-ed1f-4689-b69f-d8a154ddc53a tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-62541734" status: 202 len: 0 microversion: 2.1 time: 0.077913 Oct 12 09:00:03.638575 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1841/3976] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 12 09:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-62541734 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:00:03.865703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:03.867095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:03.897712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.901007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.904961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.908829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:03.911522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:03.914387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:03.924800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:03.932445 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ff9adb6b-14b1-4808-a361-f1891bd865cc tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1667 microversion: 2.1 time: 0.512974 Oct 12 09:00:03.937085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2136/3977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:03 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1667 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:04.190500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:04.200141 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0576e9f0-de91-40b6-8e34-da1759a95bc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.340332 Oct 12 09:00:04.202938 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1842/3978] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:03 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:04.207834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:04.208679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:04.216562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:04.217326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:04.217985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:04.218882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:04.219494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:04.220075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:04.391653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-18536200", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "d9b40dbd-7a57-473b-ad06-b5b47356cdf0"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:04.457928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:04.468370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:04.470852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:04.472082 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c9f808c-2513-44bb-b469-76b078a8bc4a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.268003 Oct 12 09:00:04.473856 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1843/3979] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:04 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:04.479309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-df9b5edd-1447-4bec-83e2-ac0846773270 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848bfb040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:04.534405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] validate_networks() for [('d9b40dbd-7a57-473b-ad06-b5b47356cdf0', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:00:04.555286 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-df9b5edd-1447-4bec-83e2-ac0846773270 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.080317 Oct 12 09:00:04.556312 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1844/3980] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:04 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:04.562580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:04.563491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:04.570860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:04.571367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:04.571812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:04.572530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:04.572988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:04.573418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:04.678088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:04.683343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:04.685123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:04.686442 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b111817-ac98-4fdd-8da0-62fe8473c017 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.128859 Oct 12 09:00:04.702348 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1845/3981] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:04 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:04.960609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:04.961327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:04.978625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:04.983575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:04.984340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:04.985354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:04.986218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:04.986924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.195527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:05.207990 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83977203-499d-4c8b-b1ac-2c71994175e4 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1667 microversion: 2.1 time: 0.251121 Oct 12 09:00:05.223184 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1846/3982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:04 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1667 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:05.232040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:05.233469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:05.240396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:05.241237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:05.241958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.243424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:05.244122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:05.244774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.423056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:05.433527 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3a52f130-62c4-454e-99e6-a5f7b759efb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.208711 Oct 12 09:00:05.436578 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1847/3983] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:05 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:05.500784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:05.501582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:05.516763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:05.517385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:05.518361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.519438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:05.520240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:05.520880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.526498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:05.848679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:05.860999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:05.870018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:05.871339 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f2c4792f-429e-4b1d-bde6-b692d82075f0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.375104 Oct 12 09:00:05.872627 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1848/3984] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:05 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:05.886789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ffa6571-4879-44d5-b3fe-b766d28148b3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848c1c9d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:05.894347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:00:05.894857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:00:05.895259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:00:05.895683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:00:05.896100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:00:05.914692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:05.915195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:05.915655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.916418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:05.916928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:05.917387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.951428 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ffa6571-4879-44d5-b3fe-b766d28148b3 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.077693 Oct 12 09:00:05.953270 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1849/3985] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:05 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:05.958204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Getting quotas for project e7709ffd03864badaa5af03f7e6b3582. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:00:05.958545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:05.959284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:05.964344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Getting quotas for user d06d354aa8e64d5eb540d98c5abb09c2 and project e7709ffd03864badaa5af03f7e6b3582. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:00:05.967219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:05.967837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:05.968361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.969262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:05.969850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:05.970432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:05.979156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:00:05.982056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:00:06.060461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:06.070931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:06.072636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:06.074168 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4283f18-db12-45ac-bbf6-232e3f263085 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.119401 Oct 12 09:00:06.075265 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1850/3986] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:05 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:06.082010 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-52c9065c-ea84-49e1-ada4-b2a56c0e155b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.040740 Oct 12 09:00:06.082502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:06.083226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:06.083639 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2137/3987] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:00:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:00:06.098230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3118d7c8-66d7-4e10-b3c2-51e529c3114e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:06.099056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3118d7c8-66d7-4e10-b3c2-51e529c3114e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:06.099715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.100345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.101265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.102140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.102604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.103039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.142257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:06.214779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3118d7c8-66d7-4e10-b3c2-51e529c3114e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:06.226360 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3118d7c8-66d7-4e10-b3c2-51e529c3114e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1223 microversion: 2.1 time: 0.135398 Oct 12 09:00:06.227789 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2138/3988] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:06 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:06.242345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:06.243422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:06.249488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:06.261413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.262320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.263141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.264132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.264859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.266479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.376763 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3bbd25e2-ff59-4c45-9b02-a544880d1a5b tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "DELETE /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 204 len: 0 microversion: 2.1 time: 0.299888 Oct 12 09:00:06.378459 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1851/3989] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:06 2022] DELETE /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:06.388420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:06.389133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:06.402582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.403134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.403794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.404573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.405079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.405735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.554692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:06.570361 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a0bc4b4f-d72c-4a7f-b23f-39adf983e987 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.338005 Oct 12 09:00:06.593306 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2139/3990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:06 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:06.602983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:06.606432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:06.608034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:06.621891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.622694 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ad154a2-849d-4b34-a644-e742b21eafd2 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1485 microversion: 2.1 time: 0.239013 Oct 12 09:00:06.624725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.626788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.633264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.633986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.634681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.642947 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1852/3991] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:06 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1485 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:06.649922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:06.650791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:06.660390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.661095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.661769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.663698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.664342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.664957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.806760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:06.814469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:06.819960 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe262381-16a1-41d8-a01f-6c84a5c68c58 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1533 microversion: 2.1 time: 0.224814 Oct 12 09:00:06.821292 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2140/3992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:06 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1533 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:06.903709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:06.905026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:06.915926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.919170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.922251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.923214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:06.925970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:06.926617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:06.996425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:07.009254 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2e9158b2-e889-4980-aed2-0ddef6c250d0 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1670 microversion: 2.1 time: 0.363274 Oct 12 09:00:07.027724 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1853/3993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:06 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1670 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:07.040723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-623b0423-80bf-43f1-8000-d455207e653c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848c1cee0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:07.152509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:07.164898 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-623b0423-80bf-43f1-8000-d455207e653c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.132086 Oct 12 09:00:07.172427 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1854/3994] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:07 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:07.178055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:07.178562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:07.183298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:07.192784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:07.194284 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e777eab7-3c73-4446-ae42-57a9bd326cd7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.297277 Oct 12 09:00:07.197525 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2141/3995] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:06 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:07.215610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:07.218975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:07.219781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:07.220249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:07.221084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:07.221216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:07.224491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:07.225047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:07.243733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:07.244166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:07.245875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:07.245875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:07.252230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:07.256301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:07.299210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:07.312516 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.compute.api [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Working on deleting snapshot 6e046670-927d-493d-8d1a-8a99d883a752 from shelved instance... Oct 12 09:00:07.438915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:07.452966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:07.466390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:07.467793 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c42cebff-7a35-481d-9064-6ea11a1978e1 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1408 microversion: 2.54 time: 0.268834 Oct 12 09:00:07.468467 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2142/3996] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:07 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:07.525521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:07.526413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:07.545904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:07.550684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:07.551989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:07.555414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:07.556122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:07.556758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:07.717636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:07.728693 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf599812-9fa6-4595-804b-38f79ff48e9e tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1227 microversion: 2.1 time: 0.211028 Oct 12 09:00:07.729310 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2143/3997] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:07 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1227 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:07.743252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:07.744111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:07.751675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:07.752426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:07.752570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:07.753269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:07.753759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:07.754186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:08.019895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:08.034424 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-03abaaee-9573-41ac-b0a7-428083e9b391 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 200 len: 1485 microversion: 2.1 time: 0.300834 Oct 12 09:00:08.039485 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2144/3998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:07 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 1485 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:08.061007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:08.063890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:08.086541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:08.090994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:08.091496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:08.092252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:08.100670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:08.101374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:08.512323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:08.531222 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-229e7b4c-40f7-4821-9441-5d507e49a95d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1533 microversion: 2.1 time: 0.489590 Oct 12 09:00:08.536637 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2145/3999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:08 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1533 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:08.554919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b188d11-21b3-4d3f-8045-b384fd9dd566 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f98492530d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:09.356221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Doing local delete in cell 0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) {{(pid=127007) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 12 09:00:09.357068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:09.357595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:09.358048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:09.359830 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.compute.api [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 12 09:00:09.368656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] deallocate_for_instance() {{(pid=127007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 12 09:00:09.391965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b188d11-21b3-4d3f-8045-b384fd9dd566 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1438 microversion: 2.1 time: 0.853902 Oct 12 09:00:09.393594 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2146/4000] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:08 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1438 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:09.408576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:09.410760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:09.419398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:09.420205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:09.420812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:09.422112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:09.423151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:09.423750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:09.640991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:09.652265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:09.662275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:09.663613 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3e587c8-6c77-4413-a414-b4ab61118e4b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.268664 Oct 12 09:00:09.664116 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2147/4001] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:09 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:09.768144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1c8765b3-e02c-4d45-95d7-e3a62d8f2ec0 req-a7ee7166-efa3-44d7-a6ea-4cb67e1444a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a4c781-b18e-4145-8fa8-a8197652846b", "name": "network-vif-deleted", "tag": "b8b52663-79a8-4f9d-89f5-5f8e0225c14c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:09.789477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1c8765b3-e02c-4d45-95d7-e3a62d8f2ec0 req-a7ee7166-efa3-44d7-a6ea-4cb67e1444a4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:09.790140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1c8765b3-e02c-4d45-95d7-e3a62d8f2ec0 req-a7ee7166-efa3-44d7-a6ea-4cb67e1444a4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:09.791187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1c8765b3-e02c-4d45-95d7-e3a62d8f2ec0 req-a7ee7166-efa3-44d7-a6ea-4cb67e1444a4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:09.825937 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1c8765b3-e02c-4d45-95d7-e3a62d8f2ec0 req-a7ee7166-efa3-44d7-a6ea-4cb67e1444a4 service nova] Creating event network-vif-deleted:b8b52663-79a8-4f9d-89f5-5f8e0225c14c for instance 95a4c781-b18e-4145-8fa8-a8197652846b on n-h1-858383-10 Oct 12 09:00:09.833955 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1c8765b3-e02c-4d45-95d7-e3a62d8f2ec0 req-a7ee7166-efa3-44d7-a6ea-4cb67e1444a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167130 Oct 12 09:00:09.835344 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2148/4002] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:09.845557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:09.846607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:09.858590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:09.859373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:09.860020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:09.861874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:09.863055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:09.863684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:09.943949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:09.957245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:09.958968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:09.960191 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cfb6b85f-1ba1-483b-9ce0-f03af71b20fa tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1414 microversion: 2.54 time: 0.123576 Oct 12 09:00:09.983685 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2149/4003] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:09 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:09.990371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d1ab6f7a-0593-4dde-b189-0242fdfa6f59 req-12f62693-df3a-4c77-9bd2-9f3a40e4da69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1acdb6-1970-410c-a904-67636bdc3d68", "name": "network-vif-plugged", "status": "completed", "tag": "6e76f914-e39e-4490-8567-4fcc14247a71"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:10.001702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d1ab6f7a-0593-4dde-b189-0242fdfa6f59 req-12f62693-df3a-4c77-9bd2-9f3a40e4da69 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.002186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d1ab6f7a-0593-4dde-b189-0242fdfa6f59 req-12f62693-df3a-4c77-9bd2-9f3a40e4da69 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.002948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d1ab6f7a-0593-4dde-b189-0242fdfa6f59 req-12f62693-df3a-4c77-9bd2-9f3a40e4da69 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.028207 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d1ab6f7a-0593-4dde-b189-0242fdfa6f59 req-12f62693-df3a-4c77-9bd2-9f3a40e4da69 service nova] Creating event network-vif-plugged:6e76f914-e39e-4490-8567-4fcc14247a71 for instance 4d1acdb6-1970-410c-a904-67636bdc3d68 on n-h2-858383-10 Oct 12 09:00:10.046004 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d1ab6f7a-0593-4dde-b189-0242fdfa6f59 req-12f62693-df3a-4c77-9bd2-9f3a40e4da69 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060568 Oct 12 09:00:10.061255 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2150/4004] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:10.083402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:10.084137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:10.111945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.112849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.114903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.117670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.118363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.119122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.249515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:10.260125 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be85e190-1deb-4d7c-bf2e-352d5589f6f6 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1281 microversion: 2.1 time: 0.191392 Oct 12 09:00:10.261591 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2151/4005] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:10 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:10.266894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:10.267520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 95a4c781-b18e-4145-8fa8-a8197652846b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:10.274103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.274690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.275220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.276043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.276637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.277146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.306189 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] HTTP exception thrown: Instance 95a4c781-b18e-4145-8fa8-a8197652846b could not be found. Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Request method failure captured: Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b HTTP/1.1 Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoCTxI4t1qncRXFzGF5cdw8IeNdTPvKSAWATYDyrR35N0KjEB1TuruyVxr-w5ntKLRyAGqD7fQUBbEFkd8AgciPKCDqrg6EoV7UBomokP6M0X4akHXp2rNV1RyaQDjskCKFN7YF1cUUeK2_VLkhkBveZerx39a0E9E5Pv9k4kzrzajg Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: f77355ddeba541b189e41cb089a07eba Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77355ddeba541b189e41cb089a07eba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f77355ddeba541b189e41cb089a07eba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f77355ddeba541b189e41cb089a07eba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77355ddeba541b189e41cb089a07eba"}]}] Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: f77355ddeba541b189e41cb089a07eba Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-LiveMigrationTest-1793301549-project Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 3662e9666cc14f80a5ea16670a6f1595 Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-LiveMigrationTest-1793301549-project Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 95a4c781-b18e-4145-8fa8-a8197652846b could not be found. Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '95a4c781-b18e-4145-8fa8-a8197652846b'} Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a4c781-b18e-4145-8fa8-a8197652846b could not be found. Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a4c781-b18e-4145-8fa8-a8197652846b could not be found. Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:10.307982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a4c781-b18e-4145-8fa8-a8197652846b could not be found. Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Returning 404 to user: Instance 95a4c781-b18e-4145-8fa8-a8197652846b could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-603d962c-2425-4178-8751-900b1f5960b6 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b" status: 404 len: 111 microversion: 2.1 time: 0.046593 Oct 12 09:00:10.318284 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2152/4006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:10 2022] GET /compute/v2.1/servers/95a4c781-b18e-4145-8fa8-a8197652846b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:10.319864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:10.320590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:10.327071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.327726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.328515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.329351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.330039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.330574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.566883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Updating instance_info_cache with network_info: [] {{(pid=127007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 09:00:10.725738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:10.737402 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4c278044-c936-4736-9461-827ccacac143 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 0.425436 Oct 12 09:00:10.747551 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2153/4007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:10 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:10.760314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:10.761034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:10.776750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.779498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.781011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.788748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:10.790426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:10.791208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:10.923457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:11.073194 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cbb63d04-766a-4aeb-a0e7-bc4007a8cde1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "DELETE /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 204 len: 0 microversion: 2.1 time: 3.899528 Oct 12 09:00:11.074099 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1855/4008] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:07 2022] DELETE /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 0 bytes in 3901 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:11.084237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dd93d9f9-4e12-45ab-b578-452f42ce4e1a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848a53b80>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:11.128098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-105de7d7-678f-4a79-b45e-c1be2b0cca90 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "DELETE /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 204 len: 0 microversion: 2.1 time: 0.376829 Oct 12 09:00:11.142391 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2154/4009] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:10 2022] DELETE /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:11.159250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:11.161887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:11.175513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:11.178543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:11.181917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:11.185268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:11.186039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:11.188583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:11.508614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:11.537477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:11.545310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:11.549609 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73c1ff16-b9f5-4c4e-bab8-92afbeee9e14 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.402953 Oct 12 09:00:11.555840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2155/4010] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:11 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:11.568715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:11.568715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:11.592857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:11.604013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:11.605117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:11.608587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:11.609196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:11.614441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:11.754512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:11.775609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:11.780119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:11.782018 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-331e581c-3ffd-4786-b544-bfb4023a2be8 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1414 microversion: 2.54 time: 0.226559 Oct 12 09:00:11.790162 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2156/4011] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:11 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1414 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:11.801841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:11.818189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 39abadf0-5184-42fe-8f70-e8a48cb15b7a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:11.845058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:11.846021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:11.846694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:11.847769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:11.848413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:11.849037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:11.884098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] HTTP exception thrown: Instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a could not be found. Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Request method failure captured: Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a HTTP/1.1 Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoAP365udkWTpc1lydTu7qX_N7CXpUrjOBJr0wez-gl3lAesjFUCh22AjkyEVAwnIIkXt-GCDdntFDiEibPa4HlO8aL-I43zq87pr7cG6va0bJbScEIcJ_YPe04MxPmCpaxDESPZzAPttwxZ8Yj5L5edfZ8gmlofL9kN4xosW0HZYYo Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}] Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 54fad01e2e6e41d0887895b131051ee1 Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a could not be found. Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '39abadf0-5184-42fe-8f70-e8a48cb15b7a'} Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a could not be found. Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a could not be found. Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:11.890286 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a could not be found. Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Returning 404 to user: Instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:11.895237 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e42683d-f284-4789-b635-c1edaa058175 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a" status: 404 len: 111 microversion: 2.1 time: 0.099642 Oct 12 09:00:11.897834 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2157/4012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:11 2022] GET /compute/v2.1/servers/39abadf0-5184-42fe-8f70-e8a48cb15b7a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:11.905639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:11.909847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:11.924255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:11.927735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:11.928376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:11.929330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:11.932153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:11.932897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:12.216875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:12.231675 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-506052a0-0f51-4729-8491-96e1ef53bc8c tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1501 microversion: 2.1 time: 0.326873 Oct 12 09:00:12.233176 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2158/4013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:11 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:12.267763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:12.268655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:12.283769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:12.284346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:12.284812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:12.289194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:12.294522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:12.295037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:12.337315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:12.995653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:13.006351 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80a772cb-5ef0-46ed-b49d-a97760fc229b tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1323 microversion: 2.1 time: 0.755632 Oct 12 09:00:13.006958 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2159/4014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:12 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1323 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:13.027490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:13.033814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:13.063703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:13.064221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:13.071225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:13.072156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:13.075470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:13.075936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:13.331247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:13.340398 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90c51c6f-bc2f-42e6-ab60-756cc9318410 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 0.321280 Oct 12 09:00:13.344286 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2160/4015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:13 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:13.360854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e2557826-0a6a-41fe-8604-8fd34698d9a0 req-10778b8d-8113-4452-b6dc-51e6759504c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39abadf0-5184-42fe-8f70-e8a48cb15b7a", "name": "network-vif-deleted", "tag": "07f0f3d3-dbae-4ad3-aca8-61b79115134b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:13.374873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2557826-0a6a-41fe-8604-8fd34698d9a0 req-10778b8d-8113-4452-b6dc-51e6759504c2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:13.375618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2557826-0a6a-41fe-8604-8fd34698d9a0 req-10778b8d-8113-4452-b6dc-51e6759504c2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:13.375783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e2557826-0a6a-41fe-8604-8fd34698d9a0 req-10778b8d-8113-4452-b6dc-51e6759504c2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:13.423971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.server_external_events [req-e2557826-0a6a-41fe-8604-8fd34698d9a0 req-10778b8d-8113-4452-b6dc-51e6759504c2 service nova] Unable to find a host for instance 39abadf0-5184-42fe-8f70-e8a48cb15b7a. Dropping event network-vif-deleted {{(pid=127006) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 09:00:13.425227 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e2557826-0a6a-41fe-8604-8fd34698d9a0 req-10778b8d-8113-4452-b6dc-51e6759504c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.079662 Oct 12 09:00:13.434529 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2161/4016] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 89 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 09:00:13.439756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:13.440508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:13.457227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:13.458127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:13.458860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:13.460036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:13.460691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:13.461519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:13.530922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:13.687524 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29e034ea-4634-4407-9a39-e013e5ddb557 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 204 len: 0 microversion: 2.1 time: 0.250477 Oct 12 09:00:13.689983 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2162/4017] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:13 2022] DELETE /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:13.706245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-afdb4a34-e02d-4caf-b203-3c54d1da4b77 req-b7f65b70-88f2-48a7-aa85-99330c175266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a870435b-8aa5-456d-b0ca-477ee2201dbb", "name": "network-vif-plugged", "status": "completed", "tag": "100f519d-4457-4d8b-acb1-e0e088317a35"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:13.735425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-afdb4a34-e02d-4caf-b203-3c54d1da4b77 req-b7f65b70-88f2-48a7-aa85-99330c175266 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:13.735924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-afdb4a34-e02d-4caf-b203-3c54d1da4b77 req-b7f65b70-88f2-48a7-aa85-99330c175266 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:13.736759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-afdb4a34-e02d-4caf-b203-3c54d1da4b77 req-b7f65b70-88f2-48a7-aa85-99330c175266 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:13.763452 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-afdb4a34-e02d-4caf-b203-3c54d1da4b77 req-b7f65b70-88f2-48a7-aa85-99330c175266 service nova] Creating event network-vif-plugged:100f519d-4457-4d8b-acb1-e0e088317a35 for instance a870435b-8aa5-456d-b0ca-477ee2201dbb on n-h2-858383-10 Oct 12 09:00:13.768778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-afdb4a34-e02d-4caf-b203-3c54d1da4b77 req-b7f65b70-88f2-48a7-aa85-99330c175266 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076107 Oct 12 09:00:13.773802 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2163/4018] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:13.779671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:13.780613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:13.787866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:13.788779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:13.789385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:13.790757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:13.791385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:13.792094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:13.950392 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dd93d9f9-4e12-45ab-b578-452f42ce4e1a tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1447 microversion: 2.1 time: 2.875029 Oct 12 09:00:13.962464 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1856/4019] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:11 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1447 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:14.003678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.013557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:14.014322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.027077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.029219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.031041 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd205005-fc45-4f01-bb36-6ef46b9315a6 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1809 microversion: 2.20 time: 0.255608 Oct 12 09:00:14.031381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.032362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.034835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.036667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.037961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.039659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.044739 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2164/4020] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:13 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:14.057991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.058917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:14.077995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.080024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.082709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.085074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.086503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.087783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.163998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.164775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.165382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.166022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lazy-loading 'fault' on Instance uuid 47229845-cf46-4d08-b972-de308074dab4 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:14.202688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.215425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.217368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.218924 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a36ebcb4-88d6-49d8-a8b8-1ae772e39637 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1399 microversion: 2.54 time: 0.255005 Oct 12 09:00:14.220201 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1857/4021] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:13 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1399 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:14.225758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-287fd135-e30d-4be1-a213-d95b56b799bb req-d0fa409f-8bfb-45ae-b0da-86e1cfc295c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47229845-cf46-4d08-b972-de308074dab4", "name": "network-vif-deleted", "tag": "5a595f0e-9643-433b-8ce2-5c59e9bd812a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:14.225921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3662e9666cc14f80a5ea16670a6f1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77355ddeba541b189e41cb089a07eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.235121 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e5685bb4-502e-4bcb-8005-fe38b6aa3ad3 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 200 len: 1301 microversion: 2.1 time: 0.189220 Oct 12 09:00:14.236536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-287fd135-e30d-4be1-a213-d95b56b799bb req-d0fa409f-8bfb-45ae-b0da-86e1cfc295c7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.237520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-287fd135-e30d-4be1-a213-d95b56b799bb req-d0fa409f-8bfb-45ae-b0da-86e1cfc295c7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.238150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-287fd135-e30d-4be1-a213-d95b56b799bb req-d0fa409f-8bfb-45ae-b0da-86e1cfc295c7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.238507 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2165/4022] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:14 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 1301 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:14.251253 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-287fd135-e30d-4be1-a213-d95b56b799bb req-d0fa409f-8bfb-45ae-b0da-86e1cfc295c7 service nova] Creating event network-vif-deleted:5a595f0e-9643-433b-8ce2-5c59e9bd812a for instance 47229845-cf46-4d08-b972-de308074dab4 on n-h2-858383-10 Oct 12 09:00:14.256797 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-287fd135-e30d-4be1-a213-d95b56b799bb req-d0fa409f-8bfb-45ae-b0da-86e1cfc295c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034807 Oct 12 09:00:14.257616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.258398 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1858/4023] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:14.258530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:14.264883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-81c92aad-0c88-4793-8084-ffd5c9e89013 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f98488563a0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.265832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.266409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.266966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.267751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.268286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.268784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.318848 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-81c92aad-0c88-4793-8084-ffd5c9e89013 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 200 len: 1447 microversion: 2.1 time: 0.058896 Oct 12 09:00:14.328384 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1859/4024] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:14 2022] GET /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 1447 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:14.339003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.339914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:14.347283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.348359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.348810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.349583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.350055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.350476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.364172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.373045 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6dcf02c3-8d8f-4af4-9fe6-3651d869d89c tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1465 microversion: 2.1 time: 0.133124 Oct 12 09:00:14.374051 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2166/4025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:14 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1465 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:14.381682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fdcfb981-7a38-42f5-8e0c-7712ad0ad69f tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '.version_select at 0x7f9848b95dc0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.404138 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fdcfb981-7a38-42f5-8e0c-7712ad0ad69f tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1225122847" status: 204 len: 0 microversion: 2.54 time: 0.028963 Oct 12 09:00:14.404930 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2167/4026] 10.222.0.40 () {60 vars in 1319 bytes} [Wed Oct 12 09:00:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1225122847 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:00:14.419578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9672eccd-d1e3-4243-9691-b004d9cdaca4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848c7d790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.552139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.563258 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-72c06201-a468-491d-aac4-bedb0208ffac tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1323 microversion: 2.1 time: 0.235918 Oct 12 09:00:14.565255 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1860/4027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:14 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1323 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:14.572890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.574473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:14.588125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.588621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.589061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.591148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.596273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.597048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.631665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:14.802544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:14.816693 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-567b29c9-37a0-4246-98b1-8c9bbd2377d1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 0.250153 Oct 12 09:00:14.830605 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1861/4028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:14 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:14.840225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:14.841001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:14.848304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.848988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.849514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.851041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:14.851830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:14.852458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:14.888787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:14.989322 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f13a13f6-70f9-4068-900f-519be9581027 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 204 len: 0 microversion: 2.54 time: 0.153091 Oct 12 09:00:14.989988 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1862/4029] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:00:14 2022] DELETE /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:00:15.015277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:15.016351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:15.027743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:15.030840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.032159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.033176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.034183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.034644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.035073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.119894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:15.136033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:15.137819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:15.139357 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2da2b3ba-ed8d-410a-8e79-b98eb7fae520 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1405 microversion: 2.54 time: 0.140232 Oct 12 09:00:15.142518 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1863/4030] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:14 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:15.160617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:15.163192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:15.176274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.176763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.179719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.181509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.182945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.184052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.186443 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9672eccd-d1e3-4243-9691-b004d9cdaca4 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 204 len: 0 microversion: 2.1 time: 0.779218 Oct 12 09:00:15.190934 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2168/4031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:14 2022] DELETE /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 0 bytes in 782 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:15.201948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:15.202459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:15.214369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.215146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.215760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.216734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.217532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.218303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.252177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:15.375389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:15.385570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:15.387179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:15.388570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45375d01-2228-4926-a339-44dc3ff92daa tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1796 microversion: 2.20 time: 0.244992 Oct 12 09:00:15.410137 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1864/4032] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:15 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1796 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:15.446165 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-46c9bd8f-3f1f-478b-bf90-8e298579d8cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 204 len: 0 microversion: 2.1 time: 0.253328 Oct 12 09:00:15.448017 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2169/4033] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:15 2022] DELETE /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:15.461725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:15.465963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:15.467186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] [instance: 47229845-cf46-4d08-b972-de308074dab4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:15.469840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:15.474083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.474574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.475082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.475797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.476249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.476967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.478332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.478671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.483106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.483997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.484487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.484921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.492998 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] HTTP exception thrown: Instance 47229845-cf46-4d08-b972-de308074dab4 could not be found. Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Request method failure captured: Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 HTTP/1.1 Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoCTxI4t1qncRXFzGF5cdw8IeNdTPvKSAWATYDyrR35N0KjEB1TuruyVxr-w5ntKLRyAGqD7fQUBbEFkd8AgciPKCDqrg6EoV7UBomokP6M0X4akHXp2rNV1RyaQDjskCKFN7YF1cUUeK2_VLkhkBveZerx39a0E9E5Pv9k4kzrzajg Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: f77355ddeba541b189e41cb089a07eba Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77355ddeba541b189e41cb089a07eba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f77355ddeba541b189e41cb089a07eba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f77355ddeba541b189e41cb089a07eba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77355ddeba541b189e41cb089a07eba"}]}] Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: f77355ddeba541b189e41cb089a07eba Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-LiveMigrationTest-1793301549 Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-LiveMigrationTest-1793301549-project Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3662e9666cc14f80a5ea16670a6f1595 Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-LiveMigrationTest-1793301549-project Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 47229845-cf46-4d08-b972-de308074dab4 could not be found. Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '47229845-cf46-4d08-b972-de308074dab4'} Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47229845-cf46-4d08-b972-de308074dab4 could not be found. Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47229845-cf46-4d08-b972-de308074dab4 could not be found. Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:15.494858 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:15.500021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:15.500021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:15.500021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:15.500021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:15.500021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:15.500021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47229845-cf46-4d08-b972-de308074dab4 could not be found. Oct 12 09:00:15.500021 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:15.501620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] Returning 404 to user: Instance 47229845-cf46-4d08-b972-de308074dab4 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:15.502662 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa33c0d5-3d30-407d-b743-8d76ff734982 tempest-LiveMigrationTest-1793301549 tempest-LiveMigrationTest-1793301549-project] 10.222.0.40 "GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4" status: 404 len: 111 microversion: 2.1 time: 0.067552 Oct 12 09:00:15.503398 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1865/4034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:15 2022] GET /compute/v2.1/servers/47229845-cf46-4d08-b972-de308074dab4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:15.586279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:15.587306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:15.594637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.595212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.595896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.596694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.597388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.598077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.751240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:15.760678 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9fec0916-9e93-4393-8768-0014d2ea94c0 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1323 microversion: 2.1 time: 0.178378 Oct 12 09:00:15.761273 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1866/4035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:15 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:15.768797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1092967828", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3dfaf69e-9114-463f-af48-2e013b44a4e8"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:15.769181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:15.777899 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04fe5a48-598c-4f38-9725-72e8a8840c8d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1465 microversion: 2.1 time: 0.328375 Oct 12 09:00:15.778490 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2170/4036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:15 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1465 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:15.849519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:15.850623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:15.853538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] validate_networks() for [('3dfaf69e-9114-463f-af48-2e013b44a4e8', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:00:15.866670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.875679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.876141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.876905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:15.877367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:15.877838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:15.945824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:16.162048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:16.175069 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-82479e8d-e57e-4f32-960a-3e0a5756c08d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 0.329095 Oct 12 09:00:16.178852 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2171/4037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:15 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:16.183505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1366d24d-e5e5-487b-b353-695860bc8fc5 req-97333f6a-3b9a-49fd-a17e-db60c9cbfc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ca001ab-20f9-4fa1-9f9e-7392e869dd6e", "tag": "e4ce9ec2-b2bd-493f-ad28-e87eb5ebb575"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:16.220597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1366d24d-e5e5-487b-b353-695860bc8fc5 req-97333f6a-3b9a-49fd-a17e-db60c9cbfc3d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.221242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1366d24d-e5e5-487b-b353-695860bc8fc5 req-97333f6a-3b9a-49fd-a17e-db60c9cbfc3d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.221406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1366d24d-e5e5-487b-b353-695860bc8fc5 req-97333f6a-3b9a-49fd-a17e-db60c9cbfc3d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:16.241184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:16.244191 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1366d24d-e5e5-487b-b353-695860bc8fc5 req-97333f6a-3b9a-49fd-a17e-db60c9cbfc3d service nova] Creating event network-changed:e4ce9ec2-b2bd-493f-ad28-e87eb5ebb575 for instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e on n-h1-858383-10 Oct 12 09:00:16.251209 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1366d24d-e5e5-487b-b353-695860bc8fc5 req-97333f6a-3b9a-49fd-a17e-db60c9cbfc3d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071251 Oct 12 09:00:16.252908 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2172/4038] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:16.264505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:16.265669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:16.272633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.273813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.274451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:16.276289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.276978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.277672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:16.371638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:16.394854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:16.398015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:16.400577 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e11d2374-8ee4-47e4-b30c-7cdc5a3bb139 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1405 microversion: 2.54 time: 0.145729 Oct 12 09:00:16.401510 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2173/4039] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:16 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:16.443246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:00:16.444200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:00:16.444200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:00:16.444836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:00:16.445047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:00:16.458723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.459539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.460178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:16.461197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.461902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.462539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:16.488436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Getting quotas for project fa3a965bdb884e0eb4f37650c30cb3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:00:16.494078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Getting quotas for user 69f6da267d5248518650775b52ca9488 and project fa3a965bdb884e0eb4f37650c30cb3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:00:16.511643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:00:16.514538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:00:16.578980 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-558aec12-e4fb-4cc0-b8fc-cae78fdee1cf tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816219 Oct 12 09:00:16.591969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-74e87e7b-67d7-487b-bb94-592296ed2764 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:16.592967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-74e87e7b-67d7-487b-bb94-592296ed2764 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:16.598737 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1867/4040] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:00:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:00:16.668066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-74e87e7b-67d7-487b-bb94-592296ed2764 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:16.676174 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-74e87e7b-67d7-487b-bb94-592296ed2764 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1208 microversion: 2.1 time: 0.088332 Oct 12 09:00:16.676762 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2174/4041] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:16 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1208 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:16.787542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:16.788572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:16.804195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:16.805250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:16.814931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.815717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.818209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:16.819712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.823985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.825928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:16.826971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.828117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.829431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:16.832582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:16.834888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:16.837249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:17.094779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:17.105556 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-15750e7a-fb12-4a4b-b897-9969faaea0ae tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1465 microversion: 2.1 time: 0.307159 Oct 12 09:00:17.109587 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2175/4042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:16 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1465 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:17.199809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:17.201420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:17.209707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:17.215442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:17.216801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:17.218408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:17.219169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:17.220946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:17.223729 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-952c94ef-72ce-4901-8f8a-68062c768f7d tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1323 microversion: 2.1 time: 0.443073 Oct 12 09:00:17.226077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:17.229148 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1868/4043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:16 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:17.432118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:17.432735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:17.444736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:17.445399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:17.445679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:17.446395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:17.446845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:17.447266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:17.545085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:17.545625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:17.546373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:17.546826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lazy-loading 'fault' on Instance uuid 9d17a962-acae-4b39-879c-d43014570dee {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:17.713629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:17.723816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:17.739706 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a7c816c-56b2-41ca-9227-94ecad882769 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 0.544576 Oct 12 09:00:17.740238 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2176/4044] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:17 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:17.743909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:17.745547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c389163f10194d7c9c44fbf66b3853ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfa18632e44512a4622e78975c6de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:17.746786 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c006b62d-cb6f-4983-87fa-0791518d1856 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 200 len: 1410 microversion: 2.54 time: 0.319851 Oct 12 09:00:17.749368 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1869/4045] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:17 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 1410 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:00:17.766611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:17.769736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:17.780044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:17.780549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:17.781052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:17.781850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:17.782367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:17.783021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:17.806940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:17.880047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:17.893311 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a652a3b-6f9d-4eee-9e16-f1211c32a5b1 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1260 microversion: 2.1 time: 0.143631 Oct 12 09:00:17.896423 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2177/4046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:17 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:18.131561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:18.132461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:18.142647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:18.143300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:18.144416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:18.145461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:18.146103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:18.146735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:18.258579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:18.259202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:18.273150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:18.276534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:18.278914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:18.280837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:18.282835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:18.283856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:18.542596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:18.566169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-edce2623-e25f-4b39-ba85-02df7e3bf6e8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1465 microversion: 2.1 time: 0.429595 Oct 12 09:00:18.567316 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1870/4047] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:18 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1465 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:18.762399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:18.763367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:18.775186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:18.776272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:18.777973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:18.778960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:18.781789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:18.782313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:19.213570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:19.230761 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-74f7e2c7-1db7-4f1b-aead-44c1ac438cc0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 0.464700 Oct 12 09:00:19.234264 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1871/4048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:18 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:19.260345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:19.260968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] [instance: 9d17a962-acae-4b39-879c-d43014570dee] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:19.267342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:19.267823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:19.268261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:19.268970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:19.269554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:19.269869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:19.325011 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] HTTP exception thrown: Instance 9d17a962-acae-4b39-879c-d43014570dee could not be found. Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Request method failure captured: Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee HTTP/1.1 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoHrfqBl6Z-my_6Xu5dzl0oq1P11fIU1pyoBf0onFTTe5vOYIH52ywASh77wrm8iWXamjBHpz51abR0_HVikl3i7iscgFMvKhXsu2Vt1cziDSQ84pruY5LQ_-89_OzRJao2MR7Pz2j1CLEUK80mOBsI4kLY-dnGawgzP7WH-KTHXovk Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.54 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 15cfa18632e44512a4622e78975c6de3 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerShowV254Test-2147253813 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/15cfa18632e44512a4622e78975c6de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/15cfa18632e44512a4622e78975c6de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_15cfa18632e44512a4622e78975c6de3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/15cfa18632e44512a4622e78975c6de3"}]}] Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerShowV254Test-2147253813 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 15cfa18632e44512a4622e78975c6de3 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerShowV254Test-2147253813 Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerShowV254Test-2147253813-project Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c389163f10194d7c9c44fbf66b3853ee Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerShowV254Test-2147253813-project Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 9d17a962-acae-4b39-879c-d43014570dee could not be found. Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '9d17a962-acae-4b39-879c-d43014570dee'} Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d17a962-acae-4b39-879c-d43014570dee could not be found. Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d17a962-acae-4b39-879c-d43014570dee could not be found. Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:19.330293 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:19.334975 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:19.334975 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:19.334975 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:19.334975 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:19.334975 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:19.334975 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d17a962-acae-4b39-879c-d43014570dee could not be found. Oct 12 09:00:19.334975 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:19.338442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] Returning 404 to user: Instance 9d17a962-acae-4b39-879c-d43014570dee could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:19.339635 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cfe5c72d-f527-4d59-af55-3fbb46ac76b9 tempest-ServerShowV254Test-2147253813 tempest-ServerShowV254Test-2147253813-project] 10.222.0.40 "GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee" status: 404 len: 111 microversion: 2.54 time: 0.104361 Oct 12 09:00:19.340499 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1872/4049] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:00:19 2022] GET /compute/v2.1/servers/9d17a962-acae-4b39-879c-d43014570dee => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:00:19.348008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:19.348727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:19.359286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:19.360359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:19.361020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:19.362144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:19.364481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:19.365357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:19.615322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:19.630306 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-30535a2a-0f55-4043-a899-7a15c18960b8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1323 microversion: 2.1 time: 1.379221 Oct 12 09:00:19.633295 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2178/4050] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:18 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1323 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:19.646867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:19.648081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:19.663000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:19.670157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:19.672882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:19.673399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:19.679311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:19.679311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:19.679311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:19.988259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:19.997356 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f3bd1a4b-6684-4216-8771-162123fb34f2 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1266 microversion: 2.1 time: 0.655562 Oct 12 09:00:20.002062 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1873/4051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:19 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1266 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:20.013606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d07acac3-2b06-4ede-98a8-3be4ddcabf02 req-f14cd442-708e-4b9c-b674-283dc7ef4570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddf8ec5-32c7-43b3-87f3-b00275edc4a2", "name": "network-vif-deleted", "tag": "3346424d-8fa9-4d5c-9d38-e57d9f8d800b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:20.043756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d07acac3-2b06-4ede-98a8-3be4ddcabf02 req-f14cd442-708e-4b9c-b674-283dc7ef4570 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:20.045480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d07acac3-2b06-4ede-98a8-3be4ddcabf02 req-f14cd442-708e-4b9c-b674-283dc7ef4570 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:20.046675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d07acac3-2b06-4ede-98a8-3be4ddcabf02 req-f14cd442-708e-4b9c-b674-283dc7ef4570 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:20.072081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:20.078061 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d07acac3-2b06-4ede-98a8-3be4ddcabf02 req-f14cd442-708e-4b9c-b674-283dc7ef4570 service nova] Creating event network-vif-deleted:3346424d-8fa9-4d5c-9d38-e57d9f8d800b for instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 on n-h1-858383-10 Oct 12 09:00:20.082789 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-082a9540-4a22-425b-a322-14634f6ded83 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 200 len: 1465 microversion: 2.1 time: 0.448232 Oct 12 09:00:20.093886 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d07acac3-2b06-4ede-98a8-3be4ddcabf02 req-f14cd442-708e-4b9c-b674-283dc7ef4570 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090055 Oct 12 09:00:20.099546 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2179/4052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:19 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 1465 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:20.106089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-89092065-92e2-40e9-9343-8cf9ca1e1244 req-32e75ffc-4988-4c55-ad31-74e0f25c7e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca001ab-20f9-4fa1-9f9e-7392e869dd6e", "name": "network-vif-plugged", "status": "completed", "tag": "e4ce9ec2-b2bd-493f-ad28-e87eb5ebb575"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:20.111178 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1874/4053] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:20.118862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89092065-92e2-40e9-9343-8cf9ca1e1244 req-32e75ffc-4988-4c55-ad31-74e0f25c7e58 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:20.119647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89092065-92e2-40e9-9343-8cf9ca1e1244 req-32e75ffc-4988-4c55-ad31-74e0f25c7e58 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:20.120282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89092065-92e2-40e9-9343-8cf9ca1e1244 req-32e75ffc-4988-4c55-ad31-74e0f25c7e58 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:20.146748 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-89092065-92e2-40e9-9343-8cf9ca1e1244 req-32e75ffc-4988-4c55-ad31-74e0f25c7e58 service nova] Creating event network-vif-plugged:e4ce9ec2-b2bd-493f-ad28-e87eb5ebb575 for instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e on n-h1-858383-10 Oct 12 09:00:20.171463 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-89092065-92e2-40e9-9343-8cf9ca1e1244 req-32e75ffc-4988-4c55-ad31-74e0f25c7e58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070128 Oct 12 09:00:20.189836 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2180/4054] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:20.257232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:20.260095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:20.291447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:20.292229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:20.294544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:20.296037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:20.298872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:20.302206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:20.658807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:20.659566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:20.672972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:20.673473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:20.677123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:20.678362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:20.679517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:20.680543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:21.249718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:21.300398 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-63844e24-c5fc-4163-a1aa-95c43a996b22 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1323 microversion: 2.1 time: 0.646031 Oct 12 09:00:21.326756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2181/4055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:20 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1323 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:21.340942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:21.341583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:21.361154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:21.362000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:21.363774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:21.364792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:21.365942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:21.366545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:21.441091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:21.455663 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-759637df-9a54-4638-a8d9-73d2595565bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 1.203684 Oct 12 09:00:21.459116 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1875/4056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:20 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:21.471325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:21.478979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: dddf8ec5-32c7-43b3-87f3-b00275edc4a2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:21.509664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:21.513486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:21.516432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:21.517202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:21.517751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:21.518185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:21.609511 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] HTTP exception thrown: Instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 could not be found. Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Request method failure captured: Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 HTTP/1.1 Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoAP365udkWTpc1lydTu7qX_N7CXpUrjOBJr0wez-gl3lAesjFUCh22AjkyEVAwnIIkXt-GCDdntFDiEibPa4HlO8aL-I43zq87pr7cG6va0bJbScEIcJ_YPe04MxPmCpaxDESPZzAPttwxZ8Yj5L5edfZ8gmlofL9kN4xosW0HZYYo Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}] Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 54fad01e2e6e41d0887895b131051ee1 Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 could not be found. Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'dddf8ec5-32c7-43b3-87f3-b00275edc4a2'} Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 could not be found. Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 could not be found. Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:21.611397 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:21.616492 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:21.616492 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:21.616492 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:21.616492 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:21.616492 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:21.616492 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 could not be found. Oct 12 09:00:21.616492 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:21.623257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Returning 404 to user: Instance dddf8ec5-32c7-43b3-87f3-b00275edc4a2 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:21.629401 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5bf55236-99bb-4b21-bbdc-e6eb8409c861 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2" status: 404 len: 111 microversion: 2.1 time: 0.163874 Oct 12 09:00:21.637412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1876/4057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:21 2022] GET /compute/v2.1/servers/dddf8ec5-32c7-43b3-87f3-b00275edc4a2 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:21.646559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:21.647396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:21.662990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:21.663492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:21.663981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:21.664691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:21.665147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:21.666894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:21.742561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:21.969457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:22.023398 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82053fa9-6cdb-4285-8d8d-022db2b5bc0f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "DELETE /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 204 len: 0 microversion: 2.1 time: 0.384487 Oct 12 09:00:22.024030 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1877/4058] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:21 2022] DELETE /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:22.035294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:22.036140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:22.055679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:22.056225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:22.056671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:22.057416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:22.057890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:22.058328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:22.179094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:22.196961 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb2e38b0-01f3-491d-80a4-977fe8be7531 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1308 microversion: 2.1 time: 0.868917 Oct 12 09:00:22.230260 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2182/4059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:21 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1308 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:22.258454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3e576372-b3bc-42b0-bf5d-7de0eb217efc req-dc1b4f4d-265e-4029-bf02-894f37d92433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760dbd63-4283-457c-838e-a2898d1c8a0d", "name": "network-vif-deleted", "tag": "c0536b06-bc86-4031-924a-fa90f1ccc7aa"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:22.282589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3e576372-b3bc-42b0-bf5d-7de0eb217efc req-dc1b4f4d-265e-4029-bf02-894f37d92433 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:22.285657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3e576372-b3bc-42b0-bf5d-7de0eb217efc req-dc1b4f4d-265e-4029-bf02-894f37d92433 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:22.286325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3e576372-b3bc-42b0-bf5d-7de0eb217efc req-dc1b4f4d-265e-4029-bf02-894f37d92433 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:22.314307 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3e576372-b3bc-42b0-bf5d-7de0eb217efc req-dc1b4f4d-265e-4029-bf02-894f37d92433 service nova] Creating event network-vif-deleted:c0536b06-bc86-4031-924a-fa90f1ccc7aa for instance 760dbd63-4283-457c-838e-a2898d1c8a0d on n-h1-858383-10 Oct 12 09:00:22.331140 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3e576372-b3bc-42b0-bf5d-7de0eb217efc req-dc1b4f4d-265e-4029-bf02-894f37d92433 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078636 Oct 12 09:00:22.336202 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2183/4060] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:22.349163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:22.352359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:22.367056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:22.367923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:22.368589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:22.370365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:22.372186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:22.372885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:22.408596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:22.419391 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07a470c6-a339-44f7-acce-ed561d5acae8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1509 microversion: 2.1 time: 0.389865 Oct 12 09:00:22.439280 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1878/4061] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:22 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:22.489290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:22.492442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:22.505638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:22.506474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:22.507861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:22.510583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:22.513631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:22.514365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:22.821523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:22.831511 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53dad261-2e0b-4420-b0be-8dc1edf250a8 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1323 microversion: 2.1 time: 0.493597 Oct 12 09:00:22.832374 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2184/4062] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:22 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:23.092092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:23.101218 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-705ba31e-ed45-4eb8-a84c-658daa93f1bf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 0.620913 Oct 12 09:00:23.133529 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1879/4063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:22 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:23.226850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:23.228107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:23.241308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:23.243930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:23.245898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:23.247404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:23.249200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:23.250342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:23.353359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-33d60952-f302-4b74-8303-7e17f65c2256 req-e2f3d3f8-b5cc-4368-9ba7-97d1d9488dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e1210a-5d85-4f7d-b4d9-eafc517f9c5f", "tag": "2347dc3d-1312-4f06-9294-9921828b24b2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:23.373417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33d60952-f302-4b74-8303-7e17f65c2256 req-e2f3d3f8-b5cc-4368-9ba7-97d1d9488dad service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:23.375242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33d60952-f302-4b74-8303-7e17f65c2256 req-e2f3d3f8-b5cc-4368-9ba7-97d1d9488dad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:23.376937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-33d60952-f302-4b74-8303-7e17f65c2256 req-e2f3d3f8-b5cc-4368-9ba7-97d1d9488dad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:23.404070 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-33d60952-f302-4b74-8303-7e17f65c2256 req-e2f3d3f8-b5cc-4368-9ba7-97d1d9488dad service nova] Creating event network-changed:2347dc3d-1312-4f06-9294-9921828b24b2 for instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f on n-h2-858383-10 Oct 12 09:00:23.410769 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-33d60952-f302-4b74-8303-7e17f65c2256 req-e2f3d3f8-b5cc-4368-9ba7-97d1d9488dad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065005 Oct 12 09:00:23.411980 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1880/4064] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:00:23.454508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:23.455721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:23.489220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:23.490255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:23.493376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:23.495894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:23.497994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:23.498636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:23.520586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:23.533060 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6950398-fbaa-4370-a5cb-7260f759654e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1308 microversion: 2.1 time: 0.311697 Oct 12 09:00:23.537661 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2185/4065] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:23 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:23.856362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:23.857211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:23.867673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:23.871124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:23.871698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:23.872530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:23.873092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:23.873675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.111585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:24.128690 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a3d3ec6-90ff-4337-8405-2e69557b70c8 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1509 microversion: 2.1 time: 0.684764 Oct 12 09:00:24.137285 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1881/4066] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:23 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:24.142432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:24.151453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:24.161889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.162767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.163443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.164368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.165034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.165722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.217237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:24.231538 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5ac93aa6-9249-4ff7-a4f5-82533bd171a1 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1519 microversion: 2.1 time: 0.375437 Oct 12 09:00:24.233566 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2186/4067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:23 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1519 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:24.263936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:24.264911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:24.272775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.273541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.274151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.275032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.275702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.276156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.309965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] HTTP exception thrown: Action 999 not found Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Request method failure captured: Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e/os-instance-actions/999 HTTP/1.1 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoIT8gsXFRhpVZao7iu-2eMU0o6QOLdN2ZPh8OjxGGiitsf-WfoWCvUajnwxLDYahjz_5Vy7a2jDJMMv7HIeBm18cWKys4QgXejok7Pd7vDT-8EQUgzwyAGh-2rteXe7r26di7MPGiLWyhONLm8GzV3s0qwVTMPNGEtKJTw94Z4tYw8 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e7709ffd03864badaa5af03f7e6b3582 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e7709ffd03864badaa5af03f7e6b3582"}]}] Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e7709ffd03864badaa5af03f7e6b3582 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-InstanceActionsNegativeTestJSON-1830369101-project Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d06d354aa8e64d5eb540d98c5abb09c2 Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1830369101-project Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: exception: Action 999 not found Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': '6ca001ab-20f9-4fa1-9f9e-7392e869dd6e', 'id': '999'} Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 12 09:00:24.318950 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:24.325799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Returning 404 to user: Action 999 not found {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:24.325799 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c8dcaf29-43d2-49d4-970c-e947acfce124 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.063776 Oct 12 09:00:24.326263 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2187/4068] 10.222.0.40 () {58 vars in 1308 bytes} [Wed Oct 12 09:00:24 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e/os-instance-actions/999 => generated 66 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 09:00:24.332493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a3eb8dd-999b-46ac-809e-6d7a2ea09d2f tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '.version_select at 0x7f9848a66790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:24.333007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4a3eb8dd-999b-46ac-809e-6d7a2ea09d2f tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 15a37251-3f1e-43de-961b-f8d7fbc6bcd2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:24.339445 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4a3eb8dd-999b-46ac-809e-6d7a2ea09d2f tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] HTTP exception thrown: Instance 15a37251-3f1e-43de-961b-f8d7fbc6bcd2 could not be found. Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a3eb8dd-999b-46ac-809e-6d7a2ea09d2f tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Request method failure captured: Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/15a37251-3f1e-43de-961b-f8d7fbc6bcd2/os-instance-actions HTTP/1.1 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoIT8gsXFRhpVZao7iu-2eMU0o6QOLdN2ZPh8OjxGGiitsf-WfoWCvUajnwxLDYahjz_5Vy7a2jDJMMv7HIeBm18cWKys4QgXejok7Pd7vDT-8EQUgzwyAGh-2rteXe7r26di7MPGiLWyhONLm8GzV3s0qwVTMPNGEtKJTw94Z4tYw8 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e7709ffd03864badaa5af03f7e6b3582 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e7709ffd03864badaa5af03f7e6b3582"}]}] Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e7709ffd03864badaa5af03f7e6b3582 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-InstanceActionsNegativeTestJSON-1830369101-project Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d06d354aa8e64d5eb540d98c5abb09c2 Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1830369101-project Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 15a37251-3f1e-43de-961b-f8d7fbc6bcd2 could not be found. Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': '15a37251-3f1e-43de-961b-f8d7fbc6bcd2'} Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a37251-3f1e-43de-961b-f8d7fbc6bcd2 could not be found. Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:24.344037 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a37251-3f1e-43de-961b-f8d7fbc6bcd2 could not be found. Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a37251-3f1e-43de-961b-f8d7fbc6bcd2 could not be found. Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a3eb8dd-999b-46ac-809e-6d7a2ea09d2f tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Returning 404 to user: Instance 15a37251-3f1e-43de-961b-f8d7fbc6bcd2 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a3eb8dd-999b-46ac-809e-6d7a2ea09d2f tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/15a37251-3f1e-43de-961b-f8d7fbc6bcd2/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.018090 Oct 12 09:00:24.353788 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2188/4069] 10.222.0.40 () {58 vars in 1296 bytes} [Wed Oct 12 09:00:24 2022] GET /compute/v2.1/servers/15a37251-3f1e-43de-961b-f8d7fbc6bcd2/os-instance-actions => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:24.355760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:24.356507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:24.364053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.364550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.365802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.366785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.367631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.367786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.397386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:24.515099 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8d628a38-ac54-409a-835b-d5018f8ecb58 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 204 len: 0 microversion: 2.1 time: 0.162950 Oct 12 09:00:24.515756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2189/4070] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:24 2022] DELETE /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:24.527495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:24.528680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:24.536225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.537149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.537885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.538970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.539594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.540213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.706930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:24.718288 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-360f6542-89b5-4b12-93c6-177b66adf99c tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1525 microversion: 2.1 time: 0.197097 Oct 12 09:00:24.733474 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2190/4071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:24 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1525 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:24.733474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:24.733474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:24.741080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.741783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.742322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.743132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:24.743656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:24.744247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:24.917545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:24.930599 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9cc1c591-1ea4-4afe-a78c-4499899d6c7d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1308 microversion: 2.1 time: 0.203330 Oct 12 09:00:24.931904 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2191/4072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:24 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:25.128224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:25.143513 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-69d05784-b963-42e8-b5b6-285bfb355a1d tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 1.003954 Oct 12 09:00:25.144822 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1882/4073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:24 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:25.165928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:25.167038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:25.175480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:25.176334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:25.176898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:25.180090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:25.181104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:25.181806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:25.437997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:25.451553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb867147-f2cd-4d8e-b336-fd050e26a5a1 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1509 microversion: 2.1 time: 0.289787 Oct 12 09:00:25.474257 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2192/4074] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:25 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:25.743973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:25.745010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:25.760946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:25.761467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:25.765856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:25.766631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:25.767105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:25.767539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:25.956185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:25.956815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:25.971123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:25.971598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:25.972039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:25.972750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:25.973200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:25.974001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:26.475632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:26.507566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:26.673081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:26.704711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:26.713640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db366f48-a54a-4563-b8f5-c77b72cc8cec tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1308 microversion: 2.1 time: 0.761212 Oct 12 09:00:26.719342 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2193/4075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:25 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1308 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:26.724320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:26.729295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:26.751688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:26.752276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:26.752717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:26.755376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:26.755851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:26.757507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:26.803950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:26.816174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7b16aa41-3187-4f03-80cc-6e8327dd9169 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1525 microversion: 2.1 time: 1.077117 Oct 12 09:00:26.819469 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1883/4076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:25 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1525 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:26.843788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-754a466f-ca6f-44d5-8f99-4be25fe4f396 req-4c3c3595-3c0c-41d4-8b63-555c3db5423b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f40117-2505-4d89-a9fd-c3a992cfd9f7", "name": "network-vif-deleted", "tag": "50c148f8-f4f7-4a59-a418-ac508c438101"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:26.880071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-754a466f-ca6f-44d5-8f99-4be25fe4f396 req-4c3c3595-3c0c-41d4-8b63-555c3db5423b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:26.880670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-754a466f-ca6f-44d5-8f99-4be25fe4f396 req-4c3c3595-3c0c-41d4-8b63-555c3db5423b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:26.881274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-754a466f-ca6f-44d5-8f99-4be25fe4f396 req-4c3c3595-3c0c-41d4-8b63-555c3db5423b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:26.905618 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-754a466f-ca6f-44d5-8f99-4be25fe4f396 req-4c3c3595-3c0c-41d4-8b63-555c3db5423b service nova] Creating event network-vif-deleted:50c148f8-f4f7-4a59-a418-ac508c438101 for instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 on n-h2-858383-10 Oct 12 09:00:26.914263 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-754a466f-ca6f-44d5-8f99-4be25fe4f396 req-4c3c3595-3c0c-41d4-8b63-555c3db5423b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082184 Oct 12 09:00:26.917089 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1884/4077] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:26.928615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:26.937041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:26.956513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:26.957022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:26.957696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:26.959101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:26.959961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:26.960559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:27.029073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:27.029616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:27.030111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:27.030505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lazy-loading 'fault' on Instance uuid 81f40117-2505-4d89-a9fd-c3a992cfd9f7 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:27.141594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:27.151898 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d953a8cc-992c-48ec-ab9e-b2571f32fa19 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 200 len: 1305 microversion: 2.1 time: 0.228185 Oct 12 09:00:27.155590 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1885/4078] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:26 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 1305 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:27.176630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:27.203563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:27.211813 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42be49ab-4bf9-476c-bc60-6fc97f3d27ac tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 0.491118 Oct 12 09:00:27.213228 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2194/4079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:26 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:27.737189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:27.738159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:27.749773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:27.750274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:27.750720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:27.763552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:27.769203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:27.770144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:27.849763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:27.850384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:27.873821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:27.874336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:27.877035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:27.879965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:27.880493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:27.881204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:27.941337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:27.942188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:27.942934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:27.943609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lazy-loading 'fault' on Instance uuid 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:28.085076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:28.090494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:28.109688 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c0e732c4-6a63-43ea-a3cf-8b1c4ba31b4b tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1308 microversion: 2.1 time: 0.377222 Oct 12 09:00:28.118325 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ea9477e5-17a6-497c-b6c2-b5e4be9f1202 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1313 microversion: 2.1 time: 0.272644 Oct 12 09:00:28.134056 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2195/4080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:27 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:28.134162 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1886/4081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:27 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:28.183129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:28.184300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 81f40117-2505-4d89-a9fd-c3a992cfd9f7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:28.208227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:28.209924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:28.210583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:28.211739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:28.212341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:28.213684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:28.240235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:28.240762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:28.269845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:28.270380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:28.277042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:28.279699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:28.280233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:28.282988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:28.294594 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] HTTP exception thrown: Instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 could not be found. Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Request method failure captured: Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 HTTP/1.1 Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoAP365udkWTpc1lydTu7qX_N7CXpUrjOBJr0wez-gl3lAesjFUCh22AjkyEVAwnIIkXt-GCDdntFDiEibPa4HlO8aL-I43zq87pr7cG6va0bJbScEIcJ_YPe04MxPmCpaxDESPZzAPttwxZ8Yj5L5edfZ8gmlofL9kN4xosW0HZYYo Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}] Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 54fad01e2e6e41d0887895b131051ee1 Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 could not be found. Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '81f40117-2505-4d89-a9fd-c3a992cfd9f7'} Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 could not be found. Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 could not be found. Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:28.303485 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:28.309029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:28.309029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:28.309029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:28.309029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:28.309029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:28.309029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 could not be found. Oct 12 09:00:28.309029 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:28.311639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Returning 404 to user: Instance 81f40117-2505-4d89-a9fd-c3a992cfd9f7 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:28.312797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b76da64-2bb3-4c36-af1c-8cc17f984637 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7" status: 404 len: 111 microversion: 2.1 time: 0.138719 Oct 12 09:00:28.314136 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2196/4082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:28 2022] GET /compute/v2.1/servers/81f40117-2505-4d89-a9fd-c3a992cfd9f7 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:00:28.323126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:28.325048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:28.337375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:28.341171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:28.341912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:28.366366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:28.371593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:28.375574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:28.449029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:28.630651 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-467fb16c-f36c-41ca-b673-5e57528086da tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "DELETE /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 204 len: 0 microversion: 2.1 time: 0.311761 Oct 12 09:00:28.631251 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2197/4083] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:28 2022] DELETE /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:28.641878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:28.642595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:28.659982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:28.664250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:28.664972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:28.665998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:28.666621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:28.667209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:29.123450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:29.134561 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b024f0be-3aa2-47f5-839d-7b23d93f764a tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1496 microversion: 2.1 time: 0.496854 Oct 12 09:00:29.135473 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2198/4084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:28 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1496 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:29.143074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:29.145043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:29.160788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:29.165063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:29.165554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:29.166339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:29.166818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:29.167256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:29.240482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:29.240993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:29.241479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:29.241932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lazy-loading 'fault' on Instance uuid 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:29.299612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd06d354aa8e64d5eb540d98c5abb09c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7709ffd03864badaa5af03f7e6b3582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:29.312242 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-439470f9-cf68-4e93-afca-389eecd961ba tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 200 len: 1313 microversion: 2.1 time: 0.173398 Oct 12 09:00:29.313490 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2199/4085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:29 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:29.318603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:29.319452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:29.326847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:29.327604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:29.328227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:29.329352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:29.330009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:29.330596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:29.460949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:29.475283 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3e93b899-952f-4473-9ace-6ae520683abf tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1528 microversion: 2.1 time: 1.239507 Oct 12 09:00:29.476187 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1887/4086] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:28 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1528 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:29.488603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ed152df7-14c3-4f71-923b-a023e63d788f req-133b0734-96d4-4c93-b8a2-bb21f93104ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca001ab-20f9-4fa1-9f9e-7392e869dd6e", "name": "network-vif-deleted", "tag": "e4ce9ec2-b2bd-493f-ad28-e87eb5ebb575"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:29.507397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ed152df7-14c3-4f71-923b-a023e63d788f req-133b0734-96d4-4c93-b8a2-bb21f93104ff service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:29.510119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ed152df7-14c3-4f71-923b-a023e63d788f req-133b0734-96d4-4c93-b8a2-bb21f93104ff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:29.510823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ed152df7-14c3-4f71-923b-a023e63d788f req-133b0734-96d4-4c93-b8a2-bb21f93104ff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:29.546464 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ed152df7-14c3-4f71-923b-a023e63d788f req-133b0734-96d4-4c93-b8a2-bb21f93104ff service nova] Creating event network-vif-deleted:e4ce9ec2-b2bd-493f-ad28-e87eb5ebb575 for instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e on n-h1-858383-10 Oct 12 09:00:29.552145 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ed152df7-14c3-4f71-923b-a023e63d788f req-133b0734-96d4-4c93-b8a2-bb21f93104ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074585 Oct 12 09:00:29.553393 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1888/4087] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:29.686339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:29.710382 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0230a6f-40a5-4209-ad9c-8e21c3ab996d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1308 microversion: 2.1 time: 0.395270 Oct 12 09:00:29.726454 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2200/4088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:29 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:30.160276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:30.160950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:30.175204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.175794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.177012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:30.178155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.178746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.179369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:30.234590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-36d01696-0ff0-4a60-9fa5-0014865647de req-5480b408-4268-412c-bd0d-2c9daec530ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e1210a-5d85-4f7d-b4d9-eafc517f9c5f", "name": "network-vif-plugged", "status": "completed", "tag": "2347dc3d-1312-4f06-9294-9921828b24b2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:30.259236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36d01696-0ff0-4a60-9fa5-0014865647de req-5480b408-4268-412c-bd0d-2c9daec530ec service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.260542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36d01696-0ff0-4a60-9fa5-0014865647de req-5480b408-4268-412c-bd0d-2c9daec530ec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.261087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36d01696-0ff0-4a60-9fa5-0014865647de req-5480b408-4268-412c-bd0d-2c9daec530ec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:30.278054 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-36d01696-0ff0-4a60-9fa5-0014865647de req-5480b408-4268-412c-bd0d-2c9daec530ec service nova] Creating event network-vif-plugged:2347dc3d-1312-4f06-9294-9921828b24b2 for instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f on n-h2-858383-10 Oct 12 09:00:30.286998 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-36d01696-0ff0-4a60-9fa5-0014865647de req-5480b408-4268-412c-bd0d-2c9daec530ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221610 Oct 12 09:00:30.288383 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1889/4089] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:30.343984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:30.344953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] [instance: 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:30.354948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.355746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.356378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:30.357297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.358105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.358705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:30.375138 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] HTTP exception thrown: Instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e could not be found. Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Request method failure captured: Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e HTTP/1.1 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoIT8gsXFRhpVZao7iu-2eMU0o6QOLdN2ZPh8OjxGGiitsf-WfoWCvUajnwxLDYahjz_5Vy7a2jDJMMv7HIeBm18cWKys4QgXejok7Pd7vDT-8EQUgzwyAGh-2rteXe7r26di7MPGiLWyhONLm8GzV3s0qwVTMPNGEtKJTw94Z4tYw8 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e7709ffd03864badaa5af03f7e6b3582 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e7709ffd03864badaa5af03f7e6b3582"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e7709ffd03864badaa5af03f7e6b3582"}]}] Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e7709ffd03864badaa5af03f7e6b3582 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1830369101 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-InstanceActionsNegativeTestJSON-1830369101-project Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d06d354aa8e64d5eb540d98c5abb09c2 Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1830369101-project Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e could not be found. Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '6ca001ab-20f9-4fa1-9f9e-7392e869dd6e'} Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e could not be found. Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e could not be found. Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:30.386624 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:30.392006 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:30.392006 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:30.392006 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:30.392006 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:30.392006 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:30.392006 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:30.392006 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e could not be found. Oct 12 09:00:30.392006 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:30.394965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] Returning 404 to user: Instance 6ca001ab-20f9-4fa1-9f9e-7392e869dd6e could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:30.396144 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa167dc3-0580-4e7e-9fae-4a207c10ff72 tempest-InstanceActionsNegativeTestJSON-1830369101 tempest-InstanceActionsNegativeTestJSON-1830369101-project] 10.222.0.40 "GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e" status: 404 len: 111 microversion: 2.1 time: 0.059417 Oct 12 09:00:30.397228 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1890/4090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:30 2022] GET /compute/v2.1/servers/6ca001ab-20f9-4fa1-9f9e-7392e869dd6e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:30.403593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:30.413398 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7a6becb0-3c75-431b-80e1-465ad27f9c4f tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1496 microversion: 2.1 time: 0.258049 Oct 12 09:00:30.414774 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2201/4091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:30 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1496 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:30.507055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:30.507629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:30.517303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.521429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.522244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:30.523769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.526861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.527807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:30.736612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:30.737260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:30.747132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.747717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.748554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:30.749667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:30.750375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:30.751028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:31.006277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:31.020282 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae48c5fb-c9b3-402b-82e4-3bb0a06016c5 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1308 microversion: 2.1 time: 0.288641 Oct 12 09:00:31.021644 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2202/4092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:30 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1308 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:31.117187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:31.133154 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3c572640-f6cc-4a44-848f-a7ec4eb36469 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1510 microversion: 2.1 time: 0.630119 Oct 12 09:00:31.152984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1891/4093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:30 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1510 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:31.438209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:31.441037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:31.453179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:31.458572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:31.460795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:31.463716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:31.464487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:31.466413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:31.608052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-fb81767e-a2f7-406f-915d-8a2f22ef0cfd req-11daa36f-618f-45a3-8d5f-0109e17b8553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059f5eeb-8abc-4a2d-85d7-1832d79f9054", "name": "network-vif-deleted", "tag": "f78111ff-c4de-4d2e-8495-2c6be34e1d8f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:31.634516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fb81767e-a2f7-406f-915d-8a2f22ef0cfd req-11daa36f-618f-45a3-8d5f-0109e17b8553 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:31.637840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fb81767e-a2f7-406f-915d-8a2f22ef0cfd req-11daa36f-618f-45a3-8d5f-0109e17b8553 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:31.639174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fb81767e-a2f7-406f-915d-8a2f22ef0cfd req-11daa36f-618f-45a3-8d5f-0109e17b8553 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:31.659458 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-fb81767e-a2f7-406f-915d-8a2f22ef0cfd req-11daa36f-618f-45a3-8d5f-0109e17b8553 service nova] Creating event network-vif-deleted:f78111ff-c4de-4d2e-8495-2c6be34e1d8f for instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 on n-h1-858383-10 Oct 12 09:00:31.666862 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-fb81767e-a2f7-406f-915d-8a2f22ef0cfd req-11daa36f-618f-45a3-8d5f-0109e17b8553 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062187 Oct 12 09:00:31.667723 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1892/4094] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:00:31.693479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:31.707863 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1e9fa54a-0a64-4f1b-9761-9cf21b5ad641 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 200 len: 1287 microversion: 2.1 time: 0.273792 Oct 12 09:00:31.708551 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2203/4095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:31 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 1287 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:32.053919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:32.055046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:32.062686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.063612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.064340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.065324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.066082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.066725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.164938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:32.167347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:32.193096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.193729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.197189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.199631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.203642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.204746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.613892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:32.629917 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f6d36e71-dec8-46d9-b8cd-666f4d117fa8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1510 microversion: 2.1 time: 0.469438 Oct 12 09:00:32.645165 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2204/4096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:32 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:32.707756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:32.722905 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54d43bd8-2f62-48b3-bfc5-34848391624d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1308 microversion: 2.1 time: 0.678032 Oct 12 09:00:32.733806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:32.734435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 059f5eeb-8abc-4a2d-85d7-1832d79f9054] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:32.738375 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1893/4097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:32 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1308 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:32.746459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.746970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.750074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.750884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.751351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.752446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.810495 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] HTTP exception thrown: Instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 could not be found. Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Request method failure captured: Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 HTTP/1.1 Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoAP365udkWTpc1lydTu7qX_N7CXpUrjOBJr0wez-gl3lAesjFUCh22AjkyEVAwnIIkXt-GCDdntFDiEibPa4HlO8aL-I43zq87pr7cG6va0bJbScEIcJ_YPe04MxPmCpaxDESPZzAPttwxZ8Yj5L5edfZ8gmlofL9kN4xosW0HZYYo Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}] Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 54fad01e2e6e41d0887895b131051ee1 Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 could not be found. Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '059f5eeb-8abc-4a2d-85d7-1832d79f9054'} Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 could not be found. Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 could not be found. Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:32.813471 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:32.818745 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:32.818745 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:32.818745 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:32.818745 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:32.818745 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:32.818745 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 could not be found. Oct 12 09:00:32.818745 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:32.820571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Returning 404 to user: Instance 059f5eeb-8abc-4a2d-85d7-1832d79f9054 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:32.821643 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4d19cc59-9758-4296-9efc-646c612ffe43 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054" status: 404 len: 111 microversion: 2.1 time: 0.092505 Oct 12 09:00:32.822522 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2205/4098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:32 2022] GET /compute/v2.1/servers/059f5eeb-8abc-4a2d-85d7-1832d79f9054 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:00:32.830645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:32.831136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:32.837328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.837910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.838346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.839049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.839494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.840142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.875797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:32.979635 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b761701b-b078-4595-98d2-a267c47a4936 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "DELETE /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 204 len: 0 microversion: 2.1 time: 0.152553 Oct 12 09:00:32.980842 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1894/4099] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:32 2022] DELETE /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:32.988835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:32.990221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:32.996949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:32.997806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:32.998410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:32.999417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:33.000101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:33.000699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:33.409560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:33.420610 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69db5515-a118-4621-9502-fce522418d06 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1676 microversion: 2.1 time: 0.434322 Oct 12 09:00:33.437619 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2206/4100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:32 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1676 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:33.665234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:33.666736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:33.726695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:33.734876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:33.735330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:33.742788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:33.743269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:33.743826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:33.756594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:33.757973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:33.777827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:33.789777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:33.790541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:33.797791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:33.798519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:33.802513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:34.206269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:34.217191 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a0c1cdd4-2db0-424f-bdac-62af3b9ffa61 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1488 microversion: 2.1 time: 0.465888 Oct 12 09:00:34.218694 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2207/4101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:33 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1488 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:34.228200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-29baed68-5dfb-4516-bafd-da8a0ae2ea6d req-3fdda609-9662-407d-b7fc-020d6deddb40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a870435b-8aa5-456d-b0ca-477ee2201dbb", "name": "network-vif-unplugged", "status": "completed", "tag": "100f519d-4457-4d8b-acb1-e0e088317a35"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:34.253584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-29baed68-5dfb-4516-bafd-da8a0ae2ea6d req-3fdda609-9662-407d-b7fc-020d6deddb40 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:34.254459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-29baed68-5dfb-4516-bafd-da8a0ae2ea6d req-3fdda609-9662-407d-b7fc-020d6deddb40 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:34.255218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-29baed68-5dfb-4516-bafd-da8a0ae2ea6d req-3fdda609-9662-407d-b7fc-020d6deddb40 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:34.260659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:34.280324 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-730ebe0d-2129-4fb5-b1ac-d64eb3a7ab8a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1510 microversion: 2.1 time: 0.616821 Oct 12 09:00:34.282816 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1895/4102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:33 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1510 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:34.313755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1293553281"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:34.316788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:34.320630 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-29baed68-5dfb-4516-bafd-da8a0ae2ea6d req-3fdda609-9662-407d-b7fc-020d6deddb40 service nova] Creating event network-vif-unplugged:100f519d-4457-4d8b-acb1-e0e088317a35 for instance a870435b-8aa5-456d-b0ca-477ee2201dbb on n-h2-858383-10 Oct 12 09:00:34.335252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-29baed68-5dfb-4516-bafd-da8a0ae2ea6d req-3fdda609-9662-407d-b7fc-020d6deddb40 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114205 Oct 12 09:00:34.338809 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2208/4103] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:34.350583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:34.351330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:34.352057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:34.357570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:34.358347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:34.359189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:34.393553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:34.447997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:34.452539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:34.466691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:34.470980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:34.473051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:34.474051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:34.477003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:34.477888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:34.740880 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-59c2d921-3375-4d4c-b225-da62b25cd497 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "POST /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f/action" status: 202 len: 0 microversion: 2.1 time: 0.456151 Oct 12 09:00:34.745867 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1896/4104] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:00:34 2022] POST /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 09:00:34.752569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b48cb075-bc26-462e-b2ec-b8615b6d1db8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848e13040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:34.828900 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b48cb075-bc26-462e-b2ec-b8615b6d1db8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d" status: 200 len: 1412 microversion: 2.1 time: 0.080324 Oct 12 09:00:34.847029 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1897/4105] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:34 2022] GET /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:34.858821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db7b6713-37f5-43cd-87bb-c7d3faac4218 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848df5a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:34.929129 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db7b6713-37f5-43cd-87bb-c7d3faac4218 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d" status: 200 len: 1412 microversion: 2.1 time: 0.073758 Oct 12 09:00:34.936640 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1898/4106] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:34 2022] GET /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:34.946491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eef0e202-e0b0-444f-aac3-891a286a80d7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f984ccf18b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:35.152006 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eef0e202-e0b0-444f-aac3-891a286a80d7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d" status: 204 len: 0 microversion: 2.1 time: 0.209335 Oct 12 09:00:35.153094 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1899/4107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:34 2022] DELETE /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:35.163125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5edc5023-4287-4af2-bd7b-e99edf403e16 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848e13790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:35.205913 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5edc5023-4287-4af2-bd7b-e99edf403e16 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Image not found. Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5edc5023-4287-4af2-bd7b-e99edf403e16 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d HTTP/1.1 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '78f54f4b-1edd-4553-9747-9c39fff9b11d'} Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 78f54f4b-1edd-4553-9747-9c39fff9b11d Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 12 09:00:35.208108 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 78f54f4b-1edd-4553-9747-9c39fff9b11d could not be found. Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5edc5023-4287-4af2-bd7b-e99edf403e16 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5edc5023-4287-4af2-bd7b-e99edf403e16 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d" status: 404 len: 62 microversion: 2.1 time: 0.050443 Oct 12 09:00:35.216088 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1900/4108] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:00:35 2022] GET /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:00:35.224780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:35.224780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:35.235591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:35.240157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:35.242562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:35.243039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:35.248252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:35.248937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:35.249734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:35.258234 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4c384128-ffc5-4082-9dd7-440be78f0842 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1676 microversion: 2.1 time: 0.816423 Oct 12 09:00:35.261153 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2209/4109] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:34 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1676 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:35.303095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:35.304392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:35.313316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:35.315737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:35.324993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:35.327129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:35.328754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:35.329975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:35.535023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:35.543809 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-73e5e544-fe56-4df5-871f-bef2153983c6 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1508 microversion: 2.1 time: 0.328900 Oct 12 09:00:35.547333 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1901/4110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:35 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:35.789463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:35.799981 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-32328171-6153-4c9d-9309-41a758b5ebae tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1510 microversion: 2.1 time: 0.500826 Oct 12 09:00:35.809890 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2210/4111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:35 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:36.283360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:36.284842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:36.289800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:36.306797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:36.308991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:36.310625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:36.314545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:36.316328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:36.317195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:36.574840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:36.576773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:36.585992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:36.600870 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8e81bf0-ca91-45bf-b7e4-9c0a869f7f22 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1676 microversion: 2.1 time: 0.322233 Oct 12 09:00:36.602083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:36.602679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:36.602938 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1902/4112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:36 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1676 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:36.604111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:36.605994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:36.606672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:36.607327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:36.630737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:36.826662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:36.836913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:36.860498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:36.862223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:36.863045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:36.867436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:36.870223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:36.871136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:37.232510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:37.246518 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4b0422a7-7f6e-4598-9c39-0dddd2f4a5dd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1453 microversion: 2.1 time: 0.422829 Oct 12 09:00:37.248505 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1903/4113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:36 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1453 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:37.250262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:37.272596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:37.272596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:37.278531 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b744e777-b19c-42d9-8567-7da6f3c76352 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1500 microversion: 2.1 time: 0.708976 Oct 12 09:00:37.280932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:37.282022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:37.283034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:37.284234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:37.284795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:37.285010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:37.289550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2211/4114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:36 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1500 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:37.631701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:37.633406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:37.644668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:37.645125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:37.645610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:37.646332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:37.646787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:37.647208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:37.675507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:37.687678 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c74dd979-fb81-4e04-976b-88e8682e374f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1453 microversion: 2.1 time: 0.420496 Oct 12 09:00:37.696766 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1904/4115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:37 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1453 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:37.769365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:37.771553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:37.787027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:37.787530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:37.787972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:37.788844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:37.789658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:37.789803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:37.807447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:37.823341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a7e6694-19d2-46be-977a-7cf11102f22d tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1608 microversion: 2.1 time: 0.193575 Oct 12 09:00:37.825830 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2212/4116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:37 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1608 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:37.858902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lazy-loading 'flavor' on Instance uuid a870435b-8aa5-456d-b0ca-477ee2201dbb {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:37.895398 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Cannot 'shelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state shelved_offloaded Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action HTTP/1.1 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 14 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: {"shelve": {}} Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'shelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state shelved_offloaded Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'shelve': {}}} Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 09:00:37.897002 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state shelved_offloaded Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state shelved_offloaded Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 409 to user: Cannot 'shelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state shelved_offloaded {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:37.902575 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86efc0c3-5fad-4b7d-bf3e-acc6e753f97f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 409 len: 155 microversion: 2.1 time: 0.133371 Oct 12 09:00:37.904286 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1905/4117] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:00:37 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 155 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:00:37.912915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:37.914435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:37.925125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:37.930250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:37.930847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:37.931746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:37.934286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:37.934836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:38.018329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127006) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 12 09:00:38.062124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5fe16673-ac17-4055-8088-6ef4d1a49932 req-1761fe45-8c27-4ce5-a0b0-54a574c1cf44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cfc40a-e74e-425f-9ff8-a23531e1f956", "name": "network-vif-deleted", "tag": "ec22031f-aaca-448c-b422-39c89ca9e237"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:38.111470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5fe16673-ac17-4055-8088-6ef4d1a49932 req-1761fe45-8c27-4ce5-a0b0-54a574c1cf44 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:38.112777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5fe16673-ac17-4055-8088-6ef4d1a49932 req-1761fe45-8c27-4ce5-a0b0-54a574c1cf44 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:38.113600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5fe16673-ac17-4055-8088-6ef4d1a49932 req-1761fe45-8c27-4ce5-a0b0-54a574c1cf44 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:38.128268 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5fe16673-ac17-4055-8088-6ef4d1a49932 req-1761fe45-8c27-4ce5-a0b0-54a574c1cf44 service nova] Creating event network-vif-deleted:ec22031f-aaca-448c-b422-39c89ca9e237 for instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 on n-h2-858383-10 Oct 12 09:00:38.134473 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5fe16673-ac17-4055-8088-6ef4d1a49932 req-1761fe45-8c27-4ce5-a0b0-54a574c1cf44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077524 Oct 12 09:00:38.136060 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1906/4118] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:38.185645 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dc0744d1-71ed-431b-9e1a-3f380b5a17be tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.278044 Oct 12 09:00:38.187015 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2213/4119] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:00:37 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:00:38.195887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:38.200629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:38.224569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:38.225354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:38.226917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:38.232308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:38.233662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:38.234511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:38.312188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:38.313559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:38.339247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:38.340876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:38.342194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:38.344830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:38.345605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:38.347649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:39.105627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:39.117889 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-11492215-3833-4f84-bbdf-f3492f3cc822 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1461 microversion: 2.1 time: 0.926464 Oct 12 09:00:39.118746 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1907/4120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:38 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1461 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:39.123366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:39.123977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:39.136362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:39.138659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:39.139223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:39.140237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:39.140781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:39.142854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:39.220950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:39.221976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:39.223165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:39.223873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lazy-loading 'fault' on Instance uuid 77cfc40a-e74e-425f-9ff8-a23531e1f956 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:39.297233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fad01e2e6e41d0887895b131051ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cad6e327a84a128250f945ec1444ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:39.310855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d919588-990a-4412-bca3-c625ea2dcbd6 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 200 len: 1327 microversion: 2.1 time: 0.190950 Oct 12 09:00:39.320419 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1908/4121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:39 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 1327 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:39.560706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:39.575372 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad2adedc-d58b-45d4-9da8-a7a84efe9c0e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1506 microversion: 2.1 time: 1.268138 Oct 12 09:00:39.586243 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2214/4122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:38 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1506 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:40.083715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cb027a21-24fb-4b18-8e23-f88e3b07d801 tempest-QuotaClassesAdminTestJSON-72084775 tempest-QuotaClassesAdminTestJSON-72084775-project-admin] Calling method '.version_select at 0x7f9848856280>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:40.105829 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cb027a21-24fb-4b18-8e23-f88e3b07d801 tempest-QuotaClassesAdminTestJSON-72084775 tempest-QuotaClassesAdminTestJSON-72084775-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.309847 Oct 12 09:00:40.108127 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1909/4123] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 12 09:00:39 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:40.132541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04ebcd79-2ac5-4092-afb8-d607757ec68e tempest-QuotaClassesAdminTestJSON-72084775 tempest-QuotaClassesAdminTestJSON-72084775-project-admin] Action: 'update', calling method: .version_select at 0x7f9843f4dc10>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:40.140264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:40.141347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:40.150646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:40.152291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:40.152745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:40.153479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:40.156552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:40.157706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:40.194665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=6,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:40.406317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:40.417198 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cd9e9e63-53fb-4545-8613-83b61b274ade tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1461 microversion: 2.1 time: 0.280761 Oct 12 09:00:40.418376 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1910/4124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:40 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1461 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:40.436103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:40.437428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] [instance: 77cfc40a-e74e-425f-9ff8-a23531e1f956] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:40.445500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:40.446214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:40.446954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:40.447851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:40.449988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:40.450757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:40.476596 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] HTTP exception thrown: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 could not be found. Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Request method failure captured: Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 HTTP/1.1 Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoAP365udkWTpc1lydTu7qX_N7CXpUrjOBJr0wez-gl3lAesjFUCh22AjkyEVAwnIIkXt-GCDdntFDiEibPa4HlO8aL-I43zq87pr7cG6va0bJbScEIcJ_YPe04MxPmCpaxDESPZzAPttwxZ8Yj5L5edfZ8gmlofL9kN4xosW0HZYYo Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f1cad6e327a84a128250f945ec1444ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f1cad6e327a84a128250f945ec1444ac"}]}] Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: f1cad6e327a84a128250f945ec1444ac Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-758128117 Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 54fad01e2e6e41d0887895b131051ee1 Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-758128117-project Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 could not be found. Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '77cfc40a-e74e-425f-9ff8-a23531e1f956'} Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 could not be found. Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 could not be found. Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:40.480270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:40.485695 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:40.485695 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:40.485695 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:40.485695 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:40.485695 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:40.485695 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 could not be found. Oct 12 09:00:40.485695 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:40.487763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Returning 404 to user: Instance 77cfc40a-e74e-425f-9ff8-a23531e1f956 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:40.489091 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-adb7e1fa-87bd-4681-ac48-039d8b645282 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956" status: 404 len: 111 microversion: 2.1 time: 0.069325 Oct 12 09:00:40.490979 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1911/4125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:40 2022] GET /compute/v2.1/servers/77cfc40a-e74e-425f-9ff8-a23531e1f956 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:40.511382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b27f7216-cc27-4fb4-88f3-0e8f301b1d32 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] Calling method '.version_select at 0x7f9848c1ca60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:40.571270 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b27f7216-cc27-4fb4-88f3-0e8f301b1d32 tempest-ServerActionsTestJSON-758128117 tempest-ServerActionsTestJSON-758128117-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-979373535" status: 202 len: 0 microversion: 2.1 time: 0.074159 Oct 12 09:00:40.589628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1912/4126] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 09:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-979373535 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:00:40.606749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:40.608077 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04ebcd79-2ac5-4092-afb8-d607757ec68e tempest-QuotaClassesAdminTestJSON-72084775 tempest-QuotaClassesAdminTestJSON-72084775-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.481225 Oct 12 09:00:40.608775 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2215/4127] 10.222.0.40 () {60 vars in 1206 bytes} [Wed Oct 12 09:00:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:40.610665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:40.629292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d23a0a11-c7cc-4b57-b9ec-458e6160d2a7 tempest-QuotaClassesAdminTestJSON-72084775 tempest-QuotaClassesAdminTestJSON-72084775-project-admin] Calling method '.version_select at 0x7f98490dbdc0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:40.648709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:40.649217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:40.654291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:40.655089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:40.655566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:40.656007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:40.677950 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d23a0a11-c7cc-4b57-b9ec-458e6160d2a7 tempest-QuotaClassesAdminTestJSON-72084775 tempest-QuotaClassesAdminTestJSON-72084775-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.057828 Oct 12 09:00:40.678929 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2216/4128] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 12 09:00:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:40.699844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63df728c-9840-4146-a2ad-116f4038663e tempest-QuotaClassesAdminTestJSON-72084775 tempest-QuotaClassesAdminTestJSON-72084775-project-admin] Action: 'update', calling method: .version_select at 0x7f9843fa8ee0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:40.904950 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-63df728c-9840-4146-a2ad-116f4038663e tempest-QuotaClassesAdminTestJSON-72084775 tempest-QuotaClassesAdminTestJSON-72084775-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.217332 Oct 12 09:00:40.906509 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2217/4129] 10.222.0.40 () {60 vars in 1206 bytes} [Wed Oct 12 09:00:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:40.972976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:40.987375 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b96a6ec-4f4b-4343-beaf-85f5771db9aa tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1488 microversion: 2.1 time: 0.387076 Oct 12 09:00:40.988357 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1913/4130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:40 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1488 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:41.014486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:41.014985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:41.033481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:41.034057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:41.034359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:41.035183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:41.035542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:41.035970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:41.097939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:41.327346 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f28f5027-a0c7-475b-86b7-f14a90a9efdb tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 204 len: 0 microversion: 2.1 time: 0.316285 Oct 12 09:00:41.330412 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2218/4131] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:41 2022] DELETE /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:41.345249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-394a4d16-05c4-456e-96c3-93845ece8763 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848c1ca60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:41.374211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-394a4d16-05c4-456e-96c3-93845ece8763 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Image not found. Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-394a4d16-05c4-456e-96c3-93845ece8763 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d HTTP/1.1 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '78f54f4b-1edd-4553-9747-9c39fff9b11d'} Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 78f54f4b-1edd-4553-9747-9c39fff9b11d to delete Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 78f54f4b-1edd-4553-9747-9c39fff9b11d could not be found. Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:41.376944 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-394a4d16-05c4-456e-96c3-93845ece8763 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:41.386520 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-394a4d16-05c4-456e-96c3-93845ece8763 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d" status: 404 len: 62 microversion: 2.1 time: 0.037874 Oct 12 09:00:41.391622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:41.391622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:41.392425 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1914/4132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:41 2022] DELETE /compute/v2.1/images/78f54f4b-1edd-4553-9747-9c39fff9b11d => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:00:41.395704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:41.396690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:41.397665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:41.398854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:41.399717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:41.400352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:41.436734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:00:41.443937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:41.444891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:41.457794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:41.459091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:41.466966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:41.467967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:41.468597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:41.469204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:41.542574 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.compute.api [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Instance is already in deleting state, ignoring this request Oct 12 09:00:41.543601 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8aefcf32-b75e-4986-a474-c1cfe4cc0e72 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 204 len: 0 microversion: 2.1 time: 0.159920 Oct 12 09:00:41.547949 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2219/4133] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:41 2022] DELETE /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:41.554770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:41.555633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:41.563002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:41.563735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:41.564345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:41.565208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:41.566051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:41.566276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:41.959159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:41.967303 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8832f1e6-522a-4c06-847e-61cfee5344c8 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1494 microversion: 2.1 time: 0.418014 Oct 12 09:00:41.967896 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2220/4134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:41 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1494 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:42.187681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:42.202957 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5fb87b1-97e6-4f53-8cea-585021ca3133 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.761518 Oct 12 09:00:42.205312 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1915/4135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:41 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:42.992963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:42.994403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:43.017084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:43.018032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:43.018735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:43.019719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:43.023559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:43.024295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:43.230384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:43.231765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:43.239229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:43.240085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:43.240733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:43.241662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:43.242302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:43.242937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:43.248173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:43.264440 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0637e069-8b50-4eeb-b88d-219ec332c000 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1494 microversion: 2.1 time: 0.275268 Oct 12 09:00:43.267976 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2221/4136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:42 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1494 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:43.780541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:43.800999 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-409767f7-7e42-42b3-b8e0-1a462811b74f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.568649 Oct 12 09:00:43.801989 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1916/4137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:43 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:44.058096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-74f26fbf-9fa2-4e03-a213-275e2e9ec858 req-b936e071-cd71-4825-a09c-06f025ec3a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a870435b-8aa5-456d-b0ca-477ee2201dbb", "tag": "100f519d-4457-4d8b-acb1-e0e088317a35"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:44.084346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-74f26fbf-9fa2-4e03-a213-275e2e9ec858 req-b936e071-cd71-4825-a09c-06f025ec3a61 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:44.084839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-74f26fbf-9fa2-4e03-a213-275e2e9ec858 req-b936e071-cd71-4825-a09c-06f025ec3a61 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:44.085313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-74f26fbf-9fa2-4e03-a213-275e2e9ec858 req-b936e071-cd71-4825-a09c-06f025ec3a61 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:44.136922 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-74f26fbf-9fa2-4e03-a213-275e2e9ec858 req-b936e071-cd71-4825-a09c-06f025ec3a61 service nova] Creating event network-changed:100f519d-4457-4d8b-acb1-e0e088317a35 for instance a870435b-8aa5-456d-b0ca-477ee2201dbb on n-h1-858383-10 Oct 12 09:00:44.152859 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-74f26fbf-9fa2-4e03-a213-275e2e9ec858 req-b936e071-cd71-4825-a09c-06f025ec3a61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099620 Oct 12 09:00:44.154215 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2222/4138] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:00:44.293802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:44.294619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:44.308729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:44.309268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:44.309759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:44.310506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:44.310995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:44.313551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:44.835621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:44.836628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:44.887690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:44.888928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:44.889689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:44.890720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:44.891392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:44.892667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:45.055326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:45.067112 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ec89134-9bb1-41b5-873b-6c0e935da97e tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1494 microversion: 2.1 time: 0.777925 Oct 12 09:00:45.087851 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1917/4139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:44 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1494 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:46.087773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:46.102232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:46.102846 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bd35c9bc-ea9c-462f-afb7-b25a78b24108 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 1.275642 Oct 12 09:00:46.116098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:46.117991 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2223/4140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:44 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:46.135068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:46.137149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:46.138910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:46.139857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:46.141447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:46.142581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:46.197933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6b2f9920-1168-4fca-8617-e82782191bcb req-41ad7032-361e-41ea-9d85-87b0e6c3ba0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e1210a-5d85-4f7d-b4d9-eafc517f9c5f", "name": "network-vif-deleted", "tag": "2347dc3d-1312-4f06-9294-9921828b24b2"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:46.214247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:46.214480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6b2f9920-1168-4fca-8617-e82782191bcb req-41ad7032-361e-41ea-9d85-87b0e6c3ba0b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:46.214769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6b2f9920-1168-4fca-8617-e82782191bcb req-41ad7032-361e-41ea-9d85-87b0e6c3ba0b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:46.215036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:46.215199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6b2f9920-1168-4fca-8617-e82782191bcb req-41ad7032-361e-41ea-9d85-87b0e6c3ba0b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:46.215476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:46.216244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lazy-loading 'fault' on Instance uuid 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:46.240924 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6b2f9920-1168-4fca-8617-e82782191bcb req-41ad7032-361e-41ea-9d85-87b0e6c3ba0b service nova] Creating event network-vif-deleted:2347dc3d-1312-4f06-9294-9921828b24b2 for instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f on n-h2-858383-10 Oct 12 09:00:46.258886 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6b2f9920-1168-4fca-8617-e82782191bcb req-41ad7032-361e-41ea-9d85-87b0e6c3ba0b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064898 Oct 12 09:00:46.259502 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2224/4141] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:00:46.343504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f6da267d5248518650775b52ca9488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa3a965bdb884e0eb4f37650c30cb3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:46.354201 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8b4ea7da-b61a-47ac-b6b8-337cce5d09cc tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 200 len: 1298 microversion: 2.1 time: 0.258843 Oct 12 09:00:46.355635 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1918/4142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:46 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 1298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:47.130155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:47.132233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:47.147008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.147921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.148552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.149989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.151526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.153629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.381474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:47.383611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:47.406379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.407747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.411937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.412748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.413243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.413720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.455434 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f could not be found. Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f HTTP/1.1 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f could not be found. Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '41e1210a-5d85-4f7d-b4d9-eafc517f9c5f'} Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f could not be found. Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f could not be found. Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.460244 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.465911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.465911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.465911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:47.465911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:47.465911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f could not be found. Oct 12 09:00:47.465911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.465911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Instance 41e1210a-5d85-4f7d-b4d9-eafc517f9c5f could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:47.470100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-63bbc585-26e4-4c99-a0e7-a500e1d5537c tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f" status: 404 len: 111 microversion: 2.1 time: 0.094653 Oct 12 09:00:47.470685 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1919/4143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:47 2022] GET /compute/v2.1/servers/41e1210a-5d85-4f7d-b4d9-eafc517f9c5f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:47.478962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d4e5aa3a-4db5-4eb3-aebb-3b44960f4b0d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843e849d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:47.526323 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d4e5aa3a-4db5-4eb3-aebb-3b44960f4b0d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Image not found. Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d4e5aa3a-4db5-4eb3-aebb-3b44960f4b0d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d HTTP/1.1 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '6a0ed483-201d-4822-92e7-cf13c9c1472d'} Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6a0ed483-201d-4822-92e7-cf13c9c1472d to delete Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a0ed483-201d-4822-92e7-cf13c9c1472d could not be found. Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.528178 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d4e5aa3a-4db5-4eb3-aebb-3b44960f4b0d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d4e5aa3a-4db5-4eb3-aebb-3b44960f4b0d tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d" status: 404 len: 62 microversion: 2.1 time: 0.054979 Oct 12 09:00:47.533412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1920/4144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:47 2022] DELETE /compute/v2.1/images/6a0ed483-201d-4822-92e7-cf13c9c1472d => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 12 09:00:47.538469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:47.539150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:47.556198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.559036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.559685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.561580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.562223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.564876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.574434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:47.612328 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d HTTP/1.1 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '760dbd63-4283-457c-838e-a2898d1c8a0d'} Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:47.614954 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.620131 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.629267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:47.630538 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32874e82-bba7-42ee-b9f8-ba3b5711981f tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 404 len: 111 microversion: 2.1 time: 0.096073 Oct 12 09:00:47.631669 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1921/4145] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:47 2022] DELETE /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:47.641857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:47.642807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 760dbd63-4283-457c-838e-a2898d1c8a0d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:47.658934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.659748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.660522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.661532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.662830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.670100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.677028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:47.691006 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d5a92b5-9aec-44aa-9b06-ba280678b330 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.566400 Oct 12 09:00:47.711232 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2225/4146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:47 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:47.718995 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d HTTP/1.1 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '760dbd63-4283-457c-838e-a2898d1c8a0d'} Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.721365 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.729158 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.729158 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.729158 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:47.729158 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:47.729158 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. Oct 12 09:00:47.729158 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.731906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Instance 760dbd63-4283-457c-838e-a2898d1c8a0d could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:47.733411 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d0a07175-91f7-4935-acb1-424ab9d1ec92 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d" status: 404 len: 111 microversion: 2.1 time: 0.097657 Oct 12 09:00:47.734602 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1922/4147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:47 2022] GET /compute/v2.1/servers/760dbd63-4283-457c-838e-a2898d1c8a0d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:47.742517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41a39521-0c94-48d8-ab9d-48d50411d5d7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9843fe3670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:47.796941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-41a39521-0c94-48d8-ab9d-48d50411d5d7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Image not found. Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41a39521-0c94-48d8-ab9d-48d50411d5d7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21 HTTP/1.1 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: exception: Image not found. Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'bf14b97c-a54a-4a2a-8576-f31c3634bc21'} Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bf14b97c-a54a-4a2a-8576-f31c3634bc21 to delete Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf14b97c-a54a-4a2a-8576-f31c3634bc21 could not be found. Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.799320 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41a39521-0c94-48d8-ab9d-48d50411d5d7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Image not found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-41a39521-0c94-48d8-ab9d-48d50411d5d7 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21" status: 404 len: 62 microversion: 2.1 time: 0.062588 Oct 12 09:00:47.803990 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2226/4148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:47 2022] DELETE /compute/v2.1/images/bf14b97c-a54a-4a2a-8576-f31c3634bc21 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:00:47.811739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:47.812485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:47.833505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.833898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.834333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.835107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.836055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.836846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.881324 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 HTTP/1.1 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'eb3cd57c-b10d-449c-bee3-9d0435916ad7'} Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:47.883869 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c32c7d5-9900-4473-a52d-b28acb9be410 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 404 len: 111 microversion: 2.1 time: 0.078529 Oct 12 09:00:47.888375 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1923/4149] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:47 2022] DELETE /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:47.895878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:47.896575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: eb3cd57c-b10d-449c-bee3-9d0435916ad7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:47.948779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.954956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.956331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:47.962504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:47.964736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:47.965309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:48.025705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 HTTP/1.1 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'eb3cd57c-b10d-449c-bee3-9d0435916ad7'} Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.027348 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.036422 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:48.036422 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:48.036422 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:48.036422 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:48.036422 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. Oct 12 09:00:48.036422 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.036422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Instance eb3cd57c-b10d-449c-bee3-9d0435916ad7 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:48.041397 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b71c898-0050-44ce-a317-02052b25ad39 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7" status: 404 len: 111 microversion: 2.1 time: 0.137892 Oct 12 09:00:48.044032 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2227/4150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:47 2022] GET /compute/v2.1/servers/eb3cd57c-b10d-449c-bee3-9d0435916ad7 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:48.052800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-904900a3-2a77-4a6f-968b-2bc737319664 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '.version_select at 0x7f9848d9b5e0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:48.093316 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-904900a3-2a77-4a6f-968b-2bc737319664 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Image not found. Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-904900a3-2a77-4a6f-968b-2bc737319664 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa HTTP/1.1 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: exception: Image not found. Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '8805eef9-fef8-4f11-ac09-e7d8c17dfdaa'} Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8805eef9-fef8-4f11-ac09-e7d8c17dfdaa to delete Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8805eef9-fef8-4f11-ac09-e7d8c17dfdaa could not be found. Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.095353 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 12 09:00:48.102302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.108076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-904900a3-2a77-4a6f-968b-2bc737319664 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Image not found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:48.110639 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-904900a3-2a77-4a6f-968b-2bc737319664 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa" status: 404 len: 62 microversion: 2.1 time: 0.062618 Oct 12 09:00:48.114468 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1924/4151] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:48 2022] DELETE /compute/v2.1/images/8805eef9-fef8-4f11-ac09-e7d8c17dfdaa => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:00:48.121895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:48.122411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:48.140836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:48.147757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:48.154570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:48.170655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:48.171262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:48.174033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:48.232637 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce HTTP/1.1 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '0ad53c17-0b1c-484e-8be6-187774d37cce'} Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:48.240114 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.245823 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.249152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:48.251555 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ecf3749-c76d-4347-abbc-cbe0a07d8238 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 404 len: 111 microversion: 2.1 time: 0.133908 Oct 12 09:00:48.263780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:48.264669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] [instance: 0ad53c17-0b1c-484e-8be6-187774d37cce] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:48.270313 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2228/4152] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:00:48 2022] DELETE /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:48.280193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:48.283512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:48.287257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:48.288046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:48.288535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:48.290522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:48.317365 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] HTTP exception thrown: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Request method failure captured: Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce HTTP/1.1 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFsw5ec4cZeQIk4bNbsGOqnQBB0ElH28YVeofFQyWlLlbHjp3K-_MU43jX-cfgdBDFW-li1YlBjGUerjcLIkLT9JISP0M_Xmu9sLw1EsEhYNJkjPvUmgQFLsy_iK-VdkB1Jis6bXR26kSohRrwX-iiEj9CKHx_OMWaJ3gEuVa5SnQY Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa3a965bdb884e0eb4f37650c30cb3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa3a965bdb884e0eb4f37650c30cb3f5"}]}] Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: fa3a965bdb884e0eb4f37650c30cb3f5 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ImagesTestJSON-249181939 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 69f6da267d5248518650775b52ca9488 Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ImagesTestJSON-249181939-project Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '0ad53c17-0b1c-484e-8be6-187774d37cce'} Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.323305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:00:48.329838 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:00:48.329838 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:00:48.329838 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:00:48.329838 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:00:48.329838 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. Oct 12 09:00:48.329838 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:00:48.332157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] Returning 404 to user: Instance 0ad53c17-0b1c-484e-8be6-187774d37cce could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:00:48.334108 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a91e01af-dad1-4ad3-af55-360e631a5e68 tempest-ImagesTestJSON-249181939 tempest-ImagesTestJSON-249181939-project] 10.222.0.40 "GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce" status: 404 len: 111 microversion: 2.1 time: 0.075330 Oct 12 09:00:48.335596 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1925/4153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:48 2022] GET /compute/v2.1/servers/0ad53c17-0b1c-484e-8be6-187774d37cce => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:00:48.725999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:48.726613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:48.754393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:48.757750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:48.760446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:48.764843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:48.767418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:48.768047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:49.851042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:49.868539 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb8f1a1a-deeb-462b-bc9a-e045d15594a6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 1.153758 Oct 12 09:00:49.869146 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2229/4154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:48 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:50.099877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:50.175927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-776888025", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:00:50.327076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:00:50.899576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:50.901547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:50.913769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:50.922092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:50.934279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:50.935088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:50.936044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:50.936693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:50.937318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:51.020095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:51.875072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:00:51.876367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:00:51.877023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:00:51.877795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:00:51.878400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:00:51.916442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:51.917042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:51.917546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:51.929068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:51.929635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:51.930119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:51.989623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Getting quotas for project f36147ec13574c09ab0ba1bf380f8b7f. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:00:52.000899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Getting quotas for user 1bb99b0938ef4297ae15dc2eb8da43db and project f36147ec13574c09ab0ba1bf380f8b7f. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:00:52.040978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:00:52.043536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:00:52.057101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:52.081027 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1064f805-68bf-440b-9702-adfbef86bea4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 1.185527 Oct 12 09:00:52.088325 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2230/4155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:50 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:52.156958 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9608ac0e-d60f-4a04-9332-e6ba1afa9789 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.263956 Oct 12 09:00:52.167461 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1926/4156] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:00:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:00:52.173603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d06c57fb-5ca6-4aa4-a3e7-67cc4e208408 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:52.174607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d06c57fb-5ca6-4aa4-a3e7-67cc4e208408 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:52.210202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=22 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:00:52.480928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d06c57fb-5ca6-4aa4-a3e7-67cc4e208408 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:52.493515 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d06c57fb-5ca6-4aa4-a3e7-67cc4e208408 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1222 microversion: 2.1 time: 0.324909 Oct 12 09:00:52.496442 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2231/4157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:52 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1222 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:53.117748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:53.119046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:53.149198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:53.149783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:53.158142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:53.163028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:53.166350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:53.167931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:53.520815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:53.521430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:53.545712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:53.546229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:53.546669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:53.547385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:53.559016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:53.559877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:54.049494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:54.065883 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20cb51c9-79f9-417c-91ef-71248bd7258c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.952555 Oct 12 09:00:54.084362 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1927/4158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:53 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:54.084733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:54.095709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:54.098100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:54.099068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db404c54-0383-45bc-bf00-a1d381f27fd7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1218 microversion: 2.1 time: 0.580109 Oct 12 09:00:54.103415 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2232/4159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:53 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1218 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:54.113894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:54.115368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:54.117202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:54.118241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:54.121702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:54.122407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:54.218244 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35ade2bf-3e41-4f22-8470-8a9552965a8c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments/fb02e88d-0b7c-4941-91e4-32e28312d6f5" status: 200 len: 194 microversion: 2.20 time: 0.146633 Oct 12 09:00:54.219235 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1928/4160] 10.222.0.40 () {60 vars in 1454 bytes} [Wed Oct 12 09:00:54 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments/fb02e88d-0b7c-4941-91e4-32e28312d6f5 => generated 194 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:00:54.381709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:54.382262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:54.398358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:54.398978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:54.399511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:54.401640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:54.402171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:54.404824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:54.614087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lazy-loading 'services' on Instance uuid 4d1acdb6-1970-410c-a904-67636bdc3d68 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:00:54.845985 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e40b0c72-f221-44e1-9f22-3e895342cec0 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments/fb02e88d-0b7c-4941-91e4-32e28312d6f5" status: 202 len: 0 microversion: 2.20 time: 0.468080 Oct 12 09:00:54.852121 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2233/4161] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Oct 12 09:00:54 2022] DELETE /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments/fb02e88d-0b7c-4941-91e4-32e28312d6f5 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:00:54.865337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:54.868498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:54.911581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:54.912207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:54.917872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:54.918657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:54.919128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:54.924109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:55.046855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6de209ed-afd3-4ad7-aab7-e5a0f453dee2 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.195598 Oct 12 09:00:55.054946 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1929/4162] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:00:54 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:00:55.094578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:55.095612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:55.126100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:55.128658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:55.129245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:55.130138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:55.130585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:55.135189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:55.137542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:55.138249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:55.153674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:55.154574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:55.155166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:55.163196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:55.167818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:55.169353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:55.557183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:55.591309 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07fab3df-8322-4019-a02d-3833b3ed868b tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1280 microversion: 2.1 time: 0.467443 Oct 12 09:00:55.597950 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1930/4163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:55 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1280 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:00:55.979682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:55.996159 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-09f30016-288f-4367-bec2-1287b0eeb320 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.906405 Oct 12 09:00:56.017795 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2234/4164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:55 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:56.070861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:56.078918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:56.103109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:56.110480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:56.111127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:56.113161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:56.113830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:56.128654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:56.289063 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b177f5b-ca15-42e7-b209-29b591b412da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.230290 Oct 12 09:00:56.294998 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1931/4165] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:00:56 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:00:56.636264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:56.636986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:56.653539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:56.654093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:56.655826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:56.657746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:56.659789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:56.662868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:56.911304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:56.937527 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-97dbe5ba-bbf7-4adc-bc93-e77f4718cb96 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1280 microversion: 2.1 time: 0.315653 Oct 12 09:00:56.944566 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2235/4166] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:56 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:57.024673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:57.025256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:57.038166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:57.044183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:57.047707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:57.067984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:57.069291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:57.073481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:57.304927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:57.307342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:57.325628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:57.329299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:57.331276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:57.338061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:57.338941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:57.339573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:57.466190 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-76ff91e2-b28c-4940-b597-85d8a8537ca8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164943 Oct 12 09:00:57.468643 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2236/4167] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:00:57 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 09:00:57.967269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:57.968319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:57.976205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:57.990677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:57.991452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:57.999733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:58.006075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:58.006546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:58.243621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:58.256707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dbbfe2c9-3903-41f5-bb12-1c18014f4dc4 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1280 microversion: 2.1 time: 0.291516 Oct 12 09:00:58.259598 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2237/4168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:57 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1280 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:58.480189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:58.482520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:58.526340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:58.526855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:58.527299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:58.528183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:58.528637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:58.529072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:58.600630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:00:58.609369 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-53124412-e9ed-49dc-9935-2c63337485b9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 1.589301 Oct 12 09:00:58.610503 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1932/4169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:57 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:00:58.656160 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ee164f3-0d60-4ee1-b25c-5ef60cbd324f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.166997 Oct 12 09:00:58.657404 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2238/4170] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:00:58 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:00:59.284362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:59.286298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:59.311658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:59.313154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:59.313881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:59.316092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:59.317160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:59.325709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:59.632364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:00:59.634348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:00:59.657114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:59.659070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:59.659666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:00:59.680833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:00:59.687395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:00:59.696237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:00.228978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:00.239543 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2931b4d7-222a-4c64-9564-073aeaca5248 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1322 microversion: 2.1 time: 0.959064 Oct 12 09:01:00.254204 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1933/4171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:59 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1322 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:00.259833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:00.283182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:00.314645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:00.315336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:00.315899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:00.316752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:00.317351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:00.317924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:00.400963 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7a645989-759d-4e48-95bf-962449fdc7f9 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145149 Oct 12 09:01:00.411450 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1934/4172] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:01:00 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:01:01.365023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-964568685", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "0faf3d66-22ee-4d4f-b2de-4a31999a9022"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:01.502045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] validate_networks() for [('0faf3d66-22ee-4d4f-b2de-4a31999a9022', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:01:01.637955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:01.663671 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0d4fc854-8fe3-428f-a18c-1c4586fc7425 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 2.035023 Oct 12 09:01:01.664707 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2239/4173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:00:59 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:01:01.686525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:01.687109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:01.718268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:01.718798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:01.719240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:01.724544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:01.726425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:01.730034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:01.958090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:02.027311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:02.470818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:02.484396 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-827473e2-9ae8-489a-9b41-02dd8e5585ad tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1322 microversion: 2.1 time: 0.818325 Oct 12 09:01:02.485004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2240/4174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:01 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1322 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:02.505929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:02.512331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:02.542626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:02.548307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:02.549583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:02.552400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:02.555574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:02.558827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:02.559884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:02.686819 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c24476b7-48ba-4b57-820e-f14c3bfac584 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198239 Oct 12 09:01:02.689595 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2241/4175] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:01:02 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:01:02.811073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-186342645", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a77f6e4a-ab9d-4a56-851e-7f252a88ef5a"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:02.938527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] validate_networks() for [('a77f6e4a-ab9d-4a56-851e-7f252a88ef5a', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:01:03.509530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:01:03.513055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:01:03.513806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:01:03.514618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:01:03.515194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:01:03.535511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:03.536287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:03.536922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:03.546615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:03.547378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:03.547995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:03.576542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Getting quotas for project 3816f2eda088491285ab03087b12fb33. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:03.582252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Getting quotas for user be40bd3e56a74d289750ba931dd214b5 and project 3816f2eda088491285ab03087b12fb33. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:03.595811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:01:03.599204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:01:03.690686 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c93282b5-0d92-46d3-a310-884c3d848aa4 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.623053 Oct 12 09:01:03.704440 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1935/4176] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:01:03.713690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:03.714608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:03.723129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:03.723874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:03.724517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:03.725535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:03.727943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:03.728621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:04.599052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:04.616990 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42a1e93c-f295-4ca5-96f6-ae7034ea9851 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.910717 Oct 12 09:01:04.618616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1936/4177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:03 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:04.637007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9a990f6e-57e0-4d59-b859-0ac39bbe9738 req-1fbcdb38-dd62-4071-80f9-1a0d1def4290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "950446e2-1715-40cc-bd72-b7e27458a2e8", "tag": "c5bb81ce-64fa-41da-93d1-4606078fa391"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:04.667324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9a990f6e-57e0-4d59-b859-0ac39bbe9738 req-1fbcdb38-dd62-4071-80f9-1a0d1def4290 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:04.672580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9a990f6e-57e0-4d59-b859-0ac39bbe9738 req-1fbcdb38-dd62-4071-80f9-1a0d1def4290 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:04.674033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9a990f6e-57e0-4d59-b859-0ac39bbe9738 req-1fbcdb38-dd62-4071-80f9-1a0d1def4290 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:04.749078 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9a990f6e-57e0-4d59-b859-0ac39bbe9738 req-1fbcdb38-dd62-4071-80f9-1a0d1def4290 service nova] Creating event network-changed:c5bb81ce-64fa-41da-93d1-4606078fa391 for instance 950446e2-1715-40cc-bd72-b7e27458a2e8 on n-h2-858383-10 Oct 12 09:01:04.793885 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9a990f6e-57e0-4d59-b859-0ac39bbe9738 req-1fbcdb38-dd62-4071-80f9-1a0d1def4290 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170866 Oct 12 09:01:04.795051 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1937/4178] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:04.808506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:04.835087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:04.854631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:04.864178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:04.866426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:04.867341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:04.873213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:04.875312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:04.875312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:04.924009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:01:04.924620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:01:04.924907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:01:04.925335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:01:04.932412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:01:04.957864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:04.958365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:04.958814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:04.959550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:04.960012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:04.960446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.045280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Getting quotas for project 65f2f36631244e30b590002855df32ee. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:05.061542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Getting quotas for user 5f771bd04b48418595d91df09dc1d8bf and project 65f2f36631244e30b590002855df32ee. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:05.102963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Going to run 3 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:01:05.105371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:01:05.169419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=1d766526-e1d7-453d-9bfb-5cfe3bdadbef,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:01:05.240844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=d34fedf2-688b-4b8c-a56c-81effb6d4a75,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:01:05.400754 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4996758-f467-49d7-b0c0-13b59f89f6a9 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.706384 Oct 12 09:01:05.401904 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2242/4179] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:01:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:01:05.407128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:05.409781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:05.416982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:05.417509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:05.417948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.418711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:05.419639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:05.420063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.456722 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cba0109a-ed63-40c5-8608-970f887fbc8b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052979 Oct 12 09:01:05.461992 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2243/4180] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:01:05 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:01:05.478038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:05.479315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:05.492514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:05.494208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:05.495061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.497501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:05.498873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:05.499669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.519832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:05.528971 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c53de35-dc22-4cca-8eac-62b51b009c81 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1322 microversion: 2.1 time: 0.731058 Oct 12 09:01:05.537053 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1938/4181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:04 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1322 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:05.542663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:05.558318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:05.559145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'deleted': False, 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:05.625097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:05.625716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:05.626063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.629500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:05.629987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:05.630684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.676563 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-886f9d44-da7e-4352-8661-49e3a4a7109a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.138228 Oct 12 09:01:05.677876 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1939/4182] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:01:05 2022] GET /compute/v2.1/servers => generated 1015 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:05.688322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:05.689176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:05.710425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:05.710721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:05.712209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:05.715551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.716866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:05.717519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:05.721096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:05.748602 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-03204802-5d15-4524-a828-ad6856f387e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1279 microversion: 2.1 time: 0.285406 Oct 12 09:01:05.763770 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2244/4183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:05 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:05.769998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfd6feae-d83f-4044-b1e3-d2bb1e96d36b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:05.772855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfd6feae-d83f-4044-b1e3-d2bb1e96d36b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:05.948814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dfd6feae-d83f-4044-b1e3-d2bb1e96d36b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:05.963616 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dfd6feae-d83f-4044-b1e3-d2bb1e96d36b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1222 microversion: 2.1 time: 0.198442 Oct 12 09:01:05.964586 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2245/4184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:05 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1222 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:06.425357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:06.435324 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c042085a-ba82-4ebe-b8e8-7bd6c7e05a3b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.754557 Oct 12 09:01:06.436574 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1940/4185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:05 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:06.470934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:06.474321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:06.503482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:06.504176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:06.504811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:06.510218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:06.510877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:06.511622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:06.556773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:06.557593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:06.566509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:06.568184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:06.568841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:06.570092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:06.570721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:06.571339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:06.587478 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9c548b10-61c7-44a3-b9b7-107181f2dbfd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.121582 Oct 12 09:01:06.590691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2246/4186] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:01:06 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:06.679914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:06.680669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:06.689796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:06.691728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:06.692368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:06.693559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:06.694750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:06.696226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:06.733072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:06.795981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:06.876778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3e168a45-72b8-4679-ae3a-5fb7b5fccc1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 204 len: 0 microversion: 2.20 time: 0.200769 Oct 12 09:01:06.880800 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2247/4187] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:01:06 2022] DELETE /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:01:06.884401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:06.886723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:06.897141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:06.897873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:06.898602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:06.899497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:06.900588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:06.901257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:06.983084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:07.008147 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2df45fc-d87c-43a7-854b-b5ea80d6fc33 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1285 microversion: 2.1 time: 0.128928 Oct 12 09:01:07.013979 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2248/4188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:06 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:07.026856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:07.027648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:07.035555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:07.036252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:07.037003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:07.038049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:07.038985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:07.039852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:07.247273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:07.256945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:07.258491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:07.260060 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4057f6ba-d1b1-4b33-9cd7-87a3bf4f2746 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.244174 Oct 12 09:01:07.261106 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2249/4189] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:07 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:07.265945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:07.266549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:07.272795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:07.273526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:07.274015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:07.274690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:07.276373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:07.277314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:07.359775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:07.374803 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b7cc986-6cee-4060-b09e-39b7c88549d3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1226 microversion: 2.1 time: 0.112356 Oct 12 09:01:07.375696 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2250/4190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:07 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:07.462329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:07.463327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:07.472602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:07.473299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:07.473948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:07.475055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:07.476581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:07.477187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:07.737535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:07.753811 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e64326b8-f191-42a5-8d38-ce42851f771c tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.296033 Oct 12 09:01:07.755019 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2251/4191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:07 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:07.810807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:07.823308 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-158a824e-7e8b-4613-93d6-b171f34e9d98 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1322 microversion: 2.1 time: 1.270568 Oct 12 09:01:07.823905 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1941/4192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:06 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1322 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:08.032690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:08.034225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:08.060428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:08.062912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:08.065782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:08.069336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:08.070826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:08.071929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:08.291273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:08.292277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:08.299795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:08.315693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:08.317820 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f24a6a1-aba0-4b9c-8a09-8ccc223eccc6 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1285 microversion: 2.1 time: 0.288330 Oct 12 09:01:08.318673 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2252/4193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:08 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:08.332884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:08.338305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:08.339682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:08.340812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:08.344281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:08.408315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:08.408955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:08.437231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:08.441360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:08.443297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:08.447402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:08.448426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:08.450511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:08.569074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:08.579522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be39c169-c6d7-4ce7-93d0-abb49a6679a3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1218 microversion: 2.1 time: 0.181041 Oct 12 09:01:08.581134 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2253/4194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:08 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:01:08.776809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:08.777463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:08.787553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:08.788072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:08.788545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:08.789258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:08.790091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:08.791292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:09.160835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:09.171235 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85f5babf-8407-4574-8bb8-6e25677b3968 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.398893 Oct 12 09:01:09.178360 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2254/4195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:08 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:01:09.193815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:09.195349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:09.208482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:09.209056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:09.209548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:09.210549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:09.211123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:09.211849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:09.526309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:09.535796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c353df56-33cc-4246-b508-597fa99d90fe tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1322 microversion: 2.1 time: 0.355773 Oct 12 09:01:09.543211 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2255/4196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:09 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:09.565565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:09.566465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:09.584355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:09.586790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:09.588865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:09.593976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:09.595159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:09.596195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:09.855185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:09.872177 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a62acada-cd9a-4214-9204-8f7d03ae57dc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1285 microversion: 2.1 time: 0.310137 Oct 12 09:01:09.873950 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2256/4197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:09 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1285 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:09.880746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:09.881856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:09.889045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:09.889842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:09.890466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:09.892308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:09.893227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:09.894077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:09.940802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:09.960520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:09.968239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:09.969709 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8af53323-d0ce-4e21-9776-f5c9c1f98c7c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 1.684042 Oct 12 09:01:09.970339 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1942/4198] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:08 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:01:10.171296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:10.183273 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-adf3cab8-ee96-4945-982a-436d9cc4d52f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1280 microversion: 2.1 time: 0.306454 Oct 12 09:01:10.183874 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2257/4199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:09 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1280 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:10.205219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:10.206099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:10.213149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:10.214577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:10.215286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:10.216654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:10.217395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:10.218047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:10.293855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20ff5402-fe3b-469f-8d19-ebf96b97c8f3 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Calling method '.version_select at 0x7f9843de9310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:10.317162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20ff5402-fe3b-469f-8d19-ebf96b97c8f3 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:10.317680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20ff5402-fe3b-469f-8d19-ebf96b97c8f3 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:10.318123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20ff5402-fe3b-469f-8d19-ebf96b97c8f3 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:10.318862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20ff5402-fe3b-469f-8d19-ebf96b97c8f3 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:10.319318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20ff5402-fe3b-469f-8d19-ebf96b97c8f3 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:10.321261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20ff5402-fe3b-469f-8d19-ebf96b97c8f3 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:10.364688 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20ff5402-fe3b-469f-8d19-ebf96b97c8f3 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.375652 Oct 12 09:01:10.380845 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1943/4200] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Oct 12 09:01:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:01:10.450220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-57b8c858-4c3f-4740-804a-104ae73e6df0 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2077214309", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:10.542430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-57b8c858-4c3f-4740-804a-104ae73e6df0 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:01:10.696716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:10.705927 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39f2d599-b464-4864-ab68-f3f99ddc021b tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.505259 Oct 12 09:01:10.707243 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2258/4201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:10 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:10.712523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:10.713550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:10.720054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:10.721045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:10.722091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:10.723369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:10.724160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:10.724889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:11.107851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:11.131244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c4ed1177-8192-46ea-8cb9-fd28773196cc tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1322 microversion: 2.1 time: 0.422515 Oct 12 09:01:11.132632 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2259/4202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:10 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:11.152542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-378a2c42-d88e-4acf-a02f-70d738000264 req-d8ee2f62-7718-485f-9f5f-765464e446ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a870435b-8aa5-456d-b0ca-477ee2201dbb", "name": "network-vif-plugged", "status": "completed", "tag": "100f519d-4457-4d8b-acb1-e0e088317a35"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:11.164738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-378a2c42-d88e-4acf-a02f-70d738000264 req-d8ee2f62-7718-485f-9f5f-765464e446ba service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:11.165485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-378a2c42-d88e-4acf-a02f-70d738000264 req-d8ee2f62-7718-485f-9f5f-765464e446ba service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:11.167510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-378a2c42-d88e-4acf-a02f-70d738000264 req-d8ee2f62-7718-485f-9f5f-765464e446ba service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:11.200186 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-378a2c42-d88e-4acf-a02f-70d738000264 req-d8ee2f62-7718-485f-9f5f-765464e446ba service nova] Creating event network-vif-plugged:100f519d-4457-4d8b-acb1-e0e088317a35 for instance a870435b-8aa5-456d-b0ca-477ee2201dbb on n-h1-858383-10 Oct 12 09:01:11.217763 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-378a2c42-d88e-4acf-a02f-70d738000264 req-d8ee2f62-7718-485f-9f5f-765464e446ba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083424 Oct 12 09:01:11.221045 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2260/4203] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:11.253647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:11.254695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:11.263417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:11.264248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:11.264868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:11.266656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:11.268044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:11.274759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:11.370010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-57b8c858-4c3f-4740-804a-104ae73e6df0 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Getting quotas for project 890d294995334edab6a939ea0dd1bc25. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:11.423029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-57b8c858-4c3f-4740-804a-104ae73e6df0 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Getting quotas for user b4546fd5b4784e57a5c2ff6be91d6206 and project 890d294995334edab6a939ea0dd1bc25. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:11.449253 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-57b8c858-4c3f-4740-804a-104ae73e6df0 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-57b8c858-4c3f-4740-804a-104ae73e6df0 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Request method failure captured: Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 1752 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoJVcmvaYtnH-wqhuNFf9WCIvFGvo51U42nyc3FLSvCNMjsesiA2vQHxkrydsfIue5D_FtsbcVvxIRxcaS2SIAW3fEbJj66roUbgicIO3-50RlTCIqzlwB_EOEHE1OVL0h6aF54-_tGaed1jQ5wVSDDBqkyZiZ9CQ9N7h3ZfXHCBta0 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 890d294995334edab6a939ea0dd1bc25 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-718973911 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/890d294995334edab6a939ea0dd1bc25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/890d294995334edab6a939ea0dd1bc25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_890d294995334edab6a939ea0dd1bc25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/890d294995334edab6a939ea0dd1bc25"}]}] Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-718973911 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 890d294995334edab6a939ea0dd1bc25 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-718973911 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-718973911-project Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: b4546fd5b4784e57a5c2ff6be91d6206 Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-718973911-project Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2077214309", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:11.452007 n-d-858383-10 devstack@n-api.service[127007]: exception: Maximum number of metadata items exceeds 128 Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2077214309', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:11.455141 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 12 09:01:11.458914 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:11.473039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-57b8c858-4c3f-4740-804a-104ae73e6df0 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:11.478674 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-57b8c858-4c3f-4740-804a-104ae73e6df0 tempest-AbsoluteLimitsNegativeTestJSON-718973911 tempest-AbsoluteLimitsNegativeTestJSON-718973911-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.032698 Oct 12 09:01:11.489599 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1944/4204] 10.222.0.40 () {60 vars in 1148 bytes} [Wed Oct 12 09:01:10 2022] POST /compute/v2.1/servers => generated 87 bytes in 1044 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:01:11.498678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:11.499318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:11.509027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:11.509779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:11.510346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:11.511293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:11.511828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:11.512580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:12.105318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:12.114877 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ae6830f-ac4f-455a-a46a-6cf29bbf6d65 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.873557 Oct 12 09:01:12.115862 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2261/4205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:11 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:12.121049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:12.122009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:12.130860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:12.131429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:12.132194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:12.133364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:12.134405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:12.135057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:12.375806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:12.388172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:12.396362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:12.398434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:12.400438 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-39c52ed3-49c9-47e4-b049-b8b6eb64c8d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1724 microversion: 2.20 time: 0.909625 Oct 12 09:01:12.401172 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1945/4206] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:11 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1724 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:12.410759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:12.411635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:12.419152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:12.419759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:12.420377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:12.421121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:12.421712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:12.423877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:12.456454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:12.466424 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b166e6f-934d-4f4e-af36-f46497574b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.349154 Oct 12 09:01:12.467057 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2262/4207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:12 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:12.486706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:12.487601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:12.494453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:12.495139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:12.495770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:12.496639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:12.497258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:12.497869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:12.716909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:12.728498 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1df04249-d627-4153-96d5-764735a846b7 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1322 microversion: 2.1 time: 0.245608 Oct 12 09:01:12.729462 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2263/4208] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:12 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:12.970461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:12.984605 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8fcc45ff-6fa1-44b8-8839-18a8d07ff4e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.578646 Oct 12 09:01:12.999848 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1946/4209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:12 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:13.155123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:13.156107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:13.200753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:13.206468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:13.209286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:13.215263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:13.219599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:13.221453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:13.236629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bcf266da-f479-4f8e-b19d-5063b4e82e6d req-8216d4ae-d33c-44af-bb7c-3fca2460b2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950446e2-1715-40cc-bd72-b7e27458a2e8", "name": "network-vif-plugged", "status": "completed", "tag": "c5bb81ce-64fa-41da-93d1-4606078fa391"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:13.256274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bcf266da-f479-4f8e-b19d-5063b4e82e6d req-8216d4ae-d33c-44af-bb7c-3fca2460b2bc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:13.256781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bcf266da-f479-4f8e-b19d-5063b4e82e6d req-8216d4ae-d33c-44af-bb7c-3fca2460b2bc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:13.257369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bcf266da-f479-4f8e-b19d-5063b4e82e6d req-8216d4ae-d33c-44af-bb7c-3fca2460b2bc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:13.307552 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bcf266da-f479-4f8e-b19d-5063b4e82e6d req-8216d4ae-d33c-44af-bb7c-3fca2460b2bc service nova] Creating event network-vif-plugged:c5bb81ce-64fa-41da-93d1-4606078fa391 for instance 950446e2-1715-40cc-bd72-b7e27458a2e8 on n-h2-858383-10 Oct 12 09:01:13.334444 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bcf266da-f479-4f8e-b19d-5063b4e82e6d req-8216d4ae-d33c-44af-bb7c-3fca2460b2bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101143 Oct 12 09:01:13.338142 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1947/4210] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:01:13.431621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:13.432325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:13.464588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:13.467766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:13.468357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:13.468967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:13.472007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:13.472735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:13.958998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:13.965126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:13.984404 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c0a4ba81-8273-4029-8461-a87a3134740b tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.843784 Oct 12 09:01:13.992355 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2264/4211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:13 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:14.006283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:14.011805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:14.027864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:14.027864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:14.028440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:14.029263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:14.029789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:14.030215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:14.215435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:14.228086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:14.232656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:14.233929 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e8371fe-3bfe-4d6b-91a5-82e5b0faf070 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1657 microversion: 2.20 time: 0.807881 Oct 12 09:01:14.244211 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1948/4212] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:13 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1657 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:14.258176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:14.258907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:14.271123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:14.275938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:14.276595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:14.277780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:14.278268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:14.278709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:14.812557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:14.833473 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd8d3e19-49f2-49a7-ac98-73aa31708cc3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.829286 Oct 12 09:01:14.834476 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2265/4213] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:13 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:14.864280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:14.865121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:14.877688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:14.898472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:14.899321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:14.900076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:14.902508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:14.904453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:14.907559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:14.991148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:15.000339 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-90457b99-2d02-4f72-bad0-77fbd5ae2aa6 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1322 microversion: 2.1 time: 0.752536 Oct 12 09:01:15.001616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1949/4214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:14 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1322 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:15.006535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2af59cb4-3989-42fa-8fd1-0e24622a50ce req-a278826b-c59d-4902-bdf0-8a1cf5c12488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1acdb6-1970-410c-a904-67636bdc3d68", "name": "network-vif-deleted", "tag": "6e76f914-e39e-4490-8567-4fcc14247a71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:15.019116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:15.032336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2af59cb4-3989-42fa-8fd1-0e24622a50ce req-a278826b-c59d-4902-bdf0-8a1cf5c12488 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.033260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2af59cb4-3989-42fa-8fd1-0e24622a50ce req-a278826b-c59d-4902-bdf0-8a1cf5c12488 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.033964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2af59cb4-3989-42fa-8fd1-0e24622a50ce req-a278826b-c59d-4902-bdf0-8a1cf5c12488 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.056728 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2af59cb4-3989-42fa-8fd1-0e24622a50ce req-a278826b-c59d-4902-bdf0-8a1cf5c12488 service nova] Creating event network-vif-deleted:6e76f914-e39e-4490-8567-4fcc14247a71 for instance 4d1acdb6-1970-410c-a904-67636bdc3d68 on n-h2-858383-10 Oct 12 09:01:15.075183 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2af59cb4-3989-42fa-8fd1-0e24622a50ce req-a278826b-c59d-4902-bdf0-8a1cf5c12488 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072052 Oct 12 09:01:15.076526 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1950/4215] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:15.082533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:15.083619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:15.095936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.098041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.099423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.102501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.103144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.104135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.287800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:15.311421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-562e879f-069e-46cd-9b35-8bfbdd685fe9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1519 microversion: 2.1 time: 0.461610 Oct 12 09:01:15.312900 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2266/4216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:14 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1519 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:15.331263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:15.332115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:15.342839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.343531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.344151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.345079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.345717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.346918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.457047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.458740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.460569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.462499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lazy-loading 'fault' on Instance uuid 4d1acdb6-1970-410c-a904-67636bdc3d68 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:01:15.583977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:15.593831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:15.601899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:15.603245 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-607fbb0f-ab81-4a60-9935-04a319b943d3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 200 len: 1371 microversion: 2.20 time: 0.285739 Oct 12 09:01:15.605848 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2267/4217] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:15 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:15.780953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-faf0726e-d6db-447f-ac0c-34cba0711e19 req-cfff4de1-6d24-417f-89c7-a71890836eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad091b2-96e3-448b-a975-38d05c0b9fcc", "tag": "4973927d-3082-4655-9edc-32330b1fe74f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:15.801668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-faf0726e-d6db-447f-ac0c-34cba0711e19 req-cfff4de1-6d24-417f-89c7-a71890836eac service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.802161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-faf0726e-d6db-447f-ac0c-34cba0711e19 req-cfff4de1-6d24-417f-89c7-a71890836eac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.802598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-faf0726e-d6db-447f-ac0c-34cba0711e19 req-cfff4de1-6d24-417f-89c7-a71890836eac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.814947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-faf0726e-d6db-447f-ac0c-34cba0711e19 req-cfff4de1-6d24-417f-89c7-a71890836eac service nova] Creating event network-changed:4973927d-3082-4655-9edc-32330b1fe74f for instance fad091b2-96e3-448b-a975-38d05c0b9fcc on n-h2-858383-10 Oct 12 09:01:15.843906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-faf0726e-d6db-447f-ac0c-34cba0711e19 req-cfff4de1-6d24-417f-89c7-a71890836eac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066548 Oct 12 09:01:15.845356 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2268/4218] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:01:15.859321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:15.860264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:15.875481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.875988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.876435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.877160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:15.880117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:15.883629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:15.963160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:16.121508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:16.160420 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2a1e821-b2f8-4d8b-90af-5834a746d861 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 1.081196 Oct 12 09:01:16.161638 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1951/4219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:15 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:16.195628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:16.196604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:16.209123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:16.209993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:16.214764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:16.215997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:16.216622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:16.217467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:16.457117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:16.469704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d14cfb0b-b0c3-4dc8-8dd9-3bf1478d6575 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.615437 Oct 12 09:01:16.476068 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2269/4220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:15 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:16.491563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:16.492904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:16.517054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:16.518893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:16.519539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:16.521300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:16.524727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:16.525180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:16.897725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:16.912111 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-33b37ef1-99cf-4f5f-8cf3-8e5f9ad9116a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.432592 Oct 12 09:01:16.912860 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2270/4221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:16 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:16.930421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:16.931442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:16.940521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:16.941655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:16.942619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:16.943452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:16.944170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:16.944869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:16.962508 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] HTTP exception thrown: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Request method failure captured: Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 HTTP/1.1 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFr-69596GXHfmy5E5SkQBrmJPVMJDJ1pD97VpqMthts7B5F3aIjzXfLitTlUhLLFhlctKZn1P-Cg5tDlWHo67FEkIuaVqPooifeFVVrO9Luo8wj9HhkgRRbjqEtiN7oobQFCiRFb-AjSDe-jdmyjeeACBPP7XCazpAQS4jfab6TDo Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}] Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c3acc9fef23b4066aaf89f766ff219f8 Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '4d1acdb6-1970-410c-a904-67636bdc3d68'} Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:16.964562 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Returning 404 to user: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-443d9682-441e-4616-98ad-46eee3f93f3f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 404 len: 111 microversion: 2.20 time: 0.052025 Oct 12 09:01:16.970637 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2271/4222] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:16 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:16.974542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:16.974952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:16.975739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:16.982873 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-150007d5-8cb3-4c5f-9c1e-8e601380b264 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1472 microversion: 2.1 time: 0.816143 Oct 12 09:01:16.984201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:16.985008 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1952/4223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:16 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1472 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:16.985622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:16.986672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:16.987543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:16.988182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:16.988702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:16.992444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-188c533a-56f6-46fa-a2de-689b83caff13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '.version_select at 0x7f9843de95e0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:17.021069 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-188c533a-56f6-46fa-a2de-689b83caff13 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537088355" status: 204 len: 0 microversion: 2.20 time: 0.033482 Oct 12 09:01:17.026601 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1953/4224] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 09:01:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1537088355 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:01:17.032253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:17.042326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:17.051888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.052554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.053130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.055369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.056984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.058479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.089100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Request method failure captured: Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8/diagnostics HTTP/1.1 Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoI_sTG2RyqOfOzvD2xGvPlaDml82QbkJKBVW3XXyJuS-hW-omVQpKkCT0HW4_lWsmV5RrJXQO_leZLTHX38LnfnKsLehf1KLih1PhDsR1djPehEx04NGJ5fPp3fAJlGYVHv54EsjGURwxMXuiUgKsbfyz9MI0kXVYRvYNYDl1Sc6BE Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: f36147ec13574c09ab0ba1bf380f8b7f Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-565341457 Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f36147ec13574c09ab0ba1bf380f8b7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f36147ec13574c09ab0ba1bf380f8b7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f36147ec13574c09ab0ba1bf380f8b7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f36147ec13574c09ab0ba1bf380f8b7f"}]}] Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-565341457 Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: f36147ec13574c09ab0ba1bf380f8b7f Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-565341457 Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiagnosticsNegativeTest-565341457-project Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 1bb99b0938ef4297ae15dc2eb8da43db Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-565341457-project Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': '950446e2-1715-40cc-bd72-b7e27458a2e8'} Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise self.value Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:17.098103 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:17.103005 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:17.103005 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:17.103005 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 12 09:01:17.103005 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 12 09:01:17.103005 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 12 09:01:17.103005 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:17.103005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:17.103005 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f56ce023-01c0-4501-8872-937ac75a7934 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.073368 Oct 12 09:01:17.107016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1954/4225] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 09:01:17 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8/diagnostics => generated 117 bytes in 79 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:17.116542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:17.118097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:17.125472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.126870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.127492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.128622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.129196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.129767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.166453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:17.309639 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1e6175c1-8544-495b-8f4b-ac4cb6ba5ce5 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "DELETE /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 204 len: 0 microversion: 2.1 time: 0.198201 Oct 12 09:01:17.313266 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1955/4226] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:17 2022] DELETE /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:01:17.318754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-274d2044-312b-4dd5-816d-7816a4e77473 req-8264537a-f255-4950-9343-472197214cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1008c89c-b870-4f0a-92f7-efbf436eeb45", "tag": "5dd2f253-6859-4f70-9e76-d85de64e3a23"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:17.330519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-274d2044-312b-4dd5-816d-7816a4e77473 req-8264537a-f255-4950-9343-472197214cf6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.331924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-274d2044-312b-4dd5-816d-7816a4e77473 req-8264537a-f255-4950-9343-472197214cf6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.332582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-274d2044-312b-4dd5-816d-7816a4e77473 req-8264537a-f255-4950-9343-472197214cf6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.373721 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-274d2044-312b-4dd5-816d-7816a4e77473 req-8264537a-f255-4950-9343-472197214cf6 service nova] Creating event network-changed:5dd2f253-6859-4f70-9e76-d85de64e3a23 for instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 on n-h1-858383-10 Oct 12 09:01:17.393623 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-274d2044-312b-4dd5-816d-7816a4e77473 req-8264537a-f255-4950-9343-472197214cf6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081330 Oct 12 09:01:17.394658 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1956/4227] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:17.409173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:17.410558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:17.418438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.419581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.420288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.421768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.422451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.423104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.510429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:17.522418 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b5e9bf6-5600-43e0-8ce8-77dcf025b5a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.554223 Oct 12 09:01:17.541608 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2272/4228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:16 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:17.554316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:17.555249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:17.564051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.564837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.565560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.566513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.567690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.568528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.737954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:17.745767 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95fdfe68-87f1-4dff-819f-df87dc52876e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1478 microversion: 2.1 time: 0.202701 Oct 12 09:01:17.746656 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2273/4229] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:17 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1478 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:17.754058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:17.754882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:17.762353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.762836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.763268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.764096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.764548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.764967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.918571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:17.927309 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8d180c98-a899-4035-83f0-af1ee7eb928d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.178934 Oct 12 09:01:17.927892 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2274/4230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:17 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:17.934603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:17.935624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:17.950969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.951457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.951898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:17.952611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:17.954714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:17.955506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:18.009787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:18.020041 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cac2d6a2-be40-4a80-aefa-85b3f70b05cc tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.623969 Oct 12 09:01:18.020626 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1957/4231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:17 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:18.050743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-89b78cf5-d844-4e1e-8f03-f9927c344802 req-bbcbc88b-1f89-491e-967b-8c1c2bbb48a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d766526-e1d7-453d-9bfb-5cfe3bdadbef", "tag": "a070931c-3812-4b0a-9dfc-efdde87287fd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:18.075258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-89b78cf5-d844-4e1e-8f03-f9927c344802 req-bbcbc88b-1f89-491e-967b-8c1c2bbb48a9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:18.076398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-89b78cf5-d844-4e1e-8f03-f9927c344802 req-bbcbc88b-1f89-491e-967b-8c1c2bbb48a9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:18.077058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-89b78cf5-d844-4e1e-8f03-f9927c344802 req-bbcbc88b-1f89-491e-967b-8c1c2bbb48a9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:18.094072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-89b78cf5-d844-4e1e-8f03-f9927c344802 req-bbcbc88b-1f89-491e-967b-8c1c2bbb48a9 service nova] Creating event network-changed:a070931c-3812-4b0a-9dfc-efdde87287fd for instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef on n-h2-858383-10 Oct 12 09:01:18.106899 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-89b78cf5-d844-4e1e-8f03-f9927c344802 req-bbcbc88b-1f89-491e-967b-8c1c2bbb48a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081114 Oct 12 09:01:18.108329 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1958/4232] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:18.248094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:18.263152 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a1508179-0c92-4a35-a69c-d09ab00eb0e0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.330409 Oct 12 09:01:18.264270 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2275/4233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:17 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:18.290287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d138c92b-5fbb-4b78-bb6e-aba3fd9041f9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:18.302365 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d138c92b-5fbb-4b78-bb6e-aba3fd9041f9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 1494cbb3-bde6-4bbd-ba43-ad877274f81c has no mapping to a cell. Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d138c92b-5fbb-4b78-bb6e-aba3fd9041f9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/1494cbb3-bde6-4bbd-ba43-ad877274f81c/action HTTP/1.1 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 15 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: {"os-stop": {}} Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 1494cbb3-bde6-4bbd-ba43-ad877274f81c has no mapping to a cell. Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1494cbb3-bde6-4bbd-ba43-ad877274f81c', 'body': {'os-stop': {}}} Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 1494cbb3-bde6-4bbd-ba43-ad877274f81c has no mapping to a cell. Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:18.323325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1494cbb3-bde6-4bbd-ba43-ad877274f81c has no mapping to a cell. Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1494cbb3-bde6-4bbd-ba43-ad877274f81c has no mapping to a cell. Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d138c92b-5fbb-4b78-bb6e-aba3fd9041f9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 1494cbb3-bde6-4bbd-ba43-ad877274f81c has no mapping to a cell. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d138c92b-5fbb-4b78-bb6e-aba3fd9041f9 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/1494cbb3-bde6-4bbd-ba43-ad877274f81c/action" status: 404 len: 117 microversion: 2.1 time: 0.041630 Oct 12 09:01:18.330170 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1959/4234] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:18 2022] POST /compute/v2.1/servers/1494cbb3-bde6-4bbd-ba43-ad877274f81c/action => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:18.337004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:18.338013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:18.344649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:18.345315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:18.346075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:18.347021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:18.347752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:18.348401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:18.771673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:18.773195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:18.788415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:18.789085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:18.789684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:18.790667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:18.791669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:18.793129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:18.878150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:18.893663 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86a19d98-72d2-4b59-8c8e-43504b3d5c89 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.560471 Oct 12 09:01:18.894980 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2276/4235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:18 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:18.928443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:18.929550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:18.936888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:18.937528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:18.939452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:18.940280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:18.941077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:18.941662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:19.458439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:19.476079 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2af0301d-e13a-418e-b436-730011510645 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.551842 Oct 12 09:01:19.485328 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2277/4236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:18 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:19.490425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:19.498412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:19.504852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:19.518727 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e999c549-5aa6-442c-8432-36853beaad6e tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1478 microversion: 2.1 time: 0.751622 Oct 12 09:01:19.522320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:19.523025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:19.523630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:19.524548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:19.525175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:19.525803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:19.529523 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1960/4237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:18 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1478 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:01:19.540108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:19.541983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:19.555152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:19.567240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:19.568882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:19.570054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:19.572333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:19.573296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:19.901832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:19.911139 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34e9d0f4-0252-4279-9afc-2b5aa1ec7c81 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.424552 Oct 12 09:01:19.911990 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2278/4238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:19 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:19.917694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4aedae79-fe32-4e14-a153-cf21a072c05a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:19.918434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4aedae79-fe32-4e14-a153-cf21a072c05a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 75e9263a-c228-4743-8617-a2a05f87bd53] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:19.924304 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4aedae79-fe32-4e14-a153-cf21a072c05a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 75e9263a-c228-4743-8617-a2a05f87bd53 could not be found. Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4aedae79-fe32-4e14-a153-cf21a072c05a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/75e9263a-c228-4743-8617-a2a05f87bd53/action HTTP/1.1 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 15 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: {"suspend": {}} Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 75e9263a-c228-4743-8617-a2a05f87bd53 could not be found. Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '75e9263a-c228-4743-8617-a2a05f87bd53', 'body': {'suspend': {}}} Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e9263a-c228-4743-8617-a2a05f87bd53 could not be found. Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e9263a-c228-4743-8617-a2a05f87bd53 could not be found. Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:19.926019 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:19.931229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:19.931229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:19.931229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e9263a-c228-4743-8617-a2a05f87bd53 could not be found. Oct 12 09:01:19.931229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:19.931229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4aedae79-fe32-4e14-a153-cf21a072c05a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 75e9263a-c228-4743-8617-a2a05f87bd53 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:19.931229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4aedae79-fe32-4e14-a153-cf21a072c05a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/75e9263a-c228-4743-8617-a2a05f87bd53/action" status: 404 len: 111 microversion: 2.1 time: 0.014384 Oct 12 09:01:19.931229 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2279/4239] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:19 2022] POST /compute/v2.1/servers/75e9263a-c228-4743-8617-a2a05f87bd53/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:19.932678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e367f382-689a-47ee-8714-24b90e3eafa8 req-08537e80-c222-45c0-b350-774811aa1b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34fedf2-688b-4b8c-a56c-81effb6d4a75", "tag": "06ed3d86-cdd1-42d5-b8c7-4b0adcf62534"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:19.943115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e367f382-689a-47ee-8714-24b90e3eafa8 req-08537e80-c222-45c0-b350-774811aa1b26 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:19.943807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e367f382-689a-47ee-8714-24b90e3eafa8 req-08537e80-c222-45c0-b350-774811aa1b26 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:19.944277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e367f382-689a-47ee-8714-24b90e3eafa8 req-08537e80-c222-45c0-b350-774811aa1b26 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:19.957279 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e367f382-689a-47ee-8714-24b90e3eafa8 req-08537e80-c222-45c0-b350-774811aa1b26 service nova] Creating event network-changed:06ed3d86-cdd1-42d5-b8c7-4b0adcf62534 for instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 on n-h1-858383-10 Oct 12 09:01:19.962387 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e367f382-689a-47ee-8714-24b90e3eafa8 req-08537e80-c222-45c0-b350-774811aa1b26 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032876 Oct 12 09:01:19.962992 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2280/4240] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:19.968051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9444ec60-5e0c-4cb2-ae21-d8dfff2aed1b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'create', calling method: .version_select at 0x7f9843e673a0>, body: {"keypair": {"name": "tempest-keypair-681091838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7vUyZCVPEkkePVmsAq5bZGqA1l/i9WJIyHj5gOMuP8k3SbR/0oLdod/WcRJ/zLEcDz1/Csit82kRwtx/x+NqJY0VzBq9hAk6bfoflGwqsvMFJ4xQTRJ/VqOyrBYsIJPg=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:19.984463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9444ec60-5e0c-4cb2-ae21-d8dfff2aed1b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Getting quotas for project 21e58c2e8c6c4f06a55edf513222d10b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:19.990254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9444ec60-5e0c-4cb2-ae21-d8dfff2aed1b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Getting quotas for user c3acc9fef23b4066aaf89f766ff219f8 and project 21e58c2e8c6c4f06a55edf513222d10b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:20.016854 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9444ec60-5e0c-4cb2-ae21-d8dfff2aed1b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052614 Oct 12 09:01:20.017855 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2281/4241] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 09:01:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 09:01:20.022566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:20.023308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:20.032078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:20.033305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:20.033305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:20.033789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:20.034257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:20.034721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:20.228763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:20.241023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c492ed6d-6115-4030-b5b1-9e1bc646087c tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.709852 Oct 12 09:01:20.254017 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1961/4242] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:19 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:20.281921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:20.296634 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68a6e64c-cf9d-4bcf-9db0-5efa3704e14e tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.277559 Oct 12 09:01:20.298270 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2282/4243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:20 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:20.327340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:20.329298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:20.341848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:20.352232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:20.353082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:20.353773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:20.354568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:20.357091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:20.357630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:20.545621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:20.546308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:20.554122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:20.554822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:20.555474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:20.556566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:20.557244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:20.557872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:20.887338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:20.899759 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a853b494-f609-40ae-bf2e-fe042f1b5733 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1478 microversion: 2.1 time: 0.358447 Oct 12 09:01:20.900944 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2283/4244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:20 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1478 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:20.935418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:20.936094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:20.942484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:20.943222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:20.943844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:20.944961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:20.945612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:20.946231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.227292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:21.239262 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c65c0715-e53c-4215-ab2d-14aa2fa627ad tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.308293 Oct 12 09:01:21.246960 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2284/4245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:20 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:21.271287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:21.272199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:21.281284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:21.282001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:21.284696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.285758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:21.286230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:21.286663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.291690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:21.356733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:21.375262 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-416b932d-fa95-43ac-9c39-efd812004635 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 1.054801 Oct 12 09:01:21.376105 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1962/4246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:20 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:21.407539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:21.408086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:21.422215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:21.429608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:21.430489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.431434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:21.432291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:21.432894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.451194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=12 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:21.464039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lazy-loading 'flavor' on Instance uuid a870435b-8aa5-456d-b0ca-477ee2201dbb {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:01:21.581236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:21.598977 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5747b82e-d578-4870-affa-cb84e131d3fa tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.329072 Oct 12 09:01:21.601908 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2285/4247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:21 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:21.608627 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fc5fd26a-aa11-49b8-aa2c-dd337394c9e8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.205281 Oct 12 09:01:21.614617 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1963/4248] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:21 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:01:21.618937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:21.619612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:21.643487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:21.643990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:21.644423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.645155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:21.645638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:21.646060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.877550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:21.891022 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3479d80-65ac-45d2-83ae-7e8e3f8ba042 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1514 microversion: 2.1 time: 0.275475 Oct 12 09:01:21.892454 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2286/4249] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:21 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:21.940946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:21.945399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:21.972107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:21.972616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:21.973071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.975360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:21.976326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:21.977616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:21.982487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:22.069234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c6dd9cf1-9c8e-475d-b776-964b31e10ea7 req-f6e05a2e-4b3a-4e73-b8fd-bfe2320be059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "950446e2-1715-40cc-bd72-b7e27458a2e8", "name": "network-vif-deleted", "tag": "c5bb81ce-64fa-41da-93d1-4606078fa391"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:22.080835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c6dd9cf1-9c8e-475d-b776-964b31e10ea7 req-f6e05a2e-4b3a-4e73-b8fd-bfe2320be059 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:22.081496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c6dd9cf1-9c8e-475d-b776-964b31e10ea7 req-f6e05a2e-4b3a-4e73-b8fd-bfe2320be059 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:22.081828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c6dd9cf1-9c8e-475d-b776-964b31e10ea7 req-f6e05a2e-4b3a-4e73-b8fd-bfe2320be059 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:22.096718 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c6dd9cf1-9c8e-475d-b776-964b31e10ea7 req-f6e05a2e-4b3a-4e73-b8fd-bfe2320be059 service nova] Creating event network-vif-deleted:c5bb81ce-64fa-41da-93d1-4606078fa391 for instance 950446e2-1715-40cc-bd72-b7e27458a2e8 on n-h2-858383-10 Oct 12 09:01:22.103679 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c6dd9cf1-9c8e-475d-b776-964b31e10ea7 req-f6e05a2e-4b3a-4e73-b8fd-bfe2320be059 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038563 Oct 12 09:01:22.104306 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2287/4250] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:22.126536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bb99b0938ef4297ae15dc2eb8da43db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36147ec13574c09ab0ba1bf380f8b7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:22.137542 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24ae19a7-7dbb-4455-93c9-48420fc202c2 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 200 len: 1436 microversion: 2.1 time: 0.216004 Oct 12 09:01:22.138934 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1964/4251] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:21 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 1436 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:22.270802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:22.271745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:22.298247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:22.305071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:22.305878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:22.306944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:22.314424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:22.315581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:22.631498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:22.634140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:22.650716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:22.651408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:22.652948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:22.654160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:22.656548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:22.657663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:22.707254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:22.722144 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4505028d-4f31-4152-b234-9a42702c4883 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.462912 Oct 12 09:01:22.722904 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2288/4252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:22 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:01:22.920921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:22.921569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:22.935178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:22.935873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:22.936328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:22.937092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:22.937638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:22.938077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:23.035538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:23.055054 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ceb6d01-bd46-4d21-999e-38eb3f764037 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.432770 Oct 12 09:01:23.076217 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1965/4253] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:22 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:23.267716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:23.281063 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a24e8c77-a0ea-4f52-8bb1-058109775bb0 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1514 microversion: 2.1 time: 0.364975 Oct 12 09:01:23.289970 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2289/4254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:22 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1514 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:01:23.303307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1798318559", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e20b0bd-ac45-475e-baa9-733715fa2691"}], "security_groups": [{"name": "tempest-securitygroup--1075430995"}], "key_name": "tempest-keypair-681091838", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:23.431372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] validate_networks() for [('0e20b0bd-ac45-475e-baa9-733715fa2691', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:01:23.458330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:23.459320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:23.469157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:23.470019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:23.471258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:23.472415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:23.473119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:23.474074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:23.506133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:23.620160 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d2516e6f-2e0c-4d58-a633-d9f189712d64 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 204 len: 0 microversion: 2.42 time: 0.540607 Oct 12 09:01:23.622232 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1966/4255] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:01:23 2022] DELETE /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:01:23.630111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:23.630991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] [instance: 950446e2-1715-40cc-bd72-b7e27458a2e8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:23.638404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:23.639075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:23.639706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:23.640098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:23.640563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:23.640992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:23.665311 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] HTTP exception thrown: Instance 950446e2-1715-40cc-bd72-b7e27458a2e8 could not be found. Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Request method failure captured: Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 HTTP/1.1 Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoI_sTG2RyqOfOzvD2xGvPlaDml82QbkJKBVW3XXyJuS-hW-omVQpKkCT0HW4_lWsmV5RrJXQO_leZLTHX38LnfnKsLehf1KLih1PhDsR1djPehEx04NGJ5fPp3fAJlGYVHv54EsjGURwxMXuiUgKsbfyz9MI0kXVYRvYNYDl1Sc6BE Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: f36147ec13574c09ab0ba1bf380f8b7f Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-565341457 Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f36147ec13574c09ab0ba1bf380f8b7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f36147ec13574c09ab0ba1bf380f8b7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f36147ec13574c09ab0ba1bf380f8b7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f36147ec13574c09ab0ba1bf380f8b7f"}]}] Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-565341457 Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: f36147ec13574c09ab0ba1bf380f8b7f Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-565341457 Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiagnosticsNegativeTest-565341457-project Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 1bb99b0938ef4297ae15dc2eb8da43db Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-565341457-project Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 950446e2-1715-40cc-bd72-b7e27458a2e8 could not be found. Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '950446e2-1715-40cc-bd72-b7e27458a2e8'} Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 950446e2-1715-40cc-bd72-b7e27458a2e8 could not be found. Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 950446e2-1715-40cc-bd72-b7e27458a2e8 could not be found. Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:23.667185 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 950446e2-1715-40cc-bd72-b7e27458a2e8 could not be found. Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] Returning 404 to user: Instance 950446e2-1715-40cc-bd72-b7e27458a2e8 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b767ba3c-4f46-4f35-ad39-bf5c8b8de0f0 tempest-ServerDiagnosticsNegativeTest-565341457 tempest-ServerDiagnosticsNegativeTest-565341457-project] 10.222.0.40 "GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8" status: 404 len: 111 microversion: 2.1 time: 0.046210 Oct 12 09:01:23.674459 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1967/4256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:23 2022] GET /compute/v2.1/servers/950446e2-1715-40cc-bd72-b7e27458a2e8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:23.742936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1864628399", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:23.815282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] validate_networks() for [('8a6f6a8e-e442-44bd-9afd-4a5283ff7543', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:01:23.964608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:01:23.965757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:01:23.966601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:01:23.967451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:01:23.968111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:01:23.979951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:23.992076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:23.992814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:23.993891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:23.994455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:23.995885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:24.015501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Getting quotas for project 21e58c2e8c6c4f06a55edf513222d10b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:24.022299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Getting quotas for user c3acc9fef23b4066aaf89f766ff219f8 and project 21e58c2e8c6c4f06a55edf513222d10b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:24.045593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:01:24.052969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:01:24.131893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-01ae9e24-e4d1-412a-b114-8e48b636a393 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.837914 Oct 12 09:01:24.131893 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2290/4257] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 09:01:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 09:01:24.140758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:24.141484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:24.153198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:24.161865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:24.162577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:24.163688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:24.164625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:24.165699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:24.410564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:24.421969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:24.424724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:24.426268 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2de29519-598c-42fa-8d44-46fa3d0a520f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2957 microversion: 2.42 time: 0.292977 Oct 12 09:01:24.427674 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2291/4258] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:24 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2957 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:24.440693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:24.445025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:24.453260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:24.454092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:24.454860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:24.455902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:24.456561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:24.457212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:24.655366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:24.673212 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f873280-fe20-4c33-ab14-464caf780e3c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.244016 Oct 12 09:01:24.674873 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2292/4259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:24 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:24.680503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:24.683127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:24.691701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:24.693290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:24.694130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:24.696853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:24.698167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:24.698883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:24.931487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:24.944585 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3aded81-0bed-42ab-9e52-383d671df373 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.268242 Oct 12 09:01:24.945920 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2293/4260] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:24 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:24.958396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:24.959472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:24.982340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:24.985334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:24.985856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:24.988292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:24.991622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:24.992110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.068598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:01:25.069205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:01:25.070096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:01:25.070508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:01:25.075672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:01:25.099717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.103742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.104273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.106033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.107270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.107887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.134694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Getting quotas for project 871b74422aee4f06a5f419f07d03936d. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:25.143372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Getting quotas for user 37e4d1277960411f909bf8e4da358e3f and project 871b74422aee4f06a5f419f07d03936d. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:25.162960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:01:25.165559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:01:25.191887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:25.206262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:25.208773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:25.210970 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ec913c5-4234-49e2-93d0-fc5a524e3096 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1285 microversion: 2.20 time: 0.263395 Oct 12 09:01:25.212276 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2294/4261] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:24 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:25.217263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:25.218162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:25.226323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.227128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.227795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.228701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.229355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.230001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.263923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:25.312830 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-56dbf920-0457-490f-90c1-3c5f00a425bd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639774 Oct 12 09:01:25.316513 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1968/4262] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:01:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:01:25.339170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a4a7ef9d-ace7-490c-a7dd-0148a0b2d9bd req-38771024-de6f-40d7-93a9-52570305bc0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1008c89c-b870-4f0a-92f7-efbf436eeb45", "name": "network-vif-plugged", "status": "completed", "tag": "5dd2f253-6859-4f70-9e76-d85de64e3a23"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:25.359666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a4a7ef9d-ace7-490c-a7dd-0148a0b2d9bd req-38771024-de6f-40d7-93a9-52570305bc0a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.360628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a4a7ef9d-ace7-490c-a7dd-0148a0b2d9bd req-38771024-de6f-40d7-93a9-52570305bc0a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.360628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a4a7ef9d-ace7-490c-a7dd-0148a0b2d9bd req-38771024-de6f-40d7-93a9-52570305bc0a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.419750 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a4a7ef9d-ace7-490c-a7dd-0148a0b2d9bd req-38771024-de6f-40d7-93a9-52570305bc0a service nova] Creating event network-vif-plugged:5dd2f253-6859-4f70-9e76-d85de64e3a23 for instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 on n-h1-858383-10 Oct 12 09:01:25.432214 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a4a7ef9d-ace7-490c-a7dd-0148a0b2d9bd req-38771024-de6f-40d7-93a9-52570305bc0a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103849 Oct 12 09:01:25.432826 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1969/4263] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:25.434006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:25.445074 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43859e06-343a-47e0-9da4-486b00753565 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1497 microversion: 2.1 time: 0.231438 Oct 12 09:01:25.446870 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2295/4264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:25 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:25.456600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:25.457680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:25.465831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-25ba09b3-0e50-48fc-ab41-013f5cebf16f tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:25.465831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-25ba09b3-0e50-48fc-ab41-013f5cebf16f tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:25.478110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.480993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.482063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.484053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.485907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.487463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.606494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-25ba09b3-0e50-48fc-ab41-013f5cebf16f tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:25.615042 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-25ba09b3-0e50-48fc-ab41-013f5cebf16f tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1224 microversion: 2.1 time: 0.180974 Oct 12 09:01:25.618451 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1970/4265] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:25 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1224 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:25.632485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:25.633642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:25.650419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.651907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.654513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.656984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.659661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.664747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.741538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lazy-loading 'flavor' on Instance uuid a870435b-8aa5-456d-b0ca-477ee2201dbb {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:01:25.777895 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Cannot 'suspend' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state suspended Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action HTTP/1.1 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 15 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: {"suspend": {}} Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'suspend' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state suspended Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'suspend': {}}} Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb in vm_state suspended. Cannot suspend while the instance is in this state. Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 12 09:01:25.780009 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state suspended Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state suspended Oct 12 09:01:25.785345 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:25.787183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 409 to user: Cannot 'suspend' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state suspended {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:25.788492 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fb1e8965-5237-4391-8079-1730294749a3 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 409 len: 148 microversion: 2.1 time: 0.168498 Oct 12 09:01:25.790493 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1971/4266] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:25 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 148 bytes in 171 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:01:25.806066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:25.807074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:25.814726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.815465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.816705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.817691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.818328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.818975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.870436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:25.884698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:25.886891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:25.888222 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eca2ee60-1cbd-48bc-9b5e-81853f9c0120 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2957 microversion: 2.42 time: 0.435787 Oct 12 09:01:25.892407 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2296/4267] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:25 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2957 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:01:25.922675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:25.924374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:25.947177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.947703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.948150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:25.956329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:25.956837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:25.957299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:26.154333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:26.178112 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-90d4c520-267b-410d-baf5-3ee70037e66f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.386259 Oct 12 09:01:26.201024 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1972/4268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:25 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:26.211973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:26.215205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:26.228263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:26.229225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:26.230022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:26.231329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:26.232119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:26.232881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:26.238427 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c5ae699c-b705-49f1-9904-50584504fed7 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 202 len: 0 microversion: 2.1 time: 0.339963 Oct 12 09:01:26.239327 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2297/4269] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:25 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:26.252716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:26.253467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:26.288704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:26.289223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:26.289671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:26.290394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:26.291335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:26.291335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:26.475871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:26.495875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:26.504089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:26.516863 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c6b4105-b149-4e5a-a9d9-f79f301e0d1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1341 microversion: 2.20 time: 0.274100 Oct 12 09:01:26.535943 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2298/4270] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:26 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1341 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:26.546218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:26.546850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:26.556771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:26.558464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:26.559124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:26.560202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:26.560963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:26.561702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:26.573710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:26.583732 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8dc2bf24-bc99-4a34-8668-5e8e169c01e5 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.379925 Oct 12 09:01:26.595470 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1973/4271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:26 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:26.640871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:26.641704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:26.655749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:26.657343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:26.661949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:26.663201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:26.665676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:26.669261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:27.028425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:27.053549 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-21cc81f7-b9f6-4289-b1a2-8ae74479b97c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1228 microversion: 2.1 time: 0.416225 Oct 12 09:01:27.055549 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1974/4272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:26 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1228 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:27.055878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:27.067947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cbd6da8b-b76e-48eb-8e06-8170d5797513 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1503 microversion: 2.1 time: 0.530856 Oct 12 09:01:27.075227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:27.077541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:27.094317 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2299/4273] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:26 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:27.110716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:27.111224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:27.118140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:27.119004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:27.119487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:27.124865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:27.206460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:27.207083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:27.224285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:27.225292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:27.226149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:27.227822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:27.229812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:27.230986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:27.585683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:27.594622 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6df7741-41ee-4959-9600-8b9c1006b8cb tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.391972 Oct 12 09:01:27.599540 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2300/4274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:27 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:27.608041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4ed2822c-a392-4b44-ad34-03228c11e58b req-0f1325cc-a469-4b96-8015-b783f44faade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad091b2-96e3-448b-a975-38d05c0b9fcc", "name": "network-vif-plugged", "status": "completed", "tag": "4973927d-3082-4655-9edc-32330b1fe74f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:27.631306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4ed2822c-a392-4b44-ad34-03228c11e58b req-0f1325cc-a469-4b96-8015-b783f44faade service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:27.631817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4ed2822c-a392-4b44-ad34-03228c11e58b req-0f1325cc-a469-4b96-8015-b783f44faade service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:27.632257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4ed2822c-a392-4b44-ad34-03228c11e58b req-0f1325cc-a469-4b96-8015-b783f44faade service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:27.644323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4ed2822c-a392-4b44-ad34-03228c11e58b req-0f1325cc-a469-4b96-8015-b783f44faade service nova] Creating event network-vif-plugged:4973927d-3082-4655-9edc-32330b1fe74f for instance fad091b2-96e3-448b-a975-38d05c0b9fcc on n-h2-858383-10 Oct 12 09:01:27.650633 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4ed2822c-a392-4b44-ad34-03228c11e58b req-0f1325cc-a469-4b96-8015-b783f44faade service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049463 Oct 12 09:01:27.651265 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2301/4275] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:27.658002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:27.658945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:27.675169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:27.677119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:27.677669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:27.679610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:27.680435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:27.680912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:27.681360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:27.906071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:27.915999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:27.924412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:27.928770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:27.932087 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2e9fe413-d9ba-4fb1-b0b6-d24333174d5c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1339 microversion: 2.20 time: 0.278168 Oct 12 09:01:27.932737 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2302/4276] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:27 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1339 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:27.975153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:27.975447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:28.014611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:28.015121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:28.015569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:28.018692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:28.019216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:28.019663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:28.374195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:28.385029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4398ed4c-ed96-4430-8f44-b975dbf43217 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1327 microversion: 2.1 time: 0.434918 Oct 12 09:01:28.385892 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2303/4277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:27 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1327 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:28.390845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:28.391456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:28.404644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:28.411500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:28.413197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:28.414707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:28.415376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:28.415991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:28.453375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:28.466750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:28.470385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:28.472383 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-91a634cd-8b85-46e9-b6e6-28844d0a7188 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2957 microversion: 2.42 time: 1.415826 Oct 12 09:01:28.473628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1975/4278] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:27 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2957 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:28.488722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:28.490227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:28.509538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:28.512285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:28.515387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:28.531005 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04654cf4-bfe4-444b-a993-364c183ecb34 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1276 microversion: 2.1 time: 0.140034 Oct 12 09:01:28.532035 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2304/4279] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:28 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:28.541419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:28.544243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:28.544840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:28.547378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:28.822666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-87ba2479-15a6-47de-b5cf-7255218beb7f tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:28.837583 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-87ba2479-15a6-47de-b5cf-7255218beb7f tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.303305 Oct 12 09:01:28.838775 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2305/4280] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:28.853752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:28.854377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:28.872715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:28.874018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:28.874659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:28.875573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:28.876232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:28.876833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:29.145215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:29.156020 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1848506b-7534-4f57-828e-2226e3b8da97 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1322 microversion: 2.1 time: 0.314690 Oct 12 09:01:29.170247 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2306/4281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:28 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:29.181942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fca932f1-96b5-454d-b10d-9afa6e96c651 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:29.216663 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fca932f1-96b5-454d-b10d-9afa6e96c651 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.042571 Oct 12 09:01:29.217948 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2307/4282] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:01:29 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:29.223261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:29.224248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:29.235147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:29.237891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:29.238689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:29.239706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:29.240443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:29.241306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:29.333735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:29.360095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:29.362215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:29.363593 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8329247b-a782-4b61-8ca8-0bf2626974dd tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1339 microversion: 2.20 time: 0.144413 Oct 12 09:01:29.364691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2308/4283] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:29 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:29.369955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de1601c1-00f1-48c1-8423-85cf313ca33f tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:29.382725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de1601c1-00f1-48c1-8423-85cf313ca33f tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014105 Oct 12 09:01:29.385360 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2309/4284] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:29.399772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6e2de931-1c55-4341-83d5-cda3905b1238 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:29.423346 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6e2de931-1c55-4341-83d5-cda3905b1238 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028076 Oct 12 09:01:29.429993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2310/4285] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:01:29.440638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:29.441299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:29.461087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:29.465913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:29.466743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:29.467717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:29.468178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:29.468558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:29.816855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:29.818170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:29.829661 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9564f78c-4978-4070-b9f4-19c315019505 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1503 microversion: 2.1 time: 1.353810 Oct 12 09:01:29.832346 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1976/4286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:28 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1503 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:29.843403 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3c6ad7e-c475-4150-9272-902bd5625592 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1527 microversion: 2.1 time: 0.411065 Oct 12 09:01:29.845850 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2311/4287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:29 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1527 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:29.847876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-696c5a76-5d36-44a0-b41c-49b68f11adc8 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:29.868448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:29.872724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:29.894324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:29.894848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:29.910336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:29.911116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:29.911592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:29.912021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:29.926216 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-696c5a76-5d36-44a0-b41c-49b68f11adc8 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.092654 Oct 12 09:01:29.926804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1977/4288] 10.222.0.40 () {58 vars in 1165 bytes} [Wed Oct 12 09:01:29 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:29.939446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:29.940068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:29.967975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:29.968455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:29.968889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:29.969624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:29.973513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:29.974196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.109086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:30.118216 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-565a346a-87b5-4c68-b31e-b89fb7687840 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1282 microversion: 2.1 time: 0.183542 Oct 12 09:01:30.121589 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1978/4289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:29 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1282 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:30.140895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b6b5de76-28ab-4480-9f40-e1397919e599 req-619160ef-d4c0-41bc-80c0-48d7e683fbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d766526-e1d7-453d-9bfb-5cfe3bdadbef", "name": "network-vif-plugged", "status": "completed", "tag": "a070931c-3812-4b0a-9dfc-efdde87287fd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:30.151541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6b5de76-28ab-4480-9f40-e1397919e599 req-619160ef-d4c0-41bc-80c0-48d7e683fbe9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.152289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6b5de76-28ab-4480-9f40-e1397919e599 req-619160ef-d4c0-41bc-80c0-48d7e683fbe9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.153278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6b5de76-28ab-4480-9f40-e1397919e599 req-619160ef-d4c0-41bc-80c0-48d7e683fbe9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.166811 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b6b5de76-28ab-4480-9f40-e1397919e599 req-619160ef-d4c0-41bc-80c0-48d7e683fbe9 service nova] Creating event network-vif-plugged:a070931c-3812-4b0a-9dfc-efdde87287fd for instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef on n-h2-858383-10 Oct 12 09:01:30.174016 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b6b5de76-28ab-4480-9f40-e1397919e599 req-619160ef-d4c0-41bc-80c0-48d7e683fbe9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048722 Oct 12 09:01:30.175184 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1979/4290] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:30.184283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:30.186177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:30.199720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.200479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.201179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.202164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.203155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.203788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.526828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:30.527282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:30.536061 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-053226d0-ff2b-4c67-8959-e3bed1ca4fc0 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1527 microversion: 2.1 time: 0.359441 Oct 12 09:01:30.538878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:30.544098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:30.548674 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-839d6e83-cd77-4750-8e4c-4ee9b327c361 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2957 microversion: 2.42 time: 0.695761 Oct 12 09:01:30.549761 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2312/4292] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:29 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2957 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:30.549888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1980/4292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:30 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1527 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:30.557852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c45f0a1-74d2-4dab-8744-884caa5bc72b tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:30.572926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:30.573155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:30.587459 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c45f0a1-74d2-4dab-8744-884caa5bc72b tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033266 Oct 12 09:01:30.588273 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2313/4293] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:30.598370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:30.603032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:30.612874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.613384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.613868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.614588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.615045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.617900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.626301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.631435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.639051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.640039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.640544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.641131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.731166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:30.745244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:30.747515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:30.748754 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-894ee47c-ff15-4e1f-8490-f98c39a8987a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1339 microversion: 2.20 time: 0.158443 Oct 12 09:01:30.758503 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2314/4294] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:30 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1339 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:30.900508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:30.901718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:30.907967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.908454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.909251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.910000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:30.910465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:30.910897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:30.925857 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] HTTP exception thrown: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Request method failure captured: Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 HTTP/1.1 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJMGaQqLox6CNV3bAaVknXAV3CRT3I_YQm0nnizpEvO4gBMgkE8PM3TGz75rHshklHXrVo-2jA68Had2ukgM-T0ItsaifiBK3Yo2-ocYd7zNWP0IJbzJ4_1vOGFTp4Ls7TcgVdr3lBVU1glViRJwUDF6x60uTqevaN7Y3Cetur7mEE Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e66168ee28e24cd08b2c5f0eb7e680e8 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-231034213 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e66168ee28e24cd08b2c5f0eb7e680e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e66168ee28e24cd08b2c5f0eb7e680e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e66168ee28e24cd08b2c5f0eb7e680e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e66168ee28e24cd08b2c5f0eb7e680e8"}]}] Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-231034213 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e66168ee28e24cd08b2c5f0eb7e680e8 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-231034213 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestMultiTenantJSON-231034213-project Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 6a31eb2b9568479fbb210c6d56477d44 Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-231034213-project Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '1008c89c-b870-4f0a-92f7-efbf436eeb45'} Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:30.928201 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:30.934671 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:30.947309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Returning 404 to user: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:30.947309 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-377a97f0-6177-4d18-892b-64f875ea4cbb tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 404 len: 111 microversion: 2.1 time: 0.189968 Oct 12 09:01:30.948194 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2315/4295] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:30 2022] DELETE /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:30.955950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-512bd999-d6f2-4dba-8c99-74fe3ea42a7f tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:30.998305 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-512bd999-d6f2-4dba-8c99-74fe3ea42a7f tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.048470 Oct 12 09:01:31.015039 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2316/4296] 10.222.0.40 () {58 vars in 1169 bytes} [Wed Oct 12 09:01:30 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:31.020432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:31.022064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:31.028640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.029617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.030074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.031348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.032077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.032770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.083395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:31.093228 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c8a0ee0-9b6e-49e6-9762-3daee0934fd3 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 200 len: 1515 microversion: 2.1 time: 0.542276 Oct 12 09:01:31.107390 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1981/4297] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:30 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 1515 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:31.119507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:31.120392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:31.132725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.133644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.134342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.135800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.138027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.140172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.343296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:31.355188 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89dfbbb6-4928-4f65-810d-27a51ae4fc24 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.338645 Oct 12 09:01:31.373857 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2317/4298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:31 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:31.381913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-522990ef-b51a-4827-b37a-e340e61418c2 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:31.405696 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-522990ef-b51a-4827-b37a-e340e61418c2 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.042800 Oct 12 09:01:31.407770 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2318/4299] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 09:01:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:31.420716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:31.423454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:31.437867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.438366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.438799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.439520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.439971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.442905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.742614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:31.758717 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2331dd69-61d2-4f4f-8832-3f13c7ae7959 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1527 microversion: 2.1 time: 0.649877 Oct 12 09:01:31.762244 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1982/4300] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:31 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1527 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:31.775519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:31.777945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:31.798454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:31.808159 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90afa05e-e055-44c4-9e2c-263c70a69a21 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1322 microversion: 2.1 time: 0.399253 Oct 12 09:01:31.820587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.821075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.821539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.821936 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2319/4301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:31 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:31.822832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.823301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.823710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.842006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:31.844733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:31.869925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.871214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.871893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:31.873633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:31.874901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:31.875593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.177033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:32.189256 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f8960c6-4275-4115-8c9f-245e1df3aadd tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.362927 Oct 12 09:01:32.190872 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2320/4302] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:31 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:32.220143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-77c52589-7fea-4102-8e20-0313f531ae4e tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:32.231375 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-77c52589-7fea-4102-8e20-0313f531ae4e tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037918 Oct 12 09:01:32.232279 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2321/4303] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:32.238597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:32.239857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:32.249823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.250736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.251355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.252441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.253680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.254304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.352827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:32.359231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:32.371021 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e4be98e-ff53-4c70-b6a0-067d85e85a94 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1324 microversion: 2.1 time: 0.605866 Oct 12 09:01:32.387743 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1983/4304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:31 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1324 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:32.394507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:32.395386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:32.404641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.407835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.408478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.409378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.419191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.419835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.551678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:32.562217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:32.564240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:32.566075 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4c1a0228-5e0e-4745-ab5d-676368051d5d tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2936 microversion: 2.42 time: 0.332597 Oct 12 09:01:32.577986 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2322/4305] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:32 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2936 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:32.594587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Action: 'update', calling method: >, body: {"server": {"name": "1008c89c-b870-4f0a-92f7-efbf436eeb45_new"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:32.598243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:32.605910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.606626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.607306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.608327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.609137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.609867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.627411 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] HTTP exception thrown: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Request method failure captured: Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 HTTP/1.1 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 64 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJMGaQqLox6CNV3bAaVknXAV3CRT3I_YQm0nnizpEvO4gBMgkE8PM3TGz75rHshklHXrVo-2jA68Had2ukgM-T0ItsaifiBK3Yo2-ocYd7zNWP0IJbzJ4_1vOGFTp4Ls7TcgVdr3lBVU1glViRJwUDF6x60uTqevaN7Y3Cetur7mEE Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e66168ee28e24cd08b2c5f0eb7e680e8 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-231034213 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e66168ee28e24cd08b2c5f0eb7e680e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e66168ee28e24cd08b2c5f0eb7e680e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e66168ee28e24cd08b2c5f0eb7e680e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e66168ee28e24cd08b2c5f0eb7e680e8"}]}] Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-231034213 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e66168ee28e24cd08b2c5f0eb7e680e8 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-231034213 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestMultiTenantJSON-231034213-project Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 6a31eb2b9568479fbb210c6d56477d44 Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-231034213-project Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "1008c89c-b870-4f0a-92f7-efbf436eeb45_new"}} Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '1008c89c-b870-4f0a-92f7-efbf436eeb45', 'body': {'server': {'name': '1008c89c-b870-4f0a-92f7-efbf436eeb45_new'}}} Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:32.629402 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:32.636223 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.639787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] Returning 404 to user: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:32.640900 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d7afc088-b516-46e2-8a0e-f3f55bf56553 tempest-ServersNegativeTestMultiTenantJSON-231034213 tempest-ServersNegativeTestMultiTenantJSON-231034213-project] 10.222.0.40 "PUT /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 404 len: 111 microversion: 2.1 time: 0.059947 Oct 12 09:01:32.646663 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2323/4306] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 09:01:32 2022] PUT /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:32.689837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:32.701766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:32.703394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:32.705967 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-835a876e-e0c6-4733-83b5-e5f8137047ef tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1407 microversion: 2.20 time: 0.315751 Oct 12 09:01:32.707707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df4dfd8c-62b8-458d-9f36-024b8ef2bcd5 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843e1dca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1882403982", "description": "tempest-description-1247908986"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:32.720469 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1984/4307] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:32 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:32.734043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efcc895c-8ec4-48cc-a754-b09c8b30ea5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:32.734959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-efcc895c-8ec4-48cc-a754-b09c8b30ea5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 6dbeb11e-37f4-4437-bc2e-9b9429e54b3c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:32.742987 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-efcc895c-8ec4-48cc-a754-b09c8b30ea5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 6dbeb11e-37f4-4437-bc2e-9b9429e54b3c could not be found. Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efcc895c-8ec4-48cc-a754-b09c8b30ea5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/6dbeb11e-37f4-4437-bc2e-9b9429e54b3c/action HTTP/1.1 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 15 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: {"unpause": {}} Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 6dbeb11e-37f4-4437-bc2e-9b9429e54b3c could not be found. Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '6dbeb11e-37f4-4437-bc2e-9b9429e54b3c', 'body': {'unpause': {}}} Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbeb11e-37f4-4437-bc2e-9b9429e54b3c could not be found. Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbeb11e-37f4-4437-bc2e-9b9429e54b3c could not be found. Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:32.744972 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:32.750473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:32.750473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:32.750473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbeb11e-37f4-4437-bc2e-9b9429e54b3c could not be found. Oct 12 09:01:32.750473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:32.752430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efcc895c-8ec4-48cc-a754-b09c8b30ea5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 6dbeb11e-37f4-4437-bc2e-9b9429e54b3c could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:32.753503 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efcc895c-8ec4-48cc-a754-b09c8b30ea5f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/6dbeb11e-37f4-4437-bc2e-9b9429e54b3c/action" status: 404 len: 111 microversion: 2.1 time: 0.031708 Oct 12 09:01:32.754573 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1985/4308] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:32 2022] POST /compute/v2.1/servers/6dbeb11e-37f4-4437-bc2e-9b9429e54b3c/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:32.759549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a79273e7-2d20-4cf7-a621-24ee169a8bd3 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:32.820116 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a79273e7-2d20-4cf7-a621-24ee169a8bd3 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.064290 Oct 12 09:01:32.821292 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1986/4309] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 12 09:01:32 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:32.827919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b1020238-8c6c-48a3-8557-848cd62b66ee req-551bbea5-75c6-408e-aab0-0022f23bf018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34fedf2-688b-4b8c-a56c-81effb6d4a75", "name": "network-vif-plugged", "status": "completed", "tag": "06ed3d86-cdd1-42d5-b8c7-4b0adcf62534"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "dd89cf22-dd9d-43c6-acf1-e972ac33ae09"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:32.842569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b1020238-8c6c-48a3-8557-848cd62b66ee req-551bbea5-75c6-408e-aab0-0022f23bf018 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.843050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b1020238-8c6c-48a3-8557-848cd62b66ee req-551bbea5-75c6-408e-aab0-0022f23bf018 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.843685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b1020238-8c6c-48a3-8557-848cd62b66ee req-551bbea5-75c6-408e-aab0-0022f23bf018 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.865386 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b1020238-8c6c-48a3-8557-848cd62b66ee req-551bbea5-75c6-408e-aab0-0022f23bf018 service nova] Creating event network-vif-plugged:06ed3d86-cdd1-42d5-b8c7-4b0adcf62534 for instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 on n-h1-858383-10 Oct 12 09:01:32.878303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b1020238-8c6c-48a3-8557-848cd62b66ee req-551bbea5-75c6-408e-aab0-0022f23bf018 service nova] Creating event network-vif-unplugged:dd89cf22-dd9d-43c6-acf1-e972ac33ae09 for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:32.885649 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b1020238-8c6c-48a3-8557-848cd62b66ee req-551bbea5-75c6-408e-aab0-0022f23bf018 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.062582 Oct 12 09:01:32.886868 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1987/4310] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:32.893651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:32.894571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:32.902318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.903080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.903773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.904872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:32.905513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:32.906109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:32.935576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:33.031826 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a791acc3-ac1e-4381-a778-7c2280d1d9dd tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 204 len: 0 microversion: 2.1 time: 0.142373 Oct 12 09:01:33.032915 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1988/4311] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:32 2022] DELETE /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:01:33.041957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2983eb4b-b95a-4d1c-a416-606a51c566da req-d160dc72-627e-41eb-a39a-4a2aa30cd74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a9d482e-606b-410f-8d89-9b5d9a4096f2", "tag": "29bbbb10-ff76-41db-9ccd-f9e063463bf9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:33.053826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2983eb4b-b95a-4d1c-a416-606a51c566da req-d160dc72-627e-41eb-a39a-4a2aa30cd74b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.054796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2983eb4b-b95a-4d1c-a416-606a51c566da req-d160dc72-627e-41eb-a39a-4a2aa30cd74b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.055450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2983eb4b-b95a-4d1c-a416-606a51c566da req-d160dc72-627e-41eb-a39a-4a2aa30cd74b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.069989 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2983eb4b-b95a-4d1c-a416-606a51c566da req-d160dc72-627e-41eb-a39a-4a2aa30cd74b service nova] Creating event network-changed:29bbbb10-ff76-41db-9ccd-f9e063463bf9 for instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 on n-h1-858383-10 Oct 12 09:01:33.076780 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2983eb4b-b95a-4d1c-a416-606a51c566da req-d160dc72-627e-41eb-a39a-4a2aa30cd74b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041307 Oct 12 09:01:33.078124 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1989/4312] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:33.084410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:33.085631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:33.094230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.095420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.096151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.097970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.099351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.101314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.190575 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df4dfd8c-62b8-458d-9f36-024b8ef2bcd5 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.542342 Oct 12 09:01:33.191774 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2324/4313] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 09:01:32 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:33.196555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-943d7132-e1f0-4ba8-8920-070470efaf9e tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:33.220088 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-943d7132-e1f0-4ba8-8920-070470efaf9e tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027014 Oct 12 09:01:33.221108 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2325/4314] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:33.226101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:33.226721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:33.234510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.235328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.235769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.236669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.237145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.237599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.381266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:33.389975 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-44a9c578-b968-4631-a2c0-6ac1a843ef84 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1322 microversion: 2.1 time: 0.167511 Oct 12 09:01:33.405685 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2326/4315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:33 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:33.405685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:33.405685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:33.405685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.406196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.406196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.406953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.407470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.407946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.557172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:33.566742 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b135c34-5d7e-4655-b600-8de32adbfbd2 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1533 microversion: 2.1 time: 0.174880 Oct 12 09:01:33.567335 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2327/4316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:33 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1533 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:33.574165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57b11424-6366-4026-9bfd-f2e847bf1d91 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843e2a790>, body: {"security_group_rule": {"parent_group_id": "dd75255c-6591-4449-b8aa-a9ea71e4dba4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:33.766521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:33.782431 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c68196e-7e0e-42e3-9db9-265b196fba19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.702751 Oct 12 09:01:33.783023 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1990/4317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:33 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:33.787858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d3a05d8-f289-4cfb-b7fd-4f4289b52c58 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:33.811627 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d3a05d8-f289-4cfb-b7fd-4f4289b52c58 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.027250 Oct 12 09:01:33.812233 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1991/4318] 10.222.0.40 () {58 vars in 1144 bytes} [Wed Oct 12 09:01:33 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:33.817057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:33.817927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:33.824549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.825041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.825529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.826625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.827240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.827838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.872459 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57b11424-6366-4026-9bfd-f2e847bf1d91 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.303207 Oct 12 09:01:33.880952 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2328/4319] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 09:01:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:33.886831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:33.887576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:33.894527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.895434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.896089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:33.897120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:33.897720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:33.898395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.006050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:34.033902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=10 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:34.107549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.118260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.119895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.121144 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d162a163-282d-4d00-8dec-f2461e53cc21 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2936 microversion: 2.42 time: 0.238843 Oct 12 09:01:34.121736 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2329/4320] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:33 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2936 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:34.126658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:34.128336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:34.135676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.136835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.139493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.140425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.141178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.141645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.342265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.353324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.355420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.356536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5c54ac0e-0db3-4eda-ada1-e0229a4498b7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1407 microversion: 2.20 time: 0.233687 Oct 12 09:01:34.357413 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2330/4321] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:34 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:34.365071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3c76e3d3-c26e-4d95-a4a5-88c6da7a97ae req-fe643c2c-0a52-4c85-825c-14f3ac92744e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173b4809-6abe-413a-bbe2-217b8718c4e5", "tag": "ab36e1ae-f07f-41d7-84d8-7d73c7956ffc"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:34.374458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.380593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3c76e3d3-c26e-4d95-a4a5-88c6da7a97ae req-fe643c2c-0a52-4c85-825c-14f3ac92744e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.381559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3c76e3d3-c26e-4d95-a4a5-88c6da7a97ae req-fe643c2c-0a52-4c85-825c-14f3ac92744e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.382272 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42bee80c-a0e0-4d98-92fb-e3735ad1c9ed tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1324 microversion: 2.1 time: 0.568749 Oct 12 09:01:34.382817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3c76e3d3-c26e-4d95-a4a5-88c6da7a97ae req-fe643c2c-0a52-4c85-825c-14f3ac92744e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.383600 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1992/4322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:33 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:34.388346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:34.389175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:34.396397 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3c76e3d3-c26e-4d95-a4a5-88c6da7a97ae req-fe643c2c-0a52-4c85-825c-14f3ac92744e service nova] Creating event network-changed:ab36e1ae-f07f-41d7-84d8-7d73c7956ffc for instance 173b4809-6abe-413a-bbe2-217b8718c4e5 on n-h2-858383-10 Oct 12 09:01:34.402127 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3c76e3d3-c26e-4d95-a4a5-88c6da7a97ae req-fe643c2c-0a52-4c85-825c-14f3ac92744e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042905 Oct 12 09:01:34.402735 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2331/4323] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:34.406705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.407293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.407734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.408437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.408559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e768c6d-ef78-458f-8417-84ab17287910 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:34.408896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.409322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.418562 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e768c6d-ef78-458f-8417-84ab17287910 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014081 Oct 12 09:01:34.419374 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2332/4324] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:34.424939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-726293d0-5dd3-4872-9da5-6e2effea857d tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843e6b430>, body: {"security_group_rule": {"parent_group_id": "dd75255c-6591-4449-b8aa-a9ea71e4dba4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:34.490284 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-726293d0-5dd3-4872-9da5-6e2effea857d tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] HTTP exception thrown: This rule already exists in group dd75255c-6591-4449-b8aa-a9ea71e4dba4 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-726293d0-5dd3-4872-9da5-6e2effea857d tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Request method failure captured: Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 138 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJs6-D_nC3gQY02hNfHplKP1I_JBZxUyQhcIjC9u9UAzma6DoQJXH8Cam9jO7006llRvOZiruGZlILqbkAtGGrTD9rSlYkXC0380WUxsfL6Ut_qKjkzfbCt3KVa_wSgJGwoANX8x35Mox1g-y49JKurM_qZgdCAX68oPOiTyfl71Uw Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53971516588f49a2b0fbd80e0402f404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}] Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: b4c340cd91f34ac4b078f0f34c6e74f5 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: {"security_group_rule": {"parent_group_id": "dd75255c-6591-4449-b8aa-a9ea71e4dba4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: exception: This rule already exists in group dd75255c-6591-4449-b8aa-a9ea71e4dba4 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dd75255c-6591-4449-b8aa-a9ea71e4dba4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group dd75255c-6591-4449-b8aa-a9ea71e4dba4 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group dd75255c-6591-4449-b8aa-a9ea71e4dba4 Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:34.492084 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:34.498315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:34.498315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:34.498315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group dd75255c-6591-4449-b8aa-a9ea71e4dba4 Oct 12 09:01:34.498315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.498315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-726293d0-5dd3-4872-9da5-6e2effea857d tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Returning 400 to user: This rule already exists in group dd75255c-6591-4449-b8aa-a9ea71e4dba4 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:34.498315 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-726293d0-5dd3-4872-9da5-6e2effea857d tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.074393 Oct 12 09:01:34.498315 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2333/4325] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 09:01:34 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:34.504914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:34.506049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:34.512531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.513024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.513516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.514336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.514624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.515049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.539363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:34.632312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.642706 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d257c481-3387-46f7-95e6-2ef63fea2788 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.257767 Oct 12 09:01:34.645003 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1993/4326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:34 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:34.651024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d6d49bc2-33c9-4017-9df4-6ea35755fd6b tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:34.667259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.676906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd9859bb-41e0-444c-92f6-0ae77a66518d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1322 microversion: 2.1 time: 0.179794 Oct 12 09:01:34.677846 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2334/4327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:34 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:34.682829 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d6d49bc2-33c9-4017-9df4-6ea35755fd6b tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.036510 Oct 12 09:01:34.683698 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1994/4328] 10.222.0.40 () {58 vars in 1148 bytes} [Wed Oct 12 09:01:34 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:34.688456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:34.689246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:34.696684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.697187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.697839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.698548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.699013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.699415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.711988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f3b54bb-0225-4bf8-b044-737510b7252d tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Calling method '.version_select at 0x7f9843e2a700>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:34.899167 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f3b54bb-0225-4bf8-b044-737510b7252d tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/695a3d37-83a0-4bf4-a646-826f7a969663" status: 202 len: 0 microversion: 2.1 time: 0.202199 Oct 12 09:01:34.904797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:34.909657 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2335/4329] 10.222.0.40 () {58 vars in 1287 bytes} [Wed Oct 12 09:01:34 2022] DELETE /compute/v2.1/os-security-group-rules/695a3d37-83a0-4bf4-a646-826f7a969663 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:34.915553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:34.916073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:34.919733 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e3d5d6b-588d-49de-81f3-7beb1cb8ceac tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1533 microversion: 2.1 time: 0.234753 Oct 12 09:01:34.920325 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1995/4330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:34 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1533 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:34.922764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.923426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.924028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.924882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71c3c765-7013-4734-a7ff-61bc8e159f3e tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:34.925209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.925887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.926463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.940893 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71c3c765-7013-4734-a7ff-61bc8e159f3e tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.019504 Oct 12 09:01:34.941492 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1996/4331] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 12 09:01:34 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:34.947671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-859d3967-6cf0-4364-872a-cc4400502e43 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843dac820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-216881179", "description": "tempest-description-712508894"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:34.955693 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Cannot 'unpause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action HTTP/1.1 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 15 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: {"unpause": {}} Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: exception: Cannot 'unpause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'unpause': {}}} Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb in vm_state active. Cannot unpause while the instance is in this state. Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:34.957134 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:34.962532 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:34.962532 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:34.962532 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:34.962532 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 09:01:34.962532 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:34.962532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 409 to user: Cannot 'unpause' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:34.962532 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6964f99-0166-4065-ab66-d8d39be0ea49 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 409 len: 145 microversion: 2.1 time: 0.047826 Oct 12 09:01:34.962532 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2336/4332] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:34 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 145 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:01:34.964862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "610a858d-7018-4592-868c-3b15b37557fa"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "02fdd17d-834c-4946-a15e-652cc4faf437"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "3a324a9b-e152-4288-b469-6bc1dd04ee7e"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "3b29526e-1c95-43fd-acbc-c4e8746e941a"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-unplugged", "status": "completed", "tag": "1e0ec976-98af-4526-abda-2f9da49a001d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:34.976161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:34.976645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:34.977104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:34.992773 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Creating event network-vif-unplugged:610a858d-7018-4592-868c-3b15b37557fa for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:34.993602 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Creating event network-vif-unplugged:02fdd17d-834c-4946-a15e-652cc4faf437 for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:34.994142 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Creating event network-vif-unplugged:3a324a9b-e152-4288-b469-6bc1dd04ee7e for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:34.994643 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Creating event network-vif-unplugged:3b29526e-1c95-43fd-acbc-c4e8746e941a for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:34.995176 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] Creating event network-vif-unplugged:1e0ec976-98af-4526-abda-2f9da49a001d for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:35.001282 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-89f09a75-9238-4ee7-b986-fc2f54700483 req-1c50569e-fe5a-4526-bc92-1ff5021b1bf0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.039891 Oct 12 09:01:35.002146 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2337/4333] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:35.007057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a7c9019-477a-40b8-8388-f3f9e0774571 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.015029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a7c9019-477a-40b8-8388-f3f9e0774571 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011909 Oct 12 09:01:35.023129 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2338/4334] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:35.023129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.023129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:35.028431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.028918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.029350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.030443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.030993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.031671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.115853 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-859d3967-6cf0-4364-872a-cc4400502e43 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.171654 Oct 12 09:01:35.118536 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1997/4335] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 09:01:34 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:35.123544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1fd4eba-a7a3-4513-a693-b48731b8bd39 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.130964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:35.147855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d1fd4eba-a7a3-4513-a693-b48731b8bd39 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.027930 Oct 12 09:01:35.148463 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1998/4336] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:35.153814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c6ea049-4490-4527-a425-bb9e862d6643 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843d64ca0>, body: {"security_group_rule": {"parent_group_id": "56521e25-b99a-4abe-95dd-87f42242eb71", "ip_protocol": "tcp", "from_port": 157522035, "to_port": 22}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:35.203989 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7c6ea049-4490-4527-a425-bb9e862d6643 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] HTTP exception thrown: Invalid port range 157522035:22. Former value cannot be greater than the later Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c6ea049-4490-4527-a425-bb9e862d6643 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Request method failure captured: Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 145 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoJs6-D_nC3gQY02hNfHplKP1I_JBZxUyQhcIjC9u9UAzma6DoQJXH8Cam9jO7006llRvOZiruGZlILqbkAtGGrTD9rSlYkXC0380WUxsfL6Ut_qKjkzfbCt3KVa_wSgJGwoANX8x35Mox1g-y49JKurM_qZgdCAX68oPOiTyfl71Uw Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53971516588f49a2b0fbd80e0402f404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}] Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: b4c340cd91f34ac4b078f0f34c6e74f5 Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: {"security_group_rule": {"parent_group_id": "56521e25-b99a-4abe-95dd-87f42242eb71", "ip_protocol": "tcp", "from_port": 157522035, "to_port": 22}} Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid port range 157522035:22. Former value cannot be greater than the later Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'security_group_rule': {'parent_group_id': '56521e25-b99a-4abe-95dd-87f42242eb71', 'ip_protocol': 'tcp', 'from_port': 157522035, 'to_port': 22}}} Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 157522035:22. Former value cannot be greater than the later Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 157522035:22. Former value cannot be greater than the later Oct 12 09:01:35.205762 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 157522035:22. Former value cannot be greater than the later Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.211992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c6ea049-4490-4527-a425-bb9e862d6643 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Returning 400 to user: Invalid port range 157522035:22. Former value cannot be greater than the later {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:35.212947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:35.213078 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7c6ea049-4490-4527-a425-bb9e862d6643 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.057446 Oct 12 09:01:35.213078 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 1999/4337] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 09:01:35 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:35.216930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-84c1641c-3562-4d99-b133-4b49bb1e1f29 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.199928 Oct 12 09:01:35.217957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.218592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:35.230172 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2339/4338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:35.230302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.230302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.230302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.230607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e1abb20-8377-457d-b994-481909e7a1a2 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.230711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.230711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.230711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.251861 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e1abb20-8377-457d-b994-481909e7a1a2 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030854 Oct 12 09:01:35.252560 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2340/4339] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:35.277729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51085499-1308-47a9-9ef5-faf0f9dbbf2e tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843dfff70>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1711064814", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:35.279942 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-51085499-1308-47a9-9ef5-faf0f9dbbf2e tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] HTTP exception thrown: Security group id should be uuid Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51085499-1308-47a9-9ef5-faf0f9dbbf2e tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Request method failure captured: Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 131 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJs6-D_nC3gQY02hNfHplKP1I_JBZxUyQhcIjC9u9UAzma6DoQJXH8Cam9jO7006llRvOZiruGZlILqbkAtGGrTD9rSlYkXC0380WUxsfL6Ut_qKjkzfbCt3KVa_wSgJGwoANX8x35Mox1g-y49JKurM_qZgdCAX68oPOiTyfl71Uw Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53971516588f49a2b0fbd80e0402f404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}] Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: b4c340cd91f34ac4b078f0f34c6e74f5 Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1711064814", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group id should be uuid Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1711064814', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:35.281715 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:35.290870 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 12 09:01:35.290870 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.290870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51085499-1308-47a9-9ef5-faf0f9dbbf2e tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Returning 400 to user: Security group id should be uuid {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:35.290870 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51085499-1308-47a9-9ef5-faf0f9dbbf2e tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016062 Oct 12 09:01:35.290870 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2341/4340] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 09:01:35 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 09:01:35.293301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.294085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:35.301610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.302100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.302724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.303429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.303880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.304323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.406949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:35.418434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:35.420113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:35.421606 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d49fbdf8-1e5b-4aea-86da-90ee940be02e tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2915 microversion: 2.42 time: 0.207410 Oct 12 09:01:35.422823 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2000/4341] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2915 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:35.427747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aa652f51-fff7-4e48-98d0-835236fbc945 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.445524 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aa652f51-fff7-4e48-98d0-835236fbc945 tempest-FlavorsV2TestJSON-1908270649 tempest-FlavorsV2TestJSON-1908270649-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019742 Oct 12 09:01:35.446521 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2001/4342] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:35.452015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ee567b1-45d4-4874-9505-924789516e14 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843d9c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1345480980", "description": "tempest-description-612868991"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:35.485123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:35.494757 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c4c80dbf-54bc-42f7-a4a9-fe52d20f7909 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.205523 Oct 12 09:01:35.495973 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2342/4343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:35.501396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.502314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:35.511513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.516500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.517011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.518598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.519248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.520377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.614825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:35.832328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:35.834332 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ee567b1-45d4-4874-9505-924789516e14 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.386600 Oct 12 09:01:35.844744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:35.850277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:35.853404 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2cbe99e-dcdf-4858-ac55-6e3c79133900 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1407 microversion: 2.20 time: 0.356279 Oct 12 09:01:35.853610 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2002/4344] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 09:01:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:35.863751 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2343/4345] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:35.868307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.870669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:35.877682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57e27b62-4ee3-46d4-b4de-861822e25c44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:35.878296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57e27b62-4ee3-46d4-b4de-861822e25c44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 9003472d-c269-4353-99e7-af7a750bde6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:35.879757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.880512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.882148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.883135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.883812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.884460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.913603 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-57e27b62-4ee3-46d4-b4de-861822e25c44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 9003472d-c269-4353-99e7-af7a750bde6e could not be found. Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57e27b62-4ee3-46d4-b4de-861822e25c44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/9003472d-c269-4353-99e7-af7a750bde6e/action HTTP/1.1 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 18 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: {"unshelve": null} Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 9003472d-c269-4353-99e7-af7a750bde6e could not be found. Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '9003472d-c269-4353-99e7-af7a750bde6e', 'body': {'unshelve': None}} Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9003472d-c269-4353-99e7-af7a750bde6e could not be found. Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9003472d-c269-4353-99e7-af7a750bde6e could not be found. Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.915424 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9003472d-c269-4353-99e7-af7a750bde6e could not be found. Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57e27b62-4ee3-46d4-b4de-861822e25c44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 9003472d-c269-4353-99e7-af7a750bde6e could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57e27b62-4ee3-46d4-b4de-861822e25c44 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/9003472d-c269-4353-99e7-af7a750bde6e/action" status: 404 len: 111 microversion: 2.1 time: 0.051868 Oct 12 09:01:35.921792 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2344/4346] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:35 2022] POST /compute/v2.1/servers/9003472d-c269-4353-99e7-af7a750bde6e/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:35.925237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:35.925897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:35.955866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.956466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.956907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:35.958164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:35.958621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:35.959329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:36.359926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:36.368690 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-364321a1-bf7b-4f3b-af04-e20576efd8b3 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1324 microversion: 2.1 time: 0.504374 Oct 12 09:01:36.369468 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2003/4347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:36.375101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a0ff3b6-393b-4f48-bdf9-cdec40b45638 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843d64f70>, body: {"security_group_rule": {"parent_group_id": "88fe57fe-f6b0-4492-bf5d-baac546b0512", "ip_protocol": "tempest-999-59152117", "from_port": 22, "to_port": 22}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:36.512091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:36.527234 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e4719909-dc69-4bad-a32f-c96b32fd54c6 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1322 microversion: 2.1 time: 0.605453 Oct 12 09:01:36.542478 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2345/4348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:35 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:36.542478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:36.542478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:36.551701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:36.552525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:36.553134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:36.554286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:36.555170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:36.556022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:36.571086 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7a0ff3b6-393b-4f48-bdf9-cdec40b45638 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] HTTP exception thrown: Invalid IP protocol tempest-999-59152117. Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a0ff3b6-393b-4f48-bdf9-cdec40b45638 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Request method failure captured: Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 155 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoJs6-D_nC3gQY02hNfHplKP1I_JBZxUyQhcIjC9u9UAzma6DoQJXH8Cam9jO7006llRvOZiruGZlILqbkAtGGrTD9rSlYkXC0380WUxsfL6Ut_qKjkzfbCt3KVa_wSgJGwoANX8x35Mox1g-y49JKurM_qZgdCAX68oPOiTyfl71Uw Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53971516588f49a2b0fbd80e0402f404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}] Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: b4c340cd91f34ac4b078f0f34c6e74f5 Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: {"security_group_rule": {"parent_group_id": "88fe57fe-f6b0-4492-bf5d-baac546b0512", "ip_protocol": "tempest-999-59152117", "from_port": 22, "to_port": 22}} Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid IP protocol tempest-999-59152117. Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'security_group_rule': {'parent_group_id': '88fe57fe-f6b0-4492-bf5d-baac546b0512', 'ip_protocol': 'tempest-999-59152117', 'from_port': 22, 'to_port': 22}}} Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-59152117. Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-59152117. Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:36.572942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:36.577598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:36.577598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:36.577598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:36.577598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:36.577598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:36.577598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:36.577598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-59152117. Oct 12 09:01:36.577598 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:36.580493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a0ff3b6-393b-4f48-bdf9-cdec40b45638 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Returning 400 to user: Invalid IP protocol tempest-999-59152117. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:36.581627 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7a0ff3b6-393b-4f48-bdf9-cdec40b45638 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.210756 Oct 12 09:01:36.582805 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2004/4349] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 09:01:36 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 09:01:36.592689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:36.593806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:36.612515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:36.616197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:36.617049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:36.618057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:36.619456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:36.622952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:36.934754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:36.952046 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-359848d0-6733-4667-a56f-b10f76b70165 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.414098 Oct 12 09:01:36.958649 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2346/4350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:36 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:36.969882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:36.970868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:36.997330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:36.998631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:36.999462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:37.000461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:37.001158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:37.001849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:37.075549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be40bd3e56a74d289750ba931dd214b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816f2eda088491285ab03087b12fb33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:37.085986 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5f344ea-0cce-4b3c-8789-bf683abacc58 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 200 len: 1533 microversion: 2.1 time: 0.501611 Oct 12 09:01:37.086580 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2005/4351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:36 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 1533 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:37.104158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39084fca-9065-49df-80a1-402212b9fd7e tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9848df5a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1981468597", "description": "tempest-description-1812149545"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:37.435349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:37.459024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:37.460739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:37.465536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-581a7653-d10f-4be6-88e6-7d0e759a37f7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2869 microversion: 2.42 time: 0.499647 Oct 12 09:01:37.466178 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2347/4352] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:36 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2869 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:37.474007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:37.474863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:37.491361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:37.491879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:37.492350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:37.493019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:37.493495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:37.503665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:37.738228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:37.749054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:37.751273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:37.753796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cb18ba86-f677-4d0b-af2e-94a17392d06c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1407 microversion: 2.20 time: 0.285668 Oct 12 09:01:37.765497 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2348/4353] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:37 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:37.771461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:37.772493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:37.782833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:37.784445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:37.785219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:37.787516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:37.788529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:37.789310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.070186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-39084fca-9065-49df-80a1-402212b9fd7e tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.979135 Oct 12 09:01:38.071109 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2006/4354] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 09:01:37 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:38.110134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:38.121555 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71597258-3f49-4cd4-ad76-2f0e0e61d477 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.354357 Oct 12 09:01:38.135368 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2349/4355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:37 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:38.138070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-100022b4-4628-48cc-9863-e391ba82e9c3 req-1ca3b625-c5b0-484d-90cc-44a69c6b5657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-deleted", "tag": "1e0ec976-98af-4526-abda-2f9da49a001d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:38.172548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-100022b4-4628-48cc-9863-e391ba82e9c3 req-1ca3b625-c5b0-484d-90cc-44a69c6b5657 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.175096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-100022b4-4628-48cc-9863-e391ba82e9c3 req-1ca3b625-c5b0-484d-90cc-44a69c6b5657 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.176122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-100022b4-4628-48cc-9863-e391ba82e9c3 req-1ca3b625-c5b0-484d-90cc-44a69c6b5657 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.192630 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-100022b4-4628-48cc-9863-e391ba82e9c3 req-1ca3b625-c5b0-484d-90cc-44a69c6b5657 service nova] Creating event network-vif-deleted:1e0ec976-98af-4526-abda-2f9da49a001d for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:38.205644 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-100022b4-4628-48cc-9863-e391ba82e9c3 req-1ca3b625-c5b0-484d-90cc-44a69c6b5657 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076524 Oct 12 09:01:38.206900 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2350/4356] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:38.214851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:38.215905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:38.223111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.223608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.224048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.225098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.225590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.226023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.311185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1dc91500-9efe-4265-85fa-ba069efc570c req-914f7c91-00cb-4b32-b560-3574b89d01fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1008c89c-b870-4f0a-92f7-efbf436eeb45", "name": "network-vif-deleted", "tag": "5dd2f253-6859-4f70-9e76-d85de64e3a23"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:38.331896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1dc91500-9efe-4265-85fa-ba069efc570c req-914f7c91-00cb-4b32-b560-3574b89d01fd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.332603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1dc91500-9efe-4265-85fa-ba069efc570c req-914f7c91-00cb-4b32-b560-3574b89d01fd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.334161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1dc91500-9efe-4265-85fa-ba069efc570c req-914f7c91-00cb-4b32-b560-3574b89d01fd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.351593 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1dc91500-9efe-4265-85fa-ba069efc570c req-914f7c91-00cb-4b32-b560-3574b89d01fd service nova] Creating event network-vif-deleted:5dd2f253-6859-4f70-9e76-d85de64e3a23 for instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 on n-h1-858383-10 Oct 12 09:01:38.360433 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1dc91500-9efe-4265-85fa-ba069efc570c req-914f7c91-00cb-4b32-b560-3574b89d01fd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287811 Oct 12 09:01:38.361210 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2007/4357] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:38.367858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:38.368885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:38.377731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.378476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.379204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.380840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.381850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.382600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.427537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:38.436554 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8bb03637-3635-4bea-ae8f-c13b56d43c38 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1324 microversion: 2.1 time: 0.227619 Oct 12 09:01:38.450140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2351/4358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:38 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1324 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:38.459196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-642ea6ce-1283-4d87-bb48-c1b8d8626a51 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843d84820>, body: {"security_group_rule": {"parent_group_id": "bf27e062-db50-4e0b-a412-02a941ec6263", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:38.519166 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-642ea6ce-1283-4d87-bb48-c1b8d8626a51 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-642ea6ce-1283-4d87-bb48-c1b8d8626a51 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Request method failure captured: Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 138 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJs6-D_nC3gQY02hNfHplKP1I_JBZxUyQhcIjC9u9UAzma6DoQJXH8Cam9jO7006llRvOZiruGZlILqbkAtGGrTD9rSlYkXC0380WUxsfL6Ut_qKjkzfbCt3KVa_wSgJGwoANX8x35Mox1g-y49JKurM_qZgdCAX68oPOiTyfl71Uw Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53971516588f49a2b0fbd80e0402f404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}] Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: b4c340cd91f34ac4b078f0f34c6e74f5 Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: {"security_group_rule": {"parent_group_id": "bf27e062-db50-4e0b-a412-02a941ec6263", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bf27e062-db50-4e0b-a412-02a941ec6263', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 09:01:38.521354 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 12 09:01:38.526887 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.529795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-642ea6ce-1283-4d87-bb48-c1b8d8626a51 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:38.531635 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-642ea6ce-1283-4d87-bb48-c1b8d8626a51 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.079331 Oct 12 09:01:38.537275 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2352/4359] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 09:01:38 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:38.548822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:38.551074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] [instance: 1008c89c-b870-4f0a-92f7-efbf436eeb45] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:38.566162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.568085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.568820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.569830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.570799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.571472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.590466 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] HTTP exception thrown: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Request method failure captured: Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 HTTP/1.1 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoI3N1MzMEOxwG-5axwk-aT-EMzbrzjxPdPQrpu_4yl7V4YwKm8LnD9indwF1lgxVBLC_AionEL_bgn1oaPAG3G5v2NAG4RZ4ZDw0bRWV5x_F0i2xv8Md85JOd6KMpNeZmSud7_emfJvJ5PhuLQ7eHZqV_Cvj4iCwqDk_Cy7OW6kfMA Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 3816f2eda088491285ab03087b12fb33 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1994416831 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3816f2eda088491285ab03087b12fb33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3816f2eda088491285ab03087b12fb33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3816f2eda088491285ab03087b12fb33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3816f2eda088491285ab03087b12fb33"}]}] Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1994416831 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 3816f2eda088491285ab03087b12fb33 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1994416831 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1994416831-project Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: be40bd3e56a74d289750ba931dd214b5 Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1994416831-project Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '1008c89c-b870-4f0a-92f7-efbf436eeb45'} Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:38.592016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. Oct 12 09:01:38.596699 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.598419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] Returning 404 to user: Instance 1008c89c-b870-4f0a-92f7-efbf436eeb45 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:38.599732 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9613b361-9e17-4cb2-a4ba-fd9efd31c0d1 tempest-ServersNegativeTestMultiTenantJSON-1994416831 tempest-ServersNegativeTestMultiTenantJSON-1994416831-project] 10.222.0.40 "GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45" status: 404 len: 111 microversion: 2.1 time: 0.061112 Oct 12 09:01:38.600509 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2353/4360] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:38 2022] GET /compute/v2.1/servers/1008c89c-b870-4f0a-92f7-efbf436eeb45 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:38.613617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:38.615111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:38.623191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.623758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.624254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.625862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.626372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.627207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.667088 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Cannot 'unshelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action HTTP/1.1 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 18 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: {"unshelve": null} Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: exception: Cannot 'unshelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'unshelve': None}} Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb in vm_state active. Cannot unshelve while the instance is in this state. Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:01:38.671063 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 409 to user: Cannot 'unshelve' instance a870435b-8aa5-456d-b0ca-477ee2201dbb while it is in vm_state active {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:38.675596 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-471d55f8-36b8-479c-a362-0d59f06b8fa2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action" status: 409 len: 146 microversion: 2.1 time: 0.071009 Oct 12 09:01:38.676501 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2354/4361] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:01:38 2022] POST /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb/action => generated 146 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:01:38.681375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:38.682414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:38.688741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.689752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.690267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.691532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:38.692654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:38.693319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:38.707023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:38.722833 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fecf5a65-6c35-48be-8014-2db282c95945 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1516 microversion: 2.1 time: 0.353412 Oct 12 09:01:38.723507 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2008/4362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:38 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1516 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:38.737768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3a06412f-e4a5-4ae3-be3c-9ff549bdda06 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843dac0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1350781514", "description": "tempest-description-949858290"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:38.985699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:39.007154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:39.009237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:39.011446 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-afd2eeac-943c-45d5-8547-20a515973f4f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2709 microversion: 2.42 time: 0.333498 Oct 12 09:01:39.012176 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2355/4363] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:38 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2709 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:39.129575 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3a06412f-e4a5-4ae3-be3c-9ff549bdda06 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.404485 Oct 12 09:01:39.138822 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2009/4364] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 09:01:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:39.156675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:39.159351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:39.170098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.170845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.171524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.172496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.173183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.173852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.215360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-efbff7c5-7755-4131-ada7-ff6ae2f7d465 tempest-ListImagesTestJSON-1812936935 tempest-ListImagesTestJSON-1812936935-project] Calling method '.version_select at 0x7f9843de6c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:39.271436 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-efbff7c5-7755-4131-ada7-ff6ae2f7d465 tempest-ListImagesTestJSON-1812936935 tempest-ListImagesTestJSON-1812936935-project] 10.222.0.40 "GET /compute/v2.1/images/3816cc90-eecd-445f-9498-be8ec212c308" status: 200 len: 784 microversion: 2.1 time: 0.258061 Oct 12 09:01:39.272679 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2356/4365] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Oct 12 09:01:39 2022] GET /compute/v2.1/images/3816cc90-eecd-445f-9498-be8ec212c308 => generated 784 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:39.277351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:39.278092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:39.284967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.285485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.285924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.286731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.287446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.287991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.446206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:39.456266 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e022934-f564-4646-94d4-51bad60db66f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.316014 Oct 12 09:01:39.470347 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2010/4366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:39 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:39.482293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-20bb3652-2ade-4625-8e76-6046341b0d2e req-a40a9625-3172-429f-9573-84cc633a11a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173b4809-6abe-413a-bbe2-217b8718c4e5", "name": "network-vif-plugged", "status": "completed", "tag": "ab36e1ae-f07f-41d7-84d8-7d73c7956ffc"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:39.493687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-20bb3652-2ade-4625-8e76-6046341b0d2e req-a40a9625-3172-429f-9573-84cc633a11a6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.494500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-20bb3652-2ade-4625-8e76-6046341b0d2e req-a40a9625-3172-429f-9573-84cc633a11a6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.494994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-20bb3652-2ade-4625-8e76-6046341b0d2e req-a40a9625-3172-429f-9573-84cc633a11a6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.508327 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-20bb3652-2ade-4625-8e76-6046341b0d2e req-a40a9625-3172-429f-9573-84cc633a11a6 service nova] Creating event network-vif-plugged:ab36e1ae-f07f-41d7-84d8-7d73c7956ffc for instance 173b4809-6abe-413a-bbe2-217b8718c4e5 on n-h2-858383-10 Oct 12 09:01:39.514349 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-20bb3652-2ade-4625-8e76-6046341b0d2e req-a40a9625-3172-429f-9573-84cc633a11a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042317 Oct 12 09:01:39.515146 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2011/4367] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:39.522502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:39.523661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:39.525307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:39.537810 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80ed0f55-b919-4626-a7e8-dafb1034d084 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef" status: 200 len: 1516 microversion: 2.1 time: 0.263570 Oct 12 09:01:39.538829 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2357/4368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:39 2022] GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:39.544021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.544751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.545362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.546245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.546846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.547420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.555493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d821a4f2-5597-4265-847d-6a75c9ce5fc3 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843e6b430>, body: {"security_group_rule": {"parent_group_id": "22fa40c5-8089-4046-af61-a8a563f40234", "ip_protocol": "tcp", "from_port": 22, "to_port": 1341476596}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:39.650374 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d821a4f2-5597-4265-847d-6a75c9ce5fc3 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] HTTP exception thrown: Invalid port range 22:1341476596. Valid TCP ports should be between 1-65535 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d821a4f2-5597-4265-847d-6a75c9ce5fc3 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Request method failure captured: Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 146 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJs6-D_nC3gQY02hNfHplKP1I_JBZxUyQhcIjC9u9UAzma6DoQJXH8Cam9jO7006llRvOZiruGZlILqbkAtGGrTD9rSlYkXC0380WUxsfL6Ut_qKjkzfbCt3KVa_wSgJGwoANX8x35Mox1g-y49JKurM_qZgdCAX68oPOiTyfl71Uw Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53971516588f49a2b0fbd80e0402f404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}] Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: b4c340cd91f34ac4b078f0f34c6e74f5 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: {"security_group_rule": {"parent_group_id": "22fa40c5-8089-4046-af61-a8a563f40234", "ip_protocol": "tcp", "from_port": 22, "to_port": 1341476596}} Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid port range 22:1341476596. Valid TCP ports should be between 1-65535 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'security_group_rule': {'parent_group_id': '22fa40c5-8089-4046-af61-a8a563f40234', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1341476596}}} Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1341476596. Valid TCP ports should be between 1-65535 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1341476596. Valid TCP ports should be between 1-65535 Oct 12 09:01:39.651916 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1341476596. Valid TCP ports should be between 1-65535 Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d821a4f2-5597-4265-847d-6a75c9ce5fc3 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Returning 400 to user: Invalid port range 22:1341476596. Valid TCP ports should be between 1-65535 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d821a4f2-5597-4265-847d-6a75c9ce5fc3 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.113386 Oct 12 09:01:39.664598 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2358/4369] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 09:01:39 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:39.666477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2dbdd2a8-391c-4691-acce-de42eb56e4e8 tempest-ListImagesTestJSON-1812936935 tempest-ListImagesTestJSON-1812936935-project] Calling method '.version_select at 0x7f9843da3ee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:39.781048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2dbdd2a8-391c-4691-acce-de42eb56e4e8 tempest-ListImagesTestJSON-1812936935 tempest-ListImagesTestJSON-1812936935-project] 10.222.0.40 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.126123 Oct 12 09:01:39.786552 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2359/4370] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Oct 12 09:01:39 2022] GET /compute/v2.1/images => generated 445 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:39.799293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:39.804907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:39.816166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.816975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.825025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.825855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.826337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.826775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.899425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:39.909572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:39.917203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:39.918941 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f65a60ee-f2b3-4518-b98e-2aeb044b3ca5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1407 microversion: 2.20 time: 0.402052 Oct 12 09:01:39.923017 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2012/4371] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:39 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:39.930900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:39.933392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:39.948974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.950348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.950979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:39.952074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:39.952720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:39.953803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.092575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:40.109736 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd6e621e-ba68-4258-85b4-ce12dbbdba5a tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1324 microversion: 2.1 time: 0.313027 Oct 12 09:01:40.110917 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2360/4372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:39 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:40.118910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:40.119256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:40.133116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:40.135376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.135982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.136674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.137601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.138158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.138679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.185698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:40.253812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:40.298599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:40.310182 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de5cc7fa-f9d4-4546-b3ff-3d06484c716d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef" status: 204 len: 0 microversion: 2.1 time: 0.197454 Oct 12 09:01:40.314073 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30b5884c-32a9-4d7c-9e5e-c0bdaa6b40a4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.389920 Oct 12 09:01:40.314409 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2361/4373] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:40 2022] DELETE /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:01:40.315068 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2013/4374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:39 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:40.321221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cc8a521-47ea-4598-8e58-ca224ea2162c tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Action: 'create', calling method: .version_select at 0x7f9843e6b670>, body: {"security_group_rule": {"parent_group_id": "02825181-24d1-4dbf-ae45-6805ca000848", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:40.329619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c9ef4466-8ad5-4076-a806-1900b73c94bf tempest-ListImagesTestJSON-1812936935 tempest-ListImagesTestJSON-1812936935-project] Calling method '.version_select at 0x7f9843d45a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:40.378662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-9cc8a521-47ea-4598-8e58-ca224ea2162c tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02825181-24d1-4dbf-ae45-6805ca000848 does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 09:01:40.381212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-9cc8a521-47ea-4598-8e58-ca224ea2162c tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Neutron security group 02825181-24d1-4dbf-ae45-6805ca000848 not found {{(pid=127006) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 12 09:01:40.381212 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9cc8a521-47ea-4598-8e58-ca224ea2162c tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] HTTP exception thrown: Security group 02825181-24d1-4dbf-ae45-6805ca000848 does not exist Oct 12 09:01:40.381212 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-e264e69e-c4eb-45e3-aa59-347fba85eda9'] Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cc8a521-47ea-4598-8e58-ca224ea2162c tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Request method failure captured: Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 138 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJs6-D_nC3gQY02hNfHplKP1I_JBZxUyQhcIjC9u9UAzma6DoQJXH8Cam9jO7006llRvOZiruGZlILqbkAtGGrTD9rSlYkXC0380WUxsfL6Ut_qKjkzfbCt3KVa_wSgJGwoANX8x35Mox1g-y49JKurM_qZgdCAX68oPOiTyfl71Uw Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53971516588f49a2b0fbd80e0402f404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}] Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: b4c340cd91f34ac4b078f0f34c6e74f5 Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: {"security_group_rule": {"parent_group_id": "02825181-24d1-4dbf-ae45-6805ca000848", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group 02825181-24d1-4dbf-ae45-6805ca000848 does not exist Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-e264e69e-c4eb-45e3-aa59-347fba85eda9'] Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'security_group_rule': {'parent_group_id': '02825181-24d1-4dbf-ae45-6805ca000848', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 09:01:40.388203 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02825181-24d1-4dbf-ae45-6805ca000848 does not exist Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e264e69e-c4eb-45e3-aa59-347fba85eda9'] Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02825181-24d1-4dbf-ae45-6805ca000848 does not exist Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e264e69e-c4eb-45e3-aa59-347fba85eda9'] Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02825181-24d1-4dbf-ae45-6805ca000848 does not exist Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e264e69e-c4eb-45e3-aa59-347fba85eda9'] Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02825181-24d1-4dbf-ae45-6805ca000848 does not exist Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e264e69e-c4eb-45e3-aa59-347fba85eda9'] Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cc8a521-47ea-4598-8e58-ca224ea2162c tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Returning 404 to user: Security group 02825181-24d1-4dbf-ae45-6805ca000848 does not exist Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-e264e69e-c4eb-45e3-aa59-347fba85eda9'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:40.392726 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9cc8a521-47ea-4598-8e58-ca224ea2162c tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.076449 Oct 12 09:01:40.403454 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2362/4375] 10.222.0.40 () {60 vars in 1195 bytes} [Wed Oct 12 09:01:40 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:40.403454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:40.403454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:40.405044 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c9ef4466-8ad5-4076-a806-1900b73c94bf tempest-ListImagesTestJSON-1812936935 tempest-ListImagesTestJSON-1812936935-project] 10.222.0.40 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.087246 Oct 12 09:01:40.409040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.410013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.410458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.411164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.411680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.412107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.416681 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2014/4376] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 09:01:40 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:40.441622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:40.442513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:40.469472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.470045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.471031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.476039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.476819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.477074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.523005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:40.700944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:40.714580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:40.716748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:40.718262 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-07735b58-00ff-4543-9eda-3ed730316d28 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 2617 microversion: 2.42 time: 0.323832 Oct 12 09:01:40.718815 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2363/4377] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:40 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 2617 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:40.745600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85557d15-e68b-4b65-a8c3-ff131ec671b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213713035_updated"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:40.748533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-85557d15-e68b-4b65-a8c3-ff131ec671b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3e9fd369-65e2-4d72-9287-b4aa27a9acd0] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:40.767662 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-85557d15-e68b-4b65-a8c3-ff131ec671b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 3e9fd369-65e2-4d72-9287-b4aa27a9acd0 could not be found. Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85557d15-e68b-4b65-a8c3-ff131ec671b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/servers/3e9fd369-65e2-4d72-9287-b4aa27a9acd0 HTTP/1.1 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 80 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213713035_updated"}} Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3e9fd369-65e2-4d72-9287-b4aa27a9acd0 could not be found. Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3e9fd369-65e2-4d72-9287-b4aa27a9acd0', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-213713035_updated'}}} Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9fd369-65e2-4d72-9287-b4aa27a9acd0 could not be found. Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 12 09:01:40.769187 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9fd369-65e2-4d72-9287-b4aa27a9acd0 could not be found. Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9fd369-65e2-4d72-9287-b4aa27a9acd0 could not be found. Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85557d15-e68b-4b65-a8c3-ff131ec671b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 3e9fd369-65e2-4d72-9287-b4aa27a9acd0 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85557d15-e68b-4b65-a8c3-ff131ec671b4 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "PUT /compute/v2.1/servers/3e9fd369-65e2-4d72-9287-b4aa27a9acd0" status: 404 len: 111 microversion: 2.1 time: 0.044173 Oct 12 09:01:40.777430 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2364/4378] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 09:01:40 2022] PUT /compute/v2.1/servers/3e9fd369-65e2-4d72-9287-b4aa27a9acd0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:40.782873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24c7522b-2499-44c1-9120-bd6a5a5ae645 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Calling method '.version_select at 0x7f9843be34c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:40.848231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:40.853381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG neutronclient.v2_0.client [None req-24c7522b-2499-44c1-9120-bd6a5a5ae645 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 does not exist", "detail": ""}} {{(pid=127006) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 12 09:01:40.854024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.security_group_api [None req-24c7522b-2499-44c1-9120-bd6a5a5ae645 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Neutron security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 not found {{(pid=127006) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 12 09:01:40.857645 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-24c7522b-2499-44c1-9120-bd6a5a5ae645 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] HTTP exception thrown: Security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 does not exist Oct 12 09:01:40.857645 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-93c62690-0705-488c-8f73-a83114a99b88'] Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24c7522b-2499-44c1-9120-bd6a5a5ae645 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Request method failure captured: Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-security-group-rules/9c06a34f-c627-4a0f-9c23-d5b0a102edf1 HTTP/1.1 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJs6-D_nC3gQY02hNfHplKP1I_JBZxUyQhcIjC9u9UAzma6DoQJXH8Cam9jO7006llRvOZiruGZlILqbkAtGGrTD9rSlYkXC0380WUxsfL6Ut_qKjkzfbCt3KVa_wSgJGwoANX8x35Mox1g-y49JKurM_qZgdCAX68oPOiTyfl71Uw Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/53971516588f49a2b0fbd80e0402f404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_53971516588f49a2b0fbd80e0402f404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/53971516588f49a2b0fbd80e0402f404"}]}] Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 53971516588f49a2b0fbd80e0402f404 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: b4c340cd91f34ac4b078f0f34c6e74f5 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-550944574-project Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: exception: Security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 does not exist Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-93c62690-0705-488c-8f73-a83114a99b88'] Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '9c06a34f-c627-4a0f-9c23-d5b0a102edf1'} Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 12 09:01:40.860650 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 does not exist Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93c62690-0705-488c-8f73-a83114a99b88'] Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 does not exist Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93c62690-0705-488c-8f73-a83114a99b88'] Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 does not exist Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93c62690-0705-488c-8f73-a83114a99b88'] Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 does not exist Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93c62690-0705-488c-8f73-a83114a99b88'] Oct 12 09:01:40.866014 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:40.869709 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc6c024a-fb81-411d-aae2-1d5fb9235a5a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef" status: 200 len: 1522 microversion: 2.1 time: 0.432255 Oct 12 09:01:40.869709 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2015/4379] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:40 2022] GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:40.871740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24c7522b-2499-44c1-9120-bd6a5a5ae645 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Returning 404 to user: Security group rule 9c06a34f-c627-4a0f-9c23-d5b0a102edf1 does not exist Oct 12 09:01:40.871740 n-d-858383-10 devstack@n-api.service[127006]: Neutron server returns request_ids: ['req-93c62690-0705-488c-8f73-a83114a99b88'] {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:40.875981 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24c7522b-2499-44c1-9120-bd6a5a5ae645 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/9c06a34f-c627-4a0f-9c23-d5b0a102edf1" status: 404 len: 199 microversion: 2.1 time: 0.097281 Oct 12 09:01:40.876806 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2365/4380] 10.222.0.40 () {58 vars in 1287 bytes} [Wed Oct 12 09:01:40 2022] DELETE /compute/v2.1/os-security-group-rules/9c06a34f-c627-4a0f-9c23-d5b0a102edf1 => generated 199 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:40.886697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1fcd6247-17ed-4c83-97eb-d72106b277dd req-f5327a5e-f8aa-4c09-b37e-19090533a58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-deleted", "tag": "610a858d-7018-4592-868c-3b15b37557fa"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-deleted", "tag": "02fdd17d-834c-4946-a15e-652cc4faf437"}, {"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-deleted", "tag": "3b29526e-1c95-43fd-acbc-c4e8746e941a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:40.890312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:40.895117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:40.896955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1fcd6247-17ed-4c83-97eb-d72106b277dd req-f5327a5e-f8aa-4c09-b37e-19090533a58f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.897778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1fcd6247-17ed-4c83-97eb-d72106b277dd req-f5327a5e-f8aa-4c09-b37e-19090533a58f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.898519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1fcd6247-17ed-4c83-97eb-d72106b277dd req-f5327a5e-f8aa-4c09-b37e-19090533a58f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.907223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.909398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.909936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.911557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:40.913946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:40.914477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:40.915441 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1fcd6247-17ed-4c83-97eb-d72106b277dd req-f5327a5e-f8aa-4c09-b37e-19090533a58f service nova] Creating event network-vif-deleted:610a858d-7018-4592-868c-3b15b37557fa for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:40.916064 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1fcd6247-17ed-4c83-97eb-d72106b277dd req-f5327a5e-f8aa-4c09-b37e-19090533a58f service nova] Creating event network-vif-deleted:02fdd17d-834c-4946-a15e-652cc4faf437 for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:40.916665 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1fcd6247-17ed-4c83-97eb-d72106b277dd req-f5327a5e-f8aa-4c09-b37e-19090533a58f service nova] Creating event network-vif-deleted:3b29526e-1c95-43fd-acbc-c4e8746e941a for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:40.923019 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1fcd6247-17ed-4c83-97eb-d72106b277dd req-f5327a5e-f8aa-4c09-b37e-19090533a58f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043536 Oct 12 09:01:40.924142 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2016/4381] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:40.929686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cdbe7fdb-0a27-49d7-ba5d-f570dfcae788 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Calling method '.version_select at 0x7f984cbf3e50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:41.289101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:41.317796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6855f598-c7aa-45a9-9fef-c20ce6daf28f tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.419508 Oct 12 09:01:41.325972 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2366/4382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:40 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:41.343687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:41.345116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:41.370837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:41.372497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:41.372948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:41.375629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:41.378970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:41.379866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:41.437267 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cdbe7fdb-0a27-49d7-ba5d-f570dfcae788 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/22fa40c5-8089-4046-af61-a8a563f40234" status: 202 len: 0 microversion: 2.1 time: 0.511632 Oct 12 09:01:41.441115 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2017/4383] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 09:01:40 2022] DELETE /compute/v2.1/os-security-groups/22fa40c5-8089-4046-af61-a8a563f40234 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:41.446163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:41.447169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:41.463457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:41.464352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:41.465030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:41.466067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:41.467707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:41.469706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:41.802829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:41.814676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:41.817312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:41.819404 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-239192b1-d564-4dd6-9931-98caba883898 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1407 microversion: 2.20 time: 0.492232 Oct 12 09:01:41.819977 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2367/4384] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:41 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:41.827097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:41.827954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:41.838188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:41.845318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:41.846419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:41.849208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:41.850711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:41.853751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:41.854420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:41.861964 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0faeecf1-99dd-484b-8c4d-7318ec228dba tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1324 microversion: 2.1 time: 0.419523 Oct 12 09:01:41.870066 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2018/4385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:41 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:41.875107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d7e3f7c-3c9c-45b5-bee9-97064dca1309 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Calling method '.version_select at 0x7f9843d0fca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:42.156498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:42.170323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-abce6a2f-dc12-46e8-8417-6e56a21bc927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.346712 Oct 12 09:01:42.171204 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2368/4386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:41 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:42.199863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-40ceed4e-a25d-49f8-a0b3-0912f093c578 req-8985b455-28a4-42f4-a560-d0502d440cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9d482e-606b-410f-8d89-9b5d9a4096f2", "name": "network-vif-plugged", "status": "completed", "tag": "29bbbb10-ff76-41db-9ccd-f9e063463bf9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:42.222208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-40ceed4e-a25d-49f8-a0b3-0912f093c578 req-8985b455-28a4-42f4-a560-d0502d440cae service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:42.224013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-40ceed4e-a25d-49f8-a0b3-0912f093c578 req-8985b455-28a4-42f4-a560-d0502d440cae service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:42.225103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-40ceed4e-a25d-49f8-a0b3-0912f093c578 req-8985b455-28a4-42f4-a560-d0502d440cae service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:42.242203 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-40ceed4e-a25d-49f8-a0b3-0912f093c578 req-8985b455-28a4-42f4-a560-d0502d440cae service nova] Creating event network-vif-plugged:29bbbb10-ff76-41db-9ccd-f9e063463bf9 for instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 on n-h1-858383-10 Oct 12 09:01:42.248458 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-40ceed4e-a25d-49f8-a0b3-0912f093c578 req-8985b455-28a4-42f4-a560-d0502d440cae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061048 Oct 12 09:01:42.250474 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2369/4387] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:42.258029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:42.259307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:42.267165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:42.267904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:42.270288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:42.271326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:42.272670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:42.277993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:42.470969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:42.489089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:42.492218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:42.493658 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-367364bb-9986-45e4-90bd-756a286aed06 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.241806 Oct 12 09:01:42.494236 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2370/4388] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:42 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:42.516330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:42.516330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:42.525477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:42.526018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:42.526459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:42.527178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:42.536664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:42.537385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:42.624669 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d7e3f7c-3c9c-45b5-bee9-97064dca1309 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/bf27e062-db50-4e0b-a412-02a941ec6263" status: 202 len: 0 microversion: 2.1 time: 0.753051 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2019/4389] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 09:01:41 2022] DELETE /compute/v2.1/os-security-groups/bf27e062-db50-4e0b-a412-02a941ec6263 => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-028187ef-cfb3-4d51-ad86-f5c5d234ebb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-028187ef-cfb3-4d51-ad86-f5c5d234ebb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: request: PUT /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb HTTP/1.1 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 280 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:42.674137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-028187ef-cfb3-4d51-ad86-f5c5d234ebb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-028187ef-cfb3-4d51-ad86-f5c5d234ebb8 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "PUT /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 400 len: 619 microversion: 2.1 time: 0.015113 Oct 12 09:01:42.685879 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2020/4390] 10.222.0.40 () {60 vars in 1257 bytes} [Wed Oct 12 09:01:42 2022] PUT /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 619 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:42.692225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8c922d5-b96a-47bc-913b-d413c21639de tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Calling method '.version_select at 0x7f9843d230d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:43.089095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:43.099409 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b14e69ef-9bc0-4a2b-bd29-0c94ecf219f5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef" status: 200 len: 1522 microversion: 2.1 time: 0.603003 Oct 12 09:01:43.100011 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2371/4391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:42 2022] GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:43.136070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:43.137331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:43.151530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:43.153683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:43.155589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:43.156923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:43.158727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:43.159840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:43.387549 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8c922d5-b96a-47bc-913b-d413c21639de tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/88fe57fe-f6b0-4492-bf5d-baac546b0512" status: 202 len: 0 microversion: 2.1 time: 0.708876 Oct 12 09:01:43.388075 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2021/4392] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 09:01:42 2022] DELETE /compute/v2.1/os-security-groups/88fe57fe-f6b0-4492-bf5d-baac546b0512 => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:43.395825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:43.396465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:43.416036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:43.416537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:43.420983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:43.423053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:43.423575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:43.424026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:43.840947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:43.864690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:43.871360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:43.876886 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4797af65-7e38-4f38-b86e-4abbe13e0b1c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1599 microversion: 2.20 time: 0.484430 Oct 12 09:01:43.891918 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2022/4393] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:43 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1599 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:43.898764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:43.910314 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2f91a22-b302-4377-a1eb-11c29e9d4142 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.788545 Oct 12 09:01:43.912434 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2372/4394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:43 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:43.929054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:43.929719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:43.946555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5ffc56ef-755d-4137-89c7-b44407d2df5d req-a18430cc-284d-487c-a0c3-c702e2230c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff3c24b-beda-4f72-9cce-27cde19fc0d9", "name": "network-vif-deleted", "tag": "3a324a9b-e152-4288-b469-6bc1dd04ee7e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:43.955327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:43.955848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:43.956295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:43.961196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:43.961567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:43.962014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:43.966246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5ffc56ef-755d-4137-89c7-b44407d2df5d req-a18430cc-284d-487c-a0c3-c702e2230c77 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:43.966878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5ffc56ef-755d-4137-89c7-b44407d2df5d req-a18430cc-284d-487c-a0c3-c702e2230c77 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:43.967642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5ffc56ef-755d-4137-89c7-b44407d2df5d req-a18430cc-284d-487c-a0c3-c702e2230c77 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:43.989372 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5ffc56ef-755d-4137-89c7-b44407d2df5d req-a18430cc-284d-487c-a0c3-c702e2230c77 service nova] Creating event network-vif-deleted:3a324a9b-e152-4288-b469-6bc1dd04ee7e for instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 on n-h1-858383-10 Oct 12 09:01:43.997979 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5ffc56ef-755d-4137-89c7-b44407d2df5d req-a18430cc-284d-487c-a0c3-c702e2230c77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060864 Oct 12 09:01:44.002328 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2373/4395] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:44.015717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79886829-56f4-42a5-bdf4-eabeaff54969 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Calling method '.version_select at 0x7f9843c281f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:44.237204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:44.246302 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e424edca-9fe0-4cf2-a399-6fbd6df19b8d tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1324 microversion: 2.1 time: 0.343555 Oct 12 09:01:44.262146 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2023/4396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:43 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:44.267298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:44.268069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:44.274044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:44.275710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:44.276416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:44.277082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:44.278050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:44.278703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:44.279362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:44.357054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:44.369081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:44.370929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:44.372426 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf0acf18-f421-4965-90fb-b49eb75b44dc tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.108995 Oct 12 09:01:44.373688 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2024/4397] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:44 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:44.476435 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79886829-56f4-42a5-bdf4-eabeaff54969 tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/56521e25-b99a-4abe-95dd-87f42242eb71" status: 202 len: 0 microversion: 2.1 time: 0.469542 Oct 12 09:01:44.477032 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2374/4398] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 09:01:44 2022] DELETE /compute/v2.1/os-security-groups/56521e25-b99a-4abe-95dd-87f42242eb71 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:44.483106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:44.484005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:44.497969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:44.498473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:44.498917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:44.499795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:44.500411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:44.503378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:44.677776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-48e46ec1-c5ba-4a71-bfbb-30703eed5293 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Action: 'create', calling method: .version_select at 0x7f9843d64820>, body: {"keypair": {"name": "tempest-keypair-476899030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZCOPwa4lK+07Sz1hG2+DifkZGSyeeevX/B8NcscWzsZ9StNi58NqTHYA4yt3ofyewVoM4rdBQlB3++MH0XRgSQxY1Zw/L7nXfZLB8Tpu5VnPj7NxEtZVLojQPE/huU8w=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:44.713833 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89608094-fc92-473f-afdd-f4b99974a8e3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.235606 Oct 12 09:01:44.714444 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2375/4399] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 12 09:01:44 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/os-interface => generated 284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:01:44.717579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-48e46ec1-c5ba-4a71-bfbb-30703eed5293 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:44.720046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:44.720656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:44.735482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:44.736137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:44.736865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:44.738626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:44.739977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:44.740549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:44.749664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-48e46ec1-c5ba-4a71-bfbb-30703eed5293 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for user 28feebfd77394d54a3d9922fca016809 and project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:44.841658 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-48e46ec1-c5ba-4a71-bfbb-30703eed5293 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.466306 Oct 12 09:01:44.850168 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2025/4400] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:01:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:44.864806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:44.866522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:44.874974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:44.875676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:44.879596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:44.880777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:44.881389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:44.882101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:44.906641 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] HTTP exception thrown: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Request method failure captured: Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef HTTP/1.1 Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoJNAVS36MWV62VttsALfOOEwKl_4iuQfgBwEgiTKxVx5h1tZJ6K6ZZ9ZTnXukdt435O83a5_JextfdnQFf-SoanVgUqArNLef3exep5n2agVnO2bOCJGJaWyoFX9dqbs9CDbWqpDZB157lhb1hDARZtCIj4hW8xCPQCAoMpMFiV8q4 Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/65f2f36631244e30b590002855df32ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_65f2f36631244e30b590002855df32ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}] Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5f771bd04b48418595d91df09dc1d8bf Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1d766526-e1d7-453d-9bfb-5cfe3bdadbef'} Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:44.908805 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:44.911749 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:44.911749 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:44.911749 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:44.911749 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:44.911749 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:44.911749 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:44.911749 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:44.911749 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:44.913586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Returning 404 to user: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:44.914630 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3e6741a2-5b1c-4f29-a5ef-1f163a4f0174 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef" status: 404 len: 111 microversion: 2.1 time: 0.063177 Oct 12 09:01:44.916535 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2026/4401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:44 2022] GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:44.925323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32675e73-b401-43dd-946b-89aaf48cff5b tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] Calling method '.version_select at 0x7f984ccecd30>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:45.168164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:45.186929 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-33435f31-694e-455b-90c7-e06d3cfa40e2 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.470751 Oct 12 09:01:45.187618 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2376/4402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:44 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:45.197290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-08fa63e7-5b16-49d2-aa38-de99fc1b56c7 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Calling method '.version_select at 0x7f9843c28af0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:45.205128 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-08fa63e7-5b16-49d2-aa38-de99fc1b56c7 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-476899030" status: 200 len: 497 microversion: 2.1 time: 0.016341 Oct 12 09:01:45.206437 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2377/4403] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 12 09:01:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-476899030 => generated 497 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:45.211360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:45.217773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:45.220714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:45.226444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:45.226927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:45.227362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:45.228072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:45.228664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:45.229222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:45.330686 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59d5e039-ae0b-4318-a4f1-38507723273a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.122448 Oct 12 09:01:45.339206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2378/4404] 10.222.0.40 () {58 vars in 1230 bytes} [Wed Oct 12 09:01:45 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:01:45.345383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-546f6225-7a44-44c0-852f-83b24714ed3a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-546f6225-7a44-44c0-852f-83b24714ed3a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: request: PUT /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb HTTP/1.1 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 24 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": ""}} Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb', 'body': {'server': {'name': ''}}} Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi '' Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:45.349545 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 12 09:01:45.353169 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.354644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-546f6225-7a44-44c0-852f-83b24714ed3a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:45.355728 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-546f6225-7a44-44c0-852f-83b24714ed3a tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "PUT /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 400 len: 108 microversion: 2.1 time: 0.015261 Oct 12 09:01:45.356811 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2379/4405] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 09:01:45 2022] PUT /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:45.362031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-912fb2f2-f3c5-4fce-a70a-1da11c760780 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Calling method '.version_select at 0x7f9843d4e310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:45.391069 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-912fb2f2-f3c5-4fce-a70a-1da11c760780 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476899030" status: 202 len: 0 microversion: 2.1 time: 0.032898 Oct 12 09:01:45.392746 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2380/4406] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 09:01:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476899030 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:45.398991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:45.399635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:45.406640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:45.407230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:45.407894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:45.408831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:45.409853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:45.413727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:45.493159 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32675e73-b401-43dd-946b-89aaf48cff5b tempest-SecurityGroupRulesNegativeTestJSON-550944574 tempest-SecurityGroupRulesNegativeTestJSON-550944574-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/dd75255c-6591-4449-b8aa-a9ea71e4dba4" status: 202 len: 0 microversion: 2.1 time: 0.575191 Oct 12 09:01:45.493814 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2027/4407] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 09:01:44 2022] DELETE /compute/v2.1/os-security-groups/dd75255c-6591-4449-b8aa-a9ea71e4dba4 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:45.498435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c89f32f1-0693-4462-8285-5e17a1cb4827 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c89f32f1-0693-4462-8285-5e17a1cb4827 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Request method failure captured: Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoJNAVS36MWV62VttsALfOOEwKl_4iuQfgBwEgiTKxVx5h1tZJ6K6ZZ9ZTnXukdt435O83a5_JextfdnQFf-SoanVgUqArNLef3exep5n2agVnO2bOCJGJaWyoFX9dqbs9CDbWqpDZB157lhb1hDARZtCIj4hW8xCPQCAoMpMFiV8q4 Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/65f2f36631244e30b590002855df32ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_65f2f36631244e30b590002855df32ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}] Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5f771bd04b48418595d91df09dc1d8bf Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: action_args: {} Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 09:01:45.502356 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c89f32f1-0693-4462-8285-5e17a1cb4827 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c89f32f1-0693-4462-8285-5e17a1cb4827 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.008978 Oct 12 09:01:45.506231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2028/4408] 10.222.0.40 () {58 vars in 1182 bytes} [Wed Oct 12 09:01:45 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:45.523234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:45.523849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:45.544260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:45.545904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:45.547241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:45.549270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:45.549945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:45.550527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:45.658729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:45.672824 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b373f2d1-cf2a-46e8-bb28-9c9db41a7fe2 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1520 microversion: 2.1 time: 0.277240 Oct 12 09:01:45.689463 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2381/4409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:45 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:45.696287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85b64306-2f12-4c4a-868d-92a5993467b0 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Action: 'create', calling method: .version_select at 0x7f9843e2a790>, body: {"keypair": {"name": "tempest-keypair-652950738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzZFy0nYDx1B2B4GBxQTMMSvftw65rv8udnD6lLJlO8q67mw5JBvoAVb20f4AwfHG75O2Dd2TLt2JwXZXvABj1fdRaM1cN3PbeIg2TF6hd5h+rZG0i70h4SBc0qu15wBQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:45.722308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-85b64306-2f12-4c4a-868d-92a5993467b0 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:45.749653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-85b64306-2f12-4c4a-868d-92a5993467b0 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for user 28feebfd77394d54a3d9922fca016809 and project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:45.789183 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85b64306-2f12-4c4a-868d-92a5993467b0 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103267 Oct 12 09:01:45.790091 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2382/4410] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:01:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:45.802324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:45.804193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:45.821538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:45.822323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:45.822970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:45.824107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:45.824751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:45.825397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:45.982963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:45.997502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:45.999270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:46.000715 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f7517c04-35ce-45ad-b328-def8e672db09 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.209222 Oct 12 09:01:46.018025 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2383/4411] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:45 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:46.024402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.029667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:46.030572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'deleted': False, 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:46.036623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.037574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.038383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.039251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.039883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.040450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.071832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:01:46.123229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cbe6687c-6e6e-4567-96e5-27663db77de0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.103954 Oct 12 09:01:46.128361 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2384/4412] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/servers => generated 681 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:46.133627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f6dca8d-ca81-4475-8cb7-7f17f5e4b138 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Calling method '.version_select at 0x7f9843c281f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.156108 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f6dca8d-ca81-4475-8cb7-7f17f5e4b138 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-652950738" status: 202 len: 0 microversion: 2.1 time: 0.026304 Oct 12 09:01:46.163426 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2385/4413] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 09:01:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-652950738 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:46.169227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4554a07-5fc5-4fb4-9233-6561a12133b6 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-519454492", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4554a07-5fc5-4fb4-9233-6561a12133b6 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Request method failure captured: Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 242 Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJiWH1QqByNEkO8PvBCYFuhsAFvdaUnTEcxQGJDwzj-jCImbb2uBMfvan_rXuTz42jJViXjbJcQlrMDbVJl2Ag1Jy2CXV0HWbdyj12S6uO4IgvhwLv-lfmgI4AjJ59x9kWD8JtA2sOwep7kav9bU0qwC-MtALgWMa9Po5h0I5Hl2eU Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_871b74422aee4f06a5f419f07d03936d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}] Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 37e4d1277960411f909bf8e4da358e3f Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-519454492", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-519454492', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8a6f6a8e-e442-44bd-9afd-4a5283ff7543'}]}}} Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:46.174989 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.178345 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.180796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4554a07-5fc5-4fb4-9233-6561a12133b6 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:46.181944 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b4554a07-5fc5-4fb4-9233-6561a12133b6 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017226 Oct 12 09:01:46.183092 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2386/4414] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/servers => generated 175 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:46.186711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:46.194000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-32b0ca5d-2418-4abc-ab48-68f41b051858 req-8c681ff7-edaa-4f99-bccc-b88b6b94ea30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d766526-e1d7-453d-9bfb-5cfe3bdadbef", "name": "network-vif-deleted", "tag": "a070931c-3812-4b0a-9dfc-efdde87287fd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.196400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b80076d-8952-4405-ad2f-2a16641c18b6 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1506 microversion: 2.1 time: 0.691115 Oct 12 09:01:46.201683 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2029/4415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:45 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1506 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:46.209739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.209925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-32b0ca5d-2418-4abc-ab48-68f41b051858 req-8c681ff7-edaa-4f99-bccc-b88b6b94ea30 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.210306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-32b0ca5d-2418-4abc-ab48-68f41b051858 req-8c681ff7-edaa-4f99-bccc-b88b6b94ea30 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.210739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-32b0ca5d-2418-4abc-ab48-68f41b051858 req-8c681ff7-edaa-4f99-bccc-b88b6b94ea30 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.222436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:46.225383 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-32b0ca5d-2418-4abc-ab48-68f41b051858 req-8c681ff7-edaa-4f99-bccc-b88b6b94ea30 service nova] Creating event network-vif-deleted:a070931c-3812-4b0a-9dfc-efdde87287fd for instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef on n-h2-858383-10 Oct 12 09:01:46.226143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.compute.servers [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Removing options 'limit' from query {{(pid=127007) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 09:01:46.227812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'deleted': False, 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:46.230461 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-32b0ca5d-2418-4abc-ab48-68f41b051858 req-8c681ff7-edaa-4f99-bccc-b88b6b94ea30 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045624 Oct 12 09:01:46.231536 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2387/4416] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:46.239208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.239967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5969afcf-9fbe-4657-8037-21fa0d84258d tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Action: 'create', calling method: .version_select at 0x7f9843da3ee0>, body: {"keypair": {"name": "tempest-keypair-1380508327", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.242073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.242744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.245621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.255776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.256600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.261089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-5969afcf-9fbe-4657-8037-21fa0d84258d tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:46.269090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-5969afcf-9fbe-4657-8037-21fa0d84258d tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for user 28feebfd77394d54a3d9922fca016809 and project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:46.316970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:01:46.321585 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5969afcf-9fbe-4657-8037-21fa0d84258d tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.088191 Oct 12 09:01:46.328565 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2388/4417] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:46.347630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bdf5e578-5c9f-44e3-a957-b9406f581aa4 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.348632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bdf5e578-5c9f-44e3-a957-b9406f581aa4 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: b8b7c693-e4f5-45b4-865c-60105868fcaf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:46.366834 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-bdf5e578-5c9f-44e3-a957-b9406f581aa4 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] HTTP exception thrown: Instance b8b7c693-e4f5-45b4-865c-60105868fcaf could not be found. Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bdf5e578-5c9f-44e3-a957-b9406f581aa4 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Request method failure captured: Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/b8b7c693-e4f5-45b4-865c-60105868fcaf/metadata HTTP/1.1 Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJiWH1QqByNEkO8PvBCYFuhsAFvdaUnTEcxQGJDwzj-jCImbb2uBMfvan_rXuTz42jJViXjbJcQlrMDbVJl2Ag1Jy2CXV0HWbdyj12S6uO4IgvhwLv-lfmgI4AjJ59x9kWD8JtA2sOwep7kav9bU0qwC-MtALgWMa9Po5h0I5Hl2eU Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_871b74422aee4f06a5f419f07d03936d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}] Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 37e4d1277960411f909bf8e4da358e3f Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance b8b7c693-e4f5-45b4-865c-60105868fcaf could not be found. Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': 'b8b7c693-e4f5-45b4-865c-60105868fcaf'} Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b7c693-e4f5-45b4-865c-60105868fcaf could not be found. Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b7c693-e4f5-45b4-865c-60105868fcaf could not be found. Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.378066 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.387075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:46.387075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:46.387075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b7c693-e4f5-45b4-865c-60105868fcaf could not be found. Oct 12 09:01:46.387075 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.387402 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-40467a9d-1057-4669-ba50-6eec8ea62894 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.176176 Oct 12 09:01:46.387402 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2030/4418] 10.222.0.40 () {58 vars in 1144 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:46.390773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bdf5e578-5c9f-44e3-a957-b9406f581aa4 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Returning 404 to user: Instance b8b7c693-e4f5-45b4-865c-60105868fcaf could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:46.391652 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bdf5e578-5c9f-44e3-a957-b9406f581aa4 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/b8b7c693-e4f5-45b4-865c-60105868fcaf/metadata" status: 404 len: 111 microversion: 2.1 time: 0.062117 Oct 12 09:01:46.392840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2389/4419] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/servers/b8b7c693-e4f5-45b4-865c-60105868fcaf/metadata => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:46.414718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c8b467c0-9333-4482-b27a-7cb1fd9aa632 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Calling method '.version_select at 0x7f9843d453a0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.424903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7d46b72-b759-4338-bb17-87474410a1c5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7d46b72-b759-4338-bb17-87474410a1c5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Request method failure captured: Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJNAVS36MWV62VttsALfOOEwKl_4iuQfgBwEgiTKxVx5h1tZJ6K6ZZ9ZTnXukdt435O83a5_JextfdnQFf-SoanVgUqArNLef3exep5n2agVnO2bOCJGJaWyoFX9dqbs9CDbWqpDZB157lhb1hDARZtCIj4hW8xCPQCAoMpMFiV8q4 Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/65f2f36631244e30b590002855df32ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_65f2f36631244e30b590002855df32ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}] Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 5f771bd04b48418595d91df09dc1d8bf Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi '-1' Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 09:01:46.438912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.442239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7d46b72-b759-4338-bb17-87474410a1c5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:46.444382 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b7d46b72-b759-4338-bb17-87474410a1c5 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.049318 Oct 12 09:01:46.445257 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2390/4420] 10.222.0.40 () {58 vars in 1142 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:46.451891 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c8b467c0-9333-4482-b27a-7cb1fd9aa632 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380508327" status: 202 len: 0 microversion: 2.1 time: 0.063526 Oct 12 09:01:46.457479 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2031/4421] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 09:01:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380508327 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:46.463315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de154e4b-3b96-4a9f-8243-899356ca42ba tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.470409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e341b940-f8c7-47f6-8537-0f86aca50895 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Action: 'create', calling method: .version_select at 0x7f9843d104c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1650963123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdTY9i4d+W/pbLpqY/3nsk7u8O5/d7gPjAeJa7vtQcKL5L3lw72S0lzp4pc3gh/jE3VnEMdlw89GTmg46IXlhWvD5u3ztZdVkDd7bso2L7xHXGRgdEUTu927RkTwNGtIg=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de154e4b-3b96-4a9f-8243-899356ca42ba tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Request method failure captured: Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJNAVS36MWV62VttsALfOOEwKl_4iuQfgBwEgiTKxVx5h1tZJ6K6ZZ9ZTnXukdt435O83a5_JextfdnQFf-SoanVgUqArNLef3exep5n2agVnO2bOCJGJaWyoFX9dqbs9CDbWqpDZB157lhb1hDARZtCIj4hW8xCPQCAoMpMFiV8q4 Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/65f2f36631244e30b590002855df32ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_65f2f36631244e30b590002855df32ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}] Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 5f771bd04b48418595d91df09dc1d8bf Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: action_args: {} Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'testing' Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 12 09:01:46.475917 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 12 09:01:46.480098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.483119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de154e4b-3b96-4a9f-8243-899356ca42ba tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:46.486887 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de154e4b-3b96-4a9f-8243-899356ca42ba tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.034516 Oct 12 09:01:46.496078 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2391/4422] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:46.501768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d00215a-ceec-4187-9ddc-6893d0bd8503 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-234082132", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d00215a-ceec-4187-9ddc-6893d0bd8503 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Request method failure captured: Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 498 Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJiWH1QqByNEkO8PvBCYFuhsAFvdaUnTEcxQGJDwzj-jCImbb2uBMfvan_rXuTz42jJViXjbJcQlrMDbVJl2Ag1Jy2CXV0HWbdyj12S6uO4IgvhwLv-lfmgI4AjJ59x9kWD8JtA2sOwep7kav9bU0qwC-MtALgWMa9Po5h0I5Hl2eU Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_871b74422aee4f06a5f419f07d03936d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}] Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 37e4d1277960411f909bf8e4da358e3f Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-234082132", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-234082132', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8a6f6a8e-e442-44bd-9afd-4a5283ff7543'}]}}} Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 09:01:46.508893 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.511628 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.514331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d00215a-ceec-4187-9ddc-6893d0bd8503 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:46.515391 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d00215a-ceec-4187-9ddc-6893d0bd8503 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.017933 Oct 12 09:01:46.527075 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2392/4423] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/servers => generated 687 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:46.539426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3f14349-8541-4788-952e-ea3bcb4ecac0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.551058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e341b940-f8c7-47f6-8537-0f86aca50895 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:46.553704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e3f14349-8541-4788-952e-ea3bcb4ecac0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:46.554206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3f14349-8541-4788-952e-ea3bcb4ecac0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:46.568533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.servers [None req-e3f14349-8541-4788-952e-ea3bcb4ecac0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Flavor 'non_existing_flavor' could not be found {{(pid=127006) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 12 09:01:46.569462 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3f14349-8541-4788-952e-ea3bcb4ecac0 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.041335 Oct 12 09:01:46.577035 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2393/4424] 10.222.0.40 () {58 vars in 1178 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:01:46.577203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e341b940-f8c7-47f6-8537-0f86aca50895 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for user 28feebfd77394d54a3d9922fca016809 and project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:46.587943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.593273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:46.594011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:46.609285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.609827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.610331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.611614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.611840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.612405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.639643 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e341b940-f8c7-47f6-8537-0f86aca50895 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.173996 Oct 12 09:01:46.641644 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2032/4425] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:46.654673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0702c23e-7518-4d52-b537-31f0aa95313b tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1445122153", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0702c23e-7518-4d52-b537-31f0aa95313b tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Request method failure captured: Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 500 Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoJiWH1QqByNEkO8PvBCYFuhsAFvdaUnTEcxQGJDwzj-jCImbb2uBMfvan_rXuTz42jJViXjbJcQlrMDbVJl2Ag1Jy2CXV0HWbdyj12S6uO4IgvhwLv-lfmgI4AjJ59x9kWD8JtA2sOwep7kav9bU0qwC-MtALgWMa9Po5h0I5Hl2eU Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_871b74422aee4f06a5f419f07d03936d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}] Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 37e4d1277960411f909bf8e4da358e3f Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1445122153", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1445122153', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8a6f6a8e-e442-44bd-9afd-4a5283ff7543'}]}}} Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 09:01:46.663823 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.666734 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.669626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0702c23e-7518-4d52-b537-31f0aa95313b tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:46.670631 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0702c23e-7518-4d52-b537-31f0aa95313b tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.027887 Oct 12 09:01:46.672857 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2033/4426] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/servers => generated 689 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:01:46.684424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-678b1067-98f7-4d58-a1b9-40f61544b369 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Action: 'create', calling method: .version_select at 0x7f9843d10310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-380211068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0vrmLUqHQgcjEWRP9bvsJdltMt+Ciui17/z/hhF4Wx+Rk5G9W2tVCyiphlEKZ58QD1jf3msgekq7UjYxokfeCWK3MIhGXh480dxKtSC1BIn945E2MDrZBLMyvyt23Cog=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.724087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-678b1067-98f7-4d58-a1b9-40f61544b369 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:46.738407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-678b1067-98f7-4d58-a1b9-40f61544b369 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for user 28feebfd77394d54a3d9922fca016809 and project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:46.783761 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b32b716f-787d-4d68-9e1b-477000aee3a4 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.203982 Oct 12 09:01:46.784672 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2394/4427] 10.222.0.40 () {58 vars in 1174 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:01:46.796779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bbf178c8-7a41-41c6-b72e-35834ea6cabd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1135950795", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bbf178c8-7a41-41c6-b72e-35834ea6cabd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Request method failure captured: Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 754 Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJiWH1QqByNEkO8PvBCYFuhsAFvdaUnTEcxQGJDwzj-jCImbb2uBMfvan_rXuTz42jJViXjbJcQlrMDbVJl2Ag1Jy2CXV0HWbdyj12S6uO4IgvhwLv-lfmgI4AjJ59x9kWD8JtA2sOwep7kav9bU0qwC-MtALgWMa9Po5h0I5Hl2eU Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_871b74422aee4f06a5f419f07d03936d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}] Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 37e4d1277960411f909bf8e4da358e3f Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1135950795", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1135950795', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8a6f6a8e-e442-44bd-9afd-4a5283ff7543'}]}}} Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:46.801507 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:46.804456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:46.806971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.806971 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.807122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-678b1067-98f7-4d58-a1b9-40f61544b369 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.127658 Oct 12 09:01:46.807122 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2034/4428] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:46.812049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bbf178c8-7a41-41c6-b72e-35834ea6cabd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:46.813087 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bbf178c8-7a41-41c6-b72e-35834ea6cabd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.027477 Oct 12 09:01:46.814588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.826779 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2395/4429] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/servers => generated 1197 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 12 09:01:46.827377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:46.828127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:46.832183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5f3f0454-c57b-49e3-a965-2b8265816dc2 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Action: 'create', calling method: .version_select at 0x7f9843da3700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-987190144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHRYxEQTCOxz/KvzaKbZKXk28+x8vu6GSXqg0ePBafIkniGewrflQR9NIrUyeO3Y2ncrybULzZ48jzpG2SUfVseTT6CoAOnIeB1WC26IEN0/11Tk97n+Nc4cHd7vwpGQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.847133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.847845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.848604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.849584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:46.850215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:46.850801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:46.874974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-5f3f0454-c57b-49e3-a965-2b8265816dc2 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:01:46.882180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-5f3f0454-c57b-49e3-a965-2b8265816dc2 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Getting quotas for user 28feebfd77394d54a3d9922fca016809 and project 361afde49c804e8f87db6f4ba4411c70. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:01:46.935550 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5f3f0454-c57b-49e3-a965-2b8265816dc2 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.107411 Oct 12 09:01:46.936792 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2396/4430] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:46.941839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f595d26d-6373-4a12-bd4c-391f1691bb59 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-505454109", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f595d26d-6373-4a12-bd4c-391f1691bb59 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Request method failure captured: Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 1265 Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJiWH1QqByNEkO8PvBCYFuhsAFvdaUnTEcxQGJDwzj-jCImbb2uBMfvan_rXuTz42jJViXjbJcQlrMDbVJl2Ag1Jy2CXV0HWbdyj12S6uO4IgvhwLv-lfmgI4AjJ59x9kWD8JtA2sOwep7kav9bU0qwC-MtALgWMa9Po5h0I5Hl2eU Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_871b74422aee4f06a5f419f07d03936d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}] Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 37e4d1277960411f909bf8e4da358e3f Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-505454109", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8a6f6a8e-e442-44bd-9afd-4a5283ff7543"}]}} Oct 12 09:01:46.946507 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-505454109', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8a6f6a8e-e442-44bd-9afd-4a5283ff7543'}]}}} Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.948530 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:01:46.949607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:01:46.951241 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 12 09:01:46.951241 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:46.958508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f595d26d-6373-4a12-bd4c-391f1691bb59 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:46.959862 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f595d26d-6373-4a12-bd4c-391f1691bb59 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.021938 Oct 12 09:01:46.968446 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2397/4431] 10.222.0.40 () {60 vars in 1148 bytes} [Wed Oct 12 09:01:46 2022] POST /compute/v2.1/servers => generated 2221 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 12 09:01:46.973523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1780c702-b4ed-4659-ac27-4d63233b0113 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Calling method '.version_select at 0x7f9843bbf790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:46.989827 n-d-858383-10 devstack@n-api.service[127006]: WARNING oslo_db.sqlalchemy.utils [None req-1780c702-b4ed-4659-ac27-4d63233b0113 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 12 09:01:47.000178 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1780c702-b4ed-4659-ac27-4d63233b0113 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.030350 Oct 12 09:01:47.000844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2398/4432] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:47.011324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23cab015-802b-4f28-9099-0865a3301524 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.012033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-23cab015-802b-4f28-9099-0865a3301524 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 185e54dd-8f8d-46fa-8a8b-a1ff04781f48] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:47.027906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-23cab015-802b-4f28-9099-0865a3301524 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] HTTP exception thrown: Instance 185e54dd-8f8d-46fa-8a8b-a1ff04781f48 could not be found. Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23cab015-802b-4f28-9099-0865a3301524 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Request method failure captured: Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/185e54dd-8f8d-46fa-8a8b-a1ff04781f48/metadata/test2 HTTP/1.1 Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJiWH1QqByNEkO8PvBCYFuhsAFvdaUnTEcxQGJDwzj-jCImbb2uBMfvan_rXuTz42jJViXjbJcQlrMDbVJl2Ag1Jy2CXV0HWbdyj12S6uO4IgvhwLv-lfmgI4AjJ59x9kWD8JtA2sOwep7kav9bU0qwC-MtALgWMa9Po5h0I5Hl2eU Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_871b74422aee4f06a5f419f07d03936d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}] Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 37e4d1277960411f909bf8e4da358e3f Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 185e54dd-8f8d-46fa-8a8b-a1ff04781f48 could not be found. Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': '185e54dd-8f8d-46fa-8a8b-a1ff04781f48', 'id': 'test2'} Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185e54dd-8f8d-46fa-8a8b-a1ff04781f48 could not be found. Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185e54dd-8f8d-46fa-8a8b-a1ff04781f48 could not be found. Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:47.029649 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:47.032959 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:47.032959 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:47.032959 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185e54dd-8f8d-46fa-8a8b-a1ff04781f48 could not be found. Oct 12 09:01:47.032959 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:47.034804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23cab015-802b-4f28-9099-0865a3301524 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Returning 404 to user: Instance 185e54dd-8f8d-46fa-8a8b-a1ff04781f48 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:47.035988 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-23cab015-802b-4f28-9099-0865a3301524 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/185e54dd-8f8d-46fa-8a8b-a1ff04781f48/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.033918 Oct 12 09:01:47.045741 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2399/4433] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 12 09:01:47 2022] GET /compute/v2.1/servers/185e54dd-8f8d-46fa-8a8b-a1ff04781f48/metadata/test2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:47.046114 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb3b0191-551f-40dd-be2d-f876679af82c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.230263 Oct 12 09:01:47.046755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2035/4434] 10.222.0.40 () {58 vars in 1184 bytes} [Wed Oct 12 09:01:46 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:01:47.051304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53af6ebd-5748-4d81-be31-e3f4acfb7405 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Calling method '.version_select at 0x7f9843bbfa60>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.051454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.052031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:47.069115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.069642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.070084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.070791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.071246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.071671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.076525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:47.098843 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53af6ebd-5748-4d81-be31-e3f4acfb7405 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-987190144" status: 202 len: 0 microversion: 2.1 time: 0.051508 Oct 12 09:01:47.100003 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2400/4435] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-987190144 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:47.105169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.114532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:47.121799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.132983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.133653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.134417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.134872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.135439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.188885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:47.240973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:47.252851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:47.270870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:47.272257 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6d358eb-366c-4ab8-9b00-6b7d9fdcaf68 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.224555 Oct 12 09:01:47.272837 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2036/4436] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:47 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:47.293147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.306806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:47.312952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:47.313745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'deleted': False, 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:47.336103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.336589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.337023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.338678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.345810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.346311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.398243 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95c6fdf8-9637-46e8-9054-fbd527473e72 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 204 len: 0 microversion: 2.1 time: 0.296165 Oct 12 09:01:47.398953 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2401/4437] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:47 2022] DELETE /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:01:47.407117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59c5a5b6-227c-4c7b-91ed-658bf00c1bf3 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Calling method '.version_select at 0x7f9843beca60>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.424212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:01:47.459152 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59c5a5b6-227c-4c7b-91ed-658bf00c1bf3 tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-380211068" status: 202 len: 0 microversion: 2.1 time: 0.058608 Oct 12 09:01:47.460322 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2402/4438] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-380211068 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:47.466665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.478509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:47.486227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.487044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.487687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.488599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.489296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.490124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.500638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:47.531942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:47.532694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:47.533286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:47.767178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:47.775725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6a14445-85ab-42c1-b489-9df7ecaf9bdd tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1526 microversion: 2.1 time: 0.314240 Oct 12 09:01:47.776319 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2403/4439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:47 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1526 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:47.790024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c17571e-c208-455a-8cc3-6ac0be7ac91f tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] Calling method '.version_select at 0x7f9843bbf280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.827375 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c17571e-c208-455a-8cc3-6ac0be7ac91f tempest-KeyPairsV2TestJSON-569786742 tempest-KeyPairsV2TestJSON-569786742-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1650963123" status: 202 len: 0 microversion: 2.1 time: 0.045959 Oct 12 09:01:47.831908 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2404/4440] 10.222.0.40 () {58 vars in 1278 bytes} [Wed Oct 12 09:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1650963123 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:01:47.955249 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-963652c9-c401-431a-b0b0-1e024b56ef63 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.666147 Oct 12 09:01:47.955856 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2037/4441] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:01:47 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:47.991063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-40c2968e-d76b-4da0-9aa5-81d8dbb3ce8a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:47.996458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-40c2968e-d76b-4da0-9aa5-81d8dbb3ce8a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:47.997463 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-40c2968e-d76b-4da0-9aa5-81d8dbb3ce8a tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010528 Oct 12 09:01:48.008531 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2405/4442] 10.222.0.40 () {58 vars in 1178 bytes} [Wed Oct 12 09:01:47 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:01:48.020996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:48.026778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:48.027452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Searching by: {'deleted': False, 'project_id': '65f2f36631244e30b590002855df32ee'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:01:48.041937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.042420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.043166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.043881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.044329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.044753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.114205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:01:48.182653 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a4e87bc8-9d6c-454d-b8de-44218980b91f tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.165553 Oct 12 09:01:48.190748 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2038/4443] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:01:48 2022] GET /compute/v2.1/servers => generated 681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:48.207192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:48.207690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:48.228442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.235222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.235683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.246653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.247171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.247594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.284953 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] HTTP exception thrown: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Request method failure captured: Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef HTTP/1.1 Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJNAVS36MWV62VttsALfOOEwKl_4iuQfgBwEgiTKxVx5h1tZJ6K6ZZ9ZTnXukdt435O83a5_JextfdnQFf-SoanVgUqArNLef3exep5n2agVnO2bOCJGJaWyoFX9dqbs9CDbWqpDZB157lhb1hDARZtCIj4hW8xCPQCAoMpMFiV8q4 Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/65f2f36631244e30b590002855df32ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_65f2f36631244e30b590002855df32ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}] Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 5f771bd04b48418595d91df09dc1d8bf Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '1d766526-e1d7-453d-9bfb-5cfe3bdadbef'} Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:48.287559 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Returning 404 to user: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-62c6c080-ec6e-47ab-94db-e09fc18d1458 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef" status: 404 len: 111 microversion: 2.1 time: 0.094439 Oct 12 09:01:48.296321 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2406/4444] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:48 2022] DELETE /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:48.298549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:48.299549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:48.307721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:48.308479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:48.315373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.318184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.318910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.319508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.320408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.321004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.321599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.324741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.325313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.326376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.326851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.327412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.412684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:48.541644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:48.585531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:48.596250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:48.606045 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fde48781-5000-4201-863d-ea4c9bc016e7 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.299595 Oct 12 09:01:48.624095 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2407/4445] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:48 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:01:48.666598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2a7883b1-f543-4413-88ce-c72d8248f367 req-e3554b0c-83c2-4ea3-b8cf-86304537c052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173b4809-6abe-413a-bbe2-217b8718c4e5", "tag": "ab36e1ae-f07f-41d7-84d8-7d73c7956ffc"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:48.710600 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d68b0249-640a-4009-b8e4-3f70a8aaeb7c tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 204 len: 0 microversion: 2.1 time: 0.416090 Oct 12 09:01:48.716796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2a7883b1-f543-4413-88ce-c72d8248f367 req-e3554b0c-83c2-4ea3-b8cf-86304537c052 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.716966 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2039/4446] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:48 2022] DELETE /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:01:48.717052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2a7883b1-f543-4413-88ce-c72d8248f367 req-e3554b0c-83c2-4ea3-b8cf-86304537c052 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.717052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2a7883b1-f543-4413-88ce-c72d8248f367 req-e3554b0c-83c2-4ea3-b8cf-86304537c052 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.735922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:48.736934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:48.751162 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-2a7883b1-f543-4413-88ce-c72d8248f367 req-e3554b0c-83c2-4ea3-b8cf-86304537c052 service nova] Creating event network-changed:ab36e1ae-f07f-41d7-84d8-7d73c7956ffc for instance 173b4809-6abe-413a-bbe2-217b8718c4e5 on n-h2-858383-10 Oct 12 09:01:48.756703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.757936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.763197 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2a7883b1-f543-4413-88ce-c72d8248f367 req-e3554b0c-83c2-4ea3-b8cf-86304537c052 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132833 Oct 12 09:01:48.764010 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2408/4447] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:48.764112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.765715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.767104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.767803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.803619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:48.804416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:48.817144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.817978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.818201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.818909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:48.819366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:48.820123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:48.843762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:48.970101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:49.049041 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-04e37a7b-c44d-419b-aa15-cd4ace44a6cd tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 204 len: 0 microversion: 2.1 time: 0.329640 Oct 12 09:01:49.052926 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2040/4448] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:48 2022] DELETE /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:01:49.059019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:49.059723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: 1d766526-e1d7-453d-9bfb-5cfe3bdadbef] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:49.074459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:49.083338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:49.083803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:49.084568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:49.085015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:49.085615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:49.123426 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] HTTP exception thrown: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Request method failure captured: Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef HTTP/1.1 Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoJNAVS36MWV62VttsALfOOEwKl_4iuQfgBwEgiTKxVx5h1tZJ6K6ZZ9ZTnXukdt435O83a5_JextfdnQFf-SoanVgUqArNLef3exep5n2agVnO2bOCJGJaWyoFX9dqbs9CDbWqpDZB157lhb1hDARZtCIj4hW8xCPQCAoMpMFiV8q4 Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/65f2f36631244e30b590002855df32ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_65f2f36631244e30b590002855df32ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}] Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5f771bd04b48418595d91df09dc1d8bf Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '1d766526-e1d7-453d-9bfb-5cfe3bdadbef'} Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:49.125303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Returning 404 to user: Instance 1d766526-e1d7-453d-9bfb-5cfe3bdadbef could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f1a0b7b9-1624-47df-ab5f-e06a72f25954 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef" status: 404 len: 111 microversion: 2.1 time: 0.072490 Oct 12 09:01:49.131690 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2041/4449] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:49 2022] GET /compute/v2.1/servers/1d766526-e1d7-453d-9bfb-5cfe3bdadbef => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:01:49.135714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:49.136332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:49.151074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:49.151574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:49.152012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:49.152728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:49.153186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:49.153652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:49.372764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:49.385512 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7936b284-2040-4c6e-9881-de61dd90e058 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1526 microversion: 2.1 time: 0.586021 Oct 12 09:01:49.388005 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2409/4450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:48 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1526 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:01:49.655134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:49.655566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:49.674119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:49.674674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:49.675212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:49.679499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:49.680566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:49.681027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:50.826719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:50.842831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:50.847016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:50.852998 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-22cb64d0-26f0-4797-9eea-a081d1a7f233 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 1.202157 Oct 12 09:01:50.855408 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2410/4451] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:49 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:01:50.874639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:50.875732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:50.879819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:50.895276 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-19cdbace-8d2a-4731-a03f-f42d59b01671 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1522 microversion: 2.1 time: 1.763417 Oct 12 09:01:50.896791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:50.899643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:50.900307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:50.908001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:50.908736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:50.909379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:50.914868 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2042/4452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:49 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1522 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:51.653049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:51.673429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-33624a1a-22b0-49bd-bcf1-30cea9d810ea tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1526 microversion: 2.1 time: 0.811077 Oct 12 09:01:51.678296 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2411/4453] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:50 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1526 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:51.882561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:51.884008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:51.896845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:51.897254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:51.897714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:51.898418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:51.898863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:51.899280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:51.925329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:51.926650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:51.939485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:51.955646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:51.956864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:51.959404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:51.962126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:51.962810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:52.534307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:52.551288 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9cfb4115-c1be-4526-be79-6a865b133b04 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1522 microversion: 2.1 time: 0.629777 Oct 12 09:01:52.552170 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2412/4454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:51 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:52.614206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1fd0076e-0748-4c83-9a8c-c230799d7359 req-e1bb2cc4-b3e8-463e-8497-39bae603511a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad091b2-96e3-448b-a975-38d05c0b9fcc", "name": "network-vif-deleted", "tag": "4973927d-3082-4655-9edc-32330b1fe74f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:52.651093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fd0076e-0748-4c83-9a8c-c230799d7359 req-e1bb2cc4-b3e8-463e-8497-39bae603511a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:52.651836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fd0076e-0748-4c83-9a8c-c230799d7359 req-e1bb2cc4-b3e8-463e-8497-39bae603511a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:52.652728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fd0076e-0748-4c83-9a8c-c230799d7359 req-e1bb2cc4-b3e8-463e-8497-39bae603511a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:52.700902 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1fd0076e-0748-4c83-9a8c-c230799d7359 req-e1bb2cc4-b3e8-463e-8497-39bae603511a service nova] Creating event network-vif-deleted:4973927d-3082-4655-9edc-32330b1fe74f for instance fad091b2-96e3-448b-a975-38d05c0b9fcc on n-h2-858383-10 Oct 12 09:01:52.728943 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1fd0076e-0748-4c83-9a8c-c230799d7359 req-e1bb2cc4-b3e8-463e-8497-39bae603511a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116361 Oct 12 09:01:52.732968 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2413/4455] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:52.770952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:52.770952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:52.786867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:52.793588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:52.794573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:52.795552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:52.796286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:52.796933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:53.095668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:53.106677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:53.118992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:53.120523 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f03e12d7-b65f-4215-bf7f-76200c487812 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 1.241818 Oct 12 09:01:53.124620 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2043/4456] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:51 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:53.337818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:53.347891 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9aa85d7a-4358-469b-af74-4c1e7eff1a62 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1526 microversion: 2.1 time: 0.610873 Oct 12 09:01:53.366488 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2414/4457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:52 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1526 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:53.579461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:53.580278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:53.596080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:53.604895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:53.607293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:53.613275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:53.614936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:53.615598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:53.866692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba3d1c5d-2de8-4c60-b76a-3304270a2239 tempest-AbsoluteLimitsTestJSON-1332154627 tempest-AbsoluteLimitsTestJSON-1332154627-project] Calling method '.version_select at 0x7f9843d64e50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:53.905969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba3d1c5d-2de8-4c60-b76a-3304270a2239 tempest-AbsoluteLimitsTestJSON-1332154627 tempest-AbsoluteLimitsTestJSON-1332154627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:53.906833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba3d1c5d-2de8-4c60-b76a-3304270a2239 tempest-AbsoluteLimitsTestJSON-1332154627 tempest-AbsoluteLimitsTestJSON-1332154627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:53.907414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba3d1c5d-2de8-4c60-b76a-3304270a2239 tempest-AbsoluteLimitsTestJSON-1332154627 tempest-AbsoluteLimitsTestJSON-1332154627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:53.908281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba3d1c5d-2de8-4c60-b76a-3304270a2239 tempest-AbsoluteLimitsTestJSON-1332154627 tempest-AbsoluteLimitsTestJSON-1332154627-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:53.908869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba3d1c5d-2de8-4c60-b76a-3304270a2239 tempest-AbsoluteLimitsTestJSON-1332154627 tempest-AbsoluteLimitsTestJSON-1332154627-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:53.909513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba3d1c5d-2de8-4c60-b76a-3304270a2239 tempest-AbsoluteLimitsTestJSON-1332154627 tempest-AbsoluteLimitsTestJSON-1332154627-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:53.936626 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba3d1c5d-2de8-4c60-b76a-3304270a2239 tempest-AbsoluteLimitsTestJSON-1332154627 tempest-AbsoluteLimitsTestJSON-1332154627-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.490058 Oct 12 09:01:53.937862 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2044/4458] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Oct 12 09:01:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:54.048739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:54.068372 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f4e19e5a-79a4-49a8-9ab7-9d0d832eb97d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1522 microversion: 2.1 time: 0.492957 Oct 12 09:01:54.069046 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2415/4459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:53 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:54.154040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:54.155358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:54.169334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:54.175542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:54.177785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:54.178675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:54.182072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:54.185343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:54.381856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:54.381856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:54.413753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:54.414300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:54.415113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:54.422424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:54.425718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:54.426193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:54.639037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:54.653222 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-344176ff-32cd-47f0-afe2-1d18852952be tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1484 microversion: 2.1 time: 0.271195 Oct 12 09:01:54.657403 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2416/4460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:54 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1484 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:54.670570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-10db08b3-bed4-42a9-8743-261eff79a2a8 req-ddb174e3-f424-49e2-a409-141f426a5fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34fedf2-688b-4b8c-a56c-81effb6d4a75", "name": "network-vif-unplugged", "status": "completed", "tag": "06ed3d86-cdd1-42d5-b8c7-4b0adcf62534"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:54.690214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:54.693675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-10db08b3-bed4-42a9-8743-261eff79a2a8 req-ddb174e3-f424-49e2-a409-141f426a5fa0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:54.694163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-10db08b3-bed4-42a9-8743-261eff79a2a8 req-ddb174e3-f424-49e2-a409-141f426a5fa0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:54.700493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:54.700662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-10db08b3-bed4-42a9-8743-261eff79a2a8 req-ddb174e3-f424-49e2-a409-141f426a5fa0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:54.708240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:54.717665 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35fd7901-1f94-439e-9025-0201353d1de6 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.559438 Oct 12 09:01:54.718329 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2045/4461] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:54 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:54.757657 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-10db08b3-bed4-42a9-8743-261eff79a2a8 req-ddb174e3-f424-49e2-a409-141f426a5fa0 service nova] Creating event network-vif-unplugged:06ed3d86-cdd1-42d5-b8c7-4b0adcf62534 for instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 on n-h1-858383-10 Oct 12 09:01:54.782067 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-10db08b3-bed4-42a9-8743-261eff79a2a8 req-ddb174e3-f424-49e2-a409-141f426a5fa0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114996 Oct 12 09:01:54.783885 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2417/4462] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:54.932373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c2ab81fc-ae4a-40e5-98ec-0e1b016fbc62 req-e2dc97cc-20c2-4a48-bd85-a4b6d44a4332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9d482e-606b-410f-8d89-9b5d9a4096f2", "name": "network-vif-deleted", "tag": "29bbbb10-ff76-41db-9ccd-f9e063463bf9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:54.987869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c2ab81fc-ae4a-40e5-98ec-0e1b016fbc62 req-e2dc97cc-20c2-4a48-bd85-a4b6d44a4332 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:54.988366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c2ab81fc-ae4a-40e5-98ec-0e1b016fbc62 req-e2dc97cc-20c2-4a48-bd85-a4b6d44a4332 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:54.988881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c2ab81fc-ae4a-40e5-98ec-0e1b016fbc62 req-e2dc97cc-20c2-4a48-bd85-a4b6d44a4332 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.024462 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c2ab81fc-ae4a-40e5-98ec-0e1b016fbc62 req-e2dc97cc-20c2-4a48-bd85-a4b6d44a4332 service nova] Creating event network-vif-deleted:29bbbb10-ff76-41db-9ccd-f9e063463bf9 for instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 on n-h1-858383-10 Oct 12 09:01:55.031139 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c2ab81fc-ae4a-40e5-98ec-0e1b016fbc62 req-e2dc97cc-20c2-4a48-bd85-a4b6d44a4332 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102513 Oct 12 09:01:55.034836 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2046/4463] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:55.095985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:55.096699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:55.113418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.115856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.116339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.117058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.121240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.122593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.633789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:55.635509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:55.654843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.655344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.655947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.656812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.658921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.667589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.695290 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.700377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 HTTP/1.1 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '3c6551d7-31a6-478d-a552-44f2ab930227'} Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:55.701852 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.704765 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.706864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:55.708990 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-113abc0c-8293-4b80-9843-a1e49fdcd01d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1522 microversion: 2.1 time: 0.618262 Oct 12 09:01:55.712693 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-865c0e6b-1f85-4168-9d23-2f729fe916db tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 404 len: 111 microversion: 2.1 time: 0.088279 Oct 12 09:01:55.713828 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2047/4464] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:55 2022] DELETE /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:55.739213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:55.740813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:55.755434 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2418/4465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:55 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1522 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:55.758465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.762093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.762780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.765109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.766400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.770645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.772465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:55.778324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: 3c6551d7-31a6-478d-a552-44f2ab930227] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:55.793071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.793838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.798572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.799518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.800175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.800785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.829893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.830761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.831472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.832152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lazy-loading 'fault' on Instance uuid 7a9d482e-606b-410f-8d89-9b5d9a4096f2 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:01:55.835195 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 HTTP/1.1 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3c6551d7-31a6-478d-a552-44f2ab930227'} Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:55.836884 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.839975 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:55.839975 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:55.839975 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:55.839975 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:55.839975 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:55.839975 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. Oct 12 09:01:55.839975 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:55.839975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance 3c6551d7-31a6-478d-a552-44f2ab930227 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:55.846796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a8c6b57-1831-4829-b84b-a3def350e927 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227" status: 404 len: 111 microversion: 2.1 time: 0.081940 Oct 12 09:01:55.847451 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2419/4466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:55 2022] GET /compute/v2.1/servers/3c6551d7-31a6-478d-a552-44f2ab930227 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:55.872092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:55.872950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:55.887609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.890746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.891394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:55.896491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:55.910315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:55.911065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:56.076624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e4d1277960411f909bf8e4da358e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871b74422aee4f06a5f419f07d03936d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:56.084981 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa5b4635-43f0-46a7-b98e-d1979ea88c83 tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 200 len: 1314 microversion: 2.1 time: 0.369854 Oct 12 09:01:56.097602 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2048/4467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:55 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:56.104246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:56.105631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:56.119643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:56.120341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:56.123115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:56.123996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:56.124541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:56.140136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:56.207028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:01:56.372195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:56.376268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:56.378303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b2d19d3-8bf2-4ba5-a7ca-9a6d570f3af1 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 204 len: 0 microversion: 2.1 time: 0.278601 Oct 12 09:01:56.378914 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2049/4468] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:01:56 2022] DELETE /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:01:56.395494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:56.395648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:56.396560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:56.398337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:56.401570 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5082b68-0e4a-463e-aefd-73ca630305cf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.539899 Oct 12 09:01:56.415967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:56.416675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:56.417578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:56.420129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:56.420496 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2420/4469] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:55 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:56.422581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:56.426719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:56.688925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:56.703880 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e81b91c5-2750-4209-80b7-6039662971df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.315149 Oct 12 09:01:56.707210 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2050/4470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:56 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:56.743074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:56.743767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:56.754844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:56.759742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:56.760270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:56.761893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:56.763737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:56.764923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:56.766337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:56.852806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:56.853636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:56.860957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:56.861776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lazy-loading 'fault' on Instance uuid d34fedf2-688b-4b8c-a56c-81effb6d4a75 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:01:56.896227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=12 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:56.950470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:56.962335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e20aef75-2e4a-4d83-851f-b07c78108b99 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1312 microversion: 2.1 time: 0.226711 Oct 12 09:01:56.977604 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2421/4471] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:56 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:57.096540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e0c5f5ef-8dc7-4c68-b6ae-b2d70b8c60ba req-1e58ee31-8930-4e85-8683-e3ab43768b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34fedf2-688b-4b8c-a56c-81effb6d4a75", "name": "network-vif-deleted", "tag": "06ed3d86-cdd1-42d5-b8c7-4b0adcf62534"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:01:57.115864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:57.116477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] [instance: 7a9d482e-606b-410f-8d89-9b5d9a4096f2] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:57.127313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e0c5f5ef-8dc7-4c68-b6ae-b2d70b8c60ba req-1e58ee31-8930-4e85-8683-e3ab43768b77 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:57.130115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e0c5f5ef-8dc7-4c68-b6ae-b2d70b8c60ba req-1e58ee31-8930-4e85-8683-e3ab43768b77 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:57.131097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e0c5f5ef-8dc7-4c68-b6ae-b2d70b8c60ba req-1e58ee31-8930-4e85-8683-e3ab43768b77 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:57.138298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:57.138965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:57.139506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:57.141264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:57.141763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:57.142201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:57.165456 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e0c5f5ef-8dc7-4c68-b6ae-b2d70b8c60ba req-1e58ee31-8930-4e85-8683-e3ab43768b77 service nova] Creating event network-vif-deleted:06ed3d86-cdd1-42d5-b8c7-4b0adcf62534 for instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 on n-h1-858383-10 Oct 12 09:01:57.180671 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] HTTP exception thrown: Instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 could not be found. Oct 12 09:01:57.188504 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e0c5f5ef-8dc7-4c68-b6ae-b2d70b8c60ba req-1e58ee31-8930-4e85-8683-e3ab43768b77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097146 Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Request method failure captured: Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 HTTP/1.1 Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJiWH1QqByNEkO8PvBCYFuhsAFvdaUnTEcxQGJDwzj-jCImbb2uBMfvan_rXuTz42jJViXjbJcQlrMDbVJl2Ag1Jy2CXV0HWbdyj12S6uO4IgvhwLv-lfmgI4AjJ59x9kWD8JtA2sOwep7kav9bU0qwC-MtALgWMa9Po5h0I5Hl2eU Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/871b74422aee4f06a5f419f07d03936d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_871b74422aee4f06a5f419f07d03936d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/871b74422aee4f06a5f419f07d03936d"}]}] Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 871b74422aee4f06a5f419f07d03936d Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1214378619 Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 37e4d1277960411f909bf8e4da358e3f Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1214378619-project Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 could not be found. Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7a9d482e-606b-410f-8d89-9b5d9a4096f2'} Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 could not be found. Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 could not be found. Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:57.188780 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 could not be found. Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:57.192151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] Returning 404 to user: Instance 7a9d482e-606b-410f-8d89-9b5d9a4096f2 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:57.192805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-af622637-3be0-4e5d-826a-851fd9b2495c tempest-ServerMetadataNegativeTestJSON-1214378619 tempest-ServerMetadataNegativeTestJSON-1214378619-project] 10.222.0.40 "GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2" status: 404 len: 111 microversion: 2.1 time: 0.081594 Oct 12 09:01:57.204952 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2051/4473] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:01:57.210055 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2422/4473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:57 2022] GET /compute/v2.1/servers/7a9d482e-606b-410f-8d89-9b5d9a4096f2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:01:57.437732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:57.438604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:57.466977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:57.470586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:57.471223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:57.473377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:57.477136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:57.477850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:57.729966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:57.731085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:57.740354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:57.746812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:57.749014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:57.750214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:57.750715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:57.752261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:57.755106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:57.775064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:57.776877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:57.786674 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c0811a4d-2df6-4017-bd2b-38a7938e714f tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.356389 Oct 12 09:01:57.790375 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2052/4474] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:57 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:57.991904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:57.992961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:58.006292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:58.007099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:58.007754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:58.008641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:58.009312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:58.009926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:58.105359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:58.106071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:58.107998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:58.108551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lazy-loading 'fault' on Instance uuid d34fedf2-688b-4b8c-a56c-81effb6d4a75 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:01:58.204759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f771bd04b48418595d91df09dc1d8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f2f36631244e30b590002855df32ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:58.215993 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4f24d917-aeaf-4c06-aeb8-ad5c0f84345d tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 200 len: 1312 microversion: 2.1 time: 0.229193 Oct 12 09:01:58.217943 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2053/4475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:57 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:58.424331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:58.440335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec5eafb1-52bc-4f30-9344-c83082ef5e19 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.715124 Oct 12 09:01:58.461431 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2423/4476] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:57 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:01:58.823691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:58.824654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:58.836534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:58.848643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:58.849360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:58.853567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:58.864105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:58.864883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:59.015660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:59.065429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:59.070812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:59.072091 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58102f0c-8148-4bb2-b718-0d896579ab30 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.259537 Oct 12 09:01:59.085276 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2054/4477] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:01:58 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:01:59.241330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:59.242733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: d34fedf2-688b-4b8c-a56c-81effb6d4a75] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:59.256842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:59.257339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:59.257870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:59.261394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:59.262239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:59.262888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:59.301663 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] HTTP exception thrown: Instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 could not be found. Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Request method failure captured: Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 HTTP/1.1 Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoJNAVS36MWV62VttsALfOOEwKl_4iuQfgBwEgiTKxVx5h1tZJ6K6ZZ9ZTnXukdt435O83a5_JextfdnQFf-SoanVgUqArNLef3exep5n2agVnO2bOCJGJaWyoFX9dqbs9CDbWqpDZB157lhb1hDARZtCIj4hW8xCPQCAoMpMFiV8q4 Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/65f2f36631244e30b590002855df32ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_65f2f36631244e30b590002855df32ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}] Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 5f771bd04b48418595d91df09dc1d8bf Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 could not be found. Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'd34fedf2-688b-4b8c-a56c-81effb6d4a75'} Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 could not be found. Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 could not be found. Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.309006 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:59.312209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.312209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:59.312209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:59.312209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:59.312209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:59.312209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:59.312209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 could not be found. Oct 12 09:01:59.312209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.313711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Returning 404 to user: Instance d34fedf2-688b-4b8c-a56c-81effb6d4a75 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:59.317676 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59de2386-b1c1-487a-85b1-fd8e686b538b tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75" status: 404 len: 111 microversion: 2.1 time: 0.081350 Oct 12 09:01:59.318462 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2424/4478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:59 2022] GET /compute/v2.1/servers/d34fedf2-688b-4b8c-a56c-81effb6d4a75 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:59.327827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:59.332865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] [instance: fad091b2-96e3-448b-a975-38d05c0b9fcc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:59.343504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:59.344167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:59.344713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:59.345717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:59.346372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:59.346907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:59.374640 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] HTTP exception thrown: Instance fad091b2-96e3-448b-a975-38d05c0b9fcc could not be found. Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Request method failure captured: Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc HTTP/1.1 Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoJNAVS36MWV62VttsALfOOEwKl_4iuQfgBwEgiTKxVx5h1tZJ6K6ZZ9ZTnXukdt435O83a5_JextfdnQFf-SoanVgUqArNLef3exep5n2agVnO2bOCJGJaWyoFX9dqbs9CDbWqpDZB157lhb1hDARZtCIj4hW8xCPQCAoMpMFiV8q4 Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/65f2f36631244e30b590002855df32ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_65f2f36631244e30b590002855df32ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/65f2f36631244e30b590002855df32ee"}]}] Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 65f2f36631244e30b590002855df32ee Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-874123078 Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5f771bd04b48418595d91df09dc1d8bf Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListServersNegativeTestJSON-874123078-project Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance fad091b2-96e3-448b-a975-38d05c0b9fcc could not be found. Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'fad091b2-96e3-448b-a975-38d05c0b9fcc'} Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad091b2-96e3-448b-a975-38d05c0b9fcc could not be found. Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad091b2-96e3-448b-a975-38d05c0b9fcc could not be found. Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.392118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:01:59.395433 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.395433 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:01:59.395433 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:01:59.395433 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:01:59.395433 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:01:59.395433 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:01:59.395433 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad091b2-96e3-448b-a975-38d05c0b9fcc could not be found. Oct 12 09:01:59.395433 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:01:59.397805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] Returning 404 to user: Instance fad091b2-96e3-448b-a975-38d05c0b9fcc could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:01:59.398950 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12be1479-c811-4c87-9f6a-0363dbe3e5a8 tempest-ListServersNegativeTestJSON-874123078 tempest-ListServersNegativeTestJSON-874123078-project] 10.222.0.40 "GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc" status: 404 len: 111 microversion: 2.1 time: 0.075963 Oct 12 09:01:59.405907 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2055/4479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:59 2022] GET /compute/v2.1/servers/fad091b2-96e3-448b-a975-38d05c0b9fcc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:01:59.471083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:01:59.471698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:01:59.480277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:59.481785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:59.483879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:59.484922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:01:59.485386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:01:59.485835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:01:59.533842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:01:59.744144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:01:59.755476 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f2507c5-ad25-42ac-a482-38c7cbbe8c96 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1512 microversion: 2.1 time: 0.288114 Oct 12 09:01:59.756680 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2425/4480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:01:59 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:00.099120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:00.099800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:00.110872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:00.111387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:00.111833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:00.112587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:00.114904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:00.116803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:00.345521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:00.360903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:00.362403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:00.363689 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c4cdf18-1b9c-4edf-9844-e9294ada1d22 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.268847 Oct 12 09:02:00.366850 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2056/4481] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:00 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:00.542483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-aac99fde-6a11-4b78-b8f5-e992da16a5c1 req-00028bde-a989-4d80-86f4-2e2de864dfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a870435b-8aa5-456d-b0ca-477ee2201dbb", "name": "network-vif-deleted", "tag": "100f519d-4457-4d8b-acb1-e0e088317a35"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:00.555578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-aac99fde-6a11-4b78-b8f5-e992da16a5c1 req-00028bde-a989-4d80-86f4-2e2de864dfec service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:00.559855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-aac99fde-6a11-4b78-b8f5-e992da16a5c1 req-00028bde-a989-4d80-86f4-2e2de864dfec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:00.562200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-aac99fde-6a11-4b78-b8f5-e992da16a5c1 req-00028bde-a989-4d80-86f4-2e2de864dfec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:00.594732 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-aac99fde-6a11-4b78-b8f5-e992da16a5c1 req-00028bde-a989-4d80-86f4-2e2de864dfec service nova] Creating event network-vif-deleted:100f519d-4457-4d8b-acb1-e0e088317a35 for instance a870435b-8aa5-456d-b0ca-477ee2201dbb on n-h1-858383-10 Oct 12 09:02:00.609297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-aac99fde-6a11-4b78-b8f5-e992da16a5c1 req-00028bde-a989-4d80-86f4-2e2de864dfec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086582 Oct 12 09:02:00.614812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2426/4482] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:02:00.781990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:00.783120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:00.797689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:00.800174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:00.803356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:00.805627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:00.809500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:00.810167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:00.903610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:00.903964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:00.905234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:00.905902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lazy-loading 'fault' on Instance uuid a870435b-8aa5-456d-b0ca-477ee2201dbb {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:02:01.080399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07268ce32b9446c981f83e6e92bee533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09f0eadea244ac2aef5d9f014cb3892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:01.092880 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-157db6d7-b5f5-4671-979f-3ce1cb361588 tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 200 len: 1307 microversion: 2.1 time: 0.317440 Oct 12 09:02:01.094491 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2057/4483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:00 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:01.395079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:01.396323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:01.413631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:01.419713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:01.420184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:01.420942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:01.421401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:01.422039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:01.594143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:01.611118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:01.620649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:01.625702 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a1491e7f-973c-4b25-8b5d-12a9e7ba3400 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.237863 Oct 12 09:02:01.626564 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2427/4484] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:01 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:02.124554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:02.125980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] [instance: a870435b-8aa5-456d-b0ca-477ee2201dbb] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:02.138735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:02.140863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:02.142726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:02.143743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:02.144373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:02.147512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:02.174999 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] HTTP exception thrown: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb could not be found. Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Request method failure captured: Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb HTTP/1.1 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoGM0eRxW2QIzch1CMznh22yG5Jn1r5-drMoRxc3pRHcUTZxEZqYE-lnzmYXg7snKMoEHSvX4xb3srye_2euFWwySuQOPM2BHZBJtRLDei6E49KS7TuTRbp6K2HcK38jsJYqLqhSThXlRxFwIsR2tCYTViUJvLt52sZKimMPYBNlRGY Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e09f0eadea244ac2aef5d9f014cb3892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e09f0eadea244ac2aef5d9f014cb3892"}]}] Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: e09f0eadea244ac2aef5d9f014cb3892 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777468499 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 07268ce32b9446c981f83e6e92bee533 Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-1777468499-project Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb could not be found. Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a870435b-8aa5-456d-b0ca-477ee2201dbb'} Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb could not be found. Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb could not be found. Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:02:02.186517 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:02.190519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:02.190519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:02:02.190519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:02:02.190519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:02:02.190519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:02:02.190519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb could not be found. Oct 12 09:02:02.190519 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:02.193256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] Returning 404 to user: Instance a870435b-8aa5-456d-b0ca-477ee2201dbb could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:02:02.194380 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1d06d213-bb5a-4fad-b06b-6ca4f497d8df tempest-ServersNegativeTestJSON-1777468499 tempest-ServersNegativeTestJSON-1777468499-project] 10.222.0.40 "GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb" status: 404 len: 111 microversion: 2.1 time: 0.078298 Oct 12 09:02:02.195479 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2058/4485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:02 2022] GET /compute/v2.1/servers/a870435b-8aa5-456d-b0ca-477ee2201dbb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:02:02.658424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:02.661869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:02.698626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:02.699167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:02.701168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:02.704305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:02.707929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:02.713982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:02.943844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:02.989532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:02.994749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:02.998478 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a0c277e-5ca3-4e83-82f1-cedc218f06a8 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.346326 Oct 12 09:02:03.017884 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2428/4486] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:02 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:04.029973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:04.031347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:04.052652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=16 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:04.054487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:04.059746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:04.063219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:04.065245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:04.068532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:04.069325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:04.080287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:04.098133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:04.616499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:04.639339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:04.644313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:04.651465 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-28f44eb3-9d30-4db1-bc68-6a30fa016363 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.625912 Oct 12 09:02:04.652383 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2059/4487] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:04 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:05.681824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:05.682487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:05.699293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:05.700132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:05.702074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:05.703061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:05.705205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:05.707202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:05.984128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:06.001945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:06.004114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:06.005576 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4611a9bd-a0fb-43ce-ae63-8bbe9cf78edf tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.327741 Oct 12 09:02:06.010636 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2429/4488] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:05 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:07.050185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:07.052113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:07.060223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:07.061160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:07.061836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:07.062756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:07.063401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:07.064038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:07.321875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:07.340208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:07.344005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b349f4b4b75445eba0205b73a6e6995d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288568b4164c4ab3824fcd2e946d2f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:07.349929 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-074d1803-b59d-4ed9-967a-059505f77c23 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 200 len: 1603 microversion: 2.42 time: 0.309396 Oct 12 09:02:07.353855 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2060/4489] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:07 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 1603 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:08.378995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:08.380784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:08.392977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:08.395823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:08.399525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:08.400476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:08.402899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:08.408018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:08.447362 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] HTTP exception thrown: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Request method failure captured: Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 HTTP/1.1 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoEBkxerLFUIPgNrsbufWA5a6a8_jJa9-T4d4rmVns5HZnU1F_Ol2esE9MGLKi6E0wdKPVi-zf-AG2_W39KvzZEt_J6yT7ZCOy_apK72nGg5k54gRzAks2cWKOF-fZwjvziYVGPuMzocXHHbAy3OAYMyrSygyfbn5TIepYjUjjFH-qQ Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 288568b4164c4ab3824fcd2e946d2f31 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/288568b4164c4ab3824fcd2e946d2f31"}]}] Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 288568b4164c4ab3824fcd2e946d2f31 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TaggedBootDevicesTest_v242-836820023-project Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: b349f4b4b75445eba0205b73a6e6995d Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TaggedBootDevicesTest_v242-836820023-project Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'cff3c24b-beda-4f72-9cce-27cde19fc0d9'} Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:08.449371 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:02:08.453690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:08.453690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:08.453690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:02:08.453690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:02:08.453690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:02:08.453690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:02:08.453690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:08.453690 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:08.456516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Returning 404 to user: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:02:08.457757 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf146bbb-eb82-4cff-a81f-d05a478f379b tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 404 len: 111 microversion: 2.42 time: 0.082850 Oct 12 09:02:08.458868 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2430/4490] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:08 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:02:08.468286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-721031d3-f9bc-4d87-b065-86acca6cd7a2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '.version_select at 0x7f9843d10700>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:08.506494 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-721031d3-f9bc-4d87-b065-86acca6cd7a2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-295715701" status: 204 len: 0 microversion: 2.42 time: 0.042482 Oct 12 09:02:08.507396 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2061/4491] 10.222.0.40 () {60 vars in 1259 bytes} [Wed Oct 12 09:02:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-295715701 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:02:14.614850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1aabb32d-f15c-443b-8512-2d02d654b07a tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Action: 'create', calling method: .version_select at 0x7f9843aebd30>, body: {"keypair": {"name": "tempest-keypair-1013803515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBquQgU3djGD95r47igvQo6/ThDBTXs25iW8MeBPKMk1UPLD/N2FlWOydFniUtmHDWsCYPfO1nzVXP+mkH/HoMZpPnXFyyqtlFWmPOEDNTGePCWvlwEWfZjsDEcdXQLRgg=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:14.647893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1aabb32d-f15c-443b-8512-2d02d654b07a tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Getting quotas for project 751116048c544045993aec6d95142d30. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:02:14.661195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1aabb32d-f15c-443b-8512-2d02d654b07a tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Getting quotas for user 869679441de4425b97e24c4686cbe87c and project 751116048c544045993aec6d95142d30. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:02:14.722689 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1aabb32d-f15c-443b-8512-2d02d654b07a tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.368067 Oct 12 09:02:14.723797 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2431/4492] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:02:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:18.969019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-721031d3-f9bc-4d87-b065-86acca6cd7a2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:18.970701 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-721031d3-f9bc-4d87-b065-86acca6cd7a2 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002250 Oct 12 09:02:18.974943 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2062/4493] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 12 09:02:18 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 09:02:20.460835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=24 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:20.859812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:20.860684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:20.880109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:20.887541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:20.888569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:20.890196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:20.893342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:20.893724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:20.894182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:20.977600 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5a864587-3566-4840-892e-6cba9e189a1e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/ips" status: 200 len: 152 microversion: 2.20 time: 0.524487 Oct 12 09:02:20.978697 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2432/4494] 10.222.0.40 () {60 vars in 1289 bytes} [Wed Oct 12 09:02:20 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/ips => generated 152 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:02:22.566735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:22.567239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:22.574298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:22.577719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:22.618507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:22.619159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:22.619631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:22.621418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:22.621920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:22.622384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:22.693758 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] HTTP exception thrown: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Request method failure captured: Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 HTTP/1.1 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoEBkxerLFUIPgNrsbufWA5a6a8_jJa9-T4d4rmVns5HZnU1F_Ol2esE9MGLKi6E0wdKPVi-zf-AG2_W39KvzZEt_J6yT7ZCOy_apK72nGg5k54gRzAks2cWKOF-fZwjvziYVGPuMzocXHHbAy3OAYMyrSygyfbn5TIepYjUjjFH-qQ Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 288568b4164c4ab3824fcd2e946d2f31 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/288568b4164c4ab3824fcd2e946d2f31"}]}] Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 288568b4164c4ab3824fcd2e946d2f31 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TaggedBootDevicesTest_v242-836820023-project Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: b349f4b4b75445eba0205b73a6e6995d Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TaggedBootDevicesTest_v242-836820023-project Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'cff3c24b-beda-4f72-9cce-27cde19fc0d9'} Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:02:22.697510 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.700992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Returning 404 to user: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:02:22.702974 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5f64d25-2004-4680-a946-d3035ab03507 tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 404 len: 111 microversion: 2.42 time: 0.137522 Oct 12 09:02:22.711203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:22.711631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] [instance: cff3c24b-beda-4f72-9cce-27cde19fc0d9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:22.715622 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2063/4495] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:02:22 2022] DELETE /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:02:22.723400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:22.731076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:22.737376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:22.738348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:22.739975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:22.742641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:22.773567 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] HTTP exception thrown: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Request method failure captured: Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 HTTP/1.1 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoEBkxerLFUIPgNrsbufWA5a6a8_jJa9-T4d4rmVns5HZnU1F_Ol2esE9MGLKi6E0wdKPVi-zf-AG2_W39KvzZEt_J6yT7ZCOy_apK72nGg5k54gRzAks2cWKOF-fZwjvziYVGPuMzocXHHbAy3OAYMyrSygyfbn5TIepYjUjjFH-qQ Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.42 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 288568b4164c4ab3824fcd2e946d2f31 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_288568b4164c4ab3824fcd2e946d2f31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/288568b4164c4ab3824fcd2e946d2f31"}]}] Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 288568b4164c4ab3824fcd2e946d2f31 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-836820023 Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TaggedBootDevicesTest_v242-836820023-project Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: b349f4b4b75445eba0205b73a6e6995d Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TaggedBootDevicesTest_v242-836820023-project Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'cff3c24b-beda-4f72-9cce-27cde19fc0d9'} Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.775458 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] Returning 404 to user: Instance cff3c24b-beda-4f72-9cce-27cde19fc0d9 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:02:22.779269 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad68c60c-49e5-4511-a834-e560e0d6c3fa tempest-TaggedBootDevicesTest_v242-836820023 tempest-TaggedBootDevicesTest_v242-836820023-project] 10.222.0.40 "GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9" status: 404 len: 111 microversion: 2.42 time: 0.069982 Oct 12 09:02:22.781757 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2433/4496] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:22 2022] GET /compute/v2.1/servers/cff3c24b-beda-4f72-9cce-27cde19fc0d9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:02:24.676124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fdb65a14-6fdc-4652-ac20-3f8c09c21303 tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] Calling method '.version_select at 0x7f984ccf1f70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:24.816753 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fdb65a14-6fdc-4652-ac20-3f8c09c21303 tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.486540 Oct 12 09:02:24.819428 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2064/4497] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 09:02:24 2022] GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2/defaults => generated 371 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:24.832522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed27d987-70b8-4341-abc4-eb655e7b34b6 tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] Calling method '.version_select at 0x7f9843adaca0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:24.872818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:25.102845 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed27d987-70b8-4341-abc4-eb655e7b34b6 tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2" status: 200 len: 371 microversion: 2.1 time: 0.274260 Oct 12 09:02:25.104876 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2434/4498] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 09:02:24 2022] GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2 => generated 371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:02:25.134430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f8e7cce-50ed-4b68-9bf0-32c9a7a09e00 tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] Calling method '.version_select at 0x7f9843d9c670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:25.356152 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4f8e7cce-50ed-4b68-9bf0-32c9a7a09e00 tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.238480 Oct 12 09:02:25.357777 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2065/4499] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 09:02:25 2022] GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2/defaults => generated 371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:25.383936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e4031efb-bb23-4ff5-92d9-5bfab94473eb tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] Calling method '.version_select at 0x7f9843ada040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:25.731156 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e4031efb-bb23-4ff5-92d9-5bfab94473eb tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2" status: 200 len: 371 microversion: 2.1 time: 0.355327 Oct 12 09:02:25.735518 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2435/4500] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 09:02:25 2022] GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2 => generated 371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:25.757828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a598279-7556-4bd3-81a0-7985d8f9eb23 tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] Calling method '.version_select at 0x7f9843aebf70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:25.854063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1775cc1f-ffd4-43fa-a615-b8aa630b3448 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Action: 'create', calling method: .version_select at 0x7f9843df9310>, body: {"keypair": {"name": "tempest-keypair-23360927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBjL+PH9YNS77jvbVsbuESDzkCEip7VjPls1Cjqc9U1vk8gmSamH4fU5lo+9vfSYNzhvDy86Oi8vI9tvAV3Duo1XqwUxzBtWw1z+PGSJ4OqaeW5jKRw9slebJF9UpQr4g=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:25.908598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1775cc1f-ffd4-43fa-a615-b8aa630b3448 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Getting quotas for project 4955f9999b0d4971bd23ea38ce3cce4b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:02:25.928533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1775cc1f-ffd4-43fa-a615-b8aa630b3448 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Getting quotas for user 25e3d7dd3a044e9c9ee7788b8a4d7b6d and project 4955f9999b0d4971bd23ea38ce3cce4b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:02:25.998656 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1775cc1f-ffd4-43fa-a615-b8aa630b3448 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.454839 Oct 12 09:02:26.000630 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2066/4501] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:02:25 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:26.015836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:26.017689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:26.035504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:26.040428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:26.042142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:26.045801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:26.046709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:26.048180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:26.101795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lazy-loading 'flavor' on Instance uuid 173b4809-6abe-413a-bbe2-217b8718c4e5 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:02:26.128111 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7a598279-7556-4bd3-81a0-7985d8f9eb23 tempest-QuotasTestJSON-499106099 tempest-QuotasTestJSON-499106099-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2?user_id=ced0bf51e83747988412a581d424e404" status: 200 len: 371 microversion: 2.1 time: 0.381972 Oct 12 09:02:26.137180 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2436/4502] 10.222.0.40 () {58 vars in 1323 bytes} [Wed Oct 12 09:02:25 2022] GET /compute/v2.1/os-quota-sets/0c708700349941c690c720eb75045bf2?user_id=ced0bf51e83747988412a581d424e404 => generated 371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:27.007585 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-885bcb9a-3932-4a9e-993d-ab781a71ab3b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/action" status: 202 len: 0 microversion: 2.20 time: 1.004725 Oct 12 09:02:27.008935 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2067/4503] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 09:02:26 2022] POST /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/action => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:02:27.026297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:27.027887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:27.042346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:27.056982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:27.060236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:27.062023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:27.065420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:27.071150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:27.500817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:27.521241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:27.531201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:27.532781 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14e052c8-3123-4819-bcf6-5119d961d08d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1724 microversion: 2.20 time: 0.510512 Oct 12 09:02:27.537663 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2437/4504] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:27 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1724 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:28.571089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:28.573057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:28.597906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:28.607095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:28.607590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:28.609466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:28.610831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:28.611440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:30.416323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:30.427727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:30.435328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:30.457642 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba5c92c0-8979-497e-9977-aec40a472581 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1724 microversion: 2.20 time: 1.893418 Oct 12 09:02:30.461109 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2068/4505] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:28 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1724 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:31.495204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:31.496010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:31.518698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:31.520390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:31.521863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:31.527316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:31.529133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:31.530896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:32.660546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:32.670895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:32.686159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:32.690005 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9609ce9c-7d13-4765-b51c-7ae8f290cb1a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1724 microversion: 2.20 time: 1.199417 Oct 12 09:02:32.694559 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2438/4506] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:31 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1724 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:02:33.723700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:33.724847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:33.743110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:33.770065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:33.781457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:33.782647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:33.798412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:33.799408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:34.948519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:34.968042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:34.970005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:34.974283 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d1f0775-ab26-46dc-8488-9158b6e545d1 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1724 microversion: 2.20 time: 1.254909 Oct 12 09:02:34.978632 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2069/4507] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:33 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1724 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:36.005362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:36.006846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:36.015970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:36.021818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:36.023769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:36.024316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:36.025978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:36.027017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:36.027548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:36.092152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:36.301691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:36.323479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:36.328699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:36.332577 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b15188dc-c191-402b-9f09-7a7291d89c88 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1724 microversion: 2.20 time: 0.332015 Oct 12 09:02:36.353516 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2070/4508] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:35 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:02:36.359121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1284961335", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "b86c6a7e-2abc-4924-9128-a6a161e00e74"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:36.364135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-161599940", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a646c9db-92cb-4d5f-b0a4-144499f15628"}], "security_groups": [{"name": "tempest-securitygroup--1512143297"}], "key_name": "tempest-keypair-23360927", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:36.601781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] validate_networks() for [('b86c6a7e-2abc-4924-9128-a6a161e00e74', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:02:36.653546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] validate_networks() for [('a646c9db-92cb-4d5f-b0a4-144499f15628', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:02:37.757090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:02:37.766884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:02:37.768987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:02:37.769533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:02:37.770657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:02:37.792021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:37.792658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:37.793207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:37.794469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:37.795085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:37.795606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:37.828835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Getting quotas for project 6fd0342e8bb34dba976c73230ea44faf. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:02:37.846321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Getting quotas for user 06448c8ed1c146aeb2e4a97ba3de21b0 and project 6fd0342e8bb34dba976c73230ea44faf. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:02:37.870371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:02:37.875639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:02:37.953124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b4cb2b11-c667-432a-8a27-c85bd3de8f79 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.330099 Oct 12 09:02:37.959988 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2439/4509] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:02:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:02:38.210150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Getting quotas for project 4955f9999b0d4971bd23ea38ce3cce4b. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:02:38.231096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Getting quotas for user 25e3d7dd3a044e9c9ee7788b8a4d7b6d and project 4955f9999b0d4971bd23ea38ce3cce4b. Resources: dict_keys(['metadata_items']) {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:02:38.279142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:02:38.279568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:02:38.280053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:02:38.280481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:02:38.280885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:02:38.296917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:38.297617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:38.298365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:38.299420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:38.300045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:38.300684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:38.350612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Getting quotas for project 4955f9999b0d4971bd23ea38ce3cce4b. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:02:38.363794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Getting quotas for user 25e3d7dd3a044e9c9ee7788b8a4d7b6d and project 4955f9999b0d4971bd23ea38ce3cce4b. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:02:38.401110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:02:38.422380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:02:38.576377 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-17c1333b-85e8-4807-9deb-46b87d93b465 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.217464 Oct 12 09:02:38.577055 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2071/4510] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:02:36 2022] POST /compute/v2.1/servers => generated 407 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:02:38.590363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:38.590960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:38.634501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:38.635014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:38.637768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:38.638519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:38.638988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:38.639101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1797668509", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:38.639466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:38.842931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] validate_networks() for [('805813d2-9614-4738-98bc-b4e5f97168b1', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:02:39.031785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:39.048435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:39.052138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:39.062852 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-44eb9838-0860-49cf-9bd7-eaf69cb5654b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1745 microversion: 2.20 time: 0.476385 Oct 12 09:02:39.064249 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2072/4511] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:38 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1745 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:39.077657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-67f0a9a7-4815-423f-8b1b-dc36f47a0b25 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:39.078437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-67f0a9a7-4815-423f-8b1b-dc36f47a0b25 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:39.207318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-67f0a9a7-4815-423f-8b1b-dc36f47a0b25 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:39.216703 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-67f0a9a7-4815-423f-8b1b-dc36f47a0b25 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1217 microversion: 2.1 time: 0.150970 Oct 12 09:02:39.224416 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2073/4512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:39 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:39.233326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9f0fc582-af85-49d1-a9d1-7b97f6fba330 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:39.253870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9f0fc582-af85-49d1-a9d1-7b97f6fba330 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:39.410635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9f0fc582-af85-49d1-a9d1-7b97f6fba330 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:39.419748 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9f0fc582-af85-49d1-a9d1-7b97f6fba330 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1267 microversion: 2.1 time: 0.193940 Oct 12 09:02:39.441547 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2074/4513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:39 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:40.095483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:40.096233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:40.133555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:40.144080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:40.148629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:40.152392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:40.152904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:40.153360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:40.334593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:02:40.335759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:02:40.336448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:02:40.337085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:02:40.337738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:02:40.355238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:40.356120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:40.357553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:40.359082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:40.359791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:40.360523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:40.389980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Getting quotas for project c5a68c868837469d98b40b8dcb1ced96. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:02:40.397775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Getting quotas for user 603b71590bed4464a543c3f510301c46 and project c5a68c868837469d98b40b8dcb1ced96. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:02:40.463393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:02:40.478707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:02:40.715407 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eba58daf-8c7e-408a-ba44-1694a83b5f0a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.759609 Oct 12 09:02:40.722210 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2440/4514] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:02:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:02:40.732720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:40.745261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:40.770451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:40.775330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:40.776063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:40.778071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:40.786696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:40.787982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:40.997673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:41.007661 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02f97682-6905-4dcc-96f3-ae92227bbf46 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1277 microversion: 2.1 time: 0.284770 Oct 12 09:02:41.008455 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2441/4515] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:40 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:41.054549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:41.055477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:41.079914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:41.083686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:41.084407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:41.085998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:41.090738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:41.094472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:41.285761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:41.316262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:41.322138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:41.327603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e308d4c0-2dc9-4c4f-9983-9a1a3bbc7a8a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 1.234404 Oct 12 09:02:41.329578 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2075/4516] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:40 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:02:41.337031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-639ed4ac-3329-49d7-8907-2825ec3b5308 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:41.337751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-639ed4ac-3329-49d7-8907-2825ec3b5308 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:41.446256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:41.458217 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d23622c-0697-40c4-9766-a6480be6d96b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1319 microversion: 2.1 time: 0.430488 Oct 12 09:02:41.482064 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2442/4517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:41 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:41.779025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-639ed4ac-3329-49d7-8907-2825ec3b5308 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:41.788580 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-639ed4ac-3329-49d7-8907-2825ec3b5308 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1214 microversion: 2.1 time: 0.457042 Oct 12 09:02:41.796142 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2076/4518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:41 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1214 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:42.032236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:42.042377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:42.064936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:42.068053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:42.069510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:42.079185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:42.080815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:42.081932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:42.313289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:42.341697 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b975f6f1-36f1-4ec2-a4ae-be71dc4fbba3 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1275 microversion: 2.1 time: 0.301452 Oct 12 09:02:42.346379 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2443/4519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:42 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1275 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:42.356626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:42.357231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:42.366260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:42.366940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:42.367182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:42.368001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:42.368344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:42.368771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:42.484784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:42.487596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:42.507286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:42.508313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:42.508917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:42.511238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:42.517061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:42.519638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:42.722208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:42.737888 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-982eac82-8336-4483-87b5-f40df96b9f6b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1337 microversion: 2.1 time: 0.257501 Oct 12 09:02:42.751273 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2444/4520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:42 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1337 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:02:42.818875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:42.822773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:42.838347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:42.839028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:42.839604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:42.840453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:42.841193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:42.842049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:42.959462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:42.975898 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb184808-6571-4104-a235-fbf246bc1281 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1210 microversion: 2.1 time: 0.164592 Oct 12 09:02:42.977737 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2445/4521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:42 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:02:43.373543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:43.374454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:43.398322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:43.405230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:43.409041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:43.412776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:43.430587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:43.446185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:43.776706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:43.836910 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-194e96b8-e726-4a8c-8b17-7c373dd4be1b tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1275 microversion: 2.1 time: 0.467144 Oct 12 09:02:43.873749 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2446/4522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:43 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1275 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:43.887803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:43.893791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:43.919157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:43.926139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:43.929219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:43.930060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:43.930528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:43.930953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:44.237240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:44.254222 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-814a4840-4c9f-4a51-8304-473786d8874f tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1325 microversion: 2.1 time: 0.380145 Oct 12 09:02:44.259260 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2447/4523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:43 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1325 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:44.297625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:44.303902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:44.330075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:44.332621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:44.338055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:44.351086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:44.356689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:44.370469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:44.664900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:44.675539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:44.679050 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67137c8a-aae3-4091-8b4a-7807ed972558 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1272 microversion: 2.1 time: 0.396472 Oct 12 09:02:44.689793 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2448/4524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:44 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1272 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:44.714478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:44.717206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:44.722137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb9f20ee-28ef-46ee-bd9b-cb1a25d2809b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 2.369406 Oct 12 09:02:44.724684 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2077/4525] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:42 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 2372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:44.901990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:44.903023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:44.930322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:44.930894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:44.931347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:44.949539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:44.955895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:44.958477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:45.231508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:45.247015 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f423de9-a550-4224-a8a3-2836c3a6c92e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1275 microversion: 2.1 time: 0.362417 Oct 12 09:02:45.259532 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2449/4526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:44 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1275 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:45.286443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:45.287136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:45.305409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:45.306686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:45.307153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:45.313423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:45.315061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:45.315670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:45.709019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:45.710060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:45.720123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:45.721256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:45.722686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:45.724223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:45.724859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:45.726651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:45.862460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:45.877621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34a80b44-a0ec-43f6-b36f-4dedb9ff7a07 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1272 microversion: 2.1 time: 0.171742 Oct 12 09:02:45.878280 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2450/4527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:45 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:02:45.898295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:45.898923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:45.936789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:45.939269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:45.940137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:45.943833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:45.944508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:45.946942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:46.233749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:46.248668 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d1c4090e-b92a-42c7-abb8-196ea130b697 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1325 microversion: 2.1 time: 0.966296 Oct 12 09:02:46.266020 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2078/4528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:45 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1325 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:46.285751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d0023c56-3c11-49bd-8445-ee94ddf741db req-bdea11ab-6f29-4dbe-bc7b-e20133e83e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173b4809-6abe-413a-bbe2-217b8718c4e5", "name": "network-vif-plugged", "status": "completed", "tag": "ab36e1ae-f07f-41d7-84d8-7d73c7956ffc"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:46.305286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d0023c56-3c11-49bd-8445-ee94ddf741db req-bdea11ab-6f29-4dbe-bc7b-e20133e83e3f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:46.306325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d0023c56-3c11-49bd-8445-ee94ddf741db req-bdea11ab-6f29-4dbe-bc7b-e20133e83e3f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:46.306325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d0023c56-3c11-49bd-8445-ee94ddf741db req-bdea11ab-6f29-4dbe-bc7b-e20133e83e3f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:46.331976 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d0023c56-3c11-49bd-8445-ee94ddf741db req-bdea11ab-6f29-4dbe-bc7b-e20133e83e3f service nova] Creating event network-vif-plugged:ab36e1ae-f07f-41d7-84d8-7d73c7956ffc for instance 173b4809-6abe-413a-bbe2-217b8718c4e5 on n-h2-858383-10 Oct 12 09:02:46.340015 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d0023c56-3c11-49bd-8445-ee94ddf741db req-bdea11ab-6f29-4dbe-bc7b-e20133e83e3f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074635 Oct 12 09:02:46.341186 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2079/4529] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:46.349957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:46.351459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:46.360701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:46.361250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:46.362567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:46.364325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:46.365587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:46.366209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:46.559896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:46.588247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:46.599054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:46.605941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6febda7f-de70-4114-8505-002c6f055a94 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.724348 Oct 12 09:02:46.610902 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2451/4530] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:45 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:46.904157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:46.904793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:46.934426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:46.935018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:46.935478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:46.936229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:46.936709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:46.937117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:47.506464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:47.535592 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79123ce0-18d2-46d1-ba27-8460a6915ebc tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1272 microversion: 2.1 time: 0.635126 Oct 12 09:02:47.555550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2452/4531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:46 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1272 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:02:47.572899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:47.578825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:47.603342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:47.603852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:47.604300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:47.605042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:47.605545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:47.606013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:48.152660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:48.157808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:48.180445 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4cab75f1-db01-4016-972f-ba53796d4a7b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 0.623568 Oct 12 09:02:48.181508 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2453/4532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:47 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:48.190037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:48.190845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:48.213984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:48.218339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:48.219087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:48.220090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:48.221039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:48.222490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:48.325026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:48.631974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:48.640948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:48.663721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:48.669235 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ce84ee1-85b7-4fe1-9623-304f60163843 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.484003 Oct 12 09:02:48.677874 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2454/4533] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:48 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:48.690429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:48.691311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:48.711796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:48.716121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:48.720187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:48.724362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:48.725219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:48.729353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:48.825710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:48.834562 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-75246395-0543-4976-95e3-7b7411d122d9 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 2.490011 Oct 12 09:02:48.837877 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2080/4534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:46 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:49.204825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:49.205471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:49.215489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:49.218046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:49.218735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:49.223533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:49.234189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:49.234863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:50.167801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:50.179728 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e4edfc0-b5f4-44ba-902f-15c2d0c0cf6d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 1.493126 Oct 12 09:02:50.180892 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2455/4535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:48 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:50.199546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:50.200598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:50.221130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:50.226174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:50.230285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:50.233476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:50.236879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:50.239062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:50.378698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:50.448024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=12 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:50.503433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:50.516053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:50.518790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:50.521773 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b705c67f-1b0f-4ca1-80d6-230044045c08 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.338560 Oct 12 09:02:50.534330 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2456/4536] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:50 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:50.541973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:50.541973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:50.588108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:50.588743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:50.599198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:50.600309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:50.601184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:50.602085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:51.109091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:51.134925 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f41e0327-2f0e-4f42-94ae-ab97b3b4175c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.603255 Oct 12 09:02:51.136997 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2457/4537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:50 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:51.207421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:51.208501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:51.212679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:51.235007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:51.236766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:51.239248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:51.249538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:51.251486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:51.253004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:51.744407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:51.756631 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6b82d6f-ed6f-44df-9af3-acdb16db729b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 0.553066 Oct 12 09:02:51.758824 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2458/4538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:51 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:51.771674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:51.774799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:51.787885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=16 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:51.801759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:51.802593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:51.803298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:51.804738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:51.806566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:51.807699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:52.356037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:52.366112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:52.381377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:52.385737 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-448be44c-fe51-4534-9eda-377f7bfbec04 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.625548 Oct 12 09:02:52.386327 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2459/4539] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:51 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:52.401348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:52.409664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:52.427624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:52.433559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:52.436967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:52.437947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:52.441459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:52.445841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:52.469689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:52.502254 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20039004-7d9e-4a9a-aae7-d09ba5b7978e tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 3.298094 Oct 12 09:02:52.508363 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2081/4540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:49 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 3307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:02:52.781078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:52.781953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:52.801962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:52.804753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:52.808635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:52.809562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:52.814309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:52.815465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:52.837015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:52.974802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:52.984362 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ff736185-901d-441f-bbea-245e1c960199 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.591693 Oct 12 09:02:52.987360 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2460/4541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:52 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:53.412547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:53.413268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:53.427973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:53.428508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:53.428956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:53.430756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:53.432482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:53.433951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:53.726105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:53.765347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:53.770161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:53.773426 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eae58043-3dc5-40d8-8dd6-8df9a56f65ca tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.364856 Oct 12 09:02:53.805968 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2461/4542] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:53 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:02:53.811009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:53.811627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:53.860026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:53.860615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:53.861042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:53.861819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:53.862280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:53.863136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:54.096106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:54.116366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c7947dd-98b5-4cc8-bf2f-dfa751ba5d37 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 1.339989 Oct 12 09:02:54.125723 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2082/4543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:52 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:02:54.131555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:54.137561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:54.155618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:54.156685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:54.160164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:54.161265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:54.161927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:54.162625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:54.235372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:54.248194 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24588baf-436a-4087-8a1d-cc7d0b0cd1e5 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 0.440980 Oct 12 09:02:54.252906 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2462/4544] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:53 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:54.810373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:54.812493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:54.854412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:54.856179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:54.858195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:54.863703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:54.867030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:54.867735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:55.001698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:55.015387 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8cc8a3ab-f5d6-40cf-90a5-72e85c70f163 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.887619 Oct 12 09:02:55.017322 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2083/4545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:54 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:55.155467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:55.157250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:55.160800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:02:55.180007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:55.185377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:55.189632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:55.190704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:55.193342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:55.194064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:55.495961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:55.518403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:55.520382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:55.524502 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-50c54a76-cf16-4064-9509-5e3ad74d7d0f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.724925 Oct 12 09:02:55.527023 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2463/4546] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:54 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:02:55.536214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-476f2e18-ac7a-4fc7-a4ec-16d6ea807c02 req-b84bc2a5-1dad-4511-8fe7-8b1cb76dfcab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50017a73-f900-4421-be27-69e9986e674a", "tag": "75df96b1-2480-4098-ac2c-e8312d50d713"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:55.586100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-476f2e18-ac7a-4fc7-a4ec-16d6ea807c02 req-b84bc2a5-1dad-4511-8fe7-8b1cb76dfcab service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:55.589253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-476f2e18-ac7a-4fc7-a4ec-16d6ea807c02 req-b84bc2a5-1dad-4511-8fe7-8b1cb76dfcab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:55.589999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-476f2e18-ac7a-4fc7-a4ec-16d6ea807c02 req-b84bc2a5-1dad-4511-8fe7-8b1cb76dfcab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:55.622072 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-476f2e18-ac7a-4fc7-a4ec-16d6ea807c02 req-b84bc2a5-1dad-4511-8fe7-8b1cb76dfcab service nova] Creating event network-changed:75df96b1-2480-4098-ac2c-e8312d50d713 for instance 50017a73-f900-4421-be27-69e9986e674a on n-h1-858383-10 Oct 12 09:02:55.631029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-476f2e18-ac7a-4fc7-a4ec-16d6ea807c02 req-b84bc2a5-1dad-4511-8fe7-8b1cb76dfcab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102481 Oct 12 09:02:55.640958 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2464/4547] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:55.654373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:55.656322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:55.679334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:55.680107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:55.680758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:55.682021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:55.686492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:55.687237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:55.913841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:55.931011 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b7e5b432-65e3-4a11-8c6f-bec4909b52a5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 0.782152 Oct 12 09:02:55.934109 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2084/4548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:55 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:56.044750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:56.045397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:56.061761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:56.062267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:56.062712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:56.063498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:56.063959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:56.064384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:56.351679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:56.368784 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bcc87ee3-ee02-4d00-8b03-79fa76d7f5c7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 0.719112 Oct 12 09:02:56.369671 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2465/4549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:55 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:56.551309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:56.552217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:56.567132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:56.570268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:56.571212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:56.574840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:56.578205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:56.583034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:56.933314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:56.942137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6af2118-1441-4e7b-810a-3beb69ad7f3e tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.901229 Oct 12 09:02:56.948090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2085/4550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:56 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:56.966700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:56.967809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:56.980796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:56.981573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:56.982243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:56.983152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:56.983799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:56.984660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:57.738375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:57.748838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:57.750365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:57.751669 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cdbc67d9-0c67-4400-8298-f7095eadcd5f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 1.204865 Oct 12 09:02:57.764613 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2466/4551] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:56 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:02:57.774629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:57.775227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:57.802347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:57.812346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:57.813059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:57.815524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:57.816151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:57.822095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:58.385381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:58.388777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:58.398773 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8bc17ebf-8896-48bd-a343-a868b5ae88e3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 0.632918 Oct 12 09:02:58.399725 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5966b18-e0dc-41c3-bd7d-9b352e465dbb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 1.435323 Oct 12 09:02:58.401628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2086/4552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:56 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:02:58.406495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-786744fc-decd-441e-9bdf-25e19bf74d07 req-450afd8a-0d03-439e-925b-0b0274f0a265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad075d6-c4f7-4b68-a7d2-711074a02789", "tag": "16185c2d-6891-46f3-bc68-9c374c95eb70"}, {"name": "network-changed", "server_uuid": "32580ec2-7ba7-43c6-b11d-78b8a6253a91", "tag": "dd6fd737-0fe2-405d-8cf0-fed4909461c6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:02:58.419769 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2467/4553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:57 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:58.435068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-786744fc-decd-441e-9bdf-25e19bf74d07 req-450afd8a-0d03-439e-925b-0b0274f0a265 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:58.436075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:58.436718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-786744fc-decd-441e-9bdf-25e19bf74d07 req-450afd8a-0d03-439e-925b-0b0274f0a265 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:58.437980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-786744fc-decd-441e-9bdf-25e19bf74d07 req-450afd8a-0d03-439e-925b-0b0274f0a265 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:58.442741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:58.461767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:58.462268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:58.462711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:58.463435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:58.469849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:58.470893 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-786744fc-decd-441e-9bdf-25e19bf74d07 req-450afd8a-0d03-439e-925b-0b0274f0a265 service nova] Creating event network-changed:16185c2d-6891-46f3-bc68-9c374c95eb70 for instance cad075d6-c4f7-4b68-a7d2-711074a02789 on n-h1-858383-10 Oct 12 09:02:58.471739 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-786744fc-decd-441e-9bdf-25e19bf74d07 req-450afd8a-0d03-439e-925b-0b0274f0a265 service nova] Creating event network-changed:dd6fd737-0fe2-405d-8cf0-fed4909461c6 for instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 on n-h2-858383-10 Oct 12 09:02:58.473865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:58.489846 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-786744fc-decd-441e-9bdf-25e19bf74d07 req-450afd8a-0d03-439e-925b-0b0274f0a265 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086639 Oct 12 09:02:58.491413 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2087/4554] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:02:58.783598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:58.784656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:58.811499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:58.814437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:58.818011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:58.820526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:58.824166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:58.825389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:58.829528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:58.849077 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b3593c1-a343-4aa9-b976-059afc816a08 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.427821 Oct 12 09:02:58.884833 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2468/4555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:58 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:02:59.426134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:59.426852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:02:59.463819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:59.465085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:59.465689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:59.477801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:02:59.478415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:02:59.481870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:02:59.880807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:59.899931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:59.915910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:02:59.918851 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c98c6bf9-6723-4846-b2c3-5e4beaaa78fc tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 1.140575 Oct 12 09:02:59.946063 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2088/4556] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:02:58 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:02:59.971227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:02:59.971915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:00.026647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:00.028755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:00.031040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:00.032817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:00.035193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:00.037271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:00.574468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:00.587216 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd456c80-f2b7-44cf-b7b1-ae66db3d647a tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 1.165367 Oct 12 09:03:00.594004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2469/4557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:59 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:00.599305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:00.611817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:00.626319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:00.627952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:00.630311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:00.631850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:00.632734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:00.634871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:00.773382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:00.783265 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05074b9f-fc0d-4a49-92fb-3b37db520c6b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 0.840632 Oct 12 09:03:00.787501 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2089/4558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:02:59 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:00.961079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:00.961735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:00.994300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:00.997547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:01.001562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:01.006224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:01.009639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:01.012041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:01.272171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:01.285030 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-25f6435a-9dcf-41d1-b7c3-5e0338f93c93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.689528 Oct 12 09:03:01.293451 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2470/4559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:00 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:01.623704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:01.625271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:01.648734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:01.652171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:01.653378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:01.656092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:01.657733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:01.660794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:01.761416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:02.196654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:02.217884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:02.220536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:02.222539 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07b64482-41e5-4b25-89cc-be0fd7076c07 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 1.267396 Oct 12 09:03:02.224139 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2090/4560] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:00 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:03:02.232921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:02.234093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:02.244958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:02.245855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:02.248029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:02.248029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:02.248378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:02.249069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:02.760292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:02.777120 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c356e6d4-78e8-4ded-bf39-88d0f9300b66 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 1.158411 Oct 12 09:03:02.780950 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2471/4561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:01 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:02.828325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:02.834138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:02.884216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:02.888423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:02.893851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:02.898714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:02.906424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:02.911407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:03.705064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:03.718800 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e8df16e-433a-452e-801e-44cbb1c43206 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.932211 Oct 12 09:03:03.723293 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2472/4562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:02 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:03.745890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:03.747298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:03.775293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:03.776858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:03.778669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:03.780020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:03.781932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:03.783930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:03.942452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:03.955128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3268f570-a7c0-47b8-89c4-28d73c9d29b7 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 1.726310 Oct 12 09:03:03.957292 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2091/4563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:02 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:03.971315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:03.971935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:03.999181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:04.001011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:04.003263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:04.004341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:04.006518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:04.007136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:04.372324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:04.382843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:04.386997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:04.393595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-64154035-7b06-4e02-bbc8-940416feff83 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.667928 Oct 12 09:03:04.396467 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2473/4564] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:03 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:04.491654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:04.504536 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86f13738-c012-427f-8f78-203b5a94ccf3 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 0.544822 Oct 12 09:03:04.518334 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2092/4565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:03 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:04.754556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:04.755386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:04.781657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:04.782860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:04.783618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:04.784549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:04.785685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:04.786294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:04.982771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:04.984422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:05.005296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:05.009158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:05.009668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:05.010424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:05.011044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:05.011994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:05.391500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:05.396057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:05.401956 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2cbc21e-07cc-494c-a852-3bf49e648294 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.654568 Oct 12 09:03:05.404023 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2474/4566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:04 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:05.419585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1252127933", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4b4d6bcd-0a49-444f-bc57-6b594938c4f1"}], "security_groups": [{"name": "tempest-securitygroup--1978542035"}], "key_name": "tempest-keypair-1013803515", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1721e6f4-b5a8-49d0-90da-674f3f518bc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:05.428350 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac789184-75c1-43fe-8f30-f3d68c8b437d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 0.450456 Oct 12 09:03:05.433766 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2093/4567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:04 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:05.446828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:05.448900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:05.468413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:05.477547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:05.478584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:05.484693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:05.486302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:05.487056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:05.824702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] validate_networks() for [('4b4d6bcd-0a49-444f-bc57-6b594938c4f1', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:03:05.883568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:05.904623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:05.907863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:05.909273 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-edfb3f5b-22a0-46a0-be2e-c5db04d050da tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.474144 Oct 12 09:03:05.922039 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2094/4568] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:05 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:05.922039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:05.922039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:05.930966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:05.930966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:05.930966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:05.931263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:05.932008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:05.933229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:06.187366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:06.204086 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4cce4c17-dd17-4105-948b-2c8d01eb9c27 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 0.292282 Oct 12 09:03:06.204681 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2095/4569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:05 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:06.236956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-6643ecd8-4a35-4ec1-8f23-67dcc7e39f8a req-131df829-0c32-4705-b907-40ac59f502b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50017a73-f900-4421-be27-69e9986e674a", "name": "network-vif-plugged", "status": "completed", "tag": "75df96b1-2480-4098-ac2c-e8312d50d713"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:06.272188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6643ecd8-4a35-4ec1-8f23-67dcc7e39f8a req-131df829-0c32-4705-b907-40ac59f502b5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:06.272679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6643ecd8-4a35-4ec1-8f23-67dcc7e39f8a req-131df829-0c32-4705-b907-40ac59f502b5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:06.273115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6643ecd8-4a35-4ec1-8f23-67dcc7e39f8a req-131df829-0c32-4705-b907-40ac59f502b5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:06.304258 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-6643ecd8-4a35-4ec1-8f23-67dcc7e39f8a req-131df829-0c32-4705-b907-40ac59f502b5 service nova] Creating event network-vif-plugged:75df96b1-2480-4098-ac2c-e8312d50d713 for instance 50017a73-f900-4421-be27-69e9986e674a on n-h1-858383-10 Oct 12 09:03:06.325857 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-6643ecd8-4a35-4ec1-8f23-67dcc7e39f8a req-131df829-0c32-4705-b907-40ac59f502b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096579 Oct 12 09:03:06.333353 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2096/4570] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:06.428317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:06.429538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:06.450502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:06.452930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:06.455308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:06.456974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:06.457735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:06.462037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:07.018169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:07.035046 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0ab969c-9911-4161-bfd9-538095e6cb93 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.606597 Oct 12 09:03:07.036493 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2097/4571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:06 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:07.040462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Getting quotas for project 751116048c544045993aec6d95142d30. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:03:07.047637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:07.048275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:07.055422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Getting quotas for user 869679441de4425b97e24c4686cbe87c and project 751116048c544045993aec6d95142d30. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:03:07.061974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:07.062482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:07.063023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:07.063800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:07.067701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:07.070412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:07.097528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:03:07.097976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:03:07.099699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:03:07.100108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:03:07.100540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:03:07.126603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:07.127093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:07.128167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:07.131899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:07.132662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:07.134234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:07.183901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Getting quotas for project 751116048c544045993aec6d95142d30. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:03:07.201292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Getting quotas for user 869679441de4425b97e24c4686cbe87c and project 751116048c544045993aec6d95142d30. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:03:07.365708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:03:07.369607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1721e6f4-b5a8-49d0-90da-674f3f518bc7',volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:03:07.476551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:07.493910 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-be82bd11-e19b-4e58-8e20-05032f427608 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 0.455958 Oct 12 09:03:07.502338 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2098/4572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:07 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:07.508981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:07.510045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:07.519487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:07.523097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:07.534679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:07.535889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:07.537288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:07.537992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:07.708698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-af7662f0-3842-4195-afe7-e1a821703c00 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.301445 Oct 12 09:03:07.717697 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2475/4573] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:03:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:03:07.732561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:07.735468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:07.764725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:07.771641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:07.775809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:07.778314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:07.779644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:07.780830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:08.055556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:08.067865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:08.071768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:08.073947 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6076a636-5645-4654-b3ad-6f53bd4bc5f3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.570207 Oct 12 09:03:08.076735 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2099/4574] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:07 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:08.116904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83b8c274-059d-47c8-89ef-3ee7f80936d9 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:08.122187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-83b8c274-059d-47c8-89ef-3ee7f80936d9 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:08.236949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:08.255091 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0d7bbb33-153b-4aa8-92a2-60c5b2695910 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 0.532000 Oct 12 09:03:08.256791 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2476/4575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:07 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:08.283999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:08.288446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:08.308958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:08.316594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-83b8c274-059d-47c8-89ef-3ee7f80936d9 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:08.336781 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83b8c274-059d-47c8-89ef-3ee7f80936d9 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1122 microversion: 2.1 time: 0.250632 Oct 12 09:03:08.339104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:08.339885 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2100/4576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:08 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1122 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:08.346741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:08.348081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:08.348969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:08.349797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:08.396802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0201a8e1-7653-4ebb-aee1-6f0e97e7c303 req-906d526a-2eb3-434c-9f4d-82d382037b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32580ec2-7ba7-43c6-b11d-78b8a6253a91", "name": "network-vif-plugged", "status": "completed", "tag": "dd6fd737-0fe2-405d-8cf0-fed4909461c6"}, {"server_uuid": "cad075d6-c4f7-4b68-a7d2-711074a02789", "name": "network-vif-plugged", "status": "completed", "tag": "16185c2d-6891-46f3-bc68-9c374c95eb70"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:08.424955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0201a8e1-7653-4ebb-aee1-6f0e97e7c303 req-906d526a-2eb3-434c-9f4d-82d382037b66 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:08.427045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0201a8e1-7653-4ebb-aee1-6f0e97e7c303 req-906d526a-2eb3-434c-9f4d-82d382037b66 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:08.427809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0201a8e1-7653-4ebb-aee1-6f0e97e7c303 req-906d526a-2eb3-434c-9f4d-82d382037b66 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:08.440531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:08.493310 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0201a8e1-7653-4ebb-aee1-6f0e97e7c303 req-906d526a-2eb3-434c-9f4d-82d382037b66 service nova] Creating event network-vif-plugged:dd6fd737-0fe2-405d-8cf0-fed4909461c6 for instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 on n-h2-858383-10 Oct 12 09:03:08.497208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0201a8e1-7653-4ebb-aee1-6f0e97e7c303 req-906d526a-2eb3-434c-9f4d-82d382037b66 service nova] Creating event network-vif-plugged:16185c2d-6891-46f3-bc68-9c374c95eb70 for instance cad075d6-c4f7-4b68-a7d2-711074a02789 on n-h1-858383-10 Oct 12 09:03:08.532981 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0201a8e1-7653-4ebb-aee1-6f0e97e7c303 req-906d526a-2eb3-434c-9f4d-82d382037b66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.141034 Oct 12 09:03:08.541710 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2101/4577] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:08.562211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:08.568250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:08.589335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:08.593376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:08.595393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:08.596422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:08.598219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:08.600112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:08.639428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:08.661243 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a93572a2-8a0f-4b36-84d8-393e5b83cef4 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1317 microversion: 2.1 time: 0.400459 Oct 12 09:03:08.674541 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2477/4578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:08 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:09.098980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:09.106988 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c081372e-d0c3-4791-bd66-a90fb83ade9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 0.563687 Oct 12 09:03:09.107589 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2102/4579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:08 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:09.111036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:09.113495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:09.123740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:09.125100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:09.126235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:09.127474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:09.128401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:09.129052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:09.280400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:09.280943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:09.294815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:09.295325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:09.295772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:09.296498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:09.297032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:09.297530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:09.460000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:09.470018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:09.471587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:09.472893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88ef6609-2c45-4aa5-ab61-22c6acfca399 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.372144 Oct 12 09:03:09.475583 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2478/4580] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:09 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:09.484912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:09.486955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:09.501377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:09.505656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:09.506660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:09.507947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:09.508571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:09.509179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.011241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:10.020539 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-81a53300-a9e9-4319-8e5d-ac5ac73a03ae tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1393 microversion: 2.1 time: 0.744134 Oct 12 09:03:10.021147 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2103/4581] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:09 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1393 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:10.063485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:10.064241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:10.064907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:10.073461 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be9add98-9251-4eff-ad9b-08a70f6011d5 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1220 microversion: 2.1 time: 0.598162 Oct 12 09:03:10.074844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2479/4582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:09 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1220 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:10.090265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.097744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.098455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.099365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.101846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.103635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.135388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:10.137171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:10.160526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.163253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.165323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.167578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.170968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.172818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.596771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:10.611187 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-48b6cc14-3876-480b-8cf5-7705b34174c5 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1314 microversion: 2.1 time: 0.479482 Oct 12 09:03:10.612686 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2480/4583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:10 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:10.619112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:10.620331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:10.640267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.644008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.644471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.652381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.660025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.660604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.683463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:10.700923 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0e3b634-38e7-444f-ada0-ca27a3552f97 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1506 microversion: 2.1 time: 0.659275 Oct 12 09:03:10.713261 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2104/4584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:10 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:10.730189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:10.730653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:10.744930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.745464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.745908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.746629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.747168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.747607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.807660 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-935e9fbf-73b1-4e9c-9fec-d2c580f046a7 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a/ips" status: 200 len: 109 microversion: 2.1 time: 0.081260 Oct 12 09:03:10.808781 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2105/4585] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:03:10 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a/ips => generated 109 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:10.839519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:10.840293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:10.864831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.869967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.873418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.874228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:10.874705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:10.875198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:10.958619 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07d23b4f-5c89-458c-b6f3-de4635532816 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a/ips" status: 200 len: 109 microversion: 2.1 time: 0.139258 Oct 12 09:03:10.965530 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2106/4586] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:03:10 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a/ips => generated 109 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:10.995990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:10.999945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:11.012802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.014456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.017101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.021196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.021991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.022671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.164115 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9918269e-1370-44bc-b8e3-27bdab30e755 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a/ips/tempest-ServerAddressesTestJSON-1322308082-network" status: 200 len: 94 microversion: 2.1 time: 0.182475 Oct 12 09:03:11.167024 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2107/4587] 10.222.0.40 () {58 vars in 1401 bytes} [Wed Oct 12 09:03:10 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a/ips/tempest-ServerAddressesTestJSON-1322308082-network => generated 94 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:03:11.191892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:11.215357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:11.218537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:11.263964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:11.267125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:11.268636 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-219ea0af-ef4b-483a-909d-12d87eb2f80a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 0.654662 Oct 12 09:03:11.269990 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2481/4588] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:10 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:11.271753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.272461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.273094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.274058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.274697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.275328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.275440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:11.276273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:11.284001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.284936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.285549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.286600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.287233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.288090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.383319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:11.394850 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7917f3fa-733a-433f-8681-dfebdb5ba708 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1238 microversion: 2.1 time: 0.123427 Oct 12 09:03:11.395688 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2482/4589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:11 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1238 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:11.402461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:11.403711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:11.411322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.412140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.412784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.414223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.415254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.415835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.459340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:03:11.679389 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-960358b7-df97-4caf-bab8-64245c36464f tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "DELETE /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 204 len: 0 microversion: 2.1 time: 0.281948 Oct 12 09:03:11.680327 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2483/4590] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:03:11 2022] DELETE /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:03:11.694051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:11.695001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:11.707352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.708766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.709464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.710422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:11.711724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:11.712366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:11.967746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:11.977727 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b9ded290-579c-4f69-9fa2-6cd18a7d33de tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1575 microversion: 2.1 time: 0.808969 Oct 12 09:03:11.988337 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2108/4591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:11 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1575 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:12.004756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:12.006761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:12.025599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.026148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.026534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.030899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.034643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.035488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.122659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:12.135554 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e13fd780-b56a-44bb-9185-40ddf552c569 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1500 microversion: 2.1 time: 0.452937 Oct 12 09:03:12.138272 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2484/4592] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:11 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1500 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:12.160783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:12.162032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:12.182753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.192949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.193975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.195685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.196386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.198847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.388050 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b57a9883-ad43-4438-afdc-466680a7d05d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.239594 Oct 12 09:03:12.389667 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2485/4593] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:03:12 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:12.396597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:12.407144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:12.439806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.442292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.444270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.448301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.448965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.449610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.503604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lazy-loading 'flavor' on Instance uuid 32580ec2-7ba7-43c6-b11d-78b8a6253a91 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:03:12.541208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:12.684079 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-da79fbb3-8c1e-4516-bebb-260152bce77b tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "POST /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91/action" status: 200 len: 32 microversion: 2.1 time: 0.292645 Oct 12 09:03:12.704019 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2486/4594] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:03:12 2022] POST /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91/action => generated 32 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:03:12.724820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:12.727931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:12.747537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.748296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.748895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.749869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.750486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.751069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.833081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:12.843053 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5c07a13-29a7-4b7b-b51e-ecb3016e30fd tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1512 microversion: 2.1 time: 0.853353 Oct 12 09:03:12.848808 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2109/4595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:11 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1512 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:12.854030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:12.859778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:12.873904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.892527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.895548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:12.896478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:12.897136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:12.897812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:13.223706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:13.237158 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d6ad338-b072-4f74-b8c2-07222480cd62 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1238 microversion: 2.1 time: 0.386876 Oct 12 09:03:13.238983 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2110/4596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:12 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1238 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:13.253741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:13.256535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:13.268107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:13.272724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:13.273795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:13.274885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:13.275562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:13.276174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:13.847659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:13.856343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:13.869620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:13.871342 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61471205-f8fb-4d80-a405-b070cc2bedda tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1740 microversion: 2.20 time: 1.162403 Oct 12 09:03:13.872383 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2487/4597] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:12 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1740 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:13.877307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:13.877955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:13.910457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:13.910979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:13.911423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:13.912149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:13.912613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:13.913046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:14.261614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:14.288316 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-50de9320-3b0c-4662-9ad1-c81aa275c43a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 1.041074 Oct 12 09:03:14.295257 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2111/4598] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:13 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:14.317294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:14.326392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:14.345223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:14.345743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:14.346442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:14.347135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:14.347586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:14.348013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:14.742049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:14.756689 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8224a4b0-9ac6-477f-80ca-4694961d5d88 tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1512 microversion: 2.1 time: 0.882977 Oct 12 09:03:14.780782 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2488/4599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:13 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1512 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:14.896750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:14.898225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:14.902464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:14.908830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:14.910901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:14.912736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:14.915845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:14.916703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:14.917580 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-59418af6-0891-4142-96ac-816ffda5b4f0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1306 microversion: 2.1 time: 0.612679 Oct 12 09:03:14.918156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:14.925345 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2112/4600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:14 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1306 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:15.322199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:15.323525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:15.339744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:15.340516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:15.341115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:15.342029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:15.342646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:15.343269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:15.867347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:15.879990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:15.882237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:15.883738 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55127598-4ed8-4af3-ba80-947c6a8f371b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1722 microversion: 2.20 time: 0.991344 Oct 12 09:03:15.897856 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2489/4601] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:14 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1722 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:15.908442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9aa0e57f-5a9a-4707-af26-c4587a7fc739 req-b198c2fe-0dee-4e5d-8554-7bd2439001ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50017a73-f900-4421-be27-69e9986e674a", "name": "network-vif-deleted", "tag": "75df96b1-2480-4098-ac2c-e8312d50d713"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:15.919942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9aa0e57f-5a9a-4707-af26-c4587a7fc739 req-b198c2fe-0dee-4e5d-8554-7bd2439001ee service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:15.920614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9aa0e57f-5a9a-4707-af26-c4587a7fc739 req-b198c2fe-0dee-4e5d-8554-7bd2439001ee service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:15.921248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9aa0e57f-5a9a-4707-af26-c4587a7fc739 req-b198c2fe-0dee-4e5d-8554-7bd2439001ee service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:15.926548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:15.934896 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54865844-93aa-4d04-9a89-ec3cade977cb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.616692 Oct 12 09:03:15.935239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9aa0e57f-5a9a-4707-af26-c4587a7fc739 req-b198c2fe-0dee-4e5d-8554-7bd2439001ee service nova] Creating event network-vif-deleted:75df96b1-2480-4098-ac2c-e8312d50d713 for instance 50017a73-f900-4421-be27-69e9986e674a on n-h1-858383-10 Oct 12 09:03:15.940806 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9aa0e57f-5a9a-4707-af26-c4587a7fc739 req-b198c2fe-0dee-4e5d-8554-7bd2439001ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040950 Oct 12 09:03:15.941712 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2490/4602] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:15.943577 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2113/4603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:15 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:15.948305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:15.948926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:15.949465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:15.950587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:15.959735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:15.960578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:15.961245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:15.962215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:15.962890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:15.964529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:15.965070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:15.965605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:15.966052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:15.966770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:15.967228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:15.967660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:16.023511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:16.024252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:16.024847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:16.025473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lazy-loading 'fault' on Instance uuid 50017a73-f900-4421-be27-69e9986e674a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:03:16.095701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06448c8ed1c146aeb2e4a97ba3de21b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd0342e8bb34dba976c73230ea44faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:16.109071 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a8a1a11d-aceb-4d86-ad46-fcbb86079fdc tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 200 len: 1307 microversion: 2.1 time: 0.164434 Oct 12 09:03:16.111556 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2491/4604] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:15 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 1307 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:16.214079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:16.215133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:16.218183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:16.233016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:16.233819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:16.243312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:16.244328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:16.244809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:16.245243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:16.561209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:16.571206 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c95c09fd-63dc-470f-98e1-489e6ab22c36 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1575 microversion: 2.1 time: 0.361499 Oct 12 09:03:16.573856 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2492/4605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:16 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1575 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:16.579641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-99867f0b-2cd9-4c86-9fb6-3fc506348a16 req-781e5ace-ccff-454f-aeb8-a4269bf5903e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad075d6-c4f7-4b68-a7d2-711074a02789", "tag": "16185c2d-6891-46f3-bc68-9c374c95eb70"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:16.595905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-99867f0b-2cd9-4c86-9fb6-3fc506348a16 req-781e5ace-ccff-454f-aeb8-a4269bf5903e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:16.597026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-99867f0b-2cd9-4c86-9fb6-3fc506348a16 req-781e5ace-ccff-454f-aeb8-a4269bf5903e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:16.597663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-99867f0b-2cd9-4c86-9fb6-3fc506348a16 req-781e5ace-ccff-454f-aeb8-a4269bf5903e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:16.613141 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-99867f0b-2cd9-4c86-9fb6-3fc506348a16 req-781e5ace-ccff-454f-aeb8-a4269bf5903e service nova] Creating event network-changed:16185c2d-6891-46f3-bc68-9c374c95eb70 for instance cad075d6-c4f7-4b68-a7d2-711074a02789 on n-h1-858383-10 Oct 12 09:03:16.619876 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-99867f0b-2cd9-4c86-9fb6-3fc506348a16 req-781e5ace-ccff-454f-aeb8-a4269bf5903e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044072 Oct 12 09:03:16.620826 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2493/4606] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:16.916190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:16.916893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:16.928635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:16.932633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:16.933322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:16.936803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:16.938977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:16.939644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:17.076346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:17.089159 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-707486a2-ab8f-42bb-9ed9-e1e486df5c05 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1306 microversion: 2.1 time: 1.142938 Oct 12 09:03:17.091276 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2114/4607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:15 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1306 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:17.103375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:17.104331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:17.118341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:17.121200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:17.123068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:17.124244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:17.125557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:17.126568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:17.156964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:17.220440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=10 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:17.481369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:17.492185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:17.500074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:17.504707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1832d128-8fb8-408d-8737-9456f23ce3d7 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1722 microversion: 2.20 time: 0.592032 Oct 12 09:03:17.508851 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2494/4608] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:16 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1722 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:17.515735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:17.516690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] [instance: 50017a73-f900-4421-be27-69e9986e674a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:17.545930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:17.547208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:17.549360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:17.550311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:17.552822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:17.553389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:17.590467 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] HTTP exception thrown: Instance 50017a73-f900-4421-be27-69e9986e674a could not be found. Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Request method failure captured: Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a HTTP/1.1 Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoKrh110Zono9LuFjbg20AvWbjtiIPwvvCGb6hHJ3K7IwL6H_agKwXX4mKNjuRjwIGwAOUFrI2slGuIBIPoR7gLy-7UD2tHEM-gZ8Sv9JbQymvcfKQvnQhhm0npEJp-3WfYNisLRNKEEucMtNgGB3ezaA-4ZrTwNUFaZOKaSEtcUUIs Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 6fd0342e8bb34dba976c73230ea44faf Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerAddressesTestJSON-150054071 Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd0342e8bb34dba976c73230ea44faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6fd0342e8bb34dba976c73230ea44faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6fd0342e8bb34dba976c73230ea44faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fd0342e8bb34dba976c73230ea44faf"}]}] Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerAddressesTestJSON-150054071 Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 6fd0342e8bb34dba976c73230ea44faf Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerAddressesTestJSON-150054071 Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerAddressesTestJSON-150054071-project Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 06448c8ed1c146aeb2e4a97ba3de21b0 Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerAddressesTestJSON-150054071-project Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 50017a73-f900-4421-be27-69e9986e674a could not be found. Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '50017a73-f900-4421-be27-69e9986e674a'} Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50017a73-f900-4421-be27-69e9986e674a could not be found. Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50017a73-f900-4421-be27-69e9986e674a could not be found. Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:03:17.595417 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:17.599880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:17.599880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:03:17.599880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:03:17.599880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:03:17.599880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:03:17.599880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50017a73-f900-4421-be27-69e9986e674a could not be found. Oct 12 09:03:17.599880 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:17.603366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] Returning 404 to user: Instance 50017a73-f900-4421-be27-69e9986e674a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:03:17.604447 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-22bc032d-b111-444a-94b2-dc9f9c3e494c tempest-ServerAddressesTestJSON-150054071 tempest-ServerAddressesTestJSON-150054071-project] 10.222.0.40 "GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a" status: 404 len: 111 microversion: 2.1 time: 0.094167 Oct 12 09:03:17.605272 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2495/4609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:17 2022] GET /compute/v2.1/servers/50017a73-f900-4421-be27-69e9986e674a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:03:17.998272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:18.006832 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d7eadda5-52ed-4fcf-8086-ce9620dbbdfe tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.914183 Oct 12 09:03:18.010854 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2115/4610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:17 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:18.119633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:18.120248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:18.128439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:18.128933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:18.131472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:18.134657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:18.137307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:18.138136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:18.532429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:18.533041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:18.535960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:18.558201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:18.559586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:18.560060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:18.560780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:18.567139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:18.569698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:18.786029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:18.800362 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04aebb7e-7653-4a78-8878-0a2df98a9873 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1306 microversion: 2.1 time: 0.683995 Oct 12 09:03:18.823133 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2496/4611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:18 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1306 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:19.052111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:19.054223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:19.076610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:19.086039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:19.094033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:19.094476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:19.094995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:19.095453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:19.100544 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2233ed63-446c-41a1-847d-87bab43b5819 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1725 microversion: 2.20 time: 0.572673 Oct 12 09:03:19.101494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:19.102016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:19.102468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:19.105119 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2116/4612] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:18 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1725 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:19.121594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-59b4a670-66bf-48ac-8d83-03048f06b661 req-544e5758-8511-4848-bb9f-dbdaca9abfcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8422525-d110-47bc-be86-de1169d34c4a", "tag": "5fadc5f1-a4f3-4431-8831-7fd555a73468"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:19.157002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-59b4a670-66bf-48ac-8d83-03048f06b661 req-544e5758-8511-4848-bb9f-dbdaca9abfcc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:19.162675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-59b4a670-66bf-48ac-8d83-03048f06b661 req-544e5758-8511-4848-bb9f-dbdaca9abfcc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:19.166106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-59b4a670-66bf-48ac-8d83-03048f06b661 req-544e5758-8511-4848-bb9f-dbdaca9abfcc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:19.191538 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-59b4a670-66bf-48ac-8d83-03048f06b661 req-544e5758-8511-4848-bb9f-dbdaca9abfcc service nova] Creating event network-changed:5fadc5f1-a4f3-4431-8831-7fd555a73468 for instance e8422525-d110-47bc-be86-de1169d34c4a on n-h2-858383-10 Oct 12 09:03:19.212655 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-59b4a670-66bf-48ac-8d83-03048f06b661 req-544e5758-8511-4848-bb9f-dbdaca9abfcc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102340 Oct 12 09:03:19.213937 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2117/4613] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:19.219947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d9c9b24-2bc3-46a0-839d-21250674be6d"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:19.234634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:19.245573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:19.250446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:19.251043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:19.251967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:19.252579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:19.253161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:19.549941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:19.565082 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2049534b-ae0c-4410-9ca1-134418e16a93 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.528957 Oct 12 09:03:19.582705 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2497/4614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:19 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:19.588951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ef767f8d-d03a-4e57-ab2e-4ff5f5a8cd27 req-6e62682f-f22b-4638-97fe-7329082020a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173b4809-6abe-413a-bbe2-217b8718c4e5", "name": "network-vif-unplugged", "status": "completed", "tag": "ab36e1ae-f07f-41d7-84d8-7d73c7956ffc"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:19.601668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ef767f8d-d03a-4e57-ab2e-4ff5f5a8cd27 req-6e62682f-f22b-4638-97fe-7329082020a3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:19.602410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ef767f8d-d03a-4e57-ab2e-4ff5f5a8cd27 req-6e62682f-f22b-4638-97fe-7329082020a3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:19.603206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ef767f8d-d03a-4e57-ab2e-4ff5f5a8cd27 req-6e62682f-f22b-4638-97fe-7329082020a3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:19.617570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.server_external_events [req-ef767f8d-d03a-4e57-ab2e-4ff5f5a8cd27 req-6e62682f-f22b-4638-97fe-7329082020a3 service nova] Unable to find a host for instance 173b4809-6abe-413a-bbe2-217b8718c4e5. Dropping event network-vif-unplugged {{(pid=127006) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 09:03:19.619137 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ef767f8d-d03a-4e57-ab2e-4ff5f5a8cd27 req-6e62682f-f22b-4638-97fe-7329082020a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034967 Oct 12 09:03:19.619920 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2498/4615] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 09:03:19.667079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:19.828241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:19.829088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:19.836347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:19.839518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:19.840070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:19.840934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:19.841582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:19.842078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:19.911297 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d46bd5dc-f869-4b5a-b619-806aad974d74 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.695642 Oct 12 09:03:19.912706 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2118/4616] 10.222.0.40 () {62 vars in 1364 bytes} [Wed Oct 12 09:03:19 2022] POST /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/os-volume_attachments => generated 188 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:03:20.081790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:20.082360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:20.109644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:20.117347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:20.118654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:20.119861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:20.121118 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cb597cc-5f00-45e0-a1b8-be51e3933115 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 0.297033 Oct 12 09:03:20.123097 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2499/4617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:19 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:20.150943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:20.151713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:20.152798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:20.564366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5265a57a-6496-48fa-8fce-e1f1684caa3a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "DELETE /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/os-volume_attachments/6d9c9b24-2bc3-46a0-839d-21250674be6d" status: 202 len: 0 microversion: 2.20 time: 0.489364 Oct 12 09:03:20.565325 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2119/4618] 10.222.0.40 () {60 vars in 1457 bytes} [Wed Oct 12 09:03:20 2022] DELETE /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/os-volume_attachments/6d9c9b24-2bc3-46a0-839d-21250674be6d => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:03:20.590330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:20.591002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:20.605624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:20.606474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:20.609723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:20.610680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:20.611385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:20.611972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:20.660396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:20.661328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:20.669540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:20.676946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:20.677637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:20.680659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:20.681311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:20.681999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:20.813751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127007) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 12 09:03:20.956645 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8cee79a6-01d5-4cca-a47f-de93272693bf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "POST /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/action" status: 202 len: 0 microversion: 2.20 time: 0.295367 Oct 12 09:03:20.962593 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2120/4619] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 09:03:20 2022] POST /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:03:20.978780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:20.979411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:21.007192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:21.008679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:21.010037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:21.013659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:21.014362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:21.016280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:21.153321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:21.183747 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b012350-714c-4c22-9849-8b7ce7924f10 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.596949 Oct 12 09:03:21.188057 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2500/4620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:20 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:21.194451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:21.195324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:21.204528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:21.205360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:21.205921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:21.206933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:21.207559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:21.207996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:21.549473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:21.558867 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1fc309be-c1a0-43a9-a3c1-ed20a6c40bd1 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 0.368938 Oct 12 09:03:21.559858 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2501/4621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:21 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:21.560557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:21.572938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:21.574423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:21.575639 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-705d8bd9-4079-4dad-9c58-698e9c7ff430 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1673 microversion: 2.20 time: 0.609136 Oct 12 09:03:21.576208 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2121/4622] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:20 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1673 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:22.215897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:22.216527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:22.237619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:22.239650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:22.240762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:22.243547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:22.247395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:22.248036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:22.512405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:22.528721 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b4388f9-8556-474c-9849-d0e3e275b44c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.320468 Oct 12 09:03:22.529534 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2502/4623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:22 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:22.585057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:22.586785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:22.606149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:22.606763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:22.615307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:22.615878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:22.616317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:22.617031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:22.617510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:22.617940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:22.621955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:22.622456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:22.622898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:22.623853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:22.624741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:22.625383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:22.838489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:22.878416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:22.884057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:22.886135 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f8be9490-14f8-4995-9c5f-366a5f6a696c tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1673 microversion: 2.20 time: 0.284308 Oct 12 09:03:22.890286 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2503/4624] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:22 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1673 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:03:22.912950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:22.921957 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-96b1729d-cdf7-4ba3-b28d-bb2cbd0a09c0 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 0.341464 Oct 12 09:03:22.928326 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2122/4625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:22 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:23.560985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:23.561698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:23.575241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:23.576038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:23.576552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:23.578428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:23.578902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:23.579706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:23.585736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:23.919710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:23.920354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:23.936987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:23.937417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:23.938050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:23.943127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:23.946301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:23.946961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:24.200707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:24.209417 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b39d347a-cc97-4083-bf66-df645c3bda9d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.658675 Oct 12 09:03:24.214887 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2504/4626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:23 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:24.229205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:24.229858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:24.242537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:24.243267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:24.243891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:24.244778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:24.245388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:24.245990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:24.456580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:24.466303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:24.468718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:24.472093 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc13c02c-5a8d-4410-8509-b543b607d2c4 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.556291 Oct 12 09:03:24.473364 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2123/4627] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:23 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:03:24.581192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:24.590251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a1af437-0543-47a3-acd8-f21792833b27 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 0.374086 Oct 12 09:03:24.590856 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2505/4628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:24 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:24.975200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f48c5ed1-bd17-492f-8674-1e38237f4877 req-e9a1b666-fa72-4eae-9091-62a18342e8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173b4809-6abe-413a-bbe2-217b8718c4e5", "tag": "ab36e1ae-f07f-41d7-84d8-7d73c7956ffc"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:24.996650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f48c5ed1-bd17-492f-8674-1e38237f4877 req-e9a1b666-fa72-4eae-9091-62a18342e8b4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:24.997236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f48c5ed1-bd17-492f-8674-1e38237f4877 req-e9a1b666-fa72-4eae-9091-62a18342e8b4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:25.000836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f48c5ed1-bd17-492f-8674-1e38237f4877 req-e9a1b666-fa72-4eae-9091-62a18342e8b4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:25.035116 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f48c5ed1-bd17-492f-8674-1e38237f4877 req-e9a1b666-fa72-4eae-9091-62a18342e8b4 service nova] Creating event network-changed:ab36e1ae-f07f-41d7-84d8-7d73c7956ffc for instance 173b4809-6abe-413a-bbe2-217b8718c4e5 on n-h1-858383-10 Oct 12 09:03:25.041965 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f48c5ed1-bd17-492f-8674-1e38237f4877 req-e9a1b666-fa72-4eae-9091-62a18342e8b4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070493 Oct 12 09:03:25.043305 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2124/4629] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:25.239703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:25.240542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:25.254155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:25.257231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:25.258033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:25.258926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:25.259403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:25.259844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:25.504121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:25.505789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:25.512142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:25.516641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:25.517492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:25.518221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:25.519252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:25.520161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:25.520844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:25.650548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:25.662680 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-91afeda7-e461-470d-9f33-b7adf35d10e3 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.426912 Oct 12 09:03:25.667176 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2506/4630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:25 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:25.688482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:25.689603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:25.710418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:25.711745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:25.712364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:25.715823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:25.716772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:25.717378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:25.946276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:25.963702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:25.966077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:25.970672 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9bbddd85-db46-4cc7-b44a-b32bee1c0dfb tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.474087 Oct 12 09:03:25.980108 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2125/4631] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:25 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:26.013887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:26.024289 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9bb81c2b-3328-4f76-852d-d57e275a26a4 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 0.355694 Oct 12 09:03:26.034091 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2507/4632] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:25 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:26.691462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:26.692541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:26.703863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:26.705781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:26.706494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:26.707741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:26.710227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:26.710962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:26.998324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:26.999235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:27.015018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:27.015523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:27.015973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:27.019709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:27.023813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:27.033802 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b933d05-4fdb-4f4b-a845-d7bd1a0de29a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.346314 Oct 12 09:03:27.034763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:27.036206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:27.044769 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2126/4633] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:26 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:27.066480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:27.067264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:27.080141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:27.082918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:27.084046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:27.089226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:27.090051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:27.090779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:27.634262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:27.644361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:27.667119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:27.668617 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae783c0e-3bbd-4baa-9994-a4f462f667d8 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.674618 Oct 12 09:03:27.677711 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2508/4634] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:26 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:03:27.738468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:27.747203 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1352cb4-80fc-4a14-9d26-369d61de174f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 0.691974 Oct 12 09:03:27.757815 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2127/4635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:27 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:28.071928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:28.072562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:28.093241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:28.093800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:28.094260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:28.095032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:28.106416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:28.107058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:28.702324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:28.704465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:28.717538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:28.718271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:28.720594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:28.721712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:28.722567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:28.723294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:29.286353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:29.297127 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-11630115-7710-42d3-bdea-dacefc0946d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 1.230098 Oct 12 09:03:29.321923 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2509/4636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:28 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:29.351801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:29.354584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:29.381857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:29.383219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:29.386089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:29.388828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:29.390659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:29.393676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:30.269261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:30.289326 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1eb31a82-2592-44b1-9198-92076523e892 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 0.954403 Oct 12 09:03:30.298822 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2510/4637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:29 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:30.329021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:30.329762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:30.350512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:30.354058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:30.356317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:30.359191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:30.364314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:30.366311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:30.368947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:30.390606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:30.395003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:30.396542 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1bba9fc3-be39-4361-9c15-1b369f63786e tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 1.698476 Oct 12 09:03:30.434677 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2128/4638] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:28 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:03:30.969861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:30.980893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12cd319c-1f89-4f6b-b4f6-770057bd5992 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.656837 Oct 12 09:03:30.981565 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2511/4639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:30 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:31.321962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:31.322575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:31.356562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:31.357061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:31.357533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:31.358292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:31.368257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:31.373411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:31.431208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:31.432152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:31.450276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:31.451581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:31.452554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:31.454688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:31.455648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:31.457380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:31.898928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:31.922130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:31.925364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:31.927169 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4580aefe-b485-4a94-aaf1-1236c7052b98 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.501518 Oct 12 09:03:31.942742 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2512/4640] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:31 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:31.947558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4b581c3f-22d9-418f-bff4-2edda048df5d req-617b1337-97cf-4a22-90ed-dfb077a67a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8422525-d110-47bc-be86-de1169d34c4a", "name": "network-vif-plugged", "status": "completed", "tag": "5fadc5f1-a4f3-4431-8831-7fd555a73468"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:31.972457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4b581c3f-22d9-418f-bff4-2edda048df5d req-617b1337-97cf-4a22-90ed-dfb077a67a80 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:31.972941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4b581c3f-22d9-418f-bff4-2edda048df5d req-617b1337-97cf-4a22-90ed-dfb077a67a80 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:31.973365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4b581c3f-22d9-418f-bff4-2edda048df5d req-617b1337-97cf-4a22-90ed-dfb077a67a80 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:32.011387 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4b581c3f-22d9-418f-bff4-2edda048df5d req-617b1337-97cf-4a22-90ed-dfb077a67a80 service nova] Creating event network-vif-plugged:5fadc5f1-a4f3-4431-8831-7fd555a73468 for instance e8422525-d110-47bc-be86-de1169d34c4a on n-h2-858383-10 Oct 12 09:03:32.027041 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4b581c3f-22d9-418f-bff4-2edda048df5d req-617b1337-97cf-4a22-90ed-dfb077a67a80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085122 Oct 12 09:03:32.029182 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2513/4641] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:32.044370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:32.049293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:32.064583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:32.066915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:32.067364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:32.070251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:32.072758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:32.073352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:32.516749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:32.540543 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9daa7519-d735-4259-85d0-3a1cad89fe5b tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 1.221379 Oct 12 09:03:32.547475 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2129/4642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:31 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:32.957882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:32.958792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:32.975693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:32.977286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:32.978779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:32.981620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:32.982906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:32.983875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:33.224505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:33.236413 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6e6a651-3c92-4ecd-b6fe-e5c1441a583f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 1.205835 Oct 12 09:03:33.240255 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2514/4643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:32 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:33.575497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:33.576382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:33.596319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:33.598921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:33.599557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:33.605978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:33.606530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:33.612208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:33.772505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:33.794206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:33.795993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:33.808929 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7df35dd5-657a-4e8d-8f57-f94a2fbcd103 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.854373 Oct 12 09:03:33.812723 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2130/4644] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:32 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:34.285337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:34.286864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:34.306775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:34.308980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:34.319476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:34.325483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:34.328561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:34.329925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:34.352720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:34.630255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:34.641682 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cef346db-96a2-4444-bdc3-c5dc58320278 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1294 microversion: 2.1 time: 1.071183 Oct 12 09:03:34.649021 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2515/4645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:33 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1294 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:34.842611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:34.843514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:34.856397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:34.859217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:34.864607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:34.870591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:34.874778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:34.876523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:35.597413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:35.612966 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac58eee7-b172-4df4-90d2-936ff7463c2a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 1.337318 Oct 12 09:03:35.629460 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2131/4646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:34 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:35.671578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:35.672300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:35.688307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:35.688926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:35.689410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:35.690326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:35.697060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:35.697597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:35.896819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:35.929500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:35.935807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:35.940279 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8691a9e2-0e76-4dfb-99f7-17f5c2138874 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 1.103116 Oct 12 09:03:35.944185 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2516/4647] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:34 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:36.648266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:36.649349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:36.670467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:36.670992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:36.673172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:36.675741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:36.676766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:36.678641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:36.894678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:36.935476 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c150e90-6b2c-4671-8a00-c8f4c47dd384 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1485 microversion: 2.1 time: 1.268173 Oct 12 09:03:36.938542 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2132/4648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:35 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1485 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:36.963060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:36.963920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:36.980889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:36.982902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:36.986345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:36.987840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:36.989873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:36.990701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:37.080938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:37.090608 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8335a135-ff94-47a8-8df2-ce73e50e169c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.450585 Oct 12 09:03:37.097034 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2517/4649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:36 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:37.113709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:37.114670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:37.130047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:37.130926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:37.131386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:37.132125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:37.136730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:37.137523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:37.276892 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10e33c5e-8c2a-437a-9a78-0d301395645f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.322431 Oct 12 09:03:37.277548 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2133/4650] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:03:36 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a/os-interface => generated 284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:37.433392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:37.446132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:37.449007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:37.450784 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-63d66e71-8a12-4f47-9799-fd55d7c9c0b3 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.351843 Oct 12 09:03:37.465974 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2518/4651] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:37 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:38.124305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:38.125834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:38.138297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:38.143631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-317372624", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:38.151984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:38.154429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:38.155487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:38.157705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:38.158445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:38.268336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] validate_networks() for [('fdcadb9c-b3a5-47b9-9dc4-a7aa968839ce', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:03:38.422327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:38.436264 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57dde9a2-f031-4682-b4e6-49f57fe4843e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.314381 Oct 12 09:03:38.437424 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2519/4652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:38 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:38.482884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:38.483726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:38.499123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:38.500611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:38.502741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:38.504350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:38.508645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:38.509102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:38.845399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:38.857285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:38.875793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:38.886946 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5dd36de0-c7e4-4bc6-a2b5-dfa033684ad5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.399955 Oct 12 09:03:38.910518 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2520/4653] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:38 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:39.462289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:39.463975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:39.481873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:39.484779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:39.485998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:39.492494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:39.493157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:39.493947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:39.574923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:40.323416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:40.339748 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b7fec736-de4f-4f13-b64f-6347174ce19e tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.880574 Oct 12 09:03:40.343240 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2521/4654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:39 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:40.376738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:40.381570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:40.419736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:40.420452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:40.423796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:40.429829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:40.434795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:40.435620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:40.913539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:40.941550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:40.943530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:40.945007 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2bab158f-32b3-47fb-9323-f0e95553c809 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.599521 Oct 12 09:03:40.959638 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2522/4655] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:40 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:41.370249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:41.370874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:41.382970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:41.383482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:41.386216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:41.387684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:41.388091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:41.388536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:41.651843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:03:41.652416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:03:41.652804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:03:41.653219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:03:41.654415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:03:41.679203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:41.679610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:41.685124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:41.690936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:41.693096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:41.693980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:41.742788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:41.751546 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-563ce40d-a8ea-4005-bb93-9213937b8afb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.385790 Oct 12 09:03:41.752531 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2523/4656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:41 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:41.765490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Getting quotas for project 4d50dff5e638459c9776ffc01c813b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:03:41.772113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Getting quotas for user 884b8a3752594dfeb0d546c73a843481 and project 4d50dff5e638459c9776ffc01c813b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:03:41.789327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:03:41.791961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:03:41.887153 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-22d92b76-e5f4-403e-b723-88f0e84bae2b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.293172 Oct 12 09:03:41.887828 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2134/4657] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:03:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 4295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:03:41.899163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55b1fc45-0693-46bc-bee3-079462db5068 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:41.900134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-55b1fc45-0693-46bc-bee3-079462db5068 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:41.988967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:41.989611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:42.002462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:42.008147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:42.015780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:42.016726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:42.018161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:42.020696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:42.045668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-55b1fc45-0693-46bc-bee3-079462db5068 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:42.054437 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55b1fc45-0693-46bc-bee3-079462db5068 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1221 microversion: 2.1 time: 0.158965 Oct 12 09:03:42.056705 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2524/4658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:41 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1221 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:42.380493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-568886497", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:42.521846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] validate_networks() for [('fdcadb9c-b3a5-47b9-9dc4-a7aa968839ce', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:03:42.671823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:42.682099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:42.683861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:42.685246 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cdd7f6bb-148a-426a-93b7-ce325edb4dbf tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.702104 Oct 12 09:03:42.709348 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2135/4659] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:41 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:03:42.776514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:42.777707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:42.787266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:42.791476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:42.792098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:42.793028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:42.793996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:42.795175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:43.401953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:43.410460 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e563cb2b-0583-45c3-8491-533b6e598996 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1506 microversion: 2.1 time: 0.638262 Oct 12 09:03:43.411118 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2136/4660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:42 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:43.471516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:43.472601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:43.484765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:43.485423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:43.486663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:43.487727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:43.488410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:43.488999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:43.756325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:43.775105 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-af5f3218-b687-441d-a339-fc6751737555 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1485 microversion: 2.1 time: 0.308107 Oct 12 09:03:43.780929 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2137/4661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:43 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1485 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:43.802094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-21fec956-803c-44a9-88b4-ce721b20a523 req-82d28e0f-bc4c-485e-98ef-4367cf988185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8422525-d110-47bc-be86-de1169d34c4a", "tag": "5fadc5f1-a4f3-4431-8831-7fd555a73468"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:43.825019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-21fec956-803c-44a9-88b4-ce721b20a523 req-82d28e0f-bc4c-485e-98ef-4367cf988185 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:43.826351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-21fec956-803c-44a9-88b4-ce721b20a523 req-82d28e0f-bc4c-485e-98ef-4367cf988185 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:43.828629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-21fec956-803c-44a9-88b4-ce721b20a523 req-82d28e0f-bc4c-485e-98ef-4367cf988185 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:43.864867 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-21fec956-803c-44a9-88b4-ce721b20a523 req-82d28e0f-bc4c-485e-98ef-4367cf988185 service nova] Creating event network-changed:5fadc5f1-a4f3-4431-8831-7fd555a73468 for instance e8422525-d110-47bc-be86-de1169d34c4a on n-h2-858383-10 Oct 12 09:03:43.878889 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-21fec956-803c-44a9-88b4-ce721b20a523 req-82d28e0f-bc4c-485e-98ef-4367cf988185 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095285 Oct 12 09:03:43.880193 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2138/4662] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:43.905819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:43.907548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:43.930003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:43.932086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:43.947149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:43.948418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:43.953003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:43.953703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:44.136672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:03:44.137807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:03:44.138511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:03:44.139126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:03:44.139692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:03:44.161646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:44.163784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:44.164616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:44.167343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:44.170524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:44.172409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:44.234859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Getting quotas for project 4d50dff5e638459c9776ffc01c813b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:03:44.252942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Getting quotas for user 884b8a3752594dfeb0d546c73a843481 and project 4d50dff5e638459c9776ffc01c813b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:03:44.274630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:03:44.281242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:03:44.420621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6231d9c0-fb6d-4fc4-b0c8-be3928020129 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.043234 Oct 12 09:03:44.427718 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2525/4663] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:03:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:03:44.447099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57f7a82d-57b3-4e54-ae4b-da8f136d99e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:44.447765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57f7a82d-57b3-4e54-ae4b-da8f136d99e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:44.646063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-57f7a82d-57b3-4e54-ae4b-da8f136d99e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:44.656235 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57f7a82d-57b3-4e54-ae4b-da8f136d99e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1221 microversion: 2.1 time: 0.227159 Oct 12 09:03:44.659609 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2526/4664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:44 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:44.670483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:44.678815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:44.706949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:44.708111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:44.708566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:44.709298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:44.709794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:44.710265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:45.123995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:45.142170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:45.145824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:45.156924 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-696fc537-b361-4a7c-a04c-122244bb7fe5 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 1.273000 Oct 12 09:03:45.159370 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2139/4665] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:43 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:45.467786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:45.482504 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eac8bad7-a8af-4dab-b001-eb4eb7931e81 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1486 microversion: 2.1 time: 0.821412 Oct 12 09:03:45.485888 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2527/4666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:44 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1486 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:45.686754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:45.687772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:45.713550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:45.715479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:45.717340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:45.721274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:45.722066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:45.723610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:45.737035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-932556257", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:45.864113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] validate_networks() for [('805813d2-9614-4738-98bc-b4e5f97168b1', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:03:46.063949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:46.091083 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a3a94de-4ae9-4037-b62f-88cf57e12035 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1217 microversion: 2.1 time: 0.408507 Oct 12 09:03:46.112990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2140/4667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:45 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1217 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:46.199898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:46.201428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:46.208949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:46.217658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:46.220807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:46.227834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:46.228479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:46.229560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:47.143664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:47.159221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:47.160932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:47.165499 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc7a2018-c8ff-4982-9519-5adf89995741 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.976540 Oct 12 09:03:47.166112 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2141/4668] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:46 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:03:47.201385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:47.202061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:47.214660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:47.215688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:47.216300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:47.221941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:47.223041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:47.224785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:47.358481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:47.379361 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77531d04-69b6-45f4-a9bb-58e65239e5ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1279 microversion: 2.1 time: 0.190268 Oct 12 09:03:47.381244 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2142/4669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:47 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:48.028908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:03:48.029562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:03:48.029905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:03:48.030322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:03:48.030742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:03:48.036277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:48.055963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:48.059411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:48.060469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:48.066535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:48.067975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:48.070694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:48.127215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Getting quotas for project c5a68c868837469d98b40b8dcb1ced96. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:03:48.143392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Getting quotas for user 603b71590bed4464a543c3f510301c46 and project c5a68c868837469d98b40b8dcb1ced96. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:03:48.192924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:48.193707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:48.195185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:03:48.199238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:03:48.216898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:48.217454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:48.217911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:48.228568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:48.229509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:48.232394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:48.301118 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3e293424-97d7-494d-872f-754e90ebfe69 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.568830 Oct 12 09:03:48.306066 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2528/4670] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:03:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:03:48.316717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-465bcea3-dcb4-4fca-b462-a51e9dbd51fb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:48.317770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-465bcea3-dcb4-4fca-b462-a51e9dbd51fb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:48.563366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-465bcea3-dcb4-4fca-b462-a51e9dbd51fb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:48.572086 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-465bcea3-dcb4-4fca-b462-a51e9dbd51fb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1213 microversion: 2.1 time: 0.259818 Oct 12 09:03:48.574812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2529/4671] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:48 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1213 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:48.588688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:48.589798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:48.617374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:48.617959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:48.618409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:48.619138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:48.619598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:48.620079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:49.169787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:49.179421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f722db9e-ea9b-4474-985d-d68170f222b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.602861 Oct 12 09:03:49.194999 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2530/4672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:48 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:49.358121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cc6be4a5-91c6-4b9c-94f1-d84d341cadb8 req-89d6eb4e-73f6-44fc-9065-08edaef851ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173b4809-6abe-413a-bbe2-217b8718c4e5", "name": "network-vif-plugged", "status": "completed", "tag": "ab36e1ae-f07f-41d7-84d8-7d73c7956ffc"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:49.385455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cc6be4a5-91c6-4b9c-94f1-d84d341cadb8 req-89d6eb4e-73f6-44fc-9065-08edaef851ad service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:49.387042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cc6be4a5-91c6-4b9c-94f1-d84d341cadb8 req-89d6eb4e-73f6-44fc-9065-08edaef851ad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:49.388539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cc6be4a5-91c6-4b9c-94f1-d84d341cadb8 req-89d6eb4e-73f6-44fc-9065-08edaef851ad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:49.452980 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cc6be4a5-91c6-4b9c-94f1-d84d341cadb8 req-89d6eb4e-73f6-44fc-9065-08edaef851ad service nova] Creating event network-vif-plugged:ab36e1ae-f07f-41d7-84d8-7d73c7956ffc for instance 173b4809-6abe-413a-bbe2-217b8718c4e5 on n-h1-858383-10 Oct 12 09:03:49.470178 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cc6be4a5-91c6-4b9c-94f1-d84d341cadb8 req-89d6eb4e-73f6-44fc-9065-08edaef851ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116886 Oct 12 09:03:49.473615 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2531/4673] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:49.601347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:49.602149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:49.634833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:49.638897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:49.639304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:49.642041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:49.644311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:49.645203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:49.873625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:49.901785 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bdb153f7-2906-49db-a38a-11d950f501da tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1209 microversion: 2.1 time: 0.302125 Oct 12 09:03:49.926027 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2532/4674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:49 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1209 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:50.040208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:50.076656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:50.078656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:50.087134 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-074ba548-f519-4448-b6ee-264259c2cd2b tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 1.898081 Oct 12 09:03:50.108248 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2143/4675] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:48 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:50.202048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:50.202599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:50.220220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:50.220723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:50.228689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:50.229668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:50.230170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:50.230621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:50.281129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-65698e51-12d4-4f0b-9066-c16524f3d417 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Action: 'create', calling method: .version_select at 0x7f9843f6e280>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:50.350705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-65698e51-12d4-4f0b-9066-c16524f3d417 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Getting quotas for project 2e6fb6520e20485d8389beb9110f6ec9. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:03:50.372328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-65698e51-12d4-4f0b-9066-c16524f3d417 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Getting quotas for user 8097c056a5bd490bacf047102cb7721e and project 2e6fb6520e20485d8389beb9110f6ec9. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:03:50.605347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-65698e51-12d4-4f0b-9066-c16524f3d417 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Getting quotas for project 2e6fb6520e20485d8389beb9110f6ec9. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:03:50.625777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-65698e51-12d4-4f0b-9066-c16524f3d417 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Getting quotas for user 8097c056a5bd490bacf047102cb7721e and project 2e6fb6520e20485d8389beb9110f6ec9. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:03:50.669283 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-65698e51-12d4-4f0b-9066-c16524f3d417 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.733793 Oct 12 09:03:50.678068 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2533/4676] 10.222.0.40 () {62 vars in 1214 bytes} [Wed Oct 12 09:03:49 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:03:50.689012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:50.704032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:50.704799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Searching by: {'deleted': False, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:03:50.721697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:50.722204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:50.722657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:50.723406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:50.723867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:50.724298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:50.807023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:03:50.905855 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b21b2c66-ffc3-4ad9-bd47-765d1271262b tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.224178 Oct 12 09:03:50.921601 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2534/4677] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:03:50 2022] GET /compute/v2.1/servers => generated 333 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:50.933166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f5037f4-f432-45ed-b9c7-3f87eb2eb9f9 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:50.960578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f5037f4-f432-45ed-b9c7-3f87eb2eb9f9 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.037647 Oct 12 09:03:50.961723 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2535/4678] 10.222.0.40 () {60 vars in 1193 bytes} [Wed Oct 12 09:03:50 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:03:50.967524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:50.974440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:50.975821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Searching by: {'deleted': False, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:03:50.981919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:50.982564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:50.983154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:50.984666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:50.985903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:50.986494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:51.137144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:03:51.157875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:51.170987 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e36ecb79-5648-4343-a2b6-10d82e775052 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.973030 Oct 12 09:03:51.175745 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2144/4679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:50 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:51.180854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:51.184183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:51.222815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:51.224270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:51.225924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:51.227176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:51.229397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:51.232721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:51.348099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:51.363562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:51.365897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:51.366390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:51.592867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:51.601429 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4649fda4-40e9-4d55-8523-c1f9a9e5e54f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1271 microversion: 2.1 time: 0.424303 Oct 12 09:03:51.605238 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2145/4680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:51 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1271 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:51.619664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ccca5654-394c-49d0-8bf7-a4f4c35d8a1c tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:51.640062 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ccca5654-394c-49d0-8bf7-a4f4c35d8a1c tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/99359329-6f54-433e-9b9b-c27f24a015e3" status: 200 len: 235 microversion: 2.64 time: 0.033510 Oct 12 09:03:51.641665 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2146/4681] 10.222.0.40 () {60 vars in 1304 bytes} [Wed Oct 12 09:03:51 2022] GET /compute/v2.1/os-server-groups/99359329-6f54-433e-9b9b-c27f24a015e3 => generated 235 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:03:51.652253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:51.652872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:51.667018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:51.667514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:51.667954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:51.668663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:51.669112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:51.669611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:51.682968 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f49d0c0d-a985-4163-9ff6-05ee060e0eb7 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.719777 Oct 12 09:03:51.683575 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2536/4682] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:03:50 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:51.711353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ab02bca-a68a-4ecf-8073-93a3ce5440e0 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:51.736233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:51.781121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:51.796776 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ab02bca-a68a-4ecf-8073-93a3ce5440e0 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/99359329-6f54-433e-9b9b-c27f24a015e3" status: 204 len: 0 microversion: 2.64 time: 0.093082 Oct 12 09:03:51.797597 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2537/4683] 10.222.0.40 () {60 vars in 1307 bytes} [Wed Oct 12 09:03:51 2022] DELETE /compute/v2.1/os-server-groups/99359329-6f54-433e-9b9b-c27f24a015e3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:03:51.808846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2573d320-447c-43d2-97dd-e7b99238e190 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:51.828075 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2573d320-447c-43d2-97dd-e7b99238e190 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021252 Oct 12 09:03:51.828724 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2538/4684] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:03:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:51.849618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7de12deb-71cb-4930-b4b6-b35e3ef01ab8 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:51.869459 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7de12deb-71cb-4930-b4b6-b35e3ef01ab8 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] HTTP exception thrown: Instance group 99359329-6f54-433e-9b9b-c27f24a015e3 could not be found. Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7de12deb-71cb-4930-b4b6-b35e3ef01ab8 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Request method failure captured: Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-server-groups/99359329-6f54-433e-9b9b-c27f24a015e3 HTTP/1.1 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoL1PMHYxmtJpqeXGTDZF4-Jt9eQnLu21i7ZSzO_46eDt-hlR9fWbGk30ntx2EW6TSVoAkx-dvJaX4TOvEBh1qgRZ-Loqbhm1N3HXDltq_Ky1J0BG_m0egLAxTDRl-dN7MpMt-yX-FlaxS9JzPbPT5azCxt3PyI6sYPVXqR7lJVp6PI Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.64 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2e6fb6520e20485d8389beb9110f6ec9 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerGroup264TestJSON-125310870 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e6fb6520e20485d8389beb9110f6ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e6fb6520e20485d8389beb9110f6ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e6fb6520e20485d8389beb9110f6ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e6fb6520e20485d8389beb9110f6ec9"}]}] Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerGroup264TestJSON-125310870 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2e6fb6520e20485d8389beb9110f6ec9 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerGroup264TestJSON-125310870 Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerGroup264TestJSON-125310870-project Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 8097c056a5bd490bacf047102cb7721e Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerGroup264TestJSON-125310870-project Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance group 99359329-6f54-433e-9b9b-c27f24a015e3 could not be found. Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '99359329-6f54-433e-9b9b-c27f24a015e3'} Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 99359329-6f54-433e-9b9b-c27f24a015e3 could not be found. Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 99359329-6f54-433e-9b9b-c27f24a015e3 could not be found. Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:51.880125 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:51.883953 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:03:51.883953 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:03:51.883953 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:03:51.883953 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:03:51.883953 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 99359329-6f54-433e-9b9b-c27f24a015e3 could not be found. Oct 12 09:03:51.883953 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:51.891410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7de12deb-71cb-4930-b4b6-b35e3ef01ab8 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] Returning 404 to user: Instance group 99359329-6f54-433e-9b9b-c27f24a015e3 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:03:51.892650 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7de12deb-71cb-4930-b4b6-b35e3ef01ab8 tempest-ServerGroup264TestJSON-125310870 tempest-ServerGroup264TestJSON-125310870-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/99359329-6f54-433e-9b9b-c27f24a015e3" status: 404 len: 117 microversion: 2.64 time: 0.053583 Oct 12 09:03:51.893350 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2539/4685] 10.222.0.40 () {60 vars in 1307 bytes} [Wed Oct 12 09:03:51 2022] DELETE /compute/v2.1/os-server-groups/99359329-6f54-433e-9b9b-c27f24a015e3 => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:03:52.128630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:52.130237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:52.139905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:52.140639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:52.141525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:52.143320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:52.144144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:52.144761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:52.202640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:03:52.273092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:52.302450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:52.310559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:52.311918 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d17f29ea-3cf3-4478-bbf5-cbb83ffdfe31 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.668667 Oct 12 09:03:52.313159 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2147/4686] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:51 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:52.328219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:52.331009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:52.348724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:52.353830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:52.354537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:52.357899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:52.359176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:52.359775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:52.487925 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d454e65-19c9-4467-9d75-bae6ea669d1d tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 204 len: 0 microversion: 2.1 time: 0.364567 Oct 12 09:03:52.497614 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2540/4687] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:03:52 2022] DELETE /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:03:52.530426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6560719c-6253-4c51-ad39-23dba4771700 req-3aeb42fa-e3ca-469b-971c-5f3c033a0cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527f2061-c9c7-4dca-a23e-cecca8f2189b", "tag": "5b4ea9b8-e2ea-4552-9336-0b2d64292ac6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:52.563948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6560719c-6253-4c51-ad39-23dba4771700 req-3aeb42fa-e3ca-469b-971c-5f3c033a0cd1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:52.567602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6560719c-6253-4c51-ad39-23dba4771700 req-3aeb42fa-e3ca-469b-971c-5f3c033a0cd1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:52.568157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6560719c-6253-4c51-ad39-23dba4771700 req-3aeb42fa-e3ca-469b-971c-5f3c033a0cd1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:52.599982 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6560719c-6253-4c51-ad39-23dba4771700 req-3aeb42fa-e3ca-469b-971c-5f3c033a0cd1 service nova] Creating event network-changed:5b4ea9b8-e2ea-4552-9336-0b2d64292ac6 for instance 527f2061-c9c7-4dca-a23e-cecca8f2189b on n-h1-858383-10 Oct 12 09:03:52.610323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6560719c-6253-4c51-ad39-23dba4771700 req-3aeb42fa-e3ca-469b-971c-5f3c033a0cd1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107037 Oct 12 09:03:52.612003 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2541/4688] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:52.617397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:52.618699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:52.626577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:52.627393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:52.628041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:52.628958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:52.629703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:52.630978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:52.972862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:52.987226 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3a80229-245d-4558-917e-077513576f13 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1700 microversion: 2.1 time: 0.373765 Oct 12 09:03:52.987818 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2542/4689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:52 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1700 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:52.998755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:52.999540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:53.013885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:53.014278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:53.014724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:53.021480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:53.022026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:53.024917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:53.198302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:53.203081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:53.223701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1eb42117-5893-46ed-9374-a8429805773c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1271 microversion: 2.1 time: 0.231818 Oct 12 09:03:53.224962 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2543/4690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:52 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:53.225163 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f274502e-2ffa-42c6-ac36-52271795e54f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.893338 Oct 12 09:03:53.226130 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2148/4691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:52 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:53.342184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:53.343165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:53.352052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:53.356281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:53.357126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:53.359788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:53.360499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:53.361787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:54.011014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:54.011637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:54.029627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:54.030462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:54.030903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:54.031620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:54.032092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:54.032504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:54.110770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:54.125293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:54.126814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:54.145058 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6748878a-6cc3-4f89-ad9b-ea7dd1026e7a tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1731 microversion: 2.20 time: 0.807213 Oct 12 09:03:54.145702 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2544/4692] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:53 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1731 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:03:54.254145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:54.254770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:54.261966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:54.262671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:54.263499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:54.265209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:54.266687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:54.267273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:54.815293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:54.830262 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-604c4eba-90fc-4270-8126-fb9a82e26451 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1313 microversion: 2.1 time: 0.586958 Oct 12 09:03:54.833003 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2545/4693] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:54 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:54.864436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:54.867968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:54.886719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:54.889884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:54.890644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:54.894010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:54.896251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:54.897289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:54.900743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:54.922461 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-517de6b1-0b6f-400f-8a03-a1a066a1f8fc tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1700 microversion: 2.1 time: 0.914553 Oct 12 09:03:54.926044 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2149/4694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:54 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1700 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:54.942177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8f1d4faa-8e7a-4090-9b86-cf0c497330c8 req-e400ec28-32bf-4f54-8421-c84f069e3f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94489241-3250-4449-8a11-25e5b88bc41e", "tag": "5720f721-2c6e-4882-bcc8-3efd0b063765"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:54.969662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8f1d4faa-8e7a-4090-9b86-cf0c497330c8 req-e400ec28-32bf-4f54-8421-c84f069e3f1c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:54.970522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8f1d4faa-8e7a-4090-9b86-cf0c497330c8 req-e400ec28-32bf-4f54-8421-c84f069e3f1c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:54.971523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8f1d4faa-8e7a-4090-9b86-cf0c497330c8 req-e400ec28-32bf-4f54-8421-c84f069e3f1c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:55.001783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:55.008180 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8f1d4faa-8e7a-4090-9b86-cf0c497330c8 req-e400ec28-32bf-4f54-8421-c84f069e3f1c service nova] Creating event network-changed:5720f721-2c6e-4882-bcc8-3efd0b063765 for instance 94489241-3250-4449-8a11-25e5b88bc41e on n-h1-858383-10 Oct 12 09:03:55.021205 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8f1d4faa-8e7a-4090-9b86-cf0c497330c8 req-e400ec28-32bf-4f54-8421-c84f069e3f1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092134 Oct 12 09:03:55.028104 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2150/4695] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:55.178321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:55.180381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:55.192571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:55.193072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:55.193539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:55.194250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:55.194700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:55.195124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:55.226609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:55.675126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:55.691421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e97e67be-9c2a-4873-b35f-0a6d0ef1dc14 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.856745 Oct 12 09:03:55.696690 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2546/4696] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:54 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:55.864003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:55.864636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:55.881227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:55.882438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:55.883054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:55.885132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:55.885993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:55.886606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:55.956866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:55.969098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:55.971214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:55.972900 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-adf4dfcd-c205-4a26-9833-1033f6101007 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1718 microversion: 2.20 time: 0.800373 Oct 12 09:03:55.974217 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2151/4697] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:03:55 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1718 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:03:55.980291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:55.980986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:55.983297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:55.988622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:55.989951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:55.990622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:55.991526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:55.992331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:55.992943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:56.646732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:56.663110 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-270fd9db-d28b-488d-bc24-4a52b1236263 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1700 microversion: 2.1 time: 0.686254 Oct 12 09:03:56.665810 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2152/4698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:55 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1700 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:56.735733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:56.741512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:56.743712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:56.760015 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d872ecf7-03bb-4b4e-92ac-1f68605c28b1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1313 microversion: 2.1 time: 0.897946 Oct 12 09:03:56.762023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:56.762607 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2547/4699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:55 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1313 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:56.763602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:56.764289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:56.765244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:56.766506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:56.767190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:57.197703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:57.209335 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c538dc31-3d43-4d63-bbf5-00ba42dc97d1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.489756 Oct 12 09:03:57.211753 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2153/4700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:56 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:03:57.447780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2ae3b1a5-adfd-443b-bfb6-bd0d10ae9a28 req-8c6e4729-3819-4d15-aa35-5313aed02c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad2d2c2-0b89-40fe-b065-c11ffebd7b4b", "tag": "80844db9-7f10-4ab3-b41b-c03d31b525ae"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:57.467933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2ae3b1a5-adfd-443b-bfb6-bd0d10ae9a28 req-8c6e4729-3819-4d15-aa35-5313aed02c61 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:57.468707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2ae3b1a5-adfd-443b-bfb6-bd0d10ae9a28 req-8c6e4729-3819-4d15-aa35-5313aed02c61 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:57.469497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2ae3b1a5-adfd-443b-bfb6-bd0d10ae9a28 req-8c6e4729-3819-4d15-aa35-5313aed02c61 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:57.492195 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-2ae3b1a5-adfd-443b-bfb6-bd0d10ae9a28 req-8c6e4729-3819-4d15-aa35-5313aed02c61 service nova] Creating event network-changed:80844db9-7f10-4ab3-b41b-c03d31b525ae for instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b on n-h2-858383-10 Oct 12 09:03:57.500175 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2ae3b1a5-adfd-443b-bfb6-bd0d10ae9a28 req-8c6e4729-3819-4d15-aa35-5313aed02c61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066382 Oct 12 09:03:57.501343 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2548/4701] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:57.596692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d3767838-55d2-430d-a365-7f4601f211d4 req-39919822-c59f-4ffc-8cd4-888b3e10be94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad075d6-c4f7-4b68-a7d2-711074a02789", "name": "network-vif-deleted", "tag": "16185c2d-6891-46f3-bc68-9c374c95eb70"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:03:57.640511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3767838-55d2-430d-a365-7f4601f211d4 req-39919822-c59f-4ffc-8cd4-888b3e10be94 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:57.642593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3767838-55d2-430d-a365-7f4601f211d4 req-39919822-c59f-4ffc-8cd4-888b3e10be94 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:57.645257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3767838-55d2-430d-a365-7f4601f211d4 req-39919822-c59f-4ffc-8cd4-888b3e10be94 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:57.686717 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d3767838-55d2-430d-a365-7f4601f211d4 req-39919822-c59f-4ffc-8cd4-888b3e10be94 service nova] Creating event network-vif-deleted:16185c2d-6891-46f3-bc68-9c374c95eb70 for instance cad075d6-c4f7-4b68-a7d2-711074a02789 on n-h1-858383-10 Oct 12 09:03:57.693327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:57.694201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:57.697680 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d3767838-55d2-430d-a365-7f4601f211d4 req-39919822-c59f-4ffc-8cd4-888b3e10be94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115867 Oct 12 09:03:57.701993 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2154/4702] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:03:57.709248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:57.712127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:57.713471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:57.715533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:57.716266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:57.718203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:57.788168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:57.790574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:57.819211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:57.822656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:57.823352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:57.828284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:57.828817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:57.829605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:57.965038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e3d7dd3a044e9c9ee7788b8a4d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4955f9999b0d4971bd23ea38ce3cce4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:57.983607 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e223cbeb-930f-406e-868b-2b3079cded25 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 200 len: 1632 microversion: 2.1 time: 0.294079 Oct 12 09:03:57.986323 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2549/4703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:57 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 1632 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:58.236535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:58.237378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:58.245172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:58.251651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:58.252086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:58.253016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:58.255257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:58.255781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:58.518378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:58.530374 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d96100a2-e6db-43ae-881f-71b46a563e96 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.298090 Oct 12 09:03:58.536843 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2550/4704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:58 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:59.017143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:59.018313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] [instance: cad075d6-c4f7-4b68-a7d2-711074a02789] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:59.029045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:03:59.041636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:59.042215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:59.045526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:59.046370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:59.046919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:59.047385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:59.082785 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] HTTP exception thrown: Instance cad075d6-c4f7-4b68-a7d2-711074a02789 could not be found. Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Request method failure captured: Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 HTTP/1.1 Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoKhgmRjnEpReOModlakD9M2oIsf3PPm__JwUx7y_rvKYVODbMghBBzC8MEecc5WCXATn6-CLSRIsZ2bzO5WRAX7rKudQjylqdGycSATfnqZpiiu2ZUQ3T0GGBbVFYuR5nlb4kZwDEuK62FkchSdqRvkGFtUsvpe1U8ooYgtiRPYQ1Q Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 4955f9999b0d4971bd23ea38ce3cce4b Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersTestJSON-46248554 Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "tempest-type-1746616875", "name": "tempest-service-624116081", "endpoints": [{"region": "tempest-region-1181435337", "publicURL": "https://url-1641787772.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4955f9999b0d4971bd23ea38ce3cce4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4955f9999b0d4971bd23ea38ce3cce4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4955f9999b0d4971bd23ea38ce3cce4b"}]}, {"type": "tempest-type-360516632", "name": "tempest-service-692459647", "endpoints": [{"region": "tempest-region-1240947380", "internalURL": "https://url-12900854.com"}]}, {"type": "tempest-type-1701208299", "name": "tempest-service-891750589", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4955f9999b0d4971bd23ea38ce3cce4b"}]}] Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersTestJSON-46248554 Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 4955f9999b0d4971bd23ea38ce3cce4b Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersTestJSON-46248554 Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersTestJSON-46248554-project Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 25e3d7dd3a044e9c9ee7788b8a4d7b6d Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersTestJSON-46248554-project Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance cad075d6-c4f7-4b68-a7d2-711074a02789 could not be found. Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'cad075d6-c4f7-4b68-a7d2-711074a02789'} Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad075d6-c4f7-4b68-a7d2-711074a02789 could not be found. Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:03:59.085742 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad075d6-c4f7-4b68-a7d2-711074a02789 could not be found. Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad075d6-c4f7-4b68-a7d2-711074a02789 could not be found. Oct 12 09:03:59.091135 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:03:59.094938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Returning 404 to user: Instance cad075d6-c4f7-4b68-a7d2-711074a02789 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:03:59.096759 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a091a8d-c5d6-4aa9-a861-07ffec486848 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789" status: 404 len: 111 microversion: 2.1 time: 0.087234 Oct 12 09:03:59.098986 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2551/4705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:59 2022] GET /compute/v2.1/servers/cad075d6-c4f7-4b68-a7d2-711074a02789 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:03:59.108419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b0b5da2-51cc-488e-89e9-d7fa1f1858b9 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] Calling method '.version_select at 0x7f98489544c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:59.139310 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b0b5da2-51cc-488e-89e9-d7fa1f1858b9 tempest-ServersTestJSON-46248554 tempest-ServersTestJSON-46248554-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-23360927" status: 202 len: 0 microversion: 2.1 time: 0.035508 Oct 12 09:03:59.145411 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2552/4706] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 12 09:03:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-23360927 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:03:59.464282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:59.476970 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4489a26a-67db-4e03-bdaf-f33df3c23b15 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1313 microversion: 2.1 time: 1.693517 Oct 12 09:03:59.478859 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2155/4707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:57 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1313 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:03:59.569268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:03:59.570189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:03:59.582208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:59.582819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:59.584166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:59.586241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:03:59.586778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:03:59.589804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:03:59.932541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:03:59.944794 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dbc77dd9-2b80-4816-93ac-480e492d9fbe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.387808 Oct 12 09:03:59.946533 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2553/4708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:03:59 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:00.504338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:00.505691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:00.515969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:00.518968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:00.519687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:00.520664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:00.521350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:00.521991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:00.903913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:00.917572 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5acc8518-790e-4fd9-86d2-4f83b1905d6f tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1313 microversion: 2.1 time: 0.415148 Oct 12 09:04:00.919481 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2156/4709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:00 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:00.981146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:00.984625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:00.998450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:00.999177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:00.999869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:01.001823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:01.002995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:01.004427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:01.049681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:01.298729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:01.339453 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-700b1b75-d3ef-4150-9afe-9c656324b7de tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.371827 Oct 12 09:04:01.340876 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2554/4710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:00 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:01.479114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f627f7b8-5ef5-40d8-b778-9010133f7ac1 req-8131d230-efc0-49e4-a1c3-33da9b6dae81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94489241-3250-4449-8a11-25e5b88bc41e", "name": "network-vif-plugged", "status": "completed", "tag": "5720f721-2c6e-4882-bcc8-3efd0b063765"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:01.501740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f627f7b8-5ef5-40d8-b778-9010133f7ac1 req-8131d230-efc0-49e4-a1c3-33da9b6dae81 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:01.502385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f627f7b8-5ef5-40d8-b778-9010133f7ac1 req-8131d230-efc0-49e4-a1c3-33da9b6dae81 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:01.502844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f627f7b8-5ef5-40d8-b778-9010133f7ac1 req-8131d230-efc0-49e4-a1c3-33da9b6dae81 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:01.535788 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f627f7b8-5ef5-40d8-b778-9010133f7ac1 req-8131d230-efc0-49e4-a1c3-33da9b6dae81 service nova] Creating event network-vif-plugged:5720f721-2c6e-4882-bcc8-3efd0b063765 for instance 94489241-3250-4449-8a11-25e5b88bc41e on n-h1-858383-10 Oct 12 09:04:01.551293 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f627f7b8-5ef5-40d8-b778-9010133f7ac1 req-8131d230-efc0-49e4-a1c3-33da9b6dae81 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076489 Oct 12 09:04:01.554004 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2157/4711] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:01.942727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:01.943952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:01.953030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=28 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:01.955158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:01.956193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:01.958079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:01.959153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:01.959759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:01.960464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:02.366658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:02.367562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:02.379419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:02.379922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:02.380387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:02.381115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:02.381634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:02.382082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:02.458643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:02.482180 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e4821166-7e0a-4599-8e65-e043ec05600a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1313 microversion: 2.1 time: 0.544080 Oct 12 09:04:02.506561 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2555/4712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:01 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:02.959487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:02.976861 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-020511bf-7095-41d2-bb46-f0395bd351e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1321 microversion: 2.1 time: 0.616122 Oct 12 09:04:03.008573 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2158/4713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:02 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1321 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:03.514448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:03.516461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:03.525017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:03.526701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:03.527404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:03.528367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:03.528988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:03.529750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:03.645480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b3a74aff-1484-4612-a709-a4439679be43 req-5256a894-3d1f-48a8-980d-9de016935f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527f2061-c9c7-4dca-a23e-cecca8f2189b", "name": "network-vif-plugged", "status": "completed", "tag": "5b4ea9b8-e2ea-4552-9336-0b2d64292ac6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:03.684789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b3a74aff-1484-4612-a709-a4439679be43 req-5256a894-3d1f-48a8-980d-9de016935f8a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:03.687468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b3a74aff-1484-4612-a709-a4439679be43 req-5256a894-3d1f-48a8-980d-9de016935f8a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:03.688085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b3a74aff-1484-4612-a709-a4439679be43 req-5256a894-3d1f-48a8-980d-9de016935f8a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:03.715673 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b3a74aff-1484-4612-a709-a4439679be43 req-5256a894-3d1f-48a8-980d-9de016935f8a service nova] Creating event network-vif-plugged:5b4ea9b8-e2ea-4552-9336-0b2d64292ac6 for instance 527f2061-c9c7-4dca-a23e-cecca8f2189b on n-h1-858383-10 Oct 12 09:04:03.725048 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b3a74aff-1484-4612-a709-a4439679be43 req-5256a894-3d1f-48a8-980d-9de016935f8a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083518 Oct 12 09:04:03.727607 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2159/4714] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:04:03.911266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:03.924845 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-87e09fed-cd3a-4c3f-99a7-07fc29018d49 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1313 microversion: 2.1 time: 0.415376 Oct 12 09:04:03.928503 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2556/4715] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:03 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:04.006657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:04.008461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:04.015519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:04.016397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:04.017091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:04.018175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:04.018948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:04.019488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:04.444699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:04.467852 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71c6d2f6-0617-41f7-9964-a1f016fd7f73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1515 microversion: 2.1 time: 0.463220 Oct 12 09:04:04.471017 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2160/4716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:04 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:04.496357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:04.499000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:04.506228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:04.506797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:04.507333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:04.508931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:04.509522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:04.510059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:04.592425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lazy-loading 'flavor' on Instance uuid 94489241-3250-4449-8a11-25e5b88bc41e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:04:04.767552 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78a0d469-4b65-4a3b-84db-d91b0631e9f7 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e/action" status: 200 len: 32 microversion: 2.1 time: 0.275769 Oct 12 09:04:04.775195 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2557/4717] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:04:04 2022] POST /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:04:04.781588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:04.782443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:04.804291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:04.808261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:04.809384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:04.811206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:04.815131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:04.816876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:04.952252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:04.953293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:04.968589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:04.971031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:04.973261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:04.974245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:04.975783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:04.977053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:05.345811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:05.354614 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58489938-f7d7-4eff-b4c1-682592d2dc35 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.578740 Oct 12 09:04:05.359645 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2161/4718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:04 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:05.805211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0e655133-e0ee-4e0d-850d-393a318cf933 req-4552ccab-2bd9-4d40-b085-00b558d0ffc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad2d2c2-0b89-40fe-b065-c11ffebd7b4b", "name": "network-vif-plugged", "status": "completed", "tag": "80844db9-7f10-4ab3-b41b-c03d31b525ae"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:05.806609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:05.815816 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2fa1561e-39bf-4964-a502-360b250d6b44 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1313 microversion: 2.1 time: 0.869074 Oct 12 09:04:05.821106 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2558/4719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:04 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1313 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:05.824958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e655133-e0ee-4e0d-850d-393a318cf933 req-4552ccab-2bd9-4d40-b085-00b558d0ffc2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:05.825468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e655133-e0ee-4e0d-850d-393a318cf933 req-4552ccab-2bd9-4d40-b085-00b558d0ffc2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:05.826950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0e655133-e0ee-4e0d-850d-393a318cf933 req-4552ccab-2bd9-4d40-b085-00b558d0ffc2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:05.864400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0e655133-e0ee-4e0d-850d-393a318cf933 req-4552ccab-2bd9-4d40-b085-00b558d0ffc2 service nova] Creating event network-vif-plugged:80844db9-7f10-4ab3-b41b-c03d31b525ae for instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b on n-h2-858383-10 Oct 12 09:04:05.873756 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0e655133-e0ee-4e0d-850d-393a318cf933 req-4552ccab-2bd9-4d40-b085-00b558d0ffc2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074226 Oct 12 09:04:05.874381 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2162/4720] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:04:06.391552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:06.392276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:06.404144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:06.404723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:06.405242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:06.406247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:06.407390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:06.408078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:06.732387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:06.744737 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f52978d7-8751-424a-ba22-d95f78f87878 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.357620 Oct 12 09:04:06.747125 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2559/4721] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:06 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:06.852127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:06.853471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:06.862051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:06.862981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:06.864798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:06.865770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:06.866426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:06.867255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:07.229883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:07.243138 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-23b1e62d-f9c9-4a76-9053-cc7a1e121361 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1313 microversion: 2.1 time: 0.396528 Oct 12 09:04:07.245478 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2163/4722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:06 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:07.770901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:07.771531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:07.784903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:07.786093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:07.786651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:07.790159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:07.792371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:07.792865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:08.182767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:08.192899 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-49323fea-3dae-4a17-9b97-d3a1f7b18f20 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.427018 Oct 12 09:04:08.207426 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2560/4723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:07 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:08.275863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:08.280086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:08.289117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:08.290372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:08.291000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:08.292017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:08.292674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:08.293316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:08.724443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:08.733135 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb816f02-c5b4-4503-8f9c-c9cf0be0e4e1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1499 microversion: 2.1 time: 0.468739 Oct 12 09:04:08.753458 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2164/4724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:08 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1499 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:08.770755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:08.773119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:08.779926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:08.780341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:08.780803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:08.781552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:08.782185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:08.782771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:08.813969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lazy-loading 'flavor' on Instance uuid bad2d2c2-0b89-40fe-b065-c11ffebd7b4b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:04:08.915230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:08.963544 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dbb470ce-9a7b-40c7-961c-637a68e6b60c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "POST /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b/action" status: 200 len: 32 microversion: 2.1 time: 0.198490 Oct 12 09:04:08.975581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:08.976452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:08.980147 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2561/4725] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:04:08 2022] POST /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:04:08.994001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:08.994904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:08.999369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:09.017837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:09.022959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:09.024424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:09.221862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:09.222851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:09.232622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:09.236370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:09.237034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:09.238002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:09.238904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:09.239496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:09.494480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:09.512515 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53db5600-21ce-4680-92bd-d14c0cc79c4d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.297056 Oct 12 09:04:09.534480 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2562/4726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:09 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:09.613907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:09.622542 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae0036a8-8ab8-4496-86c4-4cc2a97fe4bb tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.651714 Oct 12 09:04:09.622966 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2165/4727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:08 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:10.542542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:10.544803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:10.572003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:10.572946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:10.575975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:10.592424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:10.593284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:10.594053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:10.657093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:10.658822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:10.689311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:10.689992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:10.690441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:10.693085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:10.694053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:10.697706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:11.133078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:11.148621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78deb9cd-fee8-4463-ae00-49d0243539ef tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.608538 Oct 12 09:04:11.171203 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2563/4728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:10 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:11.399158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:11.413972 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bde05fb8-203c-4277-a9d9-c79e18a776de tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.763846 Oct 12 09:04:11.414600 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2166/4729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:10 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:12.173960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:12.175307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:12.186652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:12.187156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:12.187605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:12.194355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:12.194848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:12.195298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:12.441282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:12.441934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:12.455203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:12.455931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:12.457961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:12.458882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:12.464793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:12.465311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:12.473023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:12.505452 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d23bc49-3a63-431f-9457-1beb12cd1942 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.332378 Oct 12 09:04:12.506554 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2564/4730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:12 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:13.532369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:13.532970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:13.534532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:13.548605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:13.549182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:13.549685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:13.550444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:13.551073 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-987e8591-1212-48a0-a475-ce61034467ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 1.113797 Oct 12 09:04:13.552808 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2167/4731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:12 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:13.555052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:13.555506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:13.898720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:13.910941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9175f8ea-9259-4192-ac2c-64dfcff0d5a8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.382474 Oct 12 09:04:13.923708 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2565/4732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:13 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:14.314440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:14.321460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:14.334201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Searching by: {'deleted': False, 'project_id': '751116048c544045993aec6d95142d30'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:04:14.348524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:14.349836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:14.353411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:14.356056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:14.358358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:14.359275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:14.395859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:04:14.439468 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4e03897e-903c-4f56-b6a8-c8116e330ba2 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.128873 Oct 12 09:04:14.442794 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2168/4733] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:04:14 2022] GET /compute/v2.1/servers => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:14.455211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:14.460095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:14.460974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Searching by: {'deleted': False, 'project_id': '751116048c544045993aec6d95142d30'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:04:14.473741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:14.474293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:14.474681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:14.475415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:14.475878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:14.476349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:14.542781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:04:14.580267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:14.581568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:14.594913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:14.596351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:14.596877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:14.598470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:14.599365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:14.599834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:14.600343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:14.606718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:14.608125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:14.608807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:14.990521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:15.043966 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-623be105-5dc3-48b3-9764-ba85bec25c86 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.467327 Oct 12 09:04:15.048190 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2169/4734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:14 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:15.069640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:15.071567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:15.088653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:15.091707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:15.092335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:15.095292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:15.097235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:15.097881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:15.106845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:15.352832 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-047dad96-3c6a-4f4c-b06b-e85b0e7cdb59 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.901385 Oct 12 09:04:15.353951 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2566/4735] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:04:14 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:15.381042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a542418-4036-4bc5-976e-6eb76ca3086f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:15.392544 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a542418-4036-4bc5-976e-6eb76ca3086f tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015972 Oct 12 09:04:15.396360 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2567/4736] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:04:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:04:15.551180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:15.561698 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5d6138b2-9df3-48ef-8e20-84822cb1d70e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.509966 Oct 12 09:04:15.562299 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2170/4737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:15 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:15.754086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:15.754645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:15.772732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:15.773233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:15.773710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:15.774566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:15.775028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:15.775463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:15.811182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:04:15.944701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ddd47eb9-5729-4501-bd93-2262874192d3 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 204 len: 0 microversion: 2.1 time: 0.196255 Oct 12 09:04:15.945921 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2568/4738] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:04:15 2022] DELETE /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:04:15.956036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:15.956809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:15.967658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:15.971727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:15.972844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:15.974571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:15.977777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:15.979068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:16.075997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:16.077265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:16.090963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:16.094036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:16.096780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:16.099915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:16.101557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:16.102816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:16.422476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:16.430968 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4b68dab9-f9a2-49e7-aec4-934fc3ccf310 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1609 microversion: 2.1 time: 0.480791 Oct 12 09:04:16.431836 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2171/4739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:15 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1609 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:16.532496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:16.543553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f98496e9-31d4-43e3-bdd5-b21f2e52d778 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.472275 Oct 12 09:04:16.558971 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2569/4740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:16 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:16.586938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:16.587719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:16.599755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:16.600190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:16.600645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:16.601384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:16.607542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:16.608080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:16.913634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-56842fcd-5ca0-4705-a337-c122df1ff17b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Action: 'create', calling method: .version_select at 0x7f98491b6790>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1081044259", "policies": ["affinity"]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:16.923757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:16.933690 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c9b20262-6d18-4a9c-9118-c0d17d4e9588 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.351597 Oct 12 09:04:16.938413 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2172/4741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:16 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:16.951792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-56842fcd-5ca0-4705-a337-c122df1ff17b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:16.963299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-56842fcd-5ca0-4705-a337-c122df1ff17b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:17.056155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-56842fcd-5ca0-4705-a337-c122df1ff17b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:17.068654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-56842fcd-5ca0-4705-a337-c122df1ff17b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:17.099577 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-56842fcd-5ca0-4705-a337-c122df1ff17b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.423251 Oct 12 09:04:17.101638 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2570/4742] 10.222.0.40 () {60 vars in 1174 bytes} [Wed Oct 12 09:04:16 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:17.114441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-de2456c0-81ef-4ee6-8bdc-062c0e839fb5 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Action: 'create', calling method: .version_select at 0x7f98489b9310>, body: {"server_group": {"name": "tempest-server-group-1549615955", "policies": ["affinity"]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:17.140860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-de2456c0-81ef-4ee6-8bdc-062c0e839fb5 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:17.148310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-de2456c0-81ef-4ee6-8bdc-062c0e839fb5 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:17.222645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-de2456c0-81ef-4ee6-8bdc-062c0e839fb5 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:17.229802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-de2456c0-81ef-4ee6-8bdc-062c0e839fb5 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:17.247704 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-de2456c0-81ef-4ee6-8bdc-062c0e839fb5 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.137769 Oct 12 09:04:17.248972 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2173/4743] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 12 09:04:17 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:17.263088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45d6312f-07aa-4a12-8619-e5f2dc33c0a2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Action: 'create', calling method: .version_select at 0x7f98488fd1f0>, body: {"server_group": {"name": "tempest-server-group-1549615955", "policies": ["affinity"]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:17.287243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-45d6312f-07aa-4a12-8619-e5f2dc33c0a2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:17.294526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-45d6312f-07aa-4a12-8619-e5f2dc33c0a2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:17.348555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-45d6312f-07aa-4a12-8619-e5f2dc33c0a2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:17.355983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-45d6312f-07aa-4a12-8619-e5f2dc33c0a2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:17.370284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:17.381047 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45d6312f-07aa-4a12-8619-e5f2dc33c0a2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.124492 Oct 12 09:04:17.387591 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2571/4744] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 12 09:04:17 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:17.394621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2249ba6a-7a3d-4552-bb1c-d83fa7018507 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:17.435682 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2249ba6a-7a3d-4552-bb1c-d83fa7018507 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/7974c586-49fa-4248-81f8-71abad7046ae" status: 204 len: 0 microversion: 2.1 time: 0.045661 Oct 12 09:04:17.446916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ced5e2de-3963-4a24-a535-41e10a5e68d4 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:17.452291 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2174/4745] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:17 2022] DELETE /compute/v2.1/os-server-groups/7974c586-49fa-4248-81f8-71abad7046ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:04:17.466561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:17.482377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:17.486534 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ced5e2de-3963-4a24-a535-41e10a5e68d4 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.042250 Oct 12 09:04:17.497474 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2572/4746] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:04:17 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:17.510751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:17.511690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:17.513336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bc406058-6866-4f7f-9653-46d505fdbfd5 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:17.514045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:17.516404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:17.517660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:17.518312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:17.584355 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bc406058-6866-4f7f-9653-46d505fdbfd5 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/62783ace-66e6-4fda-91a4-3d0f268a5bb6" status: 204 len: 0 microversion: 2.1 time: 0.085299 Oct 12 09:04:17.585371 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2573/4747] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:17 2022] DELETE /compute/v2.1/os-server-groups/62783ace-66e6-4fda-91a4-3d0f268a5bb6 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:04:17.593046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:17.599264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:17.607349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:17.608195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:17.609098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:17.610066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:17.610731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:17.611366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:17.878467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:17.893678 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-258bef16-9de8-43b9-936c-75433d731cad tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1609 microversion: 2.1 time: 0.439867 Oct 12 09:04:17.894693 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2175/4748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:17 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1609 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:17.900565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-62947db9-8df1-4f54-978e-c4a2015e53c3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:17.919528 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-62947db9-8df1-4f54-978e-c4a2015e53c3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023271 Oct 12 09:04:17.928100 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2176/4749] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:04:17 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:17.934117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e7506c76-cfff-4200-be32-3905c7dc604d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Action: 'create', calling method: .version_select at 0x7f9843ee0b80>, body: {"server_group": {"name": "tempest-server-group-640715224", "policies": ["affinity"]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:17.956109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e7506c76-cfff-4200-be32-3905c7dc604d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:17.964207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e7506c76-cfff-4200-be32-3905c7dc604d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:18.038833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:18.056188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e7506c76-cfff-4200-be32-3905c7dc604d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:18.073803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e7506c76-cfff-4200-be32-3905c7dc604d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:18.090818 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e7506c76-cfff-4200-be32-3905c7dc604d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.160953 Oct 12 09:04:18.091490 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2177/4750] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 12 09:04:17 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:18.103009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:18.103789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:18.111875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:18.112690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:18.113297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:18.114277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:18.114890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:18.116018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:18.477562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:18.486113 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58b19c62-0b63-4d0e-8573-d7e717bc9865 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.387287 Oct 12 09:04:18.498167 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2178/4751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:18 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:18.509539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e5332fde-a925-408a-8d6f-6ca68c25f0e3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:18.557137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e5332fde-a925-408a-8d6f-6ca68c25f0e3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/a02c6842-acc8-4533-811a-35431d29bbcf" status: 204 len: 0 microversion: 2.1 time: 0.057693 Oct 12 09:04:18.557773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2179/4752] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:18 2022] DELETE /compute/v2.1/os-server-groups/a02c6842-acc8-4533-811a-35431d29bbcf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:04:18.584552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2cc17204-7717-4a24-87cd-f447acc7650b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:18.617505 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2cc17204-7717-4a24-87cd-f447acc7650b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.054808 Oct 12 09:04:18.620660 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2180/4753] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:04:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:18.643196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a8f3f9e1-0c05-4536-96db-e4ff1fd8e58e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Action: 'create', calling method: .version_select at 0x7f9848a53dc0>, body: {"server_group": {"name": "tempest-server-group-167719059", "policies": ["anti-affinity"]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:18.690277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a8f3f9e1-0c05-4536-96db-e4ff1fd8e58e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:18.698485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a8f3f9e1-0c05-4536-96db-e4ff1fd8e58e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:18.805320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:18.809370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a8f3f9e1-0c05-4536-96db-e4ff1fd8e58e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:18.819058 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a899fdc-9819-40fe-8b4b-8795d9cc454a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 1.229622 Oct 12 09:04:18.819804 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2574/4754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:17 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:18.835408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-a8f3f9e1-0c05-4536-96db-e4ff1fd8e58e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_groups'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:18.899278 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a8f3f9e1-0c05-4536-96db-e4ff1fd8e58e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.266525 Oct 12 09:04:18.902934 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2181/4755] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 12 09:04:18 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:18.917498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-91d017ea-f886-4afc-a41d-d028b9ab1df4 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:18.920695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:18.921392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:18.936451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:18.936451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:18.936451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:18.941789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:18.946417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:18.947444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:18.984631 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-91d017ea-f886-4afc-a41d-d028b9ab1df4 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/e57a9fcd-b364-41ee-aead-a2793841f628" status: 204 len: 0 microversion: 2.1 time: 0.074359 Oct 12 09:04:18.985233 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2575/4756] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:18 2022] DELETE /compute/v2.1/os-server-groups/e57a9fcd-b364-41ee-aead-a2793841f628 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:04:19.000408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9ae1795-6032-4386-8366-1a5ce6c0f649 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:19.050765 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9ae1795-6032-4386-8366-1a5ce6c0f649 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.059159 Oct 12 09:04:19.054065 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2576/4757] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:04:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:19.117785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:19.128209 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ffda17ca-2f63-4a40-9914-486b5bb13733 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1541 microversion: 2.1 time: 0.212314 Oct 12 09:04:19.134329 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2182/4758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:18 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1541 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:19.333093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-680761565", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "105b82be-477e-4e6d-b304-8163992d388c"}]}, "os:scheduler_hints": {"group": "946c5f75-2f3a-4fac-8957-b234966699c9"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:19.459187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] validate_networks() for [('105b82be-477e-4e6d-b304-8163992d388c', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:04:19.525227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:19.526661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:19.540357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:19.541214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:19.542065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:19.543842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:19.544961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:19.545678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:19.803289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:19.815359 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07a6b548-ddea-441f-a75d-360a66a17589 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.305918 Oct 12 09:04:19.818416 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2183/4759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:19 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:19.839326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c84fd835-6062-4f88-aa43-68eed6f95d44 req-cc0d3290-a9ba-465d-bf11-a81bd68d28cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8422525-d110-47bc-be86-de1169d34c4a", "name": "network-vif-deleted", "tag": "5fadc5f1-a4f3-4431-8831-7fd555a73468"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:19.856631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c84fd835-6062-4f88-aa43-68eed6f95d44 req-cc0d3290-a9ba-465d-bf11-a81bd68d28cd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:19.857264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c84fd835-6062-4f88-aa43-68eed6f95d44 req-cc0d3290-a9ba-465d-bf11-a81bd68d28cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:19.857743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c84fd835-6062-4f88-aa43-68eed6f95d44 req-cc0d3290-a9ba-465d-bf11-a81bd68d28cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:19.893875 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c84fd835-6062-4f88-aa43-68eed6f95d44 req-cc0d3290-a9ba-465d-bf11-a81bd68d28cd service nova] Creating event network-vif-deleted:5fadc5f1-a4f3-4431-8831-7fd555a73468 for instance e8422525-d110-47bc-be86-de1169d34c4a on n-h2-858383-10 Oct 12 09:04:19.905771 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c84fd835-6062-4f88-aa43-68eed6f95d44 req-cc0d3290-a9ba-465d-bf11-a81bd68d28cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086067 Oct 12 09:04:19.906398 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2184/4760] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:19.918208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:19.919016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:19.926744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:19.927412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:19.927999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:19.928725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:19.929187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:19.929751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:20.223807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:20.239907 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a2454f8a-d89b-4dc0-8ce4-a8b67490a259 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.331303 Oct 12 09:04:20.243028 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2185/4761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:19 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:20.258000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:20.261096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:20.279755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:20.281862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:20.283266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:20.285347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:20.286282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:20.289084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:20.409884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:20.422022 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b90dabc-9cbd-41e3-b6b8-dece31dc533e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1253 microversion: 2.1 time: 0.176626 Oct 12 09:04:20.423427 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2186/4762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:20 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1253 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:20.803388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:04:20.804519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:04:20.806406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:04:20.807010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:04:20.807949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:04:20.843349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:20.843349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:20.851714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:20.856019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:20.857423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:20.859743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:20.866943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:20.867213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:20.868895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:20.869678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:20.872376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:20.874276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:20.878050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:20.878786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:20.953850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:20.964701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:21.005779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:04:21.009560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:04:21.131985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:21.159027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:21.292806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:04:21.304522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Getting quotas for user 73b492e184ec470db2df5105bc8c6209 and project 1ce46b5fcab64c16ac418b8db888a585. Resources: {'server_group_members'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:04:21.416971 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24f99dd7-ce00-4950-a2f5-f36a2bef5d3f tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.088766 Oct 12 09:04:21.430837 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2577/4763] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:04:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:04:21.451609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:21.452515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:21.477098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:21.480082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:21.482599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:21.485260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:21.485943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:21.486735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:21.602610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:21.636611 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e977c8a6-9faa-4651-966e-300f0e956875 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.795850 Oct 12 09:04:21.637478 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2187/4764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:20 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:21.655340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6eb980bf-69bb-4229-ae3e-3e4bea415522 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:21.656312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6eb980bf-69bb-4229-ae3e-3e4bea415522 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:21.748133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6eb980bf-69bb-4229-ae3e-3e4bea415522 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:21.759109 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6eb980bf-69bb-4229-ae3e-3e4bea415522 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1212 microversion: 2.1 time: 0.116613 Oct 12 09:04:21.760585 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2188/4765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:21 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1212 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:21.768772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:21.774272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:21.804541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:21.805157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:21.805813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:21.806668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:21.809673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:21.813696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:21.985740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:22.000118 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a87bc6b-09ef-473d-a65d-4615e97cd0d0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.562302 Oct 12 09:04:22.001482 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2578/4766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:21 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:22.133733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:22.148208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0961948b-2397-422e-beac-a2ff2310959e tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1253 microversion: 2.1 time: 0.386023 Oct 12 09:04:22.148845 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2189/4767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:21 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1253 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:22.667588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:22.668218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:22.695888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:22.696414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:22.696892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:22.697726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:22.698202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:22.700129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:22.793927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6e225a79-9538-4284-a2b0-c313e6d11ecb tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:22.794548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6e225a79-9538-4284-a2b0-c313e6d11ecb tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:22.974970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:22.985970 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95a95b56-9f77-4afe-b587-623e46681e8b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.322720 Oct 12 09:04:23.003046 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2579/4768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:22 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:23.028240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:23.028997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6e225a79-9538-4284-a2b0-c313e6d11ecb tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:23.029463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:23.040218 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6e225a79-9538-4284-a2b0-c313e6d11ecb tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1212 microversion: 2.1 time: 0.250971 Oct 12 09:04:23.040890 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2190/4769] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:22 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1212 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:23.073576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:23.074972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:23.075473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:23.076452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:23.076791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:23.077238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:23.172586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:23.173245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:23.181821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:23.182379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:23.188318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:23.189487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:23.198323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:23.199022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:23.306409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:23.314582 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c088889d-9d52-4f0c-bae7-f80e6a387ecb tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1253 microversion: 2.1 time: 0.146359 Oct 12 09:04:23.315172 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2191/4770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:23 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1253 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:23.442142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:23.461226 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8195e4ab-3119-45ca-9bd5-86e495daa0f0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.434358 Oct 12 09:04:23.465966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2580/4771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:23 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:24.014890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:24.015516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:24.040779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:24.041305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:24.041785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:24.045845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:24.049468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:24.050159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:24.072410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:24.074259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:24.119444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:24.120723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:24.125582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:24.129230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:24.130020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:24.134276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:24.313815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:24.325839 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-532e48d6-e0d0-46ce-8f23-310614e86cbc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1282 microversion: 2.1 time: 0.260033 Oct 12 09:04:24.329579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2581/4772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:24 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1282 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:24.340934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:24.342265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:24.353465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:24.354338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:24.355423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:24.356372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:24.357901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:24.358552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:24.378380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:24.483017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:24.503457 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7e59d0d-bf21-44d8-b23a-2ac8d2193f0d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1253 microversion: 2.1 time: 0.165380 Oct 12 09:04:24.505265 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2582/4773] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:24 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1253 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:24.515436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:24.519532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:24.533246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:24.541010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:24.541010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:24.541313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:24.541775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:24.542216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:24.547093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:24.793550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:24.809477 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e077fdc-553f-4c33-b0f6-3eab33af68db tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.302805 Oct 12 09:04:24.810878 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2583/4774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:24 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:25.084644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:25.098986 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10e94824-354b-4537-a955-f353c05e30dd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 1.089384 Oct 12 09:04:25.101086 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2192/4775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:24 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:25.350827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:25.351445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:25.363616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:25.371360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:25.372069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:25.373096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:25.373750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:25.374321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:25.528438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:25.532575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:25.550805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:25.551760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca0ac0dd-eb4b-4958-9767-1afd0abca86d tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1270 microversion: 2.1 time: 0.205014 Oct 12 09:04:25.560765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:25.561566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:25.562219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:25.563777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:25.564428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:25.565696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:25.571094 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2584/4776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:25 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1270 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:25.761081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:25.776834 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-19ae29ef-c2d2-47a2-b4ab-31931670a3e7 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1253 microversion: 2.1 time: 0.245851 Oct 12 09:04:25.780790 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2193/4777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:25 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1253 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:25.836228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:25.837379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:25.848263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:25.850533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:25.851177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:25.854637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:25.855394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:25.856008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.074007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Calling method '.version_select at 0x7f9843e3aee0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:26.078080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.086521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.087418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.121719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.124331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.130789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.145479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.146240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.146887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.154416 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ceff675-fd74-49b2-83b9-8b8627d0da18 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388119697-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.388915 Oct 12 09:04:26.155636 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2585/4778] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:04:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:26.166203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:26.167200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:26.175229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.176121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.176797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.178110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.178777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.179409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.456344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:26.464547 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-74b561a1-7329-4c8b-8892-90f429a9cb4c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.307578 Oct 12 09:04:26.473830 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2586/4779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:26 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:26.479264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:26.485852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:26.512489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.512982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.513645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.514717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.515591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.518694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.595761 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d389c5e4-fb8c-4e4c-ac0b-c1fd78821700 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.120480 Oct 12 09:04:26.603090 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2587/4780] 10.222.0.40 () {60 vars in 1343 bytes} [Wed Oct 12 09:04:26 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:26.623550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:26.624682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:26.644150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.645043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.645759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.646826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.647533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.648175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.810439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:26.821678 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ee63c38-fc61-4346-97ec-9d4b536ed269 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1270 microversion: 2.1 time: 0.221719 Oct 12 09:04:26.822519 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2588/4781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:26 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1270 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:26.848791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:26.851251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:26.872125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.872826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.873380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.874274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:26.874919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:26.875587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:26.925927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:04:27.033227 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-182d5b40-3142-43b0-a907-abefe66b7676 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "DELETE /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 204 len: 0 microversion: 2.20 time: 0.191815 Oct 12 09:04:27.034657 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2589/4782] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:04:26 2022] DELETE /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:04:27.042873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:27.043882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:27.052667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:27.053174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:27.053656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:27.054656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:27.054933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:27.055411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:27.370506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:27.406419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7e005c6-e233-49ad-b5f7-64bc40c72f25 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 1.574533 Oct 12 09:04:27.413420 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2194/4783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:25 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:27.458163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:27.459923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:27.502464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:27.506558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:27.507361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:27.509313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:27.518614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:27.520722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:27.663236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869679441de4425b97e24c4686cbe87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751116048c544045993aec6d95142d30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:27.682215 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-19b55e1d-d705-4c47-9f83-19e568b70424 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 200 len: 1253 microversion: 2.1 time: 0.645765 Oct 12 09:04:27.701170 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2590/4784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:27 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 1253 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:27.718409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:27.719163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:27.730481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:27.744144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:27.744652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:27.745097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:27.748345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:27.748832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:27.749274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:28.353921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:28.362418 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e1fd4fa-fb94-4dd0-b858-08ff1b094939 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.659707 Oct 12 09:04:28.381194 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2591/4785] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:27 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:28.385854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:28.386739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:28.395073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:28.395490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:28.398644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:28.400953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:28.401482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:28.410436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:28.936770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:28.944969 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-28093782-d38d-419e-bd20-6aa41884119e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1312 microversion: 2.1 time: 0.576643 Oct 12 09:04:28.945605 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2592/4786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:28 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1312 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:28.959903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:28.960535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:28.974466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:28.976192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:28.976654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:28.978999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:28.979663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:28.981317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:29.129405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:29.144511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:29.147412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:29.150318 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a7d13a8-3e5f-4723-98dd-8d1fd00051ed tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1724 microversion: 2.20 time: 1.734938 Oct 12 09:04:29.151077 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2195/4787] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:04:27 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1724 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:04:29.157624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:29.162894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] [instance: e8422525-d110-47bc-be86-de1169d34c4a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:29.184642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:29.188822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:29.190006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:29.196274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:29.196919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:29.198843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:29.240811 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] HTTP exception thrown: Instance e8422525-d110-47bc-be86-de1169d34c4a could not be found. Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Request method failure captured: Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a HTTP/1.1 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoKWmA3aAkUsiYyEFVTu-5jvO1gIL49B81Ywx4O9K36_w7PDfu0TVaIHK1ulA1KuaNlet4xxU_GcGtwGzTS0-jnZ3sdsMNHu0uH7g9wwBINIIZrXKiVE84IUWy_keLnqMnvNoEFYU3pt2vlK-El7wklD3a5WGQzhqQKUDvPGPpUtGGA Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 751116048c544045993aec6d95142d30 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersTestBootFromVolume-1462062125 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/751116048c544045993aec6d95142d30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/751116048c544045993aec6d95142d30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_751116048c544045993aec6d95142d30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/751116048c544045993aec6d95142d30"}]}] Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersTestBootFromVolume-1462062125 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 751116048c544045993aec6d95142d30 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1462062125 Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersTestBootFromVolume-1462062125-project Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 869679441de4425b97e24c4686cbe87c Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersTestBootFromVolume-1462062125-project Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e8422525-d110-47bc-be86-de1169d34c4a could not be found. Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e8422525-d110-47bc-be86-de1169d34c4a'} Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8422525-d110-47bc-be86-de1169d34c4a could not be found. Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8422525-d110-47bc-be86-de1169d34c4a could not be found. Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:29.247127 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:29.251303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:29.251303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:29.251303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:29.251303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:29.251303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:29.251303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8422525-d110-47bc-be86-de1169d34c4a could not be found. Oct 12 09:04:29.251303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:29.251303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Returning 404 to user: Instance e8422525-d110-47bc-be86-de1169d34c4a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:29.253896 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c2239537-69ae-4b2e-8c8e-bfbc51250b1d tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a" status: 404 len: 111 microversion: 2.1 time: 0.101218 Oct 12 09:04:29.255976 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2196/4788] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:29 2022] GET /compute/v2.1/servers/e8422525-d110-47bc-be86-de1169d34c4a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:04:29.272372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1d95aeb6-2c9a-40b0-8f60-a9f94cd36f81 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] Calling method '.version_select at 0x7f9848c85c10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:29.317178 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1d95aeb6-2c9a-40b0-8f60-a9f94cd36f81 tempest-ServersTestBootFromVolume-1462062125 tempest-ServersTestBootFromVolume-1462062125-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013803515" status: 202 len: 0 microversion: 2.1 time: 0.055420 Oct 12 09:04:29.321895 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2197/4789] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 09:04:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013803515 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:04:29.389197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:29.390171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:29.405093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:29.405702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:29.406167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:29.406910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:29.407912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:29.411884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:29.425416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:29.915912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:29.923402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:29.940515 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24cf036b-7c59-473a-8024-07cd14c1ed91 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.556140 Oct 12 09:04:29.944250 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57c98f7f-c2a3-42f4-aba0-6dd32eeb9019 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.993564 Oct 12 09:04:29.944851 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2198/4790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:29 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:29.946347 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2593/4791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:28 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:29.972485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:29.973736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:29.985523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:29.986517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:29.987217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:29.991249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:29.992049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:29.994365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:30.178631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:30.179398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:30.190608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:30.191106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:30.191552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:30.192265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:30.192713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:30.193134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:30.368068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:30.390876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:30.392424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:30.393667 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34c63a81-c858-493f-a61b-b1e66c927f8f tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1656 microversion: 2.20 time: 0.220953 Oct 12 09:04:30.397902 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2594/4792] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:04:30 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1656 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:04:30.969714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:30.971316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:30.979530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:30.986313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:30.987555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:30.988718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:30.992148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:30.994081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:30.996344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:31.334517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=32 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:31.703655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:31.717627 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-835e01da-f0ee-4de9-a872-0e6f6005ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.758522 Oct 12 09:04:31.725582 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2595/4793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:30 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:31.737692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:31.744508 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c63f617-03c7-4be0-a5dd-ef4e1ea1569e tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1312 microversion: 2.1 time: 1.775995 Oct 12 09:04:31.745153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:31.745978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:31.747239 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2199/4794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:29 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1312 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:31.757181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:31.759603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:31.769069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:31.772012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:31.772584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:31.773431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:31.774955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:31.775475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:31.775900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:31.776549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:31.777057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:31.779599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:31.780661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:31.781114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:32.235180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:32.246885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:32.258300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3acc9fef23b4066aaf89f766ff219f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21e58c2e8c6c4f06a55edf513222d10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:32.259664 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3907d83a-f067-4060-aed7-c429bd77d65d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 200 len: 1656 microversion: 2.20 time: 0.511325 Oct 12 09:04:32.267574 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2200/4795] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:04:31 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 1656 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:04:32.285971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-46194c74-f008-4cae-8407-fafe19c1e367 req-90d3dcfd-0571-47c9-b3bb-f9febcbf45a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9d62e0-7e07-4398-bb60-902f7fdf5301", "tag": "fe6b0740-b7a7-4f0b-808d-1bb4b3627d3b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:32.325050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46194c74-f008-4cae-8407-fafe19c1e367 req-90d3dcfd-0571-47c9-b3bb-f9febcbf45a4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:32.327252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46194c74-f008-4cae-8407-fafe19c1e367 req-90d3dcfd-0571-47c9-b3bb-f9febcbf45a4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:32.327715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-46194c74-f008-4cae-8407-fafe19c1e367 req-90d3dcfd-0571-47c9-b3bb-f9febcbf45a4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:32.346825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:32.366646 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4f478c5-c7bd-43e0-b893-b80f59db8ff1 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.639833 Oct 12 09:04:32.382111 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2596/4796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:31 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:32.392853 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-46194c74-f008-4cae-8407-fafe19c1e367 req-90d3dcfd-0571-47c9-b3bb-f9febcbf45a4 service nova] Creating event network-changed:fe6b0740-b7a7-4f0b-808d-1bb4b3627d3b for instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 on n-h1-858383-10 Oct 12 09:04:32.397035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1fe9aac6-fdf4-41dc-af3a-1b110b32e940 req-cacad592-d4d7-426b-b929-bfcbf69992c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173b4809-6abe-413a-bbe2-217b8718c4e5", "name": "network-vif-deleted", "tag": "ab36e1ae-f07f-41d7-84d8-7d73c7956ffc"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:32.412673 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-46194c74-f008-4cae-8407-fafe19c1e367 req-90d3dcfd-0571-47c9-b3bb-f9febcbf45a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142532 Oct 12 09:04:32.413289 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2201/4797] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:32.438366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fe9aac6-fdf4-41dc-af3a-1b110b32e940 req-cacad592-d4d7-426b-b929-bfcbf69992c2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:32.438850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fe9aac6-fdf4-41dc-af3a-1b110b32e940 req-cacad592-d4d7-426b-b929-bfcbf69992c2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:32.439282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1fe9aac6-fdf4-41dc-af3a-1b110b32e940 req-cacad592-d4d7-426b-b929-bfcbf69992c2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:32.479870 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1fe9aac6-fdf4-41dc-af3a-1b110b32e940 req-cacad592-d4d7-426b-b929-bfcbf69992c2 service nova] Creating event network-vif-deleted:ab36e1ae-f07f-41d7-84d8-7d73c7956ffc for instance 173b4809-6abe-413a-bbe2-217b8718c4e5 on n-h1-858383-10 Oct 12 09:04:32.496046 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1fe9aac6-fdf4-41dc-af3a-1b110b32e940 req-cacad592-d4d7-426b-b929-bfcbf69992c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109710 Oct 12 09:04:32.500288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2597/4798] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:32.751632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:32.757970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:32.772128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:32.773862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:32.774587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:32.780251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:32.781244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:32.784643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:32.786015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:32.788740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:32.796243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:32.797937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:32.801025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:32.801943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:32.802426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:32.802860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:33.034162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=28 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:33.350392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:33.364824 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f06b0393-7f8e-47a9-9235-731ed30e889f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.617755 Oct 12 09:04:33.370280 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2202/4799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:32 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:33.380361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:33.381521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:33.402463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:33.412892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:33.413363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:33.414247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:33.414711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:33.415142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:33.450317 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] HTTP exception thrown: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Request method failure captured: Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 HTTP/1.1 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoFr-69596GXHfmy5E5SkQBrmJPVMJDJ1pD97VpqMthts7B5F3aIjzXfLitTlUhLLFhlctKZn1P-Cg5tDlWHo67FEkIuaVqPooifeFVVrO9Luo8wj9HhkgRRbjqEtiN7oobQFCiRFb-AjSDe-jdmyjeeACBPP7XCazpAQS4jfab6TDo Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}] Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c3acc9fef23b4066aaf89f766ff219f8 Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '173b4809-6abe-413a-bbe2-217b8718c4e5'} Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:33.452241 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Returning 404 to user: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:33.456541 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5882b5f6-ab95-4c34-a531-b14a5b284531 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 404 len: 111 microversion: 2.20 time: 0.084095 Oct 12 09:04:33.458704 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2203/4800] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:04:33 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:04:33.472913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:33.473581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:33.488363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:33.488866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:33.489304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:33.490074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:33.490530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:33.490955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:33.864871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:33.869683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:33.883708 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-99f3e5af-2828-42fc-a2c0-57483e6aed5a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1312 microversion: 2.1 time: 1.114117 Oct 12 09:04:33.897105 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2598/4801] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:32 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1312 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:33.941902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4772dbde-1aed-4f18-bd28-180767836184 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '.version_select at 0x7f9848a615e0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:33.997431 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4772dbde-1aed-4f18-bd28-180767836184 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681091838" status: 204 len: 0 microversion: 2.20 time: 0.097170 Oct 12 09:04:33.998310 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2599/4802] 10.222.0.40 () {60 vars in 1259 bytes} [Wed Oct 12 09:04:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681091838 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:04:34.103439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:34.117188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4664d2ea-ede1-4132-814e-24164584099d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.652882 Oct 12 09:04:34.129495 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2204/4803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:33 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:34.399071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:34.400313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:34.410656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:34.412140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:34.413114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:34.414177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:34.414863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:34.415526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:34.889949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:34.906867 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5b772a7-5da9-45bc-bc7e-68980c958438 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.511079 Oct 12 09:04:34.910812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2600/4804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:34 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:34.912414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:34.913020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:34.916816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:34.923255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:34.923741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:34.926240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:34.927289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:34.929589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:34.931386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:35.159663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:35.162100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:35.174445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:35.175183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:35.177160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:35.178129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:35.178798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:35.179503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:35.581462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:35.592537 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb074d09-ff6c-41d7-8bfe-17ae2df99b34 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.450181 Oct 12 09:04:35.593840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2601/4805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:35 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:35.934837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:35.936569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:35.952976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:35.954110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:35.954862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:35.958556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:35.959818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:35.961823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:36.553798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:36.576896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d3da0b6-08b6-4bbe-b62b-93beb32102e6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 0.646857 Oct 12 09:04:36.577568 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2602/4806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:35 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:36.624563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:36.625205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:36.632585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:36.635633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:36.636132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:36.636881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:36.637354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:36.637888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:36.850229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:36.864756 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe50bd77-e400-4eb9-8738-2385fc4de9a9 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1312 microversion: 2.1 time: 1.956714 Oct 12 09:04:36.885472 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2205/4807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:34 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1312 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:37.058667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:37.073544 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2552575-0d5a-435b-9814-c61f54d61b0c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.453866 Oct 12 09:04:37.080961 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2603/4808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:36 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:37.601082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:37.602090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:37.622688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:37.626816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:37.628395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:37.632469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:37.640230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:37.642217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:37.904257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:37.904872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:37.936514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:37.941739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:37.943616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:37.944630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:37.945335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:37.945935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:38.235546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:38.261833 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-21ccafed-d8b0-4b81-aa47-90468d0e1a34 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1312 microversion: 2.1 time: 0.364167 Oct 12 09:04:38.263632 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2604/4809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:37 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:38.275078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:38.276215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:38.284445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:38.284948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:38.285396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:38.286755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:38.287401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:38.288779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:38.708453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:38.721357 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5758bc7b-99bc-4844-a3f4-4567956f3155 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.455819 Oct 12 09:04:38.723449 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2605/4810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:38 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:38.774060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:38.800079 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54884060-f400-4682-9c47-fffef6179637 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1521 microversion: 2.1 time: 1.204076 Oct 12 09:04:38.801498 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2206/4811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:37 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1521 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:39.288057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:39.288678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:39.315016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ef885919-7cd1-4d76-b164-c4e0af6d5b11 req-e01f33c8-7d93-411c-9885-7102884d8a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9d62e0-7e07-4398-bb60-902f7fdf5301", "name": "network-vif-plugged", "status": "completed", "tag": "fe6b0740-b7a7-4f0b-808d-1bb4b3627d3b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:39.317833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:39.320420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:39.320934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:39.321721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:39.324368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:39.325163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:39.340903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef885919-7cd1-4d76-b164-c4e0af6d5b11 req-e01f33c8-7d93-411c-9885-7102884d8a6f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:39.349689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef885919-7cd1-4d76-b164-c4e0af6d5b11 req-e01f33c8-7d93-411c-9885-7102884d8a6f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:39.352034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef885919-7cd1-4d76-b164-c4e0af6d5b11 req-e01f33c8-7d93-411c-9885-7102884d8a6f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:39.401691 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ef885919-7cd1-4d76-b164-c4e0af6d5b11 req-e01f33c8-7d93-411c-9885-7102884d8a6f service nova] Creating event network-vif-plugged:fe6b0740-b7a7-4f0b-808d-1bb4b3627d3b for instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 on n-h1-858383-10 Oct 12 09:04:39.421827 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ef885919-7cd1-4d76-b164-c4e0af6d5b11 req-e01f33c8-7d93-411c-9885-7102884d8a6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112693 Oct 12 09:04:39.426547 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2207/4812] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:04:39.748813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:39.749942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:39.769614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:39.770720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:39.772115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:39.773034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:39.773709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:39.777165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:39.811908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:39.826708 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de95518d-0183-4c6e-9c81-3fcbfccf7cd2 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1312 microversion: 2.1 time: 0.540138 Oct 12 09:04:39.830695 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2606/4813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:39 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1312 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:39.840162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:39.842666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:39.867770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:39.870456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:39.874550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:39.876159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:39.878382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:39.879660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.427286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:40.440419 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-54c9bc1b-d2a3-4855-b44e-4f37546cc79a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1501 microversion: 2.1 time: 0.607231 Oct 12 09:04:40.441570 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2607/4814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:39 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1501 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:40.463649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:40.464365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:40.473222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.474018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.475968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.476951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.477799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.478402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.527555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:40.538315 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-711f543c-2d8e-4942-a9a7-1b5667070eb0 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1485 microversion: 2.1 time: 0.794530 Oct 12 09:04:40.540027 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2208/4815] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:39 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1485 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:40.565305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:40.566015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:40.577036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.577478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.577906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.578619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.579248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.579963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.716852 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-87ad94e2-dbd7-4e11-b0cf-f6e88344a62d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "POST /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.156873 Oct 12 09:04:40.718359 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2209/4816] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:04:40 2022] POST /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:04:40.734529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:40.744718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:40.745944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:40.747376 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c6267380-614c-42eb-ad8f-30ae7efb0668 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1516 microversion: 2.1 time: 0.287947 Oct 12 09:04:40.750019 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2608/4817] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:40 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:40.754272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.755967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.756578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.757463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.758086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.758530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.776584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6232dd66-72bc-4ca4-8f1f-3151055659c0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:40.780171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6232dd66-72bc-4ca4-8f1f-3151055659c0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 35d2fc4d-57ca-413e-9db3-e899a97f9a62] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:40.792178 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6232dd66-72bc-4ca4-8f1f-3151055659c0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Instance 35d2fc4d-57ca-413e-9db3-e899a97f9a62 could not be found. Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6232dd66-72bc-4ca4-8f1f-3151055659c0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/35d2fc4d-57ca-413e-9db3-e899a97f9a62/action HTTP/1.1 Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 14 Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: {"rescue": {}} Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 35d2fc4d-57ca-413e-9db3-e899a97f9a62 could not be found. Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '35d2fc4d-57ca-413e-9db3-e899a97f9a62', 'body': {'rescue': {}}} Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d2fc4d-57ca-413e-9db3-e899a97f9a62 could not be found. Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d2fc4d-57ca-413e-9db3-e899a97f9a62 could not be found. Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:40.801216 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:40.806068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:40.806068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:40.806068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:40.806068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:40.806068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d2fc4d-57ca-413e-9db3-e899a97f9a62 could not be found. Oct 12 09:04:40.806068 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:40.806068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6232dd66-72bc-4ca4-8f1f-3151055659c0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 404 to user: Instance 35d2fc4d-57ca-413e-9db3-e899a97f9a62 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:40.807947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6232dd66-72bc-4ca4-8f1f-3151055659c0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/35d2fc4d-57ca-413e-9db3-e899a97f9a62/action" status: 404 len: 111 microversion: 2.1 time: 0.036369 Oct 12 09:04:40.808707 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2609/4818] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:04:40 2022] POST /compute/v2.1/servers/35d2fc4d-57ca-413e-9db3-e899a97f9a62/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:04:40.820244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:40.821760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:40.829065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.829467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.830108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.830988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.831605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.832189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.948123 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-466f9e16-de06-4024-b285-ada9112c8e4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action" status: 202 len: 0 microversion: 2.1 time: 0.132454 Oct 12 09:04:40.950758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2610/4819] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:04:40 2022] POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:04:40.960418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:40.961481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:40.979056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.982571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.983106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:40.983866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:40.985734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:40.987065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.310353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:41.329506 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2577371d-1698-4479-a329-47506fb0b68a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1312 microversion: 2.1 time: 0.376609 Oct 12 09:04:41.330117 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2611/4820] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:40 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1312 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:41.337862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:41.338777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:41.346075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.348894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.349814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.350736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.351388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.352312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.604123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:41.617398 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5aed10e0-6fbb-4a80-85e3-0dcbf6e31873 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1501 microversion: 2.1 time: 0.286149 Oct 12 09:04:41.619071 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2612/4821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:41 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1501 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:41.627720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:41.628541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:41.639300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.640082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.640759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.642780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.643501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.644125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.688931 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] HTTP exception thrown: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Request method failure captured: Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 HTTP/1.1 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFr-69596GXHfmy5E5SkQBrmJPVMJDJ1pD97VpqMthts7B5F3aIjzXfLitTlUhLLFhlctKZn1P-Cg5tDlWHo67FEkIuaVqPooifeFVVrO9Luo8wj9HhkgRRbjqEtiN7oobQFCiRFb-AjSDe-jdmyjeeACBPP7XCazpAQS4jfab6TDo Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}] Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c3acc9fef23b4066aaf89f766ff219f8 Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '173b4809-6abe-413a-bbe2-217b8718c4e5'} Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:41.690637 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Returning 404 to user: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ef8d425b-15a5-4102-af0b-feceb05dda37 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "DELETE /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 404 len: 111 microversion: 2.20 time: 0.070876 Oct 12 09:04:41.695315 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2613/4822] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:04:41 2022] DELETE /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:04:41.698542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:41.702371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:41.711926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.712606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.713761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.714664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.715285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.715867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.747256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lazy-loading 'flavor' on Instance uuid 527f2061-c9c7-4dca-a23e-cecca8f2189b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:04:41.762147 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Cannot 'rescue' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state paused Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action HTTP/1.1 Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 14 Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: {"rescue": {}} Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: exception: Cannot 'rescue' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state paused Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '527f2061-c9c7-4dca-a23e-cecca8f2189b', 'body': {'rescue': {}}} Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 527f2061-c9c7-4dca-a23e-cecca8f2189b in vm_state paused. Cannot rescue while the instance is in this state. Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state paused Oct 12 09:04:41.763980 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state paused Oct 12 09:04:41.768583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.770264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 409 to user: Cannot 'rescue' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state paused {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:41.771607 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-014acdb6-8dc8-4b68-91d6-230543a84db9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action" status: 409 len: 144 microversion: 2.1 time: 0.077882 Oct 12 09:04:41.772711 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2614/4823] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:04:41 2022] POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action => generated 144 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:04:41.778941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:41.780072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 173b4809-6abe-413a-bbe2-217b8718c4e5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:41.787665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.788443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.789078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.790717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.791835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.792510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.819970 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] HTTP exception thrown: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Request method failure captured: Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 HTTP/1.1 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFr-69596GXHfmy5E5SkQBrmJPVMJDJ1pD97VpqMthts7B5F3aIjzXfLitTlUhLLFhlctKZn1P-Cg5tDlWHo67FEkIuaVqPooifeFVVrO9Luo8wj9HhkgRRbjqEtiN7oobQFCiRFb-AjSDe-jdmyjeeACBPP7XCazpAQS4jfab6TDo Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}] Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c3acc9fef23b4066aaf89f766ff219f8 Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '173b4809-6abe-413a-bbe2-217b8718c4e5'} Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.828614 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:41.833708 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.833708 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:41.833708 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:41.833708 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:41.833708 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:41.833708 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:41.833708 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. Oct 12 09:04:41.833708 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:41.835257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Returning 404 to user: Instance 173b4809-6abe-413a-bbe2-217b8718c4e5 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:41.836369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d32bc07d-dbb7-41b8-9409-977cdb1eb53d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5" status: 404 len: 111 microversion: 2.20 time: 0.062569 Oct 12 09:04:41.839920 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2615/4824] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:04:41 2022] GET /compute/v2.1/servers/173b4809-6abe-413a-bbe2-217b8718c4e5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:04:41.852017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:41.852829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:41.860995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.861786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.863704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.864901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:41.865578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:41.866170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:41.969385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:41.978948 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77e71dd3-f11e-403d-b118-ec7b1dc4a329 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1493 microversion: 2.1 time: 1.243329 Oct 12 09:04:41.979523 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2210/4825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:40 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1493 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:41.988292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:42.004030 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3356b800-44d7-46da-b416-9e1b336b6774 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action" status: 202 len: 0 microversion: 2.1 time: 0.162534 Oct 12 09:04:42.008060 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2616/4826] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:04:41 2022] POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:04:42.029061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:42.031795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:42.063012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:42.063523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:42.064084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:42.064702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:42.065165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:42.070713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:42.361970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:42.363002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:42.387001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:42.390902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:42.391584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:42.397162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:42.398131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:42.399125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:43.020630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:43.030472 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-378c8ea9-4590-4b6d-b16e-03912946cc47 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1497 microversion: 2.1 time: 0.673747 Oct 12 09:04:43.038922 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2617/4827] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:42 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1497 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:43.046629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:43.050001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:43.064270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:43.068325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:43.074597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:43.080443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:43.081293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:43.081862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:43.082096 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-000b436c-d260-4111-b28e-65e70c6bfca6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1508 microversion: 2.1 time: 1.064714 Oct 12 09:04:43.085814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:43.086818 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2211/4828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:42 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1508 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:43.103166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e42e5af-b8ed-4d31-a6a7-05ff239b9449 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:43.148399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.compute.server_groups [None req-0e42e5af-b8ed-4d31-a6a7-05ff239b9449 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Querying cell 0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) for 1 instances {{(pid=127007) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 09:04:43.151773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e42e5af-b8ed-4d31-a6a7-05ff239b9449 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:43.152515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e42e5af-b8ed-4d31-a6a7-05ff239b9449 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:43.152987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e42e5af-b8ed-4d31-a6a7-05ff239b9449 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:43.279336 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e42e5af-b8ed-4d31-a6a7-05ff239b9449 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/946c5f75-2f3a-4fac-8957-b234966699c9" status: 200 len: 222 microversion: 2.1 time: 0.184860 Oct 12 09:04:43.292262 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2212/4829] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 09:04:43 2022] GET /compute/v2.1/os-server-groups/946c5f75-2f3a-4fac-8957-b234966699c9 => generated 222 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:43.318931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:43.321393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:43.340620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:43.342537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:43.343872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:43.346317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:43.350256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:43.350717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:43.416752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:04:43.611048 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33ff2b3e-3508-4ff9-9ccc-5d0e35ea17a7 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 204 len: 0 microversion: 2.1 time: 0.313456 Oct 12 09:04:43.614046 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2213/4830] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:04:43 2022] DELETE /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:04:43.624367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:43.625338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:43.633654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:43.635387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:43.636130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:43.637075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:43.637737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:43.638413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:43.666920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:43.716955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:43.727698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a54967ab-1b18-4ff7-a05a-0ffedb15dc76 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1493 microversion: 2.1 time: 0.687367 Oct 12 09:04:43.729348 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2618/4831] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:43 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1493 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:44.113001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:44.113819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:44.133227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:44.134993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:44.136215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:44.138046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:44.139472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:44.140732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:44.780830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:44.796130 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b665526-45d9-4c0a-8f16-7548141f9781 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1503 microversion: 2.1 time: 1.170686 Oct 12 09:04:44.798073 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2214/4832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:43 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1503 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:44.803190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:44.806998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:44.832194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:44.834466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:44.836573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:44.842346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:44.842839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:44.843290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:45.047293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:45.058139 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bfe6047d-04f2-4449-8282-8302d7674b52 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1516 microversion: 2.1 time: 0.951071 Oct 12 09:04:45.058931 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2619/4833] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:44 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1516 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:45.762524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:45.784217 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c186d0b-cdeb-4925-9abc-6b37fcd4319d tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1493 microversion: 2.1 time: 0.980750 Oct 12 09:04:45.787763 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2215/4834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:44 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1493 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:45.825797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:45.826419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:45.846506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:45.847345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:45.848002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:45.849988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:45.855941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:45.857960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:46.132977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:46.142130 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b882f5c-5813-42dd-8968-001dc72ed791 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1503 microversion: 2.1 time: 0.324321 Oct 12 09:04:46.159801 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2620/4835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:45 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:46.808358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:46.811617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:46.825237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:46.825760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:46.826206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:46.826920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:46.827370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:46.827794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:47.165902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:47.166521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:47.178152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:47.178865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:47.179703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:47.181402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:47.183410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:47.183898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:47.367759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:47.381575 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5cbfedad-4f85-4c19-bdfd-67f19e10e762 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1461 microversion: 2.1 time: 0.218941 Oct 12 09:04:47.383275 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2621/4836] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:47 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1461 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:47.495294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:47.512325 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-49d6bad2-7920-4914-8178-678afaf23b3c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1493 microversion: 2.1 time: 0.707917 Oct 12 09:04:47.512933 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2216/4837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:46 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1493 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:47.621675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:47.623831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:47.639317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:47.642976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:47.646265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:47.650664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:47.652340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:47.654486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:47.669831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3648065f-7458-44bb-bd55-48d9932c3470 req-e42ab6ac-31a4-4ffd-9eee-9d9c97ea2306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9d62e0-7e07-4398-bb60-902f7fdf5301", "name": "network-vif-deleted", "tag": "fe6b0740-b7a7-4f0b-808d-1bb4b3627d3b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:47.687260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3648065f-7458-44bb-bd55-48d9932c3470 req-e42ab6ac-31a4-4ffd-9eee-9d9c97ea2306 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:47.687956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3648065f-7458-44bb-bd55-48d9932c3470 req-e42ab6ac-31a4-4ffd-9eee-9d9c97ea2306 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:47.688586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3648065f-7458-44bb-bd55-48d9932c3470 req-e42ab6ac-31a4-4ffd-9eee-9d9c97ea2306 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:47.723324 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] HTTP exception thrown: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.724090 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3648065f-7458-44bb-bd55-48d9932c3470 req-e42ab6ac-31a4-4ffd-9eee-9d9c97ea2306 service nova] Creating event network-vif-deleted:fe6b0740-b7a7-4f0b-808d-1bb4b3627d3b for instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 on n-h1-858383-10 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Request method failure captured: Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 HTTP/1.1 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFr-69596GXHfmy5E5SkQBrmJPVMJDJ1pD97VpqMthts7B5F3aIjzXfLitTlUhLLFhlctKZn1P-Cg5tDlWHo67FEkIuaVqPooifeFVVrO9Luo8wj9HhkgRRbjqEtiN7oobQFCiRFb-AjSDe-jdmyjeeACBPP7XCazpAQS4jfab6TDo Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}] Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c3acc9fef23b4066aaf89f766ff219f8 Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '4d1acdb6-1970-410c-a904-67636bdc3d68'} Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:47.728287 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.731942 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.736533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Returning 404 to user: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:47.741524 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a88f99f9-dfcb-49fd-a1d1-dda254a52c18 tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 404 len: 111 microversion: 2.20 time: 0.126930 Oct 12 09:04:47.742779 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2622/4838] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:04:47 2022] DELETE /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:04:47.743991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3648065f-7458-44bb-bd55-48d9932c3470 req-e42ab6ac-31a4-4ffd-9eee-9d9c97ea2306 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077448 Oct 12 09:04:47.746112 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2217/4839] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:47.755022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:47.755781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] [instance: 4d1acdb6-1970-410c-a904-67636bdc3d68] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:47.779932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:47.781328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:47.783198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:47.786190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:47.786784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:47.787437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:47.839541 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] HTTP exception thrown: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Request method failure captured: Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 HTTP/1.1 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoFr-69596GXHfmy5E5SkQBrmJPVMJDJ1pD97VpqMthts7B5F3aIjzXfLitTlUhLLFhlctKZn1P-Cg5tDlWHo67FEkIuaVqPooifeFVVrO9Luo8wj9HhkgRRbjqEtiN7oobQFCiRFb-AjSDe-jdmyjeeACBPP7XCazpAQS4jfab6TDo Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_21e58c2e8c6c4f06a55edf513222d10b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21e58c2e8c6c4f06a55edf513222d10b"}]}] Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 21e58c2e8c6c4f06a55edf513222d10b Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210301503 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c3acc9fef23b4066aaf89f766ff219f8 Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210301503-project Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '4d1acdb6-1970-410c-a904-67636bdc3d68'} Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.843186 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:47.847495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.847495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:47.847495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:47.847495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:47.847495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:47.847495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:47.847495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. Oct 12 09:04:47.847495 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:47.851681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] Returning 404 to user: Instance 4d1acdb6-1970-410c-a904-67636bdc3d68 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:47.852851 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-52a3cbcf-3e05-4c27-a003-6d035bfd244d tempest-AttachVolumeShelveTestJSON-1210301503 tempest-AttachVolumeShelveTestJSON-1210301503-project] 10.222.0.40 "GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68" status: 404 len: 111 microversion: 2.20 time: 0.104112 Oct 12 09:04:47.854016 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2623/4840] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:04:47 2022] GET /compute/v2.1/servers/4d1acdb6-1970-410c-a904-67636bdc3d68 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 09:04:48.192124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:48.205972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:48.221557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:48.224870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:48.227107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:48.228210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:48.231064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:48.232108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:48.303733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lazy-loading 'flavor' on Instance uuid 527f2061-c9c7-4dca-a23e-cecca8f2189b {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:04:48.407565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:48.408183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:48.446395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:48.449698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:48.453656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:48.458120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:48.475969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:48.478854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:48.605948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:48.606777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:48.607420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:48.608048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lazy-loading 'fault' on Instance uuid 5a9d62e0-7e07-4398-bb60-902f7fdf5301 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:04:48.611358 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7242f20e-4c93-40fd-ba8d-326cd288ee1c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action" status: 200 len: 32 microversion: 2.1 time: 0.424859 Oct 12 09:04:48.630094 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2218/4841] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:04:48 2022] POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action => generated 32 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:04:48.646029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:48.647155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:48.663798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:48.664583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:48.665187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:48.666154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:48.666826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:48.670122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:49.179439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b492e184ec470db2df5105bc8c6209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce46b5fcab64c16ac418b8db888a585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:49.192522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c475ad75-f20a-451b-8ac8-d89e56d15260 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 200 len: 1302 microversion: 2.1 time: 0.788616 Oct 12 09:04:49.197757 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2624/4842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:48 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 1302 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:49.207293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:49.211112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:49.232611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:49.234431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:49.238828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:49.239803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:49.240422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:49.242463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:49.323775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:49.333037 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7fe797e5-5bd2-4b89-817b-24b4cd5fdac6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1499 microversion: 2.1 time: 0.699938 Oct 12 09:04:49.343095 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2219/4843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:48 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1499 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:49.381814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:49.382795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:49.392884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:49.393681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:49.398292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:49.410474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:49.411280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:49.411726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:49.464567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:04:49.670340 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-851a7726-5f07-4437-8be0-afb7201e692c tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 204 len: 0 microversion: 2.1 time: 0.291631 Oct 12 09:04:49.671870 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2220/4844] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:04:49 2022] DELETE /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:04:49.683021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:49.684229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:49.697354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:49.700174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:49.701965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:49.703808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:49.706000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:49.706698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:49.728104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:49.741733 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-125c724a-13f0-4e45-9b1c-601dc067d6b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.540431 Oct 12 09:04:49.749243 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2625/4845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:49 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:50.231129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.232264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:50.254065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.254596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.255047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.255785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.259605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.260140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.297870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:50.312432 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d3454f4-a520-4cdc-bbef-16dfbcef9f02 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.634360 Oct 12 09:04:50.316219 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2221/4846] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:49 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:50.331958 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] HTTP exception thrown: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Request method failure captured: Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 HTTP/1.1 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoMQC8itCXvSCn9UFCD3l1EVwxSVMFc9z4VXR_fJQ6Aiyttbg5yaiF_nCny8w-HVdcEXKhkzRHJewm7CZJv7HCbea11MFOuAUradKX8q9t4EaisbeAkPZL5WuQGVgnFENjMSLOS0tmgZkY1U_DttSidy1Vj8oH_499J7mwz4jPLI0A0 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}] Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 73b492e184ec470db2df5105bc8c6209 Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5a9d62e0-7e07-4398-bb60-902f7fdf5301'} Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.333954 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.338263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.338263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.338263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.338263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:50.338263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:50.338263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.338263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.339110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Returning 404 to user: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:50.340070 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-822ae285-08d0-4941-a33a-db51dde3266b tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 404 len: 111 microversion: 2.1 time: 0.114840 Oct 12 09:04:50.341286 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2626/4847] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:50 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:04:50.355316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc3f3520-fd67-43e4-bd75-62933db9c2f6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.380311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.compute.server_groups [None req-cc3f3520-fd67-43e4-bd75-62933db9c2f6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Querying cell 0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) for 1 instances {{(pid=127007) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 09:04:50.381772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc3f3520-fd67-43e4-bd75-62933db9c2f6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.382975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc3f3520-fd67-43e4-bd75-62933db9c2f6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.383921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc3f3520-fd67-43e4-bd75-62933db9c2f6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.395579 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc3f3520-fd67-43e4-bd75-62933db9c2f6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.045086 Oct 12 09:04:50.396932 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2222/4848] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:04:50 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:50.411787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a1132133-56e2-4638-8bef-9b82ea5dd709 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.455576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.server_groups [None req-a1132133-56e2-4638-8bef-9b82ea5dd709 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Querying cell 0f322b3e-f876-4e6b-8fd7-70274045db25(cell1) for 1 instances {{(pid=127006) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 12 09:04:50.464575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1132133-56e2-4638-8bef-9b82ea5dd709 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.466752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1132133-56e2-4638-8bef-9b82ea5dd709 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.468216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1132133-56e2-4638-8bef-9b82ea5dd709 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.501590 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a1132133-56e2-4638-8bef-9b82ea5dd709 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/946c5f75-2f3a-4fac-8957-b234966699c9" status: 200 len: 184 microversion: 2.1 time: 0.093875 Oct 12 09:04:50.504328 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2627/4849] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 09:04:50 2022] GET /compute/v2.1/os-server-groups/946c5f75-2f3a-4fac-8957-b234966699c9 => generated 184 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:50.517894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.518901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:50.536032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.537345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.538526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.543743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.546044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.546601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.588656 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] HTTP exception thrown: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Request method failure captured: Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 HTTP/1.1 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoMQC8itCXvSCn9UFCD3l1EVwxSVMFc9z4VXR_fJQ6Aiyttbg5yaiF_nCny8w-HVdcEXKhkzRHJewm7CZJv7HCbea11MFOuAUradKX8q9t4EaisbeAkPZL5WuQGVgnFENjMSLOS0tmgZkY1U_DttSidy1Vj8oH_499J7mwz4jPLI0A0 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}] Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 73b492e184ec470db2df5105bc8c6209 Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5a9d62e0-7e07-4398-bb60-902f7fdf5301'} Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:50.597228 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.601573 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.606689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Returning 404 to user: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:50.609993 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dea4b96b-063d-4727-b3e5-355888eba8f3 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 404 len: 111 microversion: 2.1 time: 0.095500 Oct 12 09:04:50.613284 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2223/4850] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:04:50 2022] DELETE /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:04:50.620688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.621479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] [instance: 5a9d62e0-7e07-4398-bb60-902f7fdf5301] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:50.637265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.643854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.667591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.671763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.672439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.674568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.696594 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] HTTP exception thrown: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Request method failure captured: Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 HTTP/1.1 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoMQC8itCXvSCn9UFCD3l1EVwxSVMFc9z4VXR_fJQ6Aiyttbg5yaiF_nCny8w-HVdcEXKhkzRHJewm7CZJv7HCbea11MFOuAUradKX8q9t4EaisbeAkPZL5WuQGVgnFENjMSLOS0tmgZkY1U_DttSidy1Vj8oH_499J7mwz4jPLI0A0 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}] Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 73b492e184ec470db2df5105bc8c6209 Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5a9d62e0-7e07-4398-bb60-902f7fdf5301'} Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.700538 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.706774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.706774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.706774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.706774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:50.706774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:50.706774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. Oct 12 09:04:50.706774 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.709731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Returning 404 to user: Instance 5a9d62e0-7e07-4398-bb60-902f7fdf5301 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:50.711697 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b874a566-183c-43a0-abac-b7b61a8206f8 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301" status: 404 len: 111 microversion: 2.1 time: 0.095675 Oct 12 09:04:50.712983 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2628/4851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:50 2022] GET /compute/v2.1/servers/5a9d62e0-7e07-4398-bb60-902f7fdf5301 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:04:50.725200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-57d1186b-3da1-4fcb-89d8-3d8d2f558db6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.741199 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-57d1186b-3da1-4fcb-89d8-3d8d2f558db6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] HTTP exception thrown: Instance group e57a9fcd-b364-41ee-aead-a2793841f628 could not be found. Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-57d1186b-3da1-4fcb-89d8-3d8d2f558db6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Request method failure captured: Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-server-groups/e57a9fcd-b364-41ee-aead-a2793841f628 HTTP/1.1 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoMQC8itCXvSCn9UFCD3l1EVwxSVMFc9z4VXR_fJQ6Aiyttbg5yaiF_nCny8w-HVdcEXKhkzRHJewm7CZJv7HCbea11MFOuAUradKX8q9t4EaisbeAkPZL5WuQGVgnFENjMSLOS0tmgZkY1U_DttSidy1Vj8oH_499J7mwz4jPLI0A0 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}] Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 73b492e184ec470db2df5105bc8c6209 Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance group e57a9fcd-b364-41ee-aead-a2793841f628 could not be found. Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e57a9fcd-b364-41ee-aead-a2793841f628'} Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e57a9fcd-b364-41ee-aead-a2793841f628 could not be found. Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e57a9fcd-b364-41ee-aead-a2793841f628 could not be found. Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.744886 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.749473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.749473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.749473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:50.749473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:50.749473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e57a9fcd-b364-41ee-aead-a2793841f628 could not be found. Oct 12 09:04:50.749473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.755611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-57d1186b-3da1-4fcb-89d8-3d8d2f558db6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Returning 404 to user: Instance group e57a9fcd-b364-41ee-aead-a2793841f628 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:50.761472 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-57d1186b-3da1-4fcb-89d8-3d8d2f558db6 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/e57a9fcd-b364-41ee-aead-a2793841f628" status: 404 len: 117 microversion: 2.1 time: 0.044516 Oct 12 09:04:50.762243 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2224/4852] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:50 2022] DELETE /compute/v2.1/os-server-groups/e57a9fcd-b364-41ee-aead-a2793841f628 => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:04:50.771458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8eb29bee-d74b-451b-93f6-890ab45bcf87 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.779534 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-8eb29bee-d74b-451b-93f6-890ab45bcf87 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] HTTP exception thrown: Instance group a02c6842-acc8-4533-811a-35431d29bbcf could not be found. Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8eb29bee-d74b-451b-93f6-890ab45bcf87 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Request method failure captured: Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-server-groups/a02c6842-acc8-4533-811a-35431d29bbcf HTTP/1.1 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoMQC8itCXvSCn9UFCD3l1EVwxSVMFc9z4VXR_fJQ6Aiyttbg5yaiF_nCny8w-HVdcEXKhkzRHJewm7CZJv7HCbea11MFOuAUradKX8q9t4EaisbeAkPZL5WuQGVgnFENjMSLOS0tmgZkY1U_DttSidy1Vj8oH_499J7mwz4jPLI0A0 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}] Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 73b492e184ec470db2df5105bc8c6209 Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance group a02c6842-acc8-4533-811a-35431d29bbcf could not be found. Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a02c6842-acc8-4533-811a-35431d29bbcf'} Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a02c6842-acc8-4533-811a-35431d29bbcf could not be found. Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a02c6842-acc8-4533-811a-35431d29bbcf could not be found. Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.782081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.787010 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.787010 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.787010 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:50.787010 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:50.787010 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a02c6842-acc8-4533-811a-35431d29bbcf could not be found. Oct 12 09:04:50.787010 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.791682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8eb29bee-d74b-451b-93f6-890ab45bcf87 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Returning 404 to user: Instance group a02c6842-acc8-4533-811a-35431d29bbcf could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:50.792806 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8eb29bee-d74b-451b-93f6-890ab45bcf87 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/a02c6842-acc8-4533-811a-35431d29bbcf" status: 404 len: 117 microversion: 2.1 time: 0.026280 Oct 12 09:04:50.794235 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2629/4853] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:50 2022] DELETE /compute/v2.1/os-server-groups/a02c6842-acc8-4533-811a-35431d29bbcf => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:04:50.794740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.795627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:50.803779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b6e7d78-d728-4c27-a111-c4df80815825 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.812319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.817979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.818908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.819904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:50.820592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:50.821258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:50.826100 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-4b6e7d78-d728-4c27-a111-c4df80815825 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] HTTP exception thrown: Instance group 62783ace-66e6-4fda-91a4-3d0f268a5bb6 could not be found. Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b6e7d78-d728-4c27-a111-c4df80815825 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Request method failure captured: Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-server-groups/62783ace-66e6-4fda-91a4-3d0f268a5bb6 HTTP/1.1 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoMQC8itCXvSCn9UFCD3l1EVwxSVMFc9z4VXR_fJQ6Aiyttbg5yaiF_nCny8w-HVdcEXKhkzRHJewm7CZJv7HCbea11MFOuAUradKX8q9t4EaisbeAkPZL5WuQGVgnFENjMSLOS0tmgZkY1U_DttSidy1Vj8oH_499J7mwz4jPLI0A0 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}] Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 73b492e184ec470db2df5105bc8c6209 Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance group 62783ace-66e6-4fda-91a4-3d0f268a5bb6 could not be found. Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '62783ace-66e6-4fda-91a4-3d0f268a5bb6'} Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 62783ace-66e6-4fda-91a4-3d0f268a5bb6 could not be found. Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 62783ace-66e6-4fda-91a4-3d0f268a5bb6 could not be found. Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.827970 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.831648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.831648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.831648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:50.831648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:50.831648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 62783ace-66e6-4fda-91a4-3d0f268a5bb6 could not be found. Oct 12 09:04:50.831648 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.835813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b6e7d78-d728-4c27-a111-c4df80815825 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Returning 404 to user: Instance group 62783ace-66e6-4fda-91a4-3d0f268a5bb6 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:50.843307 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b6e7d78-d728-4c27-a111-c4df80815825 tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/62783ace-66e6-4fda-91a4-3d0f268a5bb6" status: 404 len: 117 microversion: 2.1 time: 0.044195 Oct 12 09:04:50.862258 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2630/4854] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:50 2022] DELETE /compute/v2.1/os-server-groups/62783ace-66e6-4fda-91a4-3d0f268a5bb6 => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:04:50.879801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20fdfb11-53f0-46c7-a81c-87103485a17a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.888016 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-20fdfb11-53f0-46c7-a81c-87103485a17a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] HTTP exception thrown: Instance group 7974c586-49fa-4248-81f8-71abad7046ae could not be found. Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20fdfb11-53f0-46c7-a81c-87103485a17a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Request method failure captured: Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-server-groups/7974c586-49fa-4248-81f8-71abad7046ae HTTP/1.1 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoMQC8itCXvSCn9UFCD3l1EVwxSVMFc9z4VXR_fJQ6Aiyttbg5yaiF_nCny8w-HVdcEXKhkzRHJewm7CZJv7HCbea11MFOuAUradKX8q9t4EaisbeAkPZL5WuQGVgnFENjMSLOS0tmgZkY1U_DttSidy1Vj8oH_499J7mwz4jPLI0A0 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ce46b5fcab64c16ac418b8db888a585"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ce46b5fcab64c16ac418b8db888a585"}]}] Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1ce46b5fcab64c16ac418b8db888a585 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerGroupTestJSON-1820791582 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 73b492e184ec470db2df5105bc8c6209 Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerGroupTestJSON-1820791582-project Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance group 7974c586-49fa-4248-81f8-71abad7046ae could not be found. Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7974c586-49fa-4248-81f8-71abad7046ae'} Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7974c586-49fa-4248-81f8-71abad7046ae could not be found. Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7974c586-49fa-4248-81f8-71abad7046ae could not be found. Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.890002 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:50.893679 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:50.893679 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:50.893679 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:50.893679 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:50.893679 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7974c586-49fa-4248-81f8-71abad7046ae could not be found. Oct 12 09:04:50.893679 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:50.895654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-20fdfb11-53f0-46c7-a81c-87103485a17a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Returning 404 to user: Instance group 7974c586-49fa-4248-81f8-71abad7046ae could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:50.896725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-20fdfb11-53f0-46c7-a81c-87103485a17a tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/7974c586-49fa-4248-81f8-71abad7046ae" status: 404 len: 117 microversion: 2.1 time: 0.030627 Oct 12 09:04:50.897806 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2631/4855] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:50 2022] DELETE /compute/v2.1/os-server-groups/7974c586-49fa-4248-81f8-71abad7046ae => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:04:50.908495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c5e83a90-d2ac-4725-ac11-6ef5f3e11cfc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:50.971149 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c5e83a90-d2ac-4725-ac11-6ef5f3e11cfc tempest-ServerGroupTestJSON-1820791582 tempest-ServerGroupTestJSON-1820791582-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/946c5f75-2f3a-4fac-8957-b234966699c9" status: 204 len: 0 microversion: 2.1 time: 0.066822 Oct 12 09:04:50.977172 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2632/4856] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:04:50 2022] DELETE /compute/v2.1/os-server-groups/946c5f75-2f3a-4fac-8957-b234966699c9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:04:51.212497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:51.235211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d316c3b-8d2e-4eb6-9595-24fc9c1ee09f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.455024 Oct 12 09:04:51.256222 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2225/4857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:50 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:51.340770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:51.341391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:51.352688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:51.353743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:51.354387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:51.355266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:51.355883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:51.356469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:51.600895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:51.617074 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-63fc4f87-7bf0-48db-925b-45a52f2720b9 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.280439 Oct 12 09:04:51.638008 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2633/4858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:51 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:52.264752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:52.265345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:52.283779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:52.285421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:52.287327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:52.288285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:52.289872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:52.290568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:52.647383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:52.649384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:52.662042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:52.662042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:52.662042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:52.662289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:52.662520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:52.663667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:52.846037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:52.886894 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9f88779e-7a6a-4f7f-a80a-6397f11ac1cf tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.626805 Oct 12 09:04:52.888310 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2226/4859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:52 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:53.014934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:53.027310 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5a44e92-7df6-4bbe-9aab-9e058ffd9118 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.385364 Oct 12 09:04:53.041969 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2634/4860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:52 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:53.915124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:53.916408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:53.929147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:53.932423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:53.933054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:53.934014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:53.934472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:53.934902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:54.061345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:54.063436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:54.078281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:54.088839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:54.091982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:54.099333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:54.101702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:54.110249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:54.112097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:54.603572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:54.649708 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6dd74f70-335d-467f-b2d7-e68ff7bd7b82 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1505 microversion: 2.1 time: 0.600171 Oct 12 09:04:54.651609 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2635/4861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:54 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:54.752615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:54.761510 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-91c3d1c9-a4e0-4e10-a440-145038519957 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.851257 Oct 12 09:04:54.767326 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2227/4862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:53 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:55.679335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:55.680114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:55.700162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:55.703716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:55.704509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:55.708294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:55.710684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:55.711876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:55.793354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:55.794208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:55.811821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:55.818622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:55.821180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:55.822521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:55.829069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:55.830968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:55.978486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:56.008985 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0137085c-5eb5-406c-9b2f-a24f6a29bde2 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 200 len: 1463 microversion: 2.1 time: 0.330461 Oct 12 09:04:56.012317 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2636/4863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:55 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 1463 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:56.032046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1a3a0752-e3c4-4fa9-bdc7-4cb661f3fd0a req-5e6fd47d-19d6-4df9-be25-b8641879821b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad2d2c2-0b89-40fe-b065-c11ffebd7b4b", "name": "network-vif-deleted", "tag": "80844db9-7f10-4ab3-b41b-c03d31b525ae"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:04:56.067282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1a3a0752-e3c4-4fa9-bdc7-4cb661f3fd0a req-5e6fd47d-19d6-4df9-be25-b8641879821b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:56.068528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1a3a0752-e3c4-4fa9-bdc7-4cb661f3fd0a req-5e6fd47d-19d6-4df9-be25-b8641879821b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:56.069232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1a3a0752-e3c4-4fa9-bdc7-4cb661f3fd0a req-5e6fd47d-19d6-4df9-be25-b8641879821b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:56.087758 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1a3a0752-e3c4-4fa9-bdc7-4cb661f3fd0a req-5e6fd47d-19d6-4df9-be25-b8641879821b service nova] Creating event network-vif-deleted:80844db9-7f10-4ab3-b41b-c03d31b525ae for instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b on n-h2-858383-10 Oct 12 09:04:56.095567 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1a3a0752-e3c4-4fa9-bdc7-4cb661f3fd0a req-5e6fd47d-19d6-4df9-be25-b8641879821b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078190 Oct 12 09:04:56.096995 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2637/4864] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:04:56.340294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:56.366470 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07e5e174-7110-4676-b80c-0fa0a3ec3055 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.572991 Oct 12 09:04:56.367499 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2228/4865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:55 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:04:57.038337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:57.039079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: bad2d2c2-0b89-40fe-b065-c11ffebd7b4b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:57.051195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:57.051686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:57.052138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:57.052858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:57.053319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:57.058669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:57.107544 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] HTTP exception thrown: Instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b could not be found. Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Request method failure captured: Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b HTTP/1.1 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoKrLGDIxrw5K0AD9sxLvjgVCyzOQtRXEpUa571OnZ_Lauq4Lx-vj9YGM87J5LrEKXCp3CoQvv5Rrw3Uj6_HGkwpEDNpOCS332tAjew5zI839rcF7pgYM0jVIxbxIy71_NWzSQ_qL5Dd-I_FVN8DUAfHBsNJ9WcPOO0WlBmeR4cQNvs Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: c5a68c868837469d98b40b8dcb1ced96 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerRescueTestJSON-743260920 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5a68c868837469d98b40b8dcb1ced96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5a68c868837469d98b40b8dcb1ced96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5a68c868837469d98b40b8dcb1ced96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5a68c868837469d98b40b8dcb1ced96"}]}] Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerRescueTestJSON-743260920 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: c5a68c868837469d98b40b8dcb1ced96 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerRescueTestJSON-743260920 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerRescueTestJSON-743260920-project Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 603b71590bed4464a543c3f510301c46 Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerRescueTestJSON-743260920-project Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b could not be found. Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'bad2d2c2-0b89-40fe-b065-c11ffebd7b4b'} Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b could not be found. Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b could not be found. Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:04:57.118974 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b could not be found. Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Returning 404 to user: Instance bad2d2c2-0b89-40fe-b065-c11ffebd7b4b could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:04:57.126167 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-201a0eee-f819-459b-9718-70805f516a3a tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b" status: 404 len: 111 microversion: 2.1 time: 0.088509 Oct 12 09:04:57.134601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:57.135293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:57.140503 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2638/4866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:57 2022] GET /compute/v2.1/servers/bad2d2c2-0b89-40fe-b065-c11ffebd7b4b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:04:57.148460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:57.149273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:57.150063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:57.150826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:57.157398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:57.158011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:57.213344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:04:57.333938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:04:57.390365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:57.390994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:57.404627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:57.405371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:57.405859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:57.422859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:57.426805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:57.427651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:57.465389 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4850acb7-ccab-433f-ab28-c7f3735c35a6 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 204 len: 0 microversion: 2.1 time: 0.333951 Oct 12 09:04:57.466992 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2229/4867] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:04:57 2022] DELETE /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:04:57.476412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:57.477396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:57.497413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:57.498209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:57.498939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:57.499835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:57.500446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:57.501820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:57.909791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:57.924694 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c7aefdf2-eb9c-460a-8268-76d8e6f0d0da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.538132 Oct 12 09:04:57.925638 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2639/4868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:57 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:58.677394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:58.693097 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a2c1d9f-5c8c-43ae-a8dd-6aff74e8ddbd tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1492 microversion: 2.1 time: 1.221654 Oct 12 09:04:58.693952 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2230/4869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:57 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1492 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:04:58.953692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:58.954488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:58.981905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:58.984824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:58.986726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:58.988904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:58.993985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:58.994820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:59.720426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:04:59.721651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:04:59.739729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:59.749160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:59.750817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:59.752900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:04:59.756677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:04:59.757677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:04:59.827546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:04:59.841714 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2b4a9cec-f7ae-4672-a944-507a0e2583bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.890310 Oct 12 09:04:59.843261 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2640/4870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:58 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:00.598968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:00.685759 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4a025525-9ff4-499b-9b37-8c99cfc2f2ff tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1492 microversion: 2.1 time: 0.967573 Oct 12 09:05:00.692124 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2231/4871] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:04:59 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1492 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:00.896078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:00.897331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:00.929385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:00.929957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:00.930374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:00.931132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:00.932092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:00.932523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:01.416314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0c3faa24-54ec-45a6-a766-80b24a0d1937 req-c273eedc-cfd5-4fe4-ad6a-1064f7bf6ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32580ec2-7ba7-43c6-b11d-78b8a6253a91", "name": "network-vif-deleted", "tag": "dd6fd737-0fe2-405d-8cf0-fed4909461c6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:01.460573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0c3faa24-54ec-45a6-a766-80b24a0d1937 req-c273eedc-cfd5-4fe4-ad6a-1064f7bf6ee8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:01.461639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0c3faa24-54ec-45a6-a766-80b24a0d1937 req-c273eedc-cfd5-4fe4-ad6a-1064f7bf6ee8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:01.463685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0c3faa24-54ec-45a6-a766-80b24a0d1937 req-c273eedc-cfd5-4fe4-ad6a-1064f7bf6ee8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:01.479989 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0c3faa24-54ec-45a6-a766-80b24a0d1937 req-c273eedc-cfd5-4fe4-ad6a-1064f7bf6ee8 service nova] Creating event network-vif-deleted:dd6fd737-0fe2-405d-8cf0-fed4909461c6 for instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 on n-h2-858383-10 Oct 12 09:05:01.486271 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0c3faa24-54ec-45a6-a766-80b24a0d1937 req-c273eedc-cfd5-4fe4-ad6a-1064f7bf6ee8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074564 Oct 12 09:05:01.487641 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2232/4872] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:05:01.713685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:01.714583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:01.728748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:01.733877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:01.738621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:01.740050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:01.742525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:01.743654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:01.807864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:01.809788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:01.810575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:01.811277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lazy-loading 'fault' on Instance uuid 32580ec2-7ba7-43c6-b11d-78b8a6253a91 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:05:02.231004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603b71590bed4464a543c3f510301c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a68c868837469d98b40b8dcb1ced96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:02.245647 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ed5543a-645d-49a4-8e22-fc674ee40874 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 200 len: 1304 microversion: 2.1 time: 0.536824 Oct 12 09:05:02.250526 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2233/4873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:01 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 1304 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:02.363505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:02.372089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:02.379255 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b495da9d-0222-4d7c-a2d7-b6af4493d406 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 1.490617 Oct 12 09:05:02.383493 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2641/4874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:00 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:03.278667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:03.281118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] [instance: 32580ec2-7ba7-43c6-b11d-78b8a6253a91] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:03.290776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:03.294943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:03.296825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:03.298627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:03.303035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:03.303684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:03.336650 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] HTTP exception thrown: Instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 could not be found. Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Request method failure captured: Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 HTTP/1.1 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoKrLGDIxrw5K0AD9sxLvjgVCyzOQtRXEpUa571OnZ_Lauq4Lx-vj9YGM87J5LrEKXCp3CoQvv5Rrw3Uj6_HGkwpEDNpOCS332tAjew5zI839rcF7pgYM0jVIxbxIy71_NWzSQ_qL5Dd-I_FVN8DUAfHBsNJ9WcPOO0WlBmeR4cQNvs Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c5a68c868837469d98b40b8dcb1ced96 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerRescueTestJSON-743260920 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5a68c868837469d98b40b8dcb1ced96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5a68c868837469d98b40b8dcb1ced96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5a68c868837469d98b40b8dcb1ced96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5a68c868837469d98b40b8dcb1ced96"}]}] Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerRescueTestJSON-743260920 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c5a68c868837469d98b40b8dcb1ced96 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerRescueTestJSON-743260920 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerRescueTestJSON-743260920-project Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 603b71590bed4464a543c3f510301c46 Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerRescueTestJSON-743260920-project Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 could not be found. Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '32580ec2-7ba7-43c6-b11d-78b8a6253a91'} Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 could not be found. Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 could not be found. Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:03.339871 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:03.344288 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:03.344288 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:05:03.344288 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:05:03.344288 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:05:03.344288 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:05:03.344288 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 could not be found. Oct 12 09:05:03.344288 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:03.345597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] Returning 404 to user: Instance 32580ec2-7ba7-43c6-b11d-78b8a6253a91 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:05:03.349231 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e748d671-4a03-4e26-ab6c-8dcd9c6b9841 tempest-ServerRescueTestJSON-743260920 tempest-ServerRescueTestJSON-743260920-project] 10.222.0.40 "GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91" status: 404 len: 111 microversion: 2.1 time: 0.076323 Oct 12 09:05:03.355389 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2234/4875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:03 2022] GET /compute/v2.1/servers/32580ec2-7ba7-43c6-b11d-78b8a6253a91 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:05:03.411373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:03.412143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:03.431807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:03.432314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:03.432900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:03.433984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:03.434660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:03.435301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:05.131096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:05.148175 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d09158d1-9e12-4f5a-b4b5-25527c7cd3b4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 1.741394 Oct 12 09:05:05.154908 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2642/4876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:03 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:06.178794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:06.180062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:06.184728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:06.201372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:06.201917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:06.205097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:06.205925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:06.206400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:06.206836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:08.365110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:08.374605 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c86f8065-9a0b-48f8-b026-dba74ac003e4 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 2.200492 Oct 12 09:05:08.380693 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2235/4877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:06 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:09.403202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:09.404518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:09.416010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:09.420213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:09.421568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:09.423954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:09.425878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:09.427612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:10.098788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:10.112326 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-326aaf5e-1e05-4924-8a7b-ea66afbfa493 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.713247 Oct 12 09:05:10.113220 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2643/4878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:09 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:11.135769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:11.136558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:11.154776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:11.155685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:11.159013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:11.160308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:11.164197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:11.164825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:12.240390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:12.252328 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fc8cdf7e-4f1f-4b7b-b14f-d5f255bb5d4b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1502 microversion: 2.1 time: 1.119599 Oct 12 09:05:12.253852 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2236/4879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:11 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1502 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:12.283148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-992166078", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "945412f2-a51b-465e-b117-3fae72cb5c99"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:12.284104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65a4e8d0-febe-414b-b692-ce8944357bb3"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:12.286946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:12.321147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:12.321700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:12.322145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:12.322881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:12.323341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:12.323774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:12.374767 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Cannot 'attach_volume' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state rescued Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/os-volume_attachments HTTP/1.1 Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 74 Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: {"volumeAttachment": {"volumeId": "65a4e8d0-febe-414b-b692-ce8944357bb3"}} Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'attach_volume' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state rescued Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': '527f2061-c9c7-4dca-a23e-cecca8f2189b', 'body': {'volumeAttachment': {'volumeId': '65a4e8d0-febe-414b-b692-ce8944357bb3'}}} Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 527f2061-c9c7-4dca-a23e-cecca8f2189b in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 12 09:05:12.376355 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state rescued Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state rescued Oct 12 09:05:12.381497 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:12.384963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 409 to user: Cannot 'attach_volume' instance 527f2061-c9c7-4dca-a23e-cecca8f2189b while it is in vm_state rescued {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:05:12.396784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] validate_networks() for [('945412f2-a51b-465e-b117-3fae72cb5c99', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:05:12.402850 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3fc81ab5-ae73-4298-a689-409943915ccd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.129681 Oct 12 09:05:12.408001 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2237/4880] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:05:12 2022] POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/os-volume_attachments => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 09:05:12.418766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:12.421720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:12.454333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:12.459886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:12.461075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:12.462162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:12.462833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:12.463493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:12.610291 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d98c4f1d-2811-45a9-be0d-e5e0da93fad9 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action" status: 202 len: 0 microversion: 2.1 time: 0.200423 Oct 12 09:05:12.627689 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2238/4881] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:05:12 2022] POST /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:05:12.658906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:12.660058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:12.691944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:12.692493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:12.692955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:12.693692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:12.694436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:12.704039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:13.482826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:13.507944 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b8ca3b3-dab4-4095-97e6-2af85b364a45 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1510 microversion: 2.1 time: 0.869292 Oct 12 09:05:13.509741 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2239/4882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:12 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1510 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:13.805913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:05:13.808628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:05:13.809731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:05:13.810376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:05:13.811028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:05:13.832577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:13.834946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:13.836466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:13.847862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:13.849411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:13.851645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:13.904865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Getting quotas for project 30ee3298ecd74641894e5eeb18b30792. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:05:13.935079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Getting quotas for user b4da2cf326724e9db041e0b86b0416d8 and project 30ee3298ecd74641894e5eeb18b30792. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:05:13.960909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:05:13.964004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:05:14.067660 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.008132 Oct 12 09:05:14.071256 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2644/4883] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:05:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:05:14.088185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cadfb273-4f30-4dcc-b9b0-9dd4ad8e2ae2 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:14.089552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cadfb273-4f30-4dcc-b9b0-9dd4ad8e2ae2 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:14.387801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cadfb273-4f30-4dcc-b9b0-9dd4ad8e2ae2 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:14.421249 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cadfb273-4f30-4dcc-b9b0-9dd4ad8e2ae2 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1216 microversion: 2.1 time: 0.342227 Oct 12 09:05:14.422525 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2240/4884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:14 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1216 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:14.536525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:14.537362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:14.564070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:14.564635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:14.567644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:14.571301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:14.573231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:14.578020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:15.154879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:15.168857 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-174308fa-24e2-441c-ac20-4f35dfcf15b5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1510 microversion: 2.1 time: 0.638412 Oct 12 09:05:15.169952 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2645/4885] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:14 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1510 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:15.449323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:15.450011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:15.462226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:15.462907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:15.463362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:15.464157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:15.464795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:15.465388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:15.805668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:15.830082 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0f93f5eb-1801-42bd-b26b-e8e4d2275c6a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1212 microversion: 2.1 time: 0.386525 Oct 12 09:05:15.831112 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2241/4886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:15 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1212 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:16.198158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:16.198957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:16.208748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:16.213880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:16.214547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:16.215792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:16.217138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:16.220023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:16.866882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:16.869482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:16.880419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:16.881080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:16.883777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:16.885120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:16.886229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:16.887282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:17.291639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:17.301112 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a9f881e1-bbeb-4cbb-93e4-0ef78dc4e862 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1510 microversion: 2.1 time: 1.109137 Oct 12 09:05:17.305693 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2646/4887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:16 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1510 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:17.408704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:17.428892 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a465f91c-6575-4851-b872-9c01953b0604 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1274 microversion: 2.1 time: 0.576258 Oct 12 09:05:17.443117 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2242/4888] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:16 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1274 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:05:18.328601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:18.329834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:18.340599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:18.348817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:18.349500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:18.350414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:18.351037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:18.351461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:18.469959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:18.470572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:18.480328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:18.486599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:18.490617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:18.491197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:18.491681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:18.492122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:19.077621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:19.095021 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-daca8bc5-185d-416f-af56-e3b01a59a070 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1516 microversion: 2.1 time: 0.770205 Oct 12 09:05:19.095605 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2647/4889] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:18 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1516 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:19.100029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:19.120570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6705ea44-d952-43ba-b73c-eb62ee905f67 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1274 microversion: 2.1 time: 0.654299 Oct 12 09:05:19.131571 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2243/4890] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:18 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1274 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:05:20.155505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:20.156379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:20.172053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:20.173346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:20.175157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:20.179398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:20.180203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:20.180749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:20.614983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:20.643739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f250d37-4e2a-4075-911a-d07c3d7ba5f5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1274 microversion: 2.1 time: 0.492259 Oct 12 09:05:20.648900 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2648/4891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:20 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1274 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:21.787788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5c9f862e-866f-4be8-add5-70781f44da4a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: .version_select at 0x7f9848ba43a0>, body: {"keypair": {"name": "tempest-keypair-648713879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUp63Vr1Z42I3gJSqgmR7X2uavFxRDFyihafgfQ2lvrNKP2e83X3WUtu0nwSfqufRGZI8A+jlUfeSgyowQVRqyx2YQogbBAvdUJsCkx8umLmW8EXRNSej5otm3RNIVAjg=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:21.850750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5c9f862e-866f-4be8-add5-70781f44da4a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:05:21.870047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-5c9f862e-866f-4be8-add5-70781f44da4a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for user d9531ada325c4b868f3bcd62331ab827 and project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:05:21.949172 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5c9f862e-866f-4be8-add5-70781f44da4a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.442435 Oct 12 09:05:21.950764 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2244/4892] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:05:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:21.961851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:21.963049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:21.976215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:21.977076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:21.977728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:21.978928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:21.979566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:21.980420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:22.038249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1474927005", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": "none"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:22.102504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:05:22.103028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:05:22.103733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:05:22.104378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:05:22.105010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:05:22.115192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:22.116228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:22.116904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:22.117938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:22.118679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:22.119465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:22.142164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Getting quotas for project a684da3c12d8453c99eba9911b089744. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:05:22.150982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Getting quotas for user c069c1b110d7414d8ae63c70b8a7a6f5 and project a684da3c12d8453c99eba9911b089744. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:05:22.168206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:05:22.171135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:05:22.253266 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aacb430b-e8ea-45d4-aea8-7ae1148e4867 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.647321 Oct 12 09:05:22.265817 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2649/4893] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 09:05:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 09:05:22.281499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-70c67b05-2841-4e26-8a5b-8acf5c5af2bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'create', calling method: .version_select at 0x7f9843e99af0>, body: {"keypair": {"name": "tempest-keypair-1122695366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3lVd6yO7pjn+9AJ/6JCZx6tXuqEzQZf7e878SuwCGanb32mRf19JsrtZuIuWoszA8m/4mSWUhfRvR6Z1I83U2ykgMajxVJnctlqpXH8zchABrc8ZpOLkwovU3jCuqasQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:22.308372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-70c67b05-2841-4e26-8a5b-8acf5c5af2bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Getting quotas for project 4d50dff5e638459c9776ffc01c813b6e. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:05:22.318244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-70c67b05-2841-4e26-8a5b-8acf5c5af2bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Getting quotas for user 884b8a3752594dfeb0d546c73a843481 and project 4d50dff5e638459c9776ffc01c813b6e. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:05:22.360639 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-70c67b05-2841-4e26-8a5b-8acf5c5af2bb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092864 Oct 12 09:05:22.362030 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2650/4894] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:05:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:22.374835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90816e76-8fd9-450d-a1c2-9e9e42eed8a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:22.375882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-90816e76-8fd9-450d-a1c2-9e9e42eed8a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:22.520582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:22.532717 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5e14cb26-71d8-4b98-bcfd-f9e54f9bf0c9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 0.580627 Oct 12 09:05:22.533529 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2245/4895] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:21 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:22.624705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90816e76-8fd9-450d-a1c2-9e9e42eed8a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:22.640429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90816e76-8fd9-450d-a1c2-9e9e42eed8a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:22.641968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90816e76-8fd9-450d-a1c2-9e9e42eed8a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:22.645141 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90816e76-8fd9-450d-a1c2-9e9e42eed8a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1278 microversion: 2.57 time: 0.281335 Oct 12 09:05:22.646373 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2651/4896] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:22 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:23.560397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:23.561030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:23.579058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:23.579487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:23.579925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:23.580806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:23.581090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:23.590504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:23.676226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:23.677019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:23.697391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:23.698255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:23.698451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:23.699208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:23.699673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:23.700110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:23.950454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:23.964378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:23.966732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:23.968552 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6847db7-5484-4fbf-9110-651ddf67ad8a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1330 microversion: 2.57 time: 0.296900 Oct 12 09:05:23.969680 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2652/4897] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:23 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1330 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:24.281931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:24.308959 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b677737a-75e5-4de2-88ba-b8e4df420429 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 0.752122 Oct 12 09:05:24.313838 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2246/4898] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:23 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:24.999701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:25.000857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:25.003874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:25.018828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:25.019672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:25.020407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:25.021309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:25.025502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:25.026193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:25.289204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:25.308781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:25.313419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:25.324173 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1bc693e7-d78c-4f7c-89d5-983cfe72de56 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1336 microversion: 2.57 time: 0.328284 Oct 12 09:05:25.324798 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2653/4899] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:24 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1336 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:25.341326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:25.342887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:25.355036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:25.355526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:25.355966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:25.356685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:25.357132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:25.357586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:26.246949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:26.250973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:26.255702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ca25f837-ddd6-4a5a-95d4-e5bcd1681f86 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 0.924766 Oct 12 09:05:26.268004 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2247/4900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:25 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:26.356474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:26.357826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:26.374615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:26.376238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:26.379562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:26.381412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:26.381930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:26.382376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:26.541273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:26.557708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:26.563003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:26.564251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3633b39d-7154-4533-b64e-b9cf41b96399 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1336 microversion: 2.57 time: 0.211979 Oct 12 09:05:26.566538 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2654/4901] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:26 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1336 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:27.284982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:27.286245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:27.315608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:27.316389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:27.319176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:27.323094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:27.325333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:27.339214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:27.598058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:27.600483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:27.615206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:27.616599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:27.618077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:27.619410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:27.620245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:27.621526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:27.803878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:27.824596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:27.831560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:27.832808 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b9c21d4c-deb7-4584-ac3c-ef08fc5d4c5e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1357 microversion: 2.57 time: 0.243585 Oct 12 09:05:27.833389 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2655/4902] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:27 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:27.870033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:27.873453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:27.882777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:27.883282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:27.883726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:27.885767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:27.886236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:27.890499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:27.989735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:05:27.990439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:05:27.991097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:05:27.991670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:05:27.992295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:05:28.098940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:28.112383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:28.112662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:28.114988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:28.115791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:28.120310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:28.120767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:28.186485 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89410671-022a-408e-b1ab-b08662792daf tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "POST /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09/action" status: 202 len: 1138 microversion: 2.57 time: 0.319481 Oct 12 09:05:28.189667 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2656/4903] 10.222.0.40 () {62 vars in 1320 bytes} [Wed Oct 12 09:05:27 2022] POST /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09/action => generated 1138 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 12 09:05:28.214643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:28.215988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:28.228785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:28.229308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:28.229784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:28.230554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:28.231574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:28.232140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:28.444046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:28.454522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:28.456288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:28.458117 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f80c04a-3fe0-4375-b540-f52159420566 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.249910 Oct 12 09:05:28.459234 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2657/4904] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:28 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:28.464959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-230667963", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1fd12de-772c-4409-a55a-e4329af851c8"}], "security_groups": [{"name": "tempest-securitygroup--78626023"}], "key_name": "tempest-keypair-648713879", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:28.555937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:28.573116 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77c0f9eb-c23f-4eb1-866a-6029bac31c35 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 1.288646 Oct 12 09:05:28.582336 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2248/4905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:27 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:28.671674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] validate_networks() for [('b1fd12de-772c-4409-a55a-e4329af851c8', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:05:28.760617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c716abbb-a0bf-4738-95d8-c8ec4332fe18 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Action: 'create', calling method: .version_select at 0x7f984cce70d0>, body: {"keypair": {"name": "tempest-keypair-1203918891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoO1D1XpF954VUwqSnrmkRC6P022UVOmxjjqWoVzf61Ff7gquy+B2pQ+9XKMySYMWJS+oIpIvNsLc1okusY+PjYjyL4MkBHPQd1AOKqLLzEwy58tdeYCapfqjPHsske3A=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:28.815081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-c716abbb-a0bf-4738-95d8-c8ec4332fe18 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Getting quotas for project 01c9cafab43e40b1bb7d5e51f0a737fe. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:05:28.836644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-c716abbb-a0bf-4738-95d8-c8ec4332fe18 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Getting quotas for user f81f250849084de1827de11047258a5d and project 01c9cafab43e40b1bb7d5e51f0a737fe. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:05:28.906197 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c716abbb-a0bf-4738-95d8-c8ec4332fe18 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.150128 Oct 12 09:05:28.913400 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2249/4906] 10.222.0.40 () {62 vars in 1200 bytes} [Wed Oct 12 09:05:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 09:05:29.023672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ef116397-561f-4bb7-b652-d8f4da48cded req-504fb227-17ee-4c99-a0b0-b33750992c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "953f751f-c158-4b7d-aa42-c9141e05af27", "tag": "ed9f0bbd-8499-4132-8c10-60c66251f5f7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:29.048466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef116397-561f-4bb7-b652-d8f4da48cded req-504fb227-17ee-4c99-a0b0-b33750992c67 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:29.052200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef116397-561f-4bb7-b652-d8f4da48cded req-504fb227-17ee-4c99-a0b0-b33750992c67 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:29.052833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef116397-561f-4bb7-b652-d8f4da48cded req-504fb227-17ee-4c99-a0b0-b33750992c67 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:29.074702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ef116397-561f-4bb7-b652-d8f4da48cded req-504fb227-17ee-4c99-a0b0-b33750992c67 service nova] Creating event network-changed:ed9f0bbd-8499-4132-8c10-60c66251f5f7 for instance 953f751f-c158-4b7d-aa42-c9141e05af27 on n-h2-858383-10 Oct 12 09:05:29.103381 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ef116397-561f-4bb7-b652-d8f4da48cded req-504fb227-17ee-4c99-a0b0-b33750992c67 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193240 Oct 12 09:05:29.104196 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2250/4907] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:29.489928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:29.490887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:29.498696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:29.499431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:29.500037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:29.500941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:29.501611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:29.502815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:29.649584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:29.657773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:05:29.658317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:05:29.658815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:05:29.659284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:05:29.659845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:29.660008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:05:29.661710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:29.663304 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-76f0254a-b5ad-45a4-ae69-c44bee472b43 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.178514 Oct 12 09:05:29.665809 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2251/4908] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:29 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:29.677246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:29.678060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:29.691116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:29.692890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:29.700433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:29.701612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:29.702280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:29.702897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:29.703093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:29.703402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:29.703852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:29.704564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:29.705037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:29.705543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:29.734594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:05:29.746425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for user d9531ada325c4b868f3bcd62331ab827 and project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:05:29.765654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:05:29.768270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:05:29.831498 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c920db38-41d6-40a7-acec-5fa67d70b78f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.370840 Oct 12 09:05:29.837176 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2658/4909] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:05:28 2022] POST /compute/v2.1/servers => generated 400 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:05:29.856865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bd405eb-2340-4000-b263-78afaf6d39a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:29.857909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3bd405eb-2340-4000-b263-78afaf6d39a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:30.017162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3bd405eb-2340-4000-b263-78afaf6d39a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:30.033716 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3bd405eb-2340-4000-b263-78afaf6d39a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1240 microversion: 2.1 time: 0.188344 Oct 12 09:05:30.034897 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2659/4910] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:29 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1240 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:30.375317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bd405eb-2340-4000-b263-78afaf6d39a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:30.376633 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3bd405eb-2340-4000-b263-78afaf6d39a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001684 Oct 12 09:05:30.377357 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2660/4911] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 12 09:05:30 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 09:05:30.693979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:30.695498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:30.708054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:30.711092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:30.711796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:30.715364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:30.716047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:30.717934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:30.846083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:30.856638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:30.864703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:30.867986 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd293ad3-17c4-46e9-aa58-02c8d907e9d0 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.176302 Oct 12 09:05:30.868840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2661/4912] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:30 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:31.023571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:31.050203 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-13c61967-7f84-4097-a5ed-fe0058396145 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 1.383073 Oct 12 09:05:31.050979 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2252/4913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:29 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:31.058446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:31.059064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:31.077365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:31.077978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:31.078472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:31.079220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:31.079717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:31.080387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:31.117191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:31.212546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:31.228106 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f59cc35a-6981-424b-a9d4-ba7abb2556b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1292 microversion: 2.1 time: 0.173461 Oct 12 09:05:31.229696 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2662/4914] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:31 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1292 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:31.419136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1396498373", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdcadb9c-b3a5-47b9-9dc4-a7aa968839ce"}], "security_groups": [{"name": "tempest-securitygroup--1529192149"}], "key_name": "tempest-keypair-1122695366", "user_data": "}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:31.898618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:31.899216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:31.907782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:31.908281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:31.908725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:31.909469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:31.910232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:31.910659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:31.977554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] validate_networks() for [('fdcadb9c-b3a5-47b9-9dc4-a7aa968839ce', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:05:32.522724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:32.532643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:32.534281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:32.535944 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a9ec7210-fab1-4584-a3af-3c3ef001dc15 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.641435 Oct 12 09:05:32.549472 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2663/4915] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:31 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:32.555339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:32.556329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:32.566663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:32.570733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:32.572009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:32.575436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:32.578030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:32.578587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:33.038785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:05:33.039309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:05:33.039911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:05:33.040327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:05:33.041052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:05:33.056565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:33.057193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:33.058079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:33.059804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:33.061271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:33.062329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:33.088508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Getting quotas for project 4d50dff5e638459c9776ffc01c813b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:05:33.095296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Getting quotas for user 884b8a3752594dfeb0d546c73a843481 and project 4d50dff5e638459c9776ffc01c813b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:05:33.109471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:05:33.112166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:05:33.177791 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f27805ae-1dd4-4c93-ba9a-ad3f070be6c8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.779538 Oct 12 09:05:33.187513 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2253/4916] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:05:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:05:33.193573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:33.194851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:33.205595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:33.206586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:33.208698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:33.210237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:33.210941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:33.211575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:33.234939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:33.246888 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6bd6da01-4c05-41f8-af05-b4aad1c54da7 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 0.705740 Oct 12 09:05:33.247973 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2664/4917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:32 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:33.255361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a608674-d707-4c65-b7b4-743d4223b4bd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:33.260424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a608674-d707-4c65-b7b4-743d4223b4bd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:33.370940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a608674-d707-4c65-b7b4-743d4223b4bd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:33.379859 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a608674-d707-4c65-b7b4-743d4223b4bd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1246 microversion: 2.1 time: 0.130438 Oct 12 09:05:33.380728 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2665/4918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:33 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1246 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:33.448675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:33.456914 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e9babe4b-f022-4546-812b-2e1090f6cb68 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1298 microversion: 2.1 time: 0.267867 Oct 12 09:05:33.464267 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2254/4919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:33 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1298 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:33.569540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:33.573676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:33.589907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:33.590412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:33.591160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:33.592274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:33.592921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:33.593346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:33.757165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:33.778049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:33.780929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:33.782466 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc308a9d-a0c0-466e-9fd3-02e175c4925b tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.220027 Oct 12 09:05:33.784068 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2666/4920] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:33 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:34.154321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-540774248", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e91f85f3-25cf-4a8d-9bf6-1b2efced9a60"}, {"port": "5a556884-14af-40aa-be30-df0ee72c6115", "tag": "port-1"}, {"port": "d7bed5e1-cb6a-4c20-8256-e65e5c1c223b", "tag": "port-2"}, {"uuid": "dba38a94-9dce-4c0b-879c-3bc19c9dc582", "tag": "net-1"}, {"uuid": "dba38a94-9dce-4c0b-879c-3bc19c9dc582"}, {"uuid": "232464b7-7716-4c3b-a062-f59d81ee2a50", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "232464b7-7716-4c3b-a062-f59d81ee2a50", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3404ef71-8e11-41b6-9dbb-5c330c0f549d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "706552b1-d60b-4b3f-a0dc-77c93b72c7c2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "208cf609-a9a5-412a-99c3-d41f66b829f4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--811156891"}], "key_name": "tempest-keypair-1203918891", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:34.274687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:34.276084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:34.291490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:34.292725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:34.293327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:34.294238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:34.294860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:34.298524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:34.791311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:34.804048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a19d292b-d647-4235-8baa-6c701e60c39b tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 0.531770 Oct 12 09:05:34.805429 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2667/4921] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:34 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:05:34.808486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] validate_networks() for [('e91f85f3-25cf-4a8d-9bf6-1b2efced9a60', None, None, None, None, None), (None, None, '5a556884-14af-40aa-be30-df0ee72c6115', None, None, None), (None, None, 'd7bed5e1-cb6a-4c20-8256-e65e5c1c223b', None, None, None), ('dba38a94-9dce-4c0b-879c-3bc19c9dc582', None, None, None, None, None), ('dba38a94-9dce-4c0b-879c-3bc19c9dc582', None, None, None, None, None), ('232464b7-7716-4c3b-a062-f59d81ee2a50', '10.2.2.100', None, None, None, None), ('232464b7-7716-4c3b-a062-f59d81ee2a50', '10.2.2.200', None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:05:34.821467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:34.822473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:34.836644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:34.838512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:34.839500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:34.842807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:34.843475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:34.844119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:35.162360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:35.178158 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-28e61675-1973-41bc-aedd-e112e0301bfb tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1306 microversion: 2.1 time: 0.369508 Oct 12 09:05:35.178757 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2668/4922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:34 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1306 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:35.198426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:35.199048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:35.208528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:35.209568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:35.210185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:35.212108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:35.214900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:35.215793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:36.150119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:36.166001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6559e651-3f04-4ac3-80f8-0683da06daab tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1364 microversion: 2.1 time: 0.976816 Oct 12 09:05:36.177653 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2669/4923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:35 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1364 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:36.183158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:36.183158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:36.198437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:36.198938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:36.199373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:36.200081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:36.200535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:36.200959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:36.438201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:36.451604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:36.453585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:36.455294 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a039c40-2f98-429f-a941-25b4040fcc2e tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.287393 Oct 12 09:05:36.456475 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2670/4924] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:36 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:36.461858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:36.462897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:36.471224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:36.472866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:36.473766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:36.474916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:36.475828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:36.476552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:36.862100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:36.876210 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a6b2749-5091-4e11-bc6c-9a10e76430b8 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 0.418271 Oct 12 09:05:36.889467 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2671/4925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:36 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:36.889467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:36.889467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:36.899577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:36.899822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:36.900265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:36.901323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:36.901471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:36.901883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:37.034552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:37.044955 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dc2adf9c-3250-4aef-a2fb-076478ed495e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1304 microversion: 2.1 time: 0.166610 Oct 12 09:05:37.046298 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2672/4926] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:36 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:37.197480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:37.199092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:37.206262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:37.207116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:37.207567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:37.208322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:37.208974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:37.209418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:37.651807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:37.663619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-718cd21a-5ff4-4cda-a882-63bf75aa8c05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1364 microversion: 2.1 time: 0.471074 Oct 12 09:05:37.665914 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2673/4927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:37 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1364 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:05:37.675829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-df02304f-70f0-47b6-b472-492db78e09da req-9281840e-3988-48e9-ad73-3e13e38d809a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ee6956-f9fb-408c-9eeb-e101fd460ec8", "tag": "8d97d239-c005-4658-b9d6-9836b9997de4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:37.689598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df02304f-70f0-47b6-b472-492db78e09da req-9281840e-3988-48e9-ad73-3e13e38d809a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:37.690620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df02304f-70f0-47b6-b472-492db78e09da req-9281840e-3988-48e9-ad73-3e13e38d809a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:37.691185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df02304f-70f0-47b6-b472-492db78e09da req-9281840e-3988-48e9-ad73-3e13e38d809a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:37.706762 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-df02304f-70f0-47b6-b472-492db78e09da req-9281840e-3988-48e9-ad73-3e13e38d809a service nova] Creating event network-changed:8d97d239-c005-4658-b9d6-9836b9997de4 for instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 on n-h1-858383-10 Oct 12 09:05:37.711901 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-df02304f-70f0-47b6-b472-492db78e09da req-9281840e-3988-48e9-ad73-3e13e38d809a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044472 Oct 12 09:05:37.713066 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2674/4928] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:37.719646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:37.720392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:37.728580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:37.729006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:37.729712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:37.731489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:37.732161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:37.732832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:37.828333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:37.842307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:37.844243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:37.864699 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d72fc1d-825f-4060-b089-70b7d69a07ac tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.148964 Oct 12 09:05:37.885833 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2675/4929] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:37 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:37.980772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3ea76b88-0547-414a-9e61-7346e372335b req-44713ac7-1cdb-43ed-9739-86bfd5766c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953f751f-c158-4b7d-aa42-c9141e05af27", "name": "network-vif-plugged", "status": "completed", "tag": "ed9f0bbd-8499-4132-8c10-60c66251f5f7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:37.994152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ea76b88-0547-414a-9e61-7346e372335b req-44713ac7-1cdb-43ed-9739-86bfd5766c0c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:37.994987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ea76b88-0547-414a-9e61-7346e372335b req-44713ac7-1cdb-43ed-9739-86bfd5766c0c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:37.995664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3ea76b88-0547-414a-9e61-7346e372335b req-44713ac7-1cdb-43ed-9739-86bfd5766c0c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:38.011624 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3ea76b88-0547-414a-9e61-7346e372335b req-44713ac7-1cdb-43ed-9739-86bfd5766c0c service nova] Creating event network-vif-plugged:ed9f0bbd-8499-4132-8c10-60c66251f5f7 for instance 953f751f-c158-4b7d-aa42-c9141e05af27 on n-h2-858383-10 Oct 12 09:05:38.018933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3ea76b88-0547-414a-9e61-7346e372335b req-44713ac7-1cdb-43ed-9739-86bfd5766c0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127295 Oct 12 09:05:38.019732 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2676/4930] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:38.027248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:38.028418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:38.038339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:38.039367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:38.040036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:38.041020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:38.041753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:38.043283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:38.398684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:38.411709 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-36f9fb6a-74d8-4bcf-97d9-8504b14c6c6e tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 0.390236 Oct 12 09:05:38.412968 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2677/4931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:38 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:38.440820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:38.441539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:38.450369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:38.451355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:38.452325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:38.453541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:38.454898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:38.455639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:38.806268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:38.814448 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cfa17297-3588-4755-9f1c-feca0b33cb87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1372 microversion: 2.1 time: 0.400213 Oct 12 09:05:38.815180 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2678/4932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:38 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1372 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:38.820522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:38.821419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:38.829154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:38.829990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:38.830655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:38.831678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:38.832419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:38.833176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:39.419583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:39.428912 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5aa4032a-d078-4834-8d53-f11b543af5d4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1364 microversion: 2.1 time: 0.612317 Oct 12 09:05:39.430275 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2679/4933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:38 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1364 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:39.436265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:39.437245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:39.444562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:39.445183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:39.447002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:39.447002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:39.447418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:39.448307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:39.540876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:39.550161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:39.551959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:39.553542 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f2cdcab7-54ca-4af1-971c-c2a46b778be7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.121947 Oct 12 09:05:39.554630 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2680/4934] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:39 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:39.580637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:39.581656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:39.588620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:39.589770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:39.590390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:39.591290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:39.591910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:39.592496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:39.616511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:39.722951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:40.041276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:40.058553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe59ee6b-c47b-48ab-8e07-27d4369786b9 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1316 microversion: 2.1 time: 0.490036 Oct 12 09:05:40.059136 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2681/4935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:39 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:40.073971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:40.074845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:40.097760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:40.098279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:40.098728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:40.099464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:40.099921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:40.100426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:40.562384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:40.577599 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5437171-91dd-4ab1-91e0-64b889886c72 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1372 microversion: 2.1 time: 0.517317 Oct 12 09:05:40.596106 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2682/4936] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:40 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1372 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:40.604173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:40.605118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:40.612330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:40.612936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:40.613701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:40.614751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:40.615319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:40.615948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:41.042849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:41.061799 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-96fd3926-c81b-453c-8bc2-0c7f9d04feea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1364 microversion: 2.1 time: 0.463306 Oct 12 09:05:41.063853 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2683/4937] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:40 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1364 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:41.074148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:41.075191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:41.090584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:41.091319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:41.091945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:41.093805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:41.094689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:41.095343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:41.257992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:41.266834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:41.268881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:41.270393 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c30b511-a734-4d5c-bb19-a35fc96a3e7d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.204693 Oct 12 09:05:41.289918 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2684/4938] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:41 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:41.296010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-62444207-a723-4594-b386-12a4d5d4577f req-09a4421b-f103-4b7f-84b3-5171e8ee5282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dfc060-f11f-4e03-a257-156ae0786b5a", "tag": "417415df-add3-4998-83fb-ea2240f786bb"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:41.307744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-62444207-a723-4594-b386-12a4d5d4577f req-09a4421b-f103-4b7f-84b3-5171e8ee5282 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:41.308462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-62444207-a723-4594-b386-12a4d5d4577f req-09a4421b-f103-4b7f-84b3-5171e8ee5282 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:41.309134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-62444207-a723-4594-b386-12a4d5d4577f req-09a4421b-f103-4b7f-84b3-5171e8ee5282 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:41.321739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-62444207-a723-4594-b386-12a4d5d4577f req-09a4421b-f103-4b7f-84b3-5171e8ee5282 service nova] Creating event network-changed:417415df-add3-4998-83fb-ea2240f786bb for instance a0dfc060-f11f-4e03-a257-156ae0786b5a on n-h1-858383-10 Oct 12 09:05:41.328304 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-62444207-a723-4594-b386-12a4d5d4577f req-09a4421b-f103-4b7f-84b3-5171e8ee5282 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036436 Oct 12 09:05:41.329616 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2685/4939] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:41.335971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:41.337302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:41.346388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:41.347171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:41.347886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:41.348876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:41.349626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:41.350296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:41.700632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:41.715278 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6432e92f-0a25-4a41-8976-2f111c61aee1 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1505 microversion: 2.1 time: 0.383843 Oct 12 09:05:41.730517 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2686/4940] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:41 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:41.736525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:41.736525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:41.740686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:41.743378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:41.743378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:41.743378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:41.743864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:41.744304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.166662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:05:42.168848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:05:42.170945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:05:42.171616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:05:42.172726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:05:42.180039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=5 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:42.194838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=17 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:42.197400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.198627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.199279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.207087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.207917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.208479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.242146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:42.243703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Getting quotas for project 01c9cafab43e40b1bb7d5e51f0a737fe. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:05:42.251751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Getting quotas for user f81f250849084de1827de11047258a5d and project 01c9cafab43e40b1bb7d5e51f0a737fe. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:05:42.256990 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-82c79da2-1254-4369-8f62-18ad17989f01 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1372 microversion: 2.1 time: 0.530812 Oct 12 09:05:42.257947 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2687/4941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:41 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1372 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:42.264274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:42.264813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:42.272325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.273341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.274077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.274996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.276061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.276700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.365236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:42.369702 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8fdb243f-c8d8-40f3-8d4b-90d341ad94fc tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27/os-instance-actions/req-d8b9bac6-cf3b-41d1-94ad-cc0061360114" status: 200 len: 313 microversion: 2.1 time: 0.108847 Oct 12 09:05:42.370908 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2688/4942] 10.222.0.40 () {58 vars in 1419 bytes} [Wed Oct 12 09:05:42 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27/os-instance-actions/req-d8b9bac6-cf3b-41d1-94ad-cc0061360114 => generated 313 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:42.385962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:42.387086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:42.394973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.396328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.397134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.398620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.399243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.399842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.606286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:05:42.609527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3404ef71-8e11-41b6-9dbb-5c330c0f549d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='706552b1-d60b-4b3f-a0dc-77c93b72c7c2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='208cf609-a9a5-412a-99c3-d41f66b829f4',volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:05:42.663648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:42.673578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-33111c71-7f10-47c4-9bfd-4ba04dc2543c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1364 microversion: 2.1 time: 0.301298 Oct 12 09:05:42.695478 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2689/4943] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:42 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:42.711461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:42.718339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:42.730174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.730174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.731318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.732136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.732514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.732939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.926115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:42.938687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:42.946367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:42.947701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cb4e5a34-ca77-417e-9dc8-2ce7b653c7a2 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.251074 Oct 12 09:05:42.950079 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2690/4944] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:42 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:42.966122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:42.970570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:42.982668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.983890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.984478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:42.985349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:42.985911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:42.986547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:43.134968 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb918d10-9e98-4c43-9e5a-3d1fee40dfdd tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "POST /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27/action" status: 202 len: 0 microversion: 2.1 time: 0.182635 Oct 12 09:05:43.139031 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2691/4945] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:05:42 2022] POST /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:05:43.147664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:43.148477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:43.154592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:43.157550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:43.158529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:43.159135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:43.160994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:43.161730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:43.162582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:43.178501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6197f886-27e5-4371-8204-6016faead592 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.029545 Oct 12 09:05:43.183564 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2255/4946] 10.222.0.40 () {62 vars in 1189 bytes} [Wed Oct 12 09:05:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 9035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 09:05:43.196289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5fd6cccc-b35c-49d6-a13c-0af4358addf0 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:43.197344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5fd6cccc-b35c-49d6-a13c-0af4358addf0 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:43.377010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=28 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:43.436830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5fd6cccc-b35c-49d6-a13c-0af4358addf0 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:43.452580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5fd6cccc-b35c-49d6-a13c-0af4358addf0 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:43.454076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5fd6cccc-b35c-49d6-a13c-0af4358addf0 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:43.455240 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5fd6cccc-b35c-49d6-a13c-0af4358addf0 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1285 microversion: 2.32 time: 0.264010 Oct 12 09:05:43.455811 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2256/4947] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:43 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:43.480482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:43.481500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:43.490677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:43.492110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:43.492810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:43.493747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:43.494364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:43.494977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:44.005707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.018413 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6383a376-d63b-4bd2-917c-d1cdec3ff45e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1372 microversion: 2.1 time: 0.542525 Oct 12 09:05:44.019013 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2257/4948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:43 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1372 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:44.031350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:44.033058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:44.052582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:44.053141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:44.054665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:44.055611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:44.056084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:44.056576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:44.180768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.195805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd7e257c-fdb4-4c32-889b-59abb2513972 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1507 microversion: 2.1 time: 1.052375 Oct 12 09:05:44.196985 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2692/4949] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:43 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1507 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:44.202392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-52b985d4-acab-4cf0-bcfd-5d89d307213d req-28c9b91f-27ca-4bc9-99e6-30164bfe900f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee6956-f9fb-408c-9eeb-e101fd460ec8", "name": "network-vif-plugged", "status": "completed", "tag": "8d97d239-c005-4658-b9d6-9836b9997de4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:44.225932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-52b985d4-acab-4cf0-bcfd-5d89d307213d req-28c9b91f-27ca-4bc9-99e6-30164bfe900f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:44.228851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-52b985d4-acab-4cf0-bcfd-5d89d307213d req-28c9b91f-27ca-4bc9-99e6-30164bfe900f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:44.229687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-52b985d4-acab-4cf0-bcfd-5d89d307213d req-28c9b91f-27ca-4bc9-99e6-30164bfe900f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:44.261804 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-52b985d4-acab-4cf0-bcfd-5d89d307213d req-28c9b91f-27ca-4bc9-99e6-30164bfe900f service nova] Creating event network-vif-plugged:8d97d239-c005-4658-b9d6-9836b9997de4 for instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 on n-h1-858383-10 Oct 12 09:05:44.270363 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-52b985d4-acab-4cf0-bcfd-5d89d307213d req-28c9b91f-27ca-4bc9-99e6-30164bfe900f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071105 Oct 12 09:05:44.271282 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2693/4950] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:44.321311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:44.322425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:44.331794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:44.332616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:44.333343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:44.334612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:44.335282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:44.336418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:44.496608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.512356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.513882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.521742 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.248498 Oct 12 09:05:44.522728 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2694/4951] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:44 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:44.544237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.544753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:44.556511 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3dccc073-62ac-4a15-bfd5-1ac4a05dc227 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.021008 Oct 12 09:05:44.566926 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2695/4952] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 12 09:05:44 2022] GET /compute/ => generated 377 bytes in 42 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 09:05:44.572257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:44.572810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:44.577973 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1364 microversion: 2.1 time: 0.553635 Oct 12 09:05:44.578759 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2258/4953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:44 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1364 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:44.580722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:44.581416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:44.582076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:44.582954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:44.583148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:44.583731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:44.584360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:44.591287 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004818 Oct 12 09:05:44.599231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2259/4954] 10.222.0.40 () {54 vars in 1035 bytes} [Wed Oct 12 09:05:44 2022] GET /compute/v2/ => generated 379 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 12 09:05:44.601807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:44.603274 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002406 Oct 12 09:05:44.604846 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2260/4955] 10.222.0.40 () {54 vars in 1041 bytes} [Wed Oct 12 09:05:44 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:44.614036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:44.615116 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ba7d03c-c1f1-42e7-a9ee-a0a056dab21b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001454 Oct 12 09:05:44.615718 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2261/4956] 10.222.0.40 () {56 vars in 886 bytes} [Wed Oct 12 09:05:44 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 12 09:05:44.821601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.842308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.845337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:44.850494 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a746223-9cc7-40ab-a6a7-34b15494b6b3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1527 microversion: 2.32 time: 0.281343 Oct 12 09:05:44.852891 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2696/4957] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:44 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1527 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:45.040700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:45.046086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:45.056372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.057214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.057867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.058769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.059685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.060303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.203196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:45.211676 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9421f9ef-bbef-4e7c-8686-50ea2d13edc3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1372 microversion: 2.1 time: 0.174894 Oct 12 09:05:45.213301 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2262/4958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:45 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:45.226065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:45.226065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:45.227579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.228256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.229064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.229959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.230558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.231129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.552877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:45.553500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:45.567105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.569289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.570018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.571112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.571578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.575651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.703503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:45.714920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:45.716815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:45.718980 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-564d6ef8-7c09-419a-b5df-3d3f08e66d35 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.170572 Oct 12 09:05:45.719898 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2263/4959] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:45 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:45.726027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:45.726889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:45.744300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.745081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.745545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.746340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.747062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.749033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.812519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:45.822931 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e1118162-0eb3-4c5e-bfd1-de68de935c7a tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1512 microversion: 2.1 time: 0.606713 Oct 12 09:05:45.826130 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2697/4960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:45 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1512 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:45.881208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:45.881940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:45.889294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.890136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.892494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:45.893326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:45.893874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:45.894401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:46.010771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:46.022030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:46.023834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:46.025320 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d74610f-91dc-46ae-9eb3-74cf0108d81a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1593 microversion: 2.32 time: 0.148122 Oct 12 09:05:46.026849 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2698/4961] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:45 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1593 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:46.238678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:46.240051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:46.249770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:46.250592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:46.251256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:46.252422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:46.253054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:46.253777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:46.277345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:46.530122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:46.540256 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-01ae5ccf-0e28-4827-816d-90228f8b6dad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1364 microversion: 2.1 time: 0.818333 Oct 12 09:05:46.558449 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2264/4962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:45 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1364 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:46.586696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:46.591182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-202c90c3-603c-4ce2-993e-8c050e50dabf req-61b4bbfe-6af1-4840-a452-4f631fad329f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dfc060-f11f-4e03-a257-156ae0786b5a", "name": "network-vif-plugged", "status": "completed", "tag": "417415df-add3-4998-83fb-ea2240f786bb"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:46.599705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3873999a-1f45-4d82-9e3a-d2f2e07f7de1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1372 microversion: 2.1 time: 0.362027 Oct 12 09:05:46.615228 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2699/4963] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:46 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:05:46.635717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-202c90c3-603c-4ce2-993e-8c050e50dabf req-61b4bbfe-6af1-4840-a452-4f631fad329f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:46.636653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-202c90c3-603c-4ce2-993e-8c050e50dabf req-61b4bbfe-6af1-4840-a452-4f631fad329f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:46.638134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-202c90c3-603c-4ce2-993e-8c050e50dabf req-61b4bbfe-6af1-4840-a452-4f631fad329f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:46.666443 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-202c90c3-603c-4ce2-993e-8c050e50dabf req-61b4bbfe-6af1-4840-a452-4f631fad329f service nova] Creating event network-vif-plugged:417415df-add3-4998-83fb-ea2240f786bb for instance a0dfc060-f11f-4e03-a257-156ae0786b5a on n-h1-858383-10 Oct 12 09:05:46.680117 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-202c90c3-603c-4ce2-993e-8c050e50dabf req-61b4bbfe-6af1-4840-a452-4f631fad329f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119352 Oct 12 09:05:46.681076 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2265/4964] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:46.752060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:46.752689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:46.766731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:46.768436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:46.770926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:46.772391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:46.773117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:46.773888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:46.856841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:46.857574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:46.869204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:46.869734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:46.870518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:46.870893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:46.871349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:46.871772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:46.918724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:46.927942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:46.933675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:46.934939 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8617a55b-b893-4842-8c71-9316db3ed91a tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.190321 Oct 12 09:05:46.935535 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2700/4965] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:46 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:47.054293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:47.055515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:47.070023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.070572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.071022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.076079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.079112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.080388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.230566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:47.236798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:47.242887 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a74e709b-aa49-446a-bbb6-348151497cff tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1505 microversion: 2.1 time: 0.390332 Oct 12 09:05:47.245827 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2266/4966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:46 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:05:47.265232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:47.267447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:47.268833 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66c88079-060a-4e37-86b9-74fba0730719 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1593 microversion: 2.32 time: 0.220768 Oct 12 09:05:47.270115 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2701/4967] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:47 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1593 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:47.270644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '.version_select at 0x7f9848ba44c0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:47.271202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:47.282477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.282970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.283407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.284109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.284559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.284984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.323859 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bf446095-98c8-4c97-9e1e-77dee78f6c3c tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.057030 Oct 12 09:05:47.326183 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2267/4968] 10.222.0.40 () {58 vars in 1296 bytes} [Wed Oct 12 09:05:47 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27/os-instance-actions => generated 611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:05:47.338262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:47.339007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:47.346415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.347121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.347728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.348622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.349532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.350120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.378840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:05:47.560214 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-844a3366-f215-414b-9ab3-bbb5b19e8216 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "DELETE /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 204 len: 0 microversion: 2.1 time: 0.222920 Oct 12 09:05:47.563651 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2702/4969] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:05:47 2022] DELETE /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:05:47.566193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:47.566869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:47.572784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:47.576189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:47.579086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.581032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.582371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.585427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.588087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.588741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.593205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.597428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.599311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.602685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.614928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.617098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.857043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:47.866310 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-29dd90f1-52e6-4ff1-8f1a-5e9df444690b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1554 microversion: 2.1 time: 0.305956 Oct 12 09:05:47.867339 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2268/4970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:47 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:05:47.881734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:47.882622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:47.889412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.894018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.895006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:47.896036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:47.899397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:47.901279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:48.004951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:48.022169 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c926f6e9-bd8f-4c9e-8813-a577f6bf1b0f tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1511 microversion: 2.1 time: 0.447389 Oct 12 09:05:48.034457 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2703/4971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:47 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:48.061111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:48.070239 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-70307305-aa41-45c6-9cad-fa18c015f264 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1372 microversion: 2.1 time: 0.201723 Oct 12 09:05:48.074019 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2269/4972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:47 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1372 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:48.080890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:48.081616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:48.092627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:48.093402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:48.094177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:48.095171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:48.095960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:48.097017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:48.201903 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-41246c85-fc2a-4aba-9347-31704b183666 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125611 Oct 12 09:05:48.202819 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2270/4973] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:05:48 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:48.213832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:48.214468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:48.223336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:48.223840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:48.224283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:48.231046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:48.231539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:48.250641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c04b9893-0a7f-44f5-8a27-7ab247c6f194 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Action: 'create', calling method: .version_select at 0x7f98491b6820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-453406164"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:48.268569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:48.439250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:48.457773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:48.460970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:48.463905 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e53683db-2a1a-44e0-8b5f-4eb9f7a00190 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.260113 Oct 12 09:05:48.465083 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2271/4974] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:48 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:48.471306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:48.472316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:48.480251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:48.480983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:48.481633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:48.482649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:48.483391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:48.483984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:48.528021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:48.870682 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c04b9893-0a7f-44f5-8a27-7ab247c6f194 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.834095 Oct 12 09:05:48.871820 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2704/4975] 10.222.0.40 () {60 vars in 1155 bytes} [Wed Oct 12 09:05:48 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 836 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 09:05:48.887695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3286f453-dc0f-4a46-936a-04d2e7aacd82 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984882c820>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:48.960439 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3286f453-dc0f-4a46-936a-04d2e7aacd82 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 200 len: 344 microversion: 2.1 time: 0.079958 Oct 12 09:05:48.961104 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2705/4976] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:05:48 2022] GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:49.051218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:49.054546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:49.079783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:49.081226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:49.083024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:49.085046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:49.086721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:49.089702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:49.091640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:49.094924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:49.100728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:49.103260 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-62463e07-a53e-4038-b54b-4774e09fc6ae tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1660 microversion: 2.32 time: 0.636468 Oct 12 09:05:49.106495 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2272/4977] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:48 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1660 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:49.117844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:49.119468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:49.135758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:49.139936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:49.140582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:49.141535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:49.143111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:49.143801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:49.515764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:49.534486 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79c1decf-16b2-4fa1-967f-64d7e1aa30a5 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1511 microversion: 2.1 time: 0.486903 Oct 12 09:05:49.536491 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2706/4978] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:49 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:05:49.549790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:49.557110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:49.573100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:49.573904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:49.574493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:49.575363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:49.575970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:49.579931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:49.730228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:49.743037 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fc5a828b-b323-4bc3-8607-99b08abddc02 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1567 microversion: 2.1 time: 0.635209 Oct 12 09:05:49.753535 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2273/4979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:49 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1567 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:49.769267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:49.769816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:49.789669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:49.790198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:49.790643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:49.791392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:49.791850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:49.792280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:50.011967 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-befb6998-14a7-461e-8ff0-cfc5545cfc9b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246962 Oct 12 09:05:50.012848 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2274/4980] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:05:49 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-interface => generated 285 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:50.018463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c632236f-100b-4857-a107-80717e8afb1c tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cbcf8b0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:50.104270 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c632236f-100b-4857-a107-80717e8afb1c tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 200 len: 344 microversion: 2.1 time: 0.089134 Oct 12 09:05:50.106057 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2275/4981] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:05:50 2022] GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:50.161258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:50.161933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:50.185296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:50.185754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:50.186208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:50.186942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:50.187401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:50.187835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:50.397307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:50.416969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:50.418378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:50.419601 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90114cac-0d89-4b14-a581-b6c293a561f3 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.876999 Oct 12 09:05:50.420198 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2707/4982] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:49 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:50.560141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:50.561065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:50.569788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:50.570818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:50.571471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:50.572408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:50.574514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:50.576525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:51.103677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:51.130602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:51.147669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:51.153655 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e68a6c62-7f48-4251-8f44-cae526b282c5 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1660 microversion: 2.32 time: 1.014227 Oct 12 09:05:51.155375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4da2cf326724e9db041e0b86b0416d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ee3298ecd74641894e5eeb18b30792', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:51.156325 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2276/4983] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:50 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1660 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:51.163684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-92eaed86-95d5-4fcd-ab1b-52215ee3d79f tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cbc4820>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:51.180944 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c71b87ee-2d42-4c45-b0bb-9a5cfaa844ed tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 200 len: 1511 microversion: 2.1 time: 0.626138 Oct 12 09:05:51.195131 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2708/4984] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:50 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 1511 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:05:51.203890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9442bf95-13a4-419f-8e74-36190c42df26 req-0d4b9a16-7dea-4697-8ca6-cf807d45d62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953f751f-c158-4b7d-aa42-c9141e05af27", "name": "network-vif-deleted", "tag": "ed9f0bbd-8499-4132-8c10-60c66251f5f7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:51.214758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9442bf95-13a4-419f-8e74-36190c42df26 req-0d4b9a16-7dea-4697-8ca6-cf807d45d62b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:51.216083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9442bf95-13a4-419f-8e74-36190c42df26 req-0d4b9a16-7dea-4697-8ca6-cf807d45d62b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:51.216745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9442bf95-13a4-419f-8e74-36190c42df26 req-0d4b9a16-7dea-4697-8ca6-cf807d45d62b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:51.242766 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9442bf95-13a4-419f-8e74-36190c42df26 req-0d4b9a16-7dea-4697-8ca6-cf807d45d62b service nova] Creating event network-vif-deleted:ed9f0bbd-8499-4132-8c10-60c66251f5f7 for instance 953f751f-c158-4b7d-aa42-c9141e05af27 on n-h2-858383-10 Oct 12 09:05:51.249532 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9442bf95-13a4-419f-8e74-36190c42df26 req-0d4b9a16-7dea-4697-8ca6-cf807d45d62b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052426 Oct 12 09:05:51.250688 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2709/4985] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:51.296546 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-92eaed86-95d5-4fcd-ab1b-52215ee3d79f tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 200 len: 345 microversion: 2.1 time: 0.138846 Oct 12 09:05:51.297173 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2277/4986] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:05:51 2022] GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:51.312847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d240e26-4b3a-4969-a556-0ac956a51cc2 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Action: 'create', calling method: .version_select at 0x7f9848204ca0>, body: {"snapshot": {"volume_id": "6200b69f-bc08-496a-bf14-91dfe1b03b7a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1036788546"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:51.452396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:51.454608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:51.480863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:51.481534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:51.484422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:51.485912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:51.486567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:51.487102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:51.637499 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d240e26-4b3a-4969-a556-0ac956a51cc2 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.329823 Oct 12 09:05:51.638288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2710/4987] 10.222.0.40 () {60 vars in 1162 bytes} [Wed Oct 12 09:05:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:51.649791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa55ca0c-ded3-4359-9504-4e3068718666 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f98487e8c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:51.723252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa55ca0c-ded3-4359-9504-4e3068718666 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 200 len: 287 microversion: 2.1 time: 0.077620 Oct 12 09:05:51.724107 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2711/4988] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:51 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:51.734832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-602fc17a-cd19-4782-8348-cd93db9d095c tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cc1eca0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:51.824573 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-602fc17a-cd19-4782-8348-cd93db9d095c tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.093372 Oct 12 09:05:51.825664 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2712/4989] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 12 09:05:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:51.838747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9bd4b586-4607-4d59-ae94-2179b36cf986 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984ccdf1f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:51.909899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:51.921048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9bd4b586-4607-4d59-ae94-2179b36cf986 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 200 len: 287 microversion: 2.1 time: 0.087699 Oct 12 09:05:51.922216 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2713/4990] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:51 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:51.929010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:51.934716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:51.939586 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-573d2543-b716-474d-a118-226239c9ee68 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.496888 Oct 12 09:05:51.950161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2278/4991] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:51 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:52.190235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:52.193182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:52.208288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:52.209533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] [instance: 953f751f-c158-4b7d-aa42-c9141e05af27] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:52.220001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:52.220955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:52.221686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:52.223895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:52.224889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:52.225845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:52.226127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:52.226880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:52.227983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:52.228627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:52.243447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:52.247049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:52.265192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:52.267233 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] HTTP exception thrown: Instance 953f751f-c158-4b7d-aa42-c9141e05af27 could not be found. Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Request method failure captured: Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 HTTP/1.1 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNHppv6COQIULRXW-8REUCef69l1rIPsHGqn_Ufqo-MvC6NJ9RUlmidV_JgMEXV9za-oZS83lAeomY4vu80cMkaj7U6yBMElmAyujxJCvOuprEiR-U9zqF33RKwX7thmLNBXOlCUYEcZBAVU0INO6C4cqC78JIM4_KWMZ-wVui-GDw Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 30ee3298ecd74641894e5eeb18b30792 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-InstanceActionsTestJSON-949800838 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30ee3298ecd74641894e5eeb18b30792"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30ee3298ecd74641894e5eeb18b30792"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30ee3298ecd74641894e5eeb18b30792"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30ee3298ecd74641894e5eeb18b30792"}]}] Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-InstanceActionsTestJSON-949800838 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 30ee3298ecd74641894e5eeb18b30792 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-InstanceActionsTestJSON-949800838 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-InstanceActionsTestJSON-949800838-project Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: b4da2cf326724e9db041e0b86b0416d8 Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-InstanceActionsTestJSON-949800838-project Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 953f751f-c158-4b7d-aa42-c9141e05af27 could not be found. Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '953f751f-c158-4b7d-aa42-c9141e05af27'} Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953f751f-c158-4b7d-aa42-c9141e05af27 could not be found. Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953f751f-c158-4b7d-aa42-c9141e05af27 could not be found. Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:52.270326 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:52.275187 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:52.275187 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:05:52.275187 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:05:52.275187 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:05:52.275187 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:05:52.275187 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953f751f-c158-4b7d-aa42-c9141e05af27 could not be found. Oct 12 09:05:52.275187 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:05:52.282443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] Returning 404 to user: Instance 953f751f-c158-4b7d-aa42-c9141e05af27 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:05:52.283724 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83d6497c-4d31-42a5-9e5c-ca881d52c167 tempest-InstanceActionsTestJSON-949800838 tempest-InstanceActionsTestJSON-949800838-project] 10.222.0.40 "GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27" status: 404 len: 111 microversion: 2.1 time: 0.079337 Oct 12 09:05:52.284810 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2279/4992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:05:52 2022] GET /compute/v2.1/servers/953f751f-c158-4b7d-aa42-c9141e05af27 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:05:52.795906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-6cd95efd-adab-496e-8f12-7c0d81d54810 req-34007551-0946-4f02-8d2e-895625c3c68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ee6956-f9fb-408c-9eeb-e101fd460ec8", "tag": "8d97d239-c005-4658-b9d6-9836b9997de4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:52.829362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6cd95efd-adab-496e-8f12-7c0d81d54810 req-34007551-0946-4f02-8d2e-895625c3c68d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:52.831825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6cd95efd-adab-496e-8f12-7c0d81d54810 req-34007551-0946-4f02-8d2e-895625c3c68d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:52.832560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6cd95efd-adab-496e-8f12-7c0d81d54810 req-34007551-0946-4f02-8d2e-895625c3c68d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:52.886169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-6cd95efd-adab-496e-8f12-7c0d81d54810 req-34007551-0946-4f02-8d2e-895625c3c68d service nova] Creating event network-changed:8d97d239-c005-4658-b9d6-9836b9997de4 for instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 on n-h1-858383-10 Oct 12 09:05:52.903911 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-6cd95efd-adab-496e-8f12-7c0d81d54810 req-34007551-0946-4f02-8d2e-895625c3c68d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111554 Oct 12 09:05:52.908442 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2280/4993] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:52.934978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9384e9d-a01d-4afe-9207-45bbe700c447 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f9848ad7c10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:52.994497 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9384e9d-a01d-4afe-9207-45bbe700c447 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 200 len: 287 microversion: 2.1 time: 0.063659 Oct 12 09:05:52.995358 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2281/4994] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:52 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:05:53.000194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:53.001204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:53.028927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:53.029704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:53.030341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:53.031303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:53.031920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:53.032511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:53.135132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:53.164989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:53.169903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:53.174021 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-667f37b7-89fe-4202-becd-a25446ee31eb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1706 microversion: 2.32 time: 0.990371 Oct 12 09:05:53.176383 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2714/4995] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:52 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1706 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:53.414915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:53.434221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:53.437084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:53.440933 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-75d6269c-13ce-4556-9fd6-f5dcdbc301f8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.444281 Oct 12 09:05:53.458405 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2282/4996] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:52 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:54.010023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-170f6d75-434b-4688-80a0-5732dd856623 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f98481e8430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:54.126012 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-170f6d75-434b-4688-80a0-5732dd856623 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 200 len: 287 microversion: 2.1 time: 0.121350 Oct 12 09:05:54.131998 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2715/4997] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:54 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:54.204970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:54.205992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:54.209413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=7 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:54.218952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:54.220678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:54.221391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:54.222934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:54.223650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:54.224298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:54.476161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:54.477712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:54.493156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:54.493749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:54.494980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:54.496117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:54.499407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:54.500812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:54.702937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:54.714171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:54.724258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:54.725861 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0ee7caed-fce4-4e85-9f29-415c94e333d7 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1366 microversion: 2.57 time: 0.255330 Oct 12 09:05:54.736513 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2716/4998] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:54 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:54.919585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:54.937847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:54.939554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:54.940964 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ae53d9f-9841-4217-8ed1-671bc4a27b45 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1706 microversion: 2.32 time: 0.740798 Oct 12 09:05:54.941734 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2283/4999] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:54 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1706 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:55.140934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e348aff1-c583-4365-a3ae-5c2f589683da tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f9848204040>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:55.250408 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e348aff1-c583-4365-a3ae-5c2f589683da tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 200 len: 288 microversion: 2.1 time: 0.114538 Oct 12 09:05:55.251800 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2717/5000] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:55 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 288 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:55.265004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f271b0e1-bb57-4a05-b170-2d4a25fb5564 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cbe1310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:55.391835 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f271b0e1-bb57-4a05-b170-2d4a25fb5564 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 202 len: 0 microversion: 2.1 time: 0.130508 Oct 12 09:05:55.392656 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2284/5001] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Oct 12 09:05:55 2022] DELETE /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:05:55.401951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dbdbb1c1-5e81-4613-915f-d8313f472f40 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f9848f99550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:55.463414 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dbdbb1c1-5e81-4613-915f-d8313f472f40 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 200 len: 287 microversion: 2.1 time: 0.066293 Oct 12 09:05:55.464162 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2718/5002] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:55 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:55.678861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-503b0e28-b21c-47d4-8b3d-e138f6c0494b req-5483bd40-3910-45a8-99a0-42cb9b03638f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dfc060-f11f-4e03-a257-156ae0786b5a", "tag": "417415df-add3-4998-83fb-ea2240f786bb"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:05:55.699349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-503b0e28-b21c-47d4-8b3d-e138f6c0494b req-5483bd40-3910-45a8-99a0-42cb9b03638f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:55.706952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-503b0e28-b21c-47d4-8b3d-e138f6c0494b req-5483bd40-3910-45a8-99a0-42cb9b03638f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:55.711090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-503b0e28-b21c-47d4-8b3d-e138f6c0494b req-5483bd40-3910-45a8-99a0-42cb9b03638f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:55.768279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:55.768938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:55.773330 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-503b0e28-b21c-47d4-8b3d-e138f6c0494b req-5483bd40-3910-45a8-99a0-42cb9b03638f service nova] Creating event network-changed:417415df-add3-4998-83fb-ea2240f786bb for instance a0dfc060-f11f-4e03-a257-156ae0786b5a on n-h1-858383-10 Oct 12 09:05:55.784751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:55.785256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:55.793417 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-503b0e28-b21c-47d4-8b3d-e138f6c0494b req-5483bd40-3910-45a8-99a0-42cb9b03638f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118056 Oct 12 09:05:55.795772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:55.796643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:55.797168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:55.797622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:55.799862 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2285/5003] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:55.977097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:55.977953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:55.992290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:55.998796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:55.999541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:56.005494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:56.006244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:56.006865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:56.543283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:56.566899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:56.571629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:56.573238 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4a565a57-9096-49d6-92a2-e03ada9cd628 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1706 microversion: 2.32 time: 0.600620 Oct 12 09:05:56.581802 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2286/5004] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:55 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1706 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:56.592342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a42bf67a-9aa4-4ecd-ad7d-3ea21e2d75c7 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cbc4820>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:56.672439 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a42bf67a-9aa4-4ecd-ad7d-3ea21e2d75c7 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 200 len: 287 microversion: 2.1 time: 0.089097 Oct 12 09:05:56.674159 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2287/5005] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:56 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:56.682231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:56.700689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:56.702464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:56.703877 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-067bba8b-a263-47f6-a2e7-6f746cd4f9b8 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1372 microversion: 2.57 time: 0.941704 Oct 12 09:05:56.712699 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2719/5006] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:55 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1372 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:05:57.608702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:57.609482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:57.624997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:57.625625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:57.626165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:57.627064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:57.627621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:57.630823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:57.687079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db1ada79-2aaa-4d23-95c0-131a7cf034d0 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cb7e670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:57.815275 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db1ada79-2aaa-4d23-95c0-131a7cf034d0 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 200 len: 287 microversion: 2.1 time: 0.132229 Oct 12 09:05:57.815944 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2720/5007] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:57 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:05:57.821873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:57.822715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:57.858930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:57.860920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:57.862026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:57.864763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:57.865985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:57.867101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:58.129467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:58.150184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:58.159498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:58.165065 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d716c98-ede6-46a9-b523-a423e5102add tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1372 microversion: 2.57 time: 0.347750 Oct 12 09:05:58.167426 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2721/5008] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:57 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1372 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:58.753928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:58.769682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:58.772971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:58.776437 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-23858ffa-d991-4bdc-b3ab-b99294eed59e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1798 microversion: 2.32 time: 1.172050 Oct 12 09:05:58.781211 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2288/5009] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:57 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1798 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:58.828893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84fac97c-f04a-4725-93e3-eb8f1d5ee624 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cc1e0d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:58.869747 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-84fac97c-f04a-4725-93e3-eb8f1d5ee624 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] HTTP exception thrown: Snapshot c4ccbe7a-5837-40a2-90fb-6755547d0e1a could not be found. Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84fac97c-f04a-4725-93e3-eb8f1d5ee624 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Request method failure captured: Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a HTTP/1.1 Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoNrrs066xdVEyggk9jnUBgukIlh9VrG95upf_zSqF_C6B8EA_PQ1jXd-xP2tHSge6TRzlFRd2zReY9z_-85iAmTzBYVrv4Kkfr543m6lRjKltoSbTl8olc_3hwNjGWEZ6Cs5Qi9iJjYKi2ZovyUS_XUyzsVCUoguDfDxbuv-SavgHE Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 0b1fa3aabc324b5cad783f884a09751d Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0b1fa3aabc324b5cad783f884a09751d"}]}] Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 0b1fa3aabc324b5cad783f884a09751d Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesSnapshotsTestJSON-2032089857-project Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 25131c8bde244676853e28b43ab6c9af Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2032089857-project Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: exception: Snapshot c4ccbe7a-5837-40a2-90fb-6755547d0e1a could not be found. Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'c4ccbe7a-5837-40a2-90fb-6755547d0e1a'} Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c4ccbe7a-5837-40a2-90fb-6755547d0e1a could not be found. (HTTP 404) (Request-ID: req-4d49377f-98e1-4f9f-b91d-d73dd15f2218) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 09:05:58.875419 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c4ccbe7a-5837-40a2-90fb-6755547d0e1a could not be found. Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c4ccbe7a-5837-40a2-90fb-6755547d0e1a could not be found. Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c4ccbe7a-5837-40a2-90fb-6755547d0e1a could not be found. Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84fac97c-f04a-4725-93e3-eb8f1d5ee624 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Returning 404 to user: Snapshot c4ccbe7a-5837-40a2-90fb-6755547d0e1a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:05:58.879456 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-84fac97c-f04a-4725-93e3-eb8f1d5ee624 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a" status: 404 len: 111 microversion: 2.1 time: 0.052050 Oct 12 09:05:58.883564 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2722/5010] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:05:58 2022] GET /compute/v2.1/os-snapshots/c4ccbe7a-5837-40a2-90fb-6755547d0e1a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:05:58.886187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-354d55be-22ab-46a8-b43f-0129cd6c1782 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cbc4040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:58.979739 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-354d55be-22ab-46a8-b43f-0129cd6c1782 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 202 len: 0 microversion: 2.1 time: 0.097357 Oct 12 09:05:58.980990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2289/5011] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:05:58 2022] DELETE /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:05:58.991501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4dff4b60-2997-4f2f-a7d2-c3d502139a7f tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984ccdf1f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:59.057088 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4dff4b60-2997-4f2f-a7d2-c3d502139a7f tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 200 len: 344 microversion: 2.1 time: 0.071675 Oct 12 09:05:59.057981 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2723/5012] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:05:58 2022] GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:05:59.198354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:59.198976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:59.217419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:59.217996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:59.218536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:59.219153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:59.219622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:59.220020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:59.412839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:59.422168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:59.432758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:59.434412 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b20758d8-6d59-43cc-80da-29d905260610 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1357 microversion: 2.57 time: 0.241350 Oct 12 09:05:59.450514 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2290/5013] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:59 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:05:59.464718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:59.465589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:59.479088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:59.480190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:59.480861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:59.481817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:59.482484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:59.483116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:59.544957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:05:59.740274 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d7a9d42-db88-40db-a19e-a200d2d9c651 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "DELETE /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 204 len: 0 microversion: 2.57 time: 0.279477 Oct 12 09:05:59.740945 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2724/5014] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:05:59 2022] DELETE /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:05:59.749933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:59.750596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:59.758801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:59.760070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:59.760757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:59.761666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:59.762279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:59.762959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:59.811024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:05:59.811732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:05:59.828536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:59.829043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:59.829617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:59.830208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:05:59.830655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:05:59.831076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:05:59.869845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:05:59.927241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:59.940483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:59.946104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:05:59.953331 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b89d1df-05e1-42ca-b6ea-6852ba8ea266 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1363 microversion: 2.57 time: 0.207144 Oct 12 09:05:59.953621 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2291/5015] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:59 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:00.072225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-22513fd3-0990-4b8c-bba2-d1297d9de1e6 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984877ce50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:00.184781 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-22513fd3-0990-4b8c-bba2-d1297d9de1e6 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 200 len: 344 microversion: 2.1 time: 0.116577 Oct 12 09:06:00.185521 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2292/5016] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:06:00 2022] GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:06:00.319507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:00.340478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:00.343903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:00.347918 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b34fef50-2958-4fc1-8746-9fd2a052cb8e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1798 microversion: 2.32 time: 0.539200 Oct 12 09:06:00.351310 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2725/5017] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:05:59 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1798 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:00.999118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:01.000375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:01.019626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:01.020377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:01.021207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:01.024230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:01.025694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:01.026879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:01.202826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb804047-da42-46cc-af49-ee2718a088bb tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984ccdf4c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:01.204553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:01.219661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:01.221520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:01.223240 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ae6419a-298e-4d45-bf27-f0e40f830109 tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1363 microversion: 2.57 time: 0.245096 Oct 12 09:06:01.227933 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2293/5018] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:00 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:01.367503 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb804047-da42-46cc-af49-ee2718a088bb tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 200 len: 344 microversion: 2.1 time: 0.171157 Oct 12 09:06:01.374844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2726/5019] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:06:01 2022] GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:06:01.396761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:01.398119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:01.411638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:01.425139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:01.426087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:01.428290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:01.431896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:01.433139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:01.898166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:01.918620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:01.922822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:01.924644 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8ca77f4b-627b-415e-bf73-c38a6c53df59 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1844 microversion: 2.32 time: 0.538723 Oct 12 09:06:01.946429 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2294/5020] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:01 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1844 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:02.263454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:02.264256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:02.283295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:02.286953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:02.286953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:02.291889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:02.292477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:02.296937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:02.384674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55223870-91af-4e68-acbf-6b538630cb91 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cbd89d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:02.463003 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-55223870-91af-4e68-acbf-6b538630cb91 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] HTTP exception thrown: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.466490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55223870-91af-4e68-acbf-6b538630cb91 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Request method failure captured: Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a HTTP/1.1 Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNrrs066xdVEyggk9jnUBgukIlh9VrG95upf_zSqF_C6B8EA_PQ1jXd-xP2tHSge6TRzlFRd2zReY9z_-85iAmTzBYVrv4Kkfr543m6lRjKltoSbTl8olc_3hwNjGWEZ6Cs5Qi9iJjYKi2ZovyUS_XUyzsVCUoguDfDxbuv-SavgHE Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 0b1fa3aabc324b5cad783f884a09751d Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0b1fa3aabc324b5cad783f884a09751d"}]}] Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 0b1fa3aabc324b5cad783f884a09751d Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesSnapshotsTestJSON-2032089857-project Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 25131c8bde244676853e28b43ab6c9af Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2032089857-project Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: exception: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '6200b69f-bc08-496a-bf14-91dfe1b03b7a'} Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. (HTTP 404) (Request-ID: req-81b76e41-242e-4966-adf6-9bffcae24368) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 09:06:02.467177 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.471636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-55223870-91af-4e68-acbf-6b538630cb91 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Returning 404 to user: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:02.474978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:02.474978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:02.475246 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-55223870-91af-4e68-acbf-6b538630cb91 tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 404 len: 109 microversion: 2.1 time: 0.090150 Oct 12 09:06:02.475246 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2295/5021] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:06:02 2022] GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:06:02.475491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lazy-loading 'fault' on Instance uuid 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:06:02.501933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c8d2e668-52aa-4e09-9226-c748e5d6b3de tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f9848ba4af0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:02.585855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-c8d2e668-52aa-4e09-9226-c748e5d6b3de tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] HTTP exception thrown: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c8d2e668-52aa-4e09-9226-c748e5d6b3de tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Request method failure captured: Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a HTTP/1.1 Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNrrs066xdVEyggk9jnUBgukIlh9VrG95upf_zSqF_C6B8EA_PQ1jXd-xP2tHSge6TRzlFRd2zReY9z_-85iAmTzBYVrv4Kkfr543m6lRjKltoSbTl8olc_3hwNjGWEZ6Cs5Qi9iJjYKi2ZovyUS_XUyzsVCUoguDfDxbuv-SavgHE Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 0b1fa3aabc324b5cad783f884a09751d Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0b1fa3aabc324b5cad783f884a09751d"}]}] Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 0b1fa3aabc324b5cad783f884a09751d Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesSnapshotsTestJSON-2032089857-project Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 25131c8bde244676853e28b43ab6c9af Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2032089857-project Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: exception: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '6200b69f-bc08-496a-bf14-91dfe1b03b7a'} Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. (HTTP 404) (Request-ID: req-1c171402-77ca-4a9c-9ca2-c52c8310399a) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 09:06:02.590775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c8d2e668-52aa-4e09-9226-c748e5d6b3de tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Returning 404 to user: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:02.594622 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c8d2e668-52aa-4e09-9226-c748e5d6b3de tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 404 len: 109 microversion: 2.1 time: 0.116539 Oct 12 09:06:02.598324 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2296/5022] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:06:02 2022] DELETE /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:06:02.612588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a24e4fa-ea13-4f05-9269-76b779a0467a tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Calling method '.version_select at 0x7f984cbd8550>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:02.662972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:02.672513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:02.673985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069c1b110d7414d8ae63c70b8a7a6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684da3c12d8453c99eba9911b089744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:02.675185 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-33f9928e-7d3a-4dfa-aa0a-cc8059b0562d tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 200 len: 1368 microversion: 2.57 time: 0.417686 Oct 12 09:06:02.682705 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-1a24e4fa-ea13-4f05-9269-76b779a0467a tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] HTTP exception thrown: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a24e4fa-ea13-4f05-9269-76b779a0467a tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Request method failure captured: Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a HTTP/1.1 Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNrrs066xdVEyggk9jnUBgukIlh9VrG95upf_zSqF_C6B8EA_PQ1jXd-xP2tHSge6TRzlFRd2zReY9z_-85iAmTzBYVrv4Kkfr543m6lRjKltoSbTl8olc_3hwNjGWEZ6Cs5Qi9iJjYKi2ZovyUS_XUyzsVCUoguDfDxbuv-SavgHE Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 0b1fa3aabc324b5cad783f884a09751d Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0b1fa3aabc324b5cad783f884a09751d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0b1fa3aabc324b5cad783f884a09751d"}]}] Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 0b1fa3aabc324b5cad783f884a09751d Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2032089857 Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesSnapshotsTestJSON-2032089857-project Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 25131c8bde244676853e28b43ab6c9af Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2032089857-project Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: exception: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '6200b69f-bc08-496a-bf14-91dfe1b03b7a'} Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. (HTTP 404) (Request-ID: req-7ca059c1-2d7b-49a5-b24d-d7997a14f471) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 09:06:02.685843 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. Oct 12 09:06:02.691683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:02.694546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a24e4fa-ea13-4f05-9269-76b779a0467a tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] Returning 404 to user: Volume 6200b69f-bc08-496a-bf14-91dfe1b03b7a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:02.694546 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a24e4fa-ea13-4f05-9269-76b779a0467a tempest-VolumesSnapshotsTestJSON-2032089857 tempest-VolumesSnapshotsTestJSON-2032089857-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a" status: 404 len: 109 microversion: 2.1 time: 0.093903 Oct 12 09:06:02.695310 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2297/5023] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:06:02 2022] GET /compute/v2.1/os-volumes/6200b69f-bc08-496a-bf14-91dfe1b03b7a => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:06:02.707832 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2727/5024] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:02 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 1368 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:02.958520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:02.960001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:02.988259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:02.992263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:02.994420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:02.995283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:03.001985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:03.008386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:03.707553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:03.716110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:03.716785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] [instance: 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:03.726237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:03.728189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:03.730349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:03.730714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7e24813-5278-47c2-b031-5b3db6ded733 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1844 microversion: 2.32 time: 0.780477 Oct 12 09:06:03.730850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:03.731887 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2298/5025] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:02 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1844 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:03.739132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:03.740187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:03.741162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:03.741893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:03.762281 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] HTTP exception thrown: Instance 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 could not be found. Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Request method failure captured: Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 HTTP/1.1 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoNRQF8fu6RkbR_tKaIMrD2VkNzQ7rW27tLl32NMpyAoDOzmieqxztpvjRqtRovpp-Z4mEqj1TXCGsVkWZLxRjMxJq2FxUCdUY5TQq5_OiYJI8tiBCWMz6kwtPRdEM2d8qUiXmVTqg6vFqk2NyAZBJ84NL8kOb6rb-kerFD_jg42zw8 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.57 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a684da3c12d8453c99eba9911b089744 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerShowV257Test-1591657790 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a684da3c12d8453c99eba9911b089744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a684da3c12d8453c99eba9911b089744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a684da3c12d8453c99eba9911b089744"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a684da3c12d8453c99eba9911b089744"}]}] Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerShowV257Test-1591657790 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a684da3c12d8453c99eba9911b089744 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerShowV257Test-1591657790 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerShowV257Test-1591657790-project Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c069c1b110d7414d8ae63c70b8a7a6f5 Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerShowV257Test-1591657790-project Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 could not be found. Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '60cd6606-3c87-4dd9-a3ff-f4dca0e03f09'} Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 could not be found. Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 could not be found. Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:03.765553 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:03.769421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:03.769421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:03.769421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:03.769421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:06:03.769421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:06:03.769421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 could not be found. Oct 12 09:06:03.769421 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:03.770791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] Returning 404 to user: Instance 60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:03.771677 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66608429-0609-4d46-ba38-cd8b0c52b3bb tempest-ServerShowV257Test-1591657790 tempest-ServerShowV257Test-1591657790-project] 10.222.0.40 "GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09" status: 404 len: 111 microversion: 2.57 time: 0.060471 Oct 12 09:06:03.775922 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2728/5026] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:03 2022] GET /compute/v2.1/servers/60cd6606-3c87-4dd9-a3ff-f4dca0e03f09 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:06:03.831179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-dc9738e9-9c4d-4c00-8b9f-a81e6f6e6297 req-d5f21964-1791-41a6-88de-8046b4168387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "tag": "06715f80-814d-47a5-9ea1-080893c72f5c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:03.854767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dc9738e9-9c4d-4c00-8b9f-a81e6f6e6297 req-d5f21964-1791-41a6-88de-8046b4168387 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:03.856083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dc9738e9-9c4d-4c00-8b9f-a81e6f6e6297 req-d5f21964-1791-41a6-88de-8046b4168387 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:03.857201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dc9738e9-9c4d-4c00-8b9f-a81e6f6e6297 req-d5f21964-1791-41a6-88de-8046b4168387 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:03.897133 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-dc9738e9-9c4d-4c00-8b9f-a81e6f6e6297 req-d5f21964-1791-41a6-88de-8046b4168387 service nova] Creating event network-changed:06715f80-814d-47a5-9ea1-080893c72f5c for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:06:03.906025 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-dc9738e9-9c4d-4c00-8b9f-a81e6f6e6297 req-d5f21964-1791-41a6-88de-8046b4168387 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079191 Oct 12 09:06:03.907990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2299/5027] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:04.761416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:04.763003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:04.779678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:04.780199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:04.780789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:04.787551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:04.788060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:04.789299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:05.390677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:05.408871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:05.414004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:05.419337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5f8008e3-d98f-4a5f-8697-4229cdb1d98a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1844 microversion: 2.32 time: 0.661070 Oct 12 09:06:05.422982 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2729/5028] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:04 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1844 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:06.449565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:06.452049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:06.506497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:06.507252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:06.511004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:06.512130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:06.515280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:06.518152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:07.042602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:07.059787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:07.063469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:07.067232 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fd7950d6-a5e5-4287-9230-9ae0cea433ac tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1865 microversion: 2.32 time: 0.622430 Oct 12 09:06:07.072541 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2300/5029] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:06 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1865 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:07.209637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2cbb6424-69f4-4b31-b9e7-e91fcfeecdb4 req-85733e51-d466-4226-992a-ca5eb302c14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "tag": "5a556884-14af-40aa-be30-df0ee72c6115"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:07.240863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2cbb6424-69f4-4b31-b9e7-e91fcfeecdb4 req-85733e51-d466-4226-992a-ca5eb302c14c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:07.244460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2cbb6424-69f4-4b31-b9e7-e91fcfeecdb4 req-85733e51-d466-4226-992a-ca5eb302c14c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:07.245563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2cbb6424-69f4-4b31-b9e7-e91fcfeecdb4 req-85733e51-d466-4226-992a-ca5eb302c14c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:07.280555 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-2cbb6424-69f4-4b31-b9e7-e91fcfeecdb4 req-85733e51-d466-4226-992a-ca5eb302c14c service nova] Creating event network-changed:5a556884-14af-40aa-be30-df0ee72c6115 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:06:07.304930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2cbb6424-69f4-4b31-b9e7-e91fcfeecdb4 req-85733e51-d466-4226-992a-ca5eb302c14c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098003 Oct 12 09:06:07.306303 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2730/5030] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:07.827121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-681882be-defa-44ee-97ae-85cd637789a4 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Action: 'create', calling method: .version_select at 0x7f984cbd3dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-255322492", "metadata": {"Type": "work"}}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-681882be-defa-44ee-97ae-85cd637789a4 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Request method failure captured: Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 121 Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoN_Sj5Lyt8WsdlsOVUUffE5OZG3o2UfBsicVuT2Ue__L0VRNLHQHGyuPXagc8hz_E54ior2LW57pdqYmRjveZdct5AvNZRr_WkwXrviowpPxIn-ptAxtIKKfGB6icA6qQmHgOx_GbOmD_OYLoLBzmBhoIMVJ8KYkzqIp3aU7s07Rvs Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}] Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: eb761b05e9084a389393d4c4974e675b Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-255322492", "metadata": {"Type": "work"}}} Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-255322492', 'metadata': {'Type': 'work'}}}} Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi '#$%' Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:06:07.832269 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.836311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-681882be-defa-44ee-97ae-85cd637789a4 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:07.841322 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-681882be-defa-44ee-97ae-85cd637789a4 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.487204 Oct 12 09:06:07.842090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2301/5031] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Oct 12 09:06:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 494 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:06:07.858618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4c6c16cf-953d-4e01-bef1-75a15c1e7c4b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Action: 'create', calling method: .version_select at 0x7f98490dbb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1588146043", "metadata": {"Type": "work"}}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4c6c16cf-953d-4e01-bef1-75a15c1e7c4b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Request method failure captured: Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 120 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoN_Sj5Lyt8WsdlsOVUUffE5OZG3o2UfBsicVuT2Ue__L0VRNLHQHGyuPXagc8hz_E54ior2LW57pdqYmRjveZdct5AvNZRr_WkwXrviowpPxIn-ptAxtIKKfGB6icA6qQmHgOx_GbOmD_OYLoLBzmBhoIMVJ8KYkzqIp3aU7s07Rvs Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}] Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: eb761b05e9084a389393d4c4974e675b Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1588146043", "metadata": {"Type": "work"}}} Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1588146043', 'metadata': {'Type': 'work'}}}} Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi '0' Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:06:07.865023 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4c6c16cf-953d-4e01-bef1-75a15c1e7c4b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:07.869842 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4c6c16cf-953d-4e01-bef1-75a15c1e7c4b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017707 Oct 12 09:06:07.870904 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2731/5032] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Oct 12 09:06:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:06:07.880849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9445cfe5-746b-4e81-a8c5-55d0a2dc53c2 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Action: 'create', calling method: .version_select at 0x7f98487a61f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2073002793", "metadata": {"Type": "work"}}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9445cfe5-746b-4e81-a8c5-55d0a2dc53c2 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Request method failure captured: Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 119 Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoN_Sj5Lyt8WsdlsOVUUffE5OZG3o2UfBsicVuT2Ue__L0VRNLHQHGyuPXagc8hz_E54ior2LW57pdqYmRjveZdct5AvNZRr_WkwXrviowpPxIn-ptAxtIKKfGB6icA6qQmHgOx_GbOmD_OYLoLBzmBhoIMVJ8KYkzqIp3aU7s07Rvs Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}] Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: eb761b05e9084a389393d4c4974e675b Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2073002793", "metadata": {"Type": "work"}}} Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2073002793', 'metadata': {'Type': 'work'}}}} Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi '' Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:06:07.886339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9445cfe5-746b-4e81-a8c5-55d0a2dc53c2 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:07.891377 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9445cfe5-746b-4e81-a8c5-55d0a2dc53c2 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014809 Oct 12 09:06:07.893838 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2302/5033] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Oct 12 09:06:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:06:07.906595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bcda7ed0-7fe2-48f1-80ba-7b2681b2d62b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Calling method '.version_select at 0x7f984cb63e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:07.967868 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-bcda7ed0-7fe2-48f1-80ba-7b2681b2d62b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] HTTP exception thrown: Volume tempest-invalid-246731061 could not be found. Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bcda7ed0-7fe2-48f1-80ba-7b2681b2d62b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Request method failure captured: Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-246731061 HTTP/1.1 Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoN_Sj5Lyt8WsdlsOVUUffE5OZG3o2UfBsicVuT2Ue__L0VRNLHQHGyuPXagc8hz_E54ior2LW57pdqYmRjveZdct5AvNZRr_WkwXrviowpPxIn-ptAxtIKKfGB6icA6qQmHgOx_GbOmD_OYLoLBzmBhoIMVJ8KYkzqIp3aU7s07Rvs Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}] Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: eb761b05e9084a389393d4c4974e675b Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: exception: Volume tempest-invalid-246731061 could not be found. Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'tempest-invalid-246731061'} Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-246731061 could not be found. (HTTP 404) (Request-ID: req-5da251de-b440-410d-ab39-b123b3ff50e6) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 09:06:07.970123 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-246731061 could not be found. Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-246731061 could not be found. Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-246731061 could not be found. Oct 12 09:06:07.974751 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:07.982770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bcda7ed0-7fe2-48f1-80ba-7b2681b2d62b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Returning 404 to user: Volume tempest-invalid-246731061 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:07.982770 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bcda7ed0-7fe2-48f1-80ba-7b2681b2d62b tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-246731061" status: 404 len: 98 microversion: 2.1 time: 0.082716 Oct 12 09:06:07.983438 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2732/5034] 10.222.0.40 () {58 vars in 1215 bytes} [Wed Oct 12 09:06:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-246731061 => generated 98 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:06:07.995446 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aae62eb6-6ad4-4c77-9058-ad35a9ba20f3 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007097 Oct 12 09:06:07.995988 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2303/5035] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 12 09:06:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 09:06:08.008836 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-382a0f79-bc33-4f44-93e3-4940e4b4a8df tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005593 Oct 12 09:06:08.013605 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2733/5036] 10.222.0.40 () {58 vars in 1137 bytes} [Wed Oct 12 09:06:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 09:06:08.019404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ecb138b3-5499-4d2d-8a29-8da993567f56 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Calling method '.version_select at 0x7f9848e1f0d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:08.075206 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ecb138b3-5499-4d2d-8a29-8da993567f56 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] HTTP exception thrown: Volume 7def28d3-e340-4c06-a8fd-7ad773f3a8ea could not be found. Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ecb138b3-5499-4d2d-8a29-8da993567f56 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Request method failure captured: Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/os-volumes/7def28d3-e340-4c06-a8fd-7ad773f3a8ea HTTP/1.1 Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoN_Sj5Lyt8WsdlsOVUUffE5OZG3o2UfBsicVuT2Ue__L0VRNLHQHGyuPXagc8hz_E54ior2LW57pdqYmRjveZdct5AvNZRr_WkwXrviowpPxIn-ptAxtIKKfGB6icA6qQmHgOx_GbOmD_OYLoLBzmBhoIMVJ8KYkzqIp3aU7s07Rvs Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}] Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: eb761b05e9084a389393d4c4974e675b Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: exception: Volume 7def28d3-e340-4c06-a8fd-7ad773f3a8ea could not be found. Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '7def28d3-e340-4c06-a8fd-7ad773f3a8ea'} Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7def28d3-e340-4c06-a8fd-7ad773f3a8ea could not be found. (HTTP 404) (Request-ID: req-8a391983-5140-49e8-8535-b3d254dbc684) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 09:06:08.078775 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7def28d3-e340-4c06-a8fd-7ad773f3a8ea could not be found. Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7def28d3-e340-4c06-a8fd-7ad773f3a8ea could not be found. Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7def28d3-e340-4c06-a8fd-7ad773f3a8ea could not be found. Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ecb138b3-5499-4d2d-8a29-8da993567f56 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Returning 404 to user: Volume 7def28d3-e340-4c06-a8fd-7ad773f3a8ea could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:08.088086 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ecb138b3-5499-4d2d-8a29-8da993567f56 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/7def28d3-e340-4c06-a8fd-7ad773f3a8ea" status: 404 len: 109 microversion: 2.1 time: 0.064925 Oct 12 09:06:08.092440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2b50c4a-d53e-4309-8276-a01db44f0603 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Calling method '.version_select at 0x7f98489541f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:08.096636 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2304/5037] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:06:08 2022] DELETE /compute/v2.1/os-volumes/7def28d3-e340-4c06-a8fd-7ad773f3a8ea => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:06:08.121861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:08.122480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:08.145904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:08.146411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:08.147802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:08.148545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:08.153168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:08.153652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:08.182885 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a2b50c4a-d53e-4309-8276-a01db44f0603 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] HTTP exception thrown: Volume eb902434-f0bc-48ff-8ae5-bd0a33372305 could not be found. Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2b50c4a-d53e-4309-8276-a01db44f0603 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Request method failure captured: Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/os-volumes/eb902434-f0bc-48ff-8ae5-bd0a33372305 HTTP/1.1 Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoN_Sj5Lyt8WsdlsOVUUffE5OZG3o2UfBsicVuT2Ue__L0VRNLHQHGyuPXagc8hz_E54ior2LW57pdqYmRjveZdct5AvNZRr_WkwXrviowpPxIn-ptAxtIKKfGB6icA6qQmHgOx_GbOmD_OYLoLBzmBhoIMVJ8KYkzqIp3aU7s07Rvs Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1959e9940e544dd7afb7aeb4b07c1ecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1959e9940e544dd7afb7aeb4b07c1ecd"}]}] Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1959e9940e544dd7afb7aeb4b07c1ecd Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesNegativeTest-1763000420 Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: eb761b05e9084a389393d4c4974e675b Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesNegativeTest-1763000420-project Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: method: Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: exception: Volume eb902434-f0bc-48ff-8ae5-bd0a33372305 could not be found. Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'eb902434-f0bc-48ff-8ae5-bd0a33372305'} Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb902434-f0bc-48ff-8ae5-bd0a33372305 could not be found. (HTTP 404) (Request-ID: req-d51e4fdd-78d4-493e-b599-741b20edbaa6) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 09:06:08.185490 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb902434-f0bc-48ff-8ae5-bd0a33372305 could not be found. Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb902434-f0bc-48ff-8ae5-bd0a33372305 could not be found. Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb902434-f0bc-48ff-8ae5-bd0a33372305 could not be found. Oct 12 09:06:08.189982 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:06:08.196914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2b50c4a-d53e-4309-8276-a01db44f0603 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] Returning 404 to user: Volume eb902434-f0bc-48ff-8ae5-bd0a33372305 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:06:08.196914 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2b50c4a-d53e-4309-8276-a01db44f0603 tempest-VolumesNegativeTest-1763000420 tempest-VolumesNegativeTest-1763000420-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/eb902434-f0bc-48ff-8ae5-bd0a33372305" status: 404 len: 109 microversion: 2.1 time: 0.106656 Oct 12 09:06:08.198071 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2734/5038] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:06:08 2022] GET /compute/v2.1/os-volumes/eb902434-f0bc-48ff-8ae5-bd0a33372305 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:06:08.836031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:08.862093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:08.866076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:08.869955 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ed4ee7b-f537-41cf-871e-f0e7545045d3 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1865 microversion: 2.32 time: 0.769791 Oct 12 09:06:08.871269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2305/5039] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:08 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1865 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:09.065315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-281577192", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "09c59039-8e48-4c82-8ec7-9b535c35c63a"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:09.179667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] validate_networks() for [('09c59039-8e48-4c82-8ec7-9b535c35c63a', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:06:09.271921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ae7b7d4-5d31-46ba-9cf5-06fd3a85f318 tempest-ExtensionsTest-574927314 tempest-ExtensionsTest-574927314-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:09.273909 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ae7b7d4-5d31-46ba-9cf5-06fd3a85f318 tempest-ExtensionsTest-574927314 tempest-ExtensionsTest-574927314-project] 10.222.0.40 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.401462 Oct 12 09:06:09.274948 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2306/5040] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 12 09:06:08 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:09.283729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-338dfab9-7595-41ae-a8cc-240e6b65b5e5 tempest-ExtensionsTest-574927314 tempest-ExtensionsTest-574927314-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:09.292254 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-338dfab9-7595-41ae-a8cc-240e6b65b5e5 tempest-ExtensionsTest-574927314 tempest-ExtensionsTest-574927314-project] 10.222.0.40 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012058 Oct 12 09:06:09.293134 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2307/5041] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Oct 12 09:06:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 09:06:09.899802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:09.900607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:09.930857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:09.934606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:09.935420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:09.937272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:09.939157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:09.945618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:09.964151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:10.632790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:06:10.633890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:06:10.634832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:06:10.635562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:06:10.635983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:06:10.652307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:10.652801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:10.653229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:10.653970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:10.661932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:10.662597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:10.709675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Getting quotas for project 2e71a3b13b224ff5a20dffa561b62aea. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:06:10.728577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Getting quotas for user c7d8a6f2007b4f76b0633e048335ff3a and project 2e71a3b13b224ff5a20dffa561b62aea. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:06:10.758657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:06:10.763549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:06:10.896517 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-77b62ece-d118-47d0-a9c8-f11bfa0418f7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.682521 Oct 12 09:06:10.897268 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2735/5042] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:06:10.913272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f1dd5707-6e3c-4b8c-9e3d-d0e9bcddad61 req-6052d7bc-8e44-4dd3-a721-5546d0ed674e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "tag": "d7bed5e1-cb6a-4c20-8256-e65e5c1c223b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:10.951504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f1dd5707-6e3c-4b8c-9e3d-d0e9bcddad61 req-6052d7bc-8e44-4dd3-a721-5546d0ed674e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:10.957579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f1dd5707-6e3c-4b8c-9e3d-d0e9bcddad61 req-6052d7bc-8e44-4dd3-a721-5546d0ed674e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:10.958381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f1dd5707-6e3c-4b8c-9e3d-d0e9bcddad61 req-6052d7bc-8e44-4dd3-a721-5546d0ed674e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:11.000217 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f1dd5707-6e3c-4b8c-9e3d-d0e9bcddad61 req-6052d7bc-8e44-4dd3-a721-5546d0ed674e service nova] Creating event network-changed:d7bed5e1-cb6a-4c20-8256-e65e5c1c223b for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:06:11.011164 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f1dd5707-6e3c-4b8c-9e3d-d0e9bcddad61 req-6052d7bc-8e44-4dd3-a721-5546d0ed674e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109453 Oct 12 09:06:11.018394 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2736/5043] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:11.182585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2120065773", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "09c59039-8e48-4c82-8ec7-9b535c35c63a"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:11.282555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] validate_networks() for [('09c59039-8e48-4c82-8ec7-9b535c35c63a', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:06:11.328417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:11.358419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:11.368392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:11.386118 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5d497740-65c6-43a6-b7a7-ce333bc4f67e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1886 microversion: 2.32 time: 1.475317 Oct 12 09:06:11.390894 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2308/5044] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:09 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1886 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:12.423899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:12.424728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:12.429614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:12.454077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:12.454679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:12.464293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:12.469574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:12.470621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:12.471244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:12.951914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:06:12.952502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:06:12.953163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:06:12.953710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:06:12.954390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:06:12.986620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:12.988755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:12.992929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:12.995242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:12.999297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:13.010553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:13.089954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Getting quotas for project 2e71a3b13b224ff5a20dffa561b62aea. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:06:13.120488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Getting quotas for user c7d8a6f2007b4f76b0633e048335ff3a and project 2e71a3b13b224ff5a20dffa561b62aea. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:06:13.180511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:13.185553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:06:13.198506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:06:13.374830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:13.406065 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-791a160c-a7d6-49da-bb33-292ce3055910 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.225801 Oct 12 09:06:13.410054 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2737/5045] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:06:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:06:13.421157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:13.426788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:13.439806 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a394a248-5974-4c0b-b980-f24cddc6fe97 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1886 microversion: 2.32 time: 1.025565 Oct 12 09:06:13.449611 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2309/5046] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:12 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1886 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:13.704399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-298871544", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "451", "networks": [{"uuid": "09c59039-8e48-4c82-8ec7-9b535c35c63a"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:13.851614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] validate_networks() for [('09c59039-8e48-4c82-8ec7-9b535c35c63a', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:06:13.927490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a4132bdb-13bc-4bf7-82da-44868e51a02a req-70135709-7e6d-4156-98ff-fb7b9c21f140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "tag": "0130d9a3-e157-4705-a9b3-ac1d5261648d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:13.959534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a4132bdb-13bc-4bf7-82da-44868e51a02a req-70135709-7e6d-4156-98ff-fb7b9c21f140 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:13.965023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a4132bdb-13bc-4bf7-82da-44868e51a02a req-70135709-7e6d-4156-98ff-fb7b9c21f140 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:13.966944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a4132bdb-13bc-4bf7-82da-44868e51a02a req-70135709-7e6d-4156-98ff-fb7b9c21f140 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:13.989235 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a4132bdb-13bc-4bf7-82da-44868e51a02a req-70135709-7e6d-4156-98ff-fb7b9c21f140 service nova] Creating event network-changed:0130d9a3-e157-4705-a9b3-ac1d5261648d for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:06:13.996312 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a4132bdb-13bc-4bf7-82da-44868e51a02a req-70135709-7e6d-4156-98ff-fb7b9c21f140 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073281 Oct 12 09:06:13.998914 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2310/5047] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:14.478247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:14.478953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:14.494611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:14.497274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:14.499267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:14.502049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:14.504572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:14.506976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:15.993809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:16.033624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:16.045593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:16.046892 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97d0897a-d31a-4952-a63e-da0d1518c6e8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1886 microversion: 2.32 time: 1.574515 Oct 12 09:06:16.047717 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2311/5048] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:14 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1886 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:16.654252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-52c4bb82-192f-4c8a-b73c-cca9c7fbae01 req-e40dd8f8-2ba1-4d09-bba3-ccce40f0bcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "tag": "d9bc3848-a570-432c-a771-9ea92864ae86"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:16.670706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-52c4bb82-192f-4c8a-b73c-cca9c7fbae01 req-e40dd8f8-2ba1-4d09-bba3-ccce40f0bcda service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:16.671633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-52c4bb82-192f-4c8a-b73c-cca9c7fbae01 req-e40dd8f8-2ba1-4d09-bba3-ccce40f0bcda service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:16.673190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-52c4bb82-192f-4c8a-b73c-cca9c7fbae01 req-e40dd8f8-2ba1-4d09-bba3-ccce40f0bcda service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:16.689227 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-52c4bb82-192f-4c8a-b73c-cca9c7fbae01 req-e40dd8f8-2ba1-4d09-bba3-ccce40f0bcda service nova] Creating event network-changed:d9bc3848-a570-432c-a771-9ea92864ae86 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:06:16.697403 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-52c4bb82-192f-4c8a-b73c-cca9c7fbae01 req-e40dd8f8-2ba1-4d09-bba3-ccce40f0bcda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045824 Oct 12 09:06:16.698920 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2312/5049] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:06:17.001905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:06:17.008897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:06:17.009844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:06:17.010493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:06:17.011150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:06:17.039903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:17.041166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:17.042150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:17.043442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:17.044355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:17.045976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:17.096912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Getting quotas for project 2e71a3b13b224ff5a20dffa561b62aea. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:06:17.101138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:17.103389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:17.116272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Getting quotas for user c7d8a6f2007b4f76b0633e048335ff3a and project 2e71a3b13b224ff5a20dffa561b62aea. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:06:17.127348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:17.138477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:17.140710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:06:17.142333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:17.145329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:17.146668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:06:17.147471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:17.149255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:17.253923 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78b5465e-d45f-4293-96b3-e18ffde6a219 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.553759 Oct 12 09:06:17.268173 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2738/5050] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:06:17.277833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-893aea8d-d735-44cd-895f-88f82180b432 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:17.280148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-893aea8d-d735-44cd-895f-88f82180b432 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:17.371453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-893aea8d-d735-44cd-895f-88f82180b432 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:17.382932 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-893aea8d-d735-44cd-895f-88f82180b432 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1220 microversion: 2.1 time: 0.113384 Oct 12 09:06:17.386476 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2739/5051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:17 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:17.806095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca17b326-9d99-45c1-87b2-7d3af08028ea tempest-ComputeTenantNetworksTest-1786506427 tempest-ComputeTenantNetworksTest-1786506427-project] Calling method '.version_select at 0x7f9843f2d310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:18.091425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:18.105679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:18.109835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:18.111903 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d815bde-cc7b-4c78-a72b-61d48c6a43af tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 1.036556 Oct 12 09:06:18.113326 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2313/5052] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:17 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:18.300042 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca17b326-9d99-45c1-87b2-7d3af08028ea tempest-ComputeTenantNetworksTest-1786506427 tempest-ComputeTenantNetworksTest-1786506427-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.793414 Oct 12 09:06:18.301536 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2740/5053] 10.222.0.40 () {58 vars in 1158 bytes} [Wed Oct 12 09:06:17 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:06:18.311857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4a9fe29-ce33-4460-94ba-00615c7947e4 tempest-ComputeTenantNetworksTest-1786506427 tempest-ComputeTenantNetworksTest-1786506427-project] Calling method '.version_select at 0x7f9843eddb80>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:18.414763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:18.416276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:18.425086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:18.433607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:18.434455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:18.435418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:18.436028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:18.436606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:18.631790 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4a9fe29-ce33-4460-94ba-00615c7947e4 tempest-ComputeTenantNetworksTest-1786506427 tempest-ComputeTenantNetworksTest-1786506427-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks/660f5963-0927-401d-89fa-402560d8c8b7" status: 200 len: 139 microversion: 2.1 time: 0.323697 Oct 12 09:06:18.638548 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2314/5054] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 09:06:18 2022] GET /compute/v2.1/os-tenant-networks/660f5963-0927-401d-89fa-402560d8c8b7 => generated 139 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:18.640769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:18.649506 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf7fd04f-72a4-4b6b-b43e-b6622bbe5107 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1272 microversion: 2.1 time: 0.239430 Oct 12 09:06:18.650203 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2741/5055] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:18 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:19.077305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ef4f15c9-79d6-4c67-8dad-e137cefe3ac7 req-d394b6a0-aaaf-428a-8c4b-bde0c2a313ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "tag": "13c27b97-234d-48ad-a8c3-13ec4989dbd3"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:19.098385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef4f15c9-79d6-4c67-8dad-e137cefe3ac7 req-d394b6a0-aaaf-428a-8c4b-bde0c2a313ec service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:19.102160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef4f15c9-79d6-4c67-8dad-e137cefe3ac7 req-d394b6a0-aaaf-428a-8c4b-bde0c2a313ec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:19.102703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef4f15c9-79d6-4c67-8dad-e137cefe3ac7 req-d394b6a0-aaaf-428a-8c4b-bde0c2a313ec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:19.117514 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ef4f15c9-79d6-4c67-8dad-e137cefe3ac7 req-d394b6a0-aaaf-428a-8c4b-bde0c2a313ec service nova] Creating event network-changed:13c27b97-234d-48ad-a8c3-13ec4989dbd3 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:06:19.124084 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ef4f15c9-79d6-4c67-8dad-e137cefe3ac7 req-d394b6a0-aaaf-428a-8c4b-bde0c2a313ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050365 Oct 12 09:06:19.125411 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2315/5056] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:19.140071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:19.141411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:19.154732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:19.157823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:19.158508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:19.161198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:19.162340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:19.164195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:19.676028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:19.676812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:19.692557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:19.696016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:19.697358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:19.699021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:19.701289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:19.701822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:19.896953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:19.908067 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cec88a51-df14-41e0-aeb4-2958d9e2e144 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1278 microversion: 2.1 time: 0.237536 Oct 12 09:06:19.921168 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2316/5057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:19 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:19.991609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:20.008292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:20.010009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:20.011220 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c9208fe9-ee9d-4a9e-9067-0dad420dbce8 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.875361 Oct 12 09:06:20.014435 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2742/5058] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:19 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:20.935256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:20.937329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:20.956909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:20.960947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:20.961744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:20.963043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:20.964260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:20.965534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:21.043299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:21.043924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:21.053548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:21.061095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:21.063073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:21.063852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:21.064320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:21.064748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:21.306174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:21.320109 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9acecc9-5971-4a35-a08a-fe034c25d6ea tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1278 microversion: 2.1 time: 0.391531 Oct 12 09:06:21.334592 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2317/5059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:20 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1278 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:21.347112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2ba1eebd-5fb5-4abf-8554-8e7f327d8f65 req-2bbfec59-6226-44b2-9a66-7cff2b54fb58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d871c37a-b6b2-4318-af2e-c29186080fb8", "tag": "17b28c98-0d6c-4c2b-98b6-4b0309579074"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:21.362277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2ba1eebd-5fb5-4abf-8554-8e7f327d8f65 req-2bbfec59-6226-44b2-9a66-7cff2b54fb58 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:21.363128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2ba1eebd-5fb5-4abf-8554-8e7f327d8f65 req-2bbfec59-6226-44b2-9a66-7cff2b54fb58 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:21.363906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2ba1eebd-5fb5-4abf-8554-8e7f327d8f65 req-2bbfec59-6226-44b2-9a66-7cff2b54fb58 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:21.393864 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2ba1eebd-5fb5-4abf-8554-8e7f327d8f65 req-2bbfec59-6226-44b2-9a66-7cff2b54fb58 service nova] Creating event network-changed:17b28c98-0d6c-4c2b-98b6-4b0309579074 for instance d871c37a-b6b2-4318-af2e-c29186080fb8 on n-h2-858383-10 Oct 12 09:06:21.409834 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2ba1eebd-5fb5-4abf-8554-8e7f327d8f65 req-2bbfec59-6226-44b2-9a66-7cff2b54fb58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073125 Oct 12 09:06:21.410919 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2318/5060] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:21.821965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:21.843743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:21.845177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:21.850377 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb15d1c5-359b-4cca-b07e-6c0da8a1cd42 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.808345 Oct 12 09:06:21.854483 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2743/5061] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:21 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:22.138537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-cffed243-c760-4e96-91a5-bb70fd7c759b req-4cad9c0d-f950-4154-9972-0f323538004f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "tag": "5edb8f6d-cf43-4ebd-aab9-43212685d426"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:22.172478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cffed243-c760-4e96-91a5-bb70fd7c759b req-4cad9c0d-f950-4154-9972-0f323538004f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:22.174987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cffed243-c760-4e96-91a5-bb70fd7c759b req-4cad9c0d-f950-4154-9972-0f323538004f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:22.177223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cffed243-c760-4e96-91a5-bb70fd7c759b req-4cad9c0d-f950-4154-9972-0f323538004f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:22.203335 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-cffed243-c760-4e96-91a5-bb70fd7c759b req-4cad9c0d-f950-4154-9972-0f323538004f service nova] Creating event network-changed:5edb8f6d-cf43-4ebd-aab9-43212685d426 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:06:22.220631 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-cffed243-c760-4e96-91a5-bb70fd7c759b req-4cad9c0d-f950-4154-9972-0f323538004f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085780 Oct 12 09:06:22.235156 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2319/5062] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:22.349384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:22.354733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:22.369888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:22.371724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:22.372381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:22.374532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:22.377309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:22.378341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:22.825963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:22.835298 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-75a0ab07-6965-42b5-90ab-69941284c6e4 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 0.492190 Oct 12 09:06:22.836537 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2744/5063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:22 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:22.881960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:22.883348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:22.898828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:22.900466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:22.901023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:22.904029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:22.907485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:22.908005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:23.453127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:23.471905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:23.475971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:23.481532 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b8540b5-b268-4eae-b4a1-719edc47fc75 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.604206 Oct 12 09:06:23.484161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2320/5064] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:22 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:23.861207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:23.862471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:23.874844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:23.875416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:23.876072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:23.877016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:23.877655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:23.878239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:24.289465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:24.290655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:24.306068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:24.306847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:24.307547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:24.308653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:24.309312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:24.310941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:24.349830 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8bded3b-5532-46ca-a582-d680a6649ea9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/ips" status: 200 len: 150 microversion: 2.1 time: 0.067142 Oct 12 09:06:24.351371 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2321/5065] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:06:24 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:06:24.435246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:24.452403 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47d5d3d3-c249-421e-bf5c-8efd690eda92 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 0.590051 Oct 12 09:06:24.455622 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2745/5066] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:23 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:24.520955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:24.523899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:24.534237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:24.535186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:24.535866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:24.540831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:24.542585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:24.543237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:24.951230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9417e5c8-2f8d-4b56-a2c2-c795c97e9c8d req-84aef44f-b8fd-4403-81fb-92e2fd6d9a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7717dae4-6939-4ec3-9879-eecba8e09671", "tag": "7e5a3569-33ad-4566-bff0-6ff93c3ff0f4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:24.987041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9417e5c8-2f8d-4b56-a2c2-c795c97e9c8d req-84aef44f-b8fd-4403-81fb-92e2fd6d9a8e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:24.987558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9417e5c8-2f8d-4b56-a2c2-c795c97e9c8d req-84aef44f-b8fd-4403-81fb-92e2fd6d9a8e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:24.988556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9417e5c8-2f8d-4b56-a2c2-c795c97e9c8d req-84aef44f-b8fd-4403-81fb-92e2fd6d9a8e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:25.038249 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9417e5c8-2f8d-4b56-a2c2-c795c97e9c8d req-84aef44f-b8fd-4403-81fb-92e2fd6d9a8e service nova] Creating event network-changed:7e5a3569-33ad-4566-bff0-6ff93c3ff0f4 for instance 7717dae4-6939-4ec3-9879-eecba8e09671 on n-h2-858383-10 Oct 12 09:06:25.051211 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9417e5c8-2f8d-4b56-a2c2-c795c97e9c8d req-84aef44f-b8fd-4403-81fb-92e2fd6d9a8e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103085 Oct 12 09:06:25.052409 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2746/5067] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:25.299489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2324c935-7a68-485e-af6c-08c9060415c0 req-ece1b074-8663-4f5c-859b-d3afcf9ca7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b00d3f-4af5-42de-8153-8d96099b68af", "tag": "aca56614-a2f4-4f83-8010-390a13896529"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:25.320027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2324c935-7a68-485e-af6c-08c9060415c0 req-ece1b074-8663-4f5c-859b-d3afcf9ca7f2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:25.320517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2324c935-7a68-485e-af6c-08c9060415c0 req-ece1b074-8663-4f5c-859b-d3afcf9ca7f2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:25.321446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2324c935-7a68-485e-af6c-08c9060415c0 req-ece1b074-8663-4f5c-859b-d3afcf9ca7f2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:25.348335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-2324c935-7a68-485e-af6c-08c9060415c0 req-ece1b074-8663-4f5c-859b-d3afcf9ca7f2 service nova] Creating event network-changed:aca56614-a2f4-4f83-8010-390a13896529 for instance e1b00d3f-4af5-42de-8153-8d96099b68af on n-h1-858383-10 Oct 12 09:06:25.361992 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2324c935-7a68-485e-af6c-08c9060415c0 req-ece1b074-8663-4f5c-859b-d3afcf9ca7f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066603 Oct 12 09:06:25.364698 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2747/5068] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:06:25.480413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:25.481277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:25.490353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:25.491269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:25.491867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:25.492783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:25.493533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:25.499632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:25.839340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:25.854701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:25.856192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:25.857422 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c65ce997-baa8-4a5e-ad11-6e07c2c0c4f6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 1.344062 Oct 12 09:06:25.865839 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2322/5069] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:24 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:25.933177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:25.971420 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0ff581a3-a821-4ef1-ac17-3ef8a16bc852 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 0.494148 Oct 12 09:06:25.987884 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2748/5070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:25 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:06:26.892836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:26.894116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:26.910145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:26.910930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:26.913017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:26.914012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:26.916119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:26.916815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:27.002319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:27.003342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:27.030002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:27.032171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:27.032742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:27.034198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:27.036567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:27.042546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:27.080213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:27.381244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=20 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:27.392159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:27.407192 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c6c9d5f5-3f03-4632-abd8-72314fdb5b7b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 0.411376 Oct 12 09:06:27.417789 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2749/5071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:26 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:27.423892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18168f65-b4b0-46b1-a08a-62b9dee96235"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:27.428042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:27.437309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:27.438303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:27.438755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:27.439614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:27.440305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:27.440932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:27.656386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:27.702685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:27.711266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:27.712674 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a5ecc847-6f9d-4b95-99ad-2174935f10ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.823950 Oct 12 09:06:27.717807 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2323/5072] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:26 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:27.724504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8050e02c-65a8-4092-a76f-1977f3aa68a8"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:27.733599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:27.746633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:27.747132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:27.749968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:27.750897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:27.753265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:27.753819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:27.981616 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e4c1f97-92ec-4fa9-a95d-a267613f0b49 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561884 Oct 12 09:06:27.982327 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2750/5073] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:06:27 2022] POST /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:28.444627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:28.446841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:28.466130 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4595c707-568a-4260-917c-2a61b19211d3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745258 Oct 12 09:06:28.468205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:28.470811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:28.471442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:28.473551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:28.474805 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2324/5074] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:06:27 2022] POST /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:28.476457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:28.477175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:28.671101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-655a20c3-83f1-43a3-ac36-145bbebfa90b req-72de9003-115a-4bc7-8c19-50274999a900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d871c37a-b6b2-4318-af2e-c29186080fb8", "name": "network-vif-plugged", "status": "completed", "tag": "17b28c98-0d6c-4c2b-98b6-4b0309579074"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:28.704413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-655a20c3-83f1-43a3-ac36-145bbebfa90b req-72de9003-115a-4bc7-8c19-50274999a900 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:28.711345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-655a20c3-83f1-43a3-ac36-145bbebfa90b req-72de9003-115a-4bc7-8c19-50274999a900 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:28.712050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-655a20c3-83f1-43a3-ac36-145bbebfa90b req-72de9003-115a-4bc7-8c19-50274999a900 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:28.764636 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-655a20c3-83f1-43a3-ac36-145bbebfa90b req-72de9003-115a-4bc7-8c19-50274999a900 service nova] Creating event network-vif-plugged:17b28c98-0d6c-4c2b-98b6-4b0309579074 for instance d871c37a-b6b2-4318-af2e-c29186080fb8 on n-h2-858383-10 Oct 12 09:06:28.773543 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-655a20c3-83f1-43a3-ac36-145bbebfa90b req-72de9003-115a-4bc7-8c19-50274999a900 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108253 Oct 12 09:06:28.784422 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2325/5075] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:28.797682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:28.804237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:28.832735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:28.833618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:28.836103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:28.842789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:28.843811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:28.847647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:29.553504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:29.587348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-10c7c4af-446d-464d-a1b5-5cefd0c9ce20 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 1.149013 Oct 12 09:06:29.590234 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2751/5076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:28 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:06:30.472680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:30.486899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:30.489382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:30.494956 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-676ac02f-706e-47f8-afa5-c1b7cc612a7e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 1.708671 Oct 12 09:06:30.510254 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2326/5077] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:28 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:30.617215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:30.618715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:30.661587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:30.662511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:30.670017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:30.670874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:30.671369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:30.671808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:30.682494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:31.542235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:31.543214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:31.557139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:31.565961 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0a2c83f-d566-4b7d-8151-f9dc336732d5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 0.953411 Oct 12 09:06:31.566562 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2752/5078] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:30 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:06:31.575909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:31.577289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:31.578271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:31.579759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:31.580391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:31.581611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:32.595706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:32.597064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:32.616387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:32.619798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:32.620544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:32.621583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:32.624933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:32.625768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:33.026605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:33.064825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:33.067457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:33.069898 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86540e3b-dc93-4de8-ad28-874e94993b61 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 1.534168 Oct 12 09:06:33.088416 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2327/5079] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:31 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:33.151752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:33.165769 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78300ac5-c91b-4475-b3f6-26f4aaea549a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 0.571800 Oct 12 09:06:33.167521 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2753/5080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:32 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:34.107694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:34.109224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:34.127568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:34.130462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:34.136220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:34.137001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:34.146142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:34.147083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:34.196179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:34.196872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:34.215690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:34.216187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:34.220233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:34.223544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:34.224214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:34.225947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:34.860872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:34.870690 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71d95c11-0295-4a71-9805-c4985af75ec5 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 0.677004 Oct 12 09:06:34.875550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:34.884610 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2754/5081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:34 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:34.884941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:34.890307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:34.896497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:34.902232 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7a08ce94-f830-4b6b-9215-8f351d6484aa tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.800344 Oct 12 09:06:34.904766 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2328/5082] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:34 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:34.987965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ce0f8b78-cf2b-44de-9ee8-11e596d5891b req-bfabe84e-6837-42bb-9bda-f297056bd612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7717dae4-6939-4ec3-9879-eecba8e09671", "name": "network-vif-plugged", "status": "completed", "tag": "7e5a3569-33ad-4566-bff0-6ff93c3ff0f4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:35.009123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce0f8b78-cf2b-44de-9ee8-11e596d5891b req-bfabe84e-6837-42bb-9bda-f297056bd612 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:35.009895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce0f8b78-cf2b-44de-9ee8-11e596d5891b req-bfabe84e-6837-42bb-9bda-f297056bd612 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:35.010552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce0f8b78-cf2b-44de-9ee8-11e596d5891b req-bfabe84e-6837-42bb-9bda-f297056bd612 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:35.040740 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ce0f8b78-cf2b-44de-9ee8-11e596d5891b req-bfabe84e-6837-42bb-9bda-f297056bd612 service nova] Creating event network-vif-plugged:7e5a3569-33ad-4566-bff0-6ff93c3ff0f4 for instance 7717dae4-6939-4ec3-9879-eecba8e09671 on n-h2-858383-10 Oct 12 09:06:35.052871 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ce0f8b78-cf2b-44de-9ee8-11e596d5891b req-bfabe84e-6837-42bb-9bda-f297056bd612 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069740 Oct 12 09:06:35.056658 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2755/5083] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:06:35.908573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:35.909357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:35.939755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:35.940646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:35.957500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:35.958079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:35.960491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:35.965168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:35.965737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:35.966196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:35.969396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:35.970481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:35.972964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:35.974098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:35.975006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:35.975557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:36.515778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:36.529094 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b6dbdef9-93cc-4c79-9471-dfa7b9254eaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 0.625387 Oct 12 09:06:36.555616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2329/5084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:35 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:36.728908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:36.745619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:36.748667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:36.754057 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e95e49b-d1fc-4eb9-a550-47708df79ddc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.818420 Oct 12 09:06:36.755162 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2756/5085] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:35 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:37.206678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-45d21a3b-f662-412a-9641-7e3efdfa995c req-62080b84-1b4d-411c-bd5b-25a2cfdc6b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b00d3f-4af5-42de-8153-8d96099b68af", "name": "network-vif-plugged", "status": "completed", "tag": "aca56614-a2f4-4f83-8010-390a13896529"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:37.226410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45d21a3b-f662-412a-9641-7e3efdfa995c req-62080b84-1b4d-411c-bd5b-25a2cfdc6b5b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:37.235294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45d21a3b-f662-412a-9641-7e3efdfa995c req-62080b84-1b4d-411c-bd5b-25a2cfdc6b5b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:37.236258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45d21a3b-f662-412a-9641-7e3efdfa995c req-62080b84-1b4d-411c-bd5b-25a2cfdc6b5b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:37.302968 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-45d21a3b-f662-412a-9641-7e3efdfa995c req-62080b84-1b4d-411c-bd5b-25a2cfdc6b5b service nova] Creating event network-vif-plugged:aca56614-a2f4-4f83-8010-390a13896529 for instance e1b00d3f-4af5-42de-8153-8d96099b68af on n-h1-858383-10 Oct 12 09:06:37.316364 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-45d21a3b-f662-412a-9641-7e3efdfa995c req-62080b84-1b4d-411c-bd5b-25a2cfdc6b5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113744 Oct 12 09:06:37.326287 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2330/5086] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:37.563655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:37.564274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:37.589528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:37.590070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:37.590520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:37.591256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:37.591718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:37.599080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:37.785204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:37.786103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:37.796792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:37.801269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:37.802034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:37.803121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:37.803959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:37.805725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:38.697072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:38.715230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:38.722681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:38.737122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1cd56880-3704-4fab-9165-5f9f53edcd95 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.956384 Oct 12 09:06:38.738103 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2331/5087] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:37 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:38.814113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:38.831581 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c1c0ce1-81c1-4a07-85ff-8d9af889aa58 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1320 microversion: 2.1 time: 1.272678 Oct 12 09:06:38.832231 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2757/5088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:37 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1320 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:39.767223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:39.768046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:39.782440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:39.787844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:39.788441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:39.789308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:39.789909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:39.790485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:39.859017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:39.859631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:39.876706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:39.877394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:39.879161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:39.881409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:39.883504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:39.884206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:40.537250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:40.549069 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f1e06fa9-7dc0-48b8-9a2f-009b476195c2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1511 microversion: 2.1 time: 0.693870 Oct 12 09:06:40.549925 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2758/5089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:39 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1511 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:40.584811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:40.585554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:40.602690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:40.605242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:40.605683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:40.606475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:40.606886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:40.607315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:40.935876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:40.950363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:40.951394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:40.959687 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bae76dde-5cdc-457a-a077-97e93f5d1db1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 1.195990 Oct 12 09:06:40.961103 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2332/5090] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:39 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:41.016834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:41.026672 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d1a5968-fe8f-4615-afc1-f6378de80638 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1511 microversion: 2.1 time: 0.455307 Oct 12 09:06:41.031804 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2759/5091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:40 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:06:41.059094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:41.059962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:41.084739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:41.088040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:41.090883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:41.093246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:41.097334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:41.102832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:41.818074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:41.832529 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b417a124-7ab5-4f6e-a4f8-0ddf783aaeaf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671" status: 200 len: 1513 microversion: 2.1 time: 0.778390 Oct 12 09:06:41.850949 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2333/5092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:41 2022] GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 => generated 1513 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:41.898720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:41.935701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:41.943702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:41.968501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:41.972522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:41.973939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:41.978029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:41.978621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:41.979228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:42.247750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-305be106-c2ed-41c1-9b5e-9d57544d13c5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'create', calling method: .version_select at 0x7f984cbc3160>, body: {"keypair": {"name": "tempest-keypair-1512472017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzbzekKQlTV0M6aBSA1/9Ig7vGepttD4TH45ULa6lYoVIL3tR3WAYgUsqpmbmXWBQNiv5/Yhjqye2us1bY+FX7UGB+kqlcQDN5jr1jAgj9t2vfjQdsziY83plCo7fwJqw=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:42.253266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:06:42.284809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-305be106-c2ed-41c1-9b5e-9d57544d13c5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Getting quotas for project dba422df2993458fbdf1c11f80e605c5. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:06:42.302081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-305be106-c2ed-41c1-9b5e-9d57544d13c5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Getting quotas for user f8ec618a633f454791d5989610c839ed and project dba422df2993458fbdf1c11f80e605c5. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:06:42.351263 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-305be106-c2ed-41c1-9b5e-9d57544d13c5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.463341 Oct 12 09:06:42.352180 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2760/5093] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:06:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:42.368297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:42.369240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:42.386365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:42.388098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:42.389938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:42.392156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:42.393240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:42.395186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:42.492983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:42.526203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=52 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:42.528365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:42.528859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:42.534426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:42.938573 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d60eea5f-5da4-4b26-9fe2-af6b192f2648 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.043791 Oct 12 09:06:42.939281 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2334/5094] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 12 09:06:41 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:42.976614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:42.991804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:42.995610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-281577192', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:43.009334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:43.019054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:43.020508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:43.021750 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-448dbf72-b02c-4016-971d-ac5ab40089d4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.666302 Oct 12 09:06:43.022335 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2761/5095] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:42 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:43.028417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:43.029879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:43.031080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:43.032649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:43.033844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:43.034283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:43.222634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:06:43.357993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:43.376522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:43.377425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:43.378057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:43.881793 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b173f5d2-57d1-4019-b280-849d294f55e1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-281577192" status: 200 len: 1514 microversion: 2.1 time: 0.913495 Oct 12 09:06:43.881793 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2335/5096] 10.222.0.40 () {58 vars in 1261 bytes} [Wed Oct 12 09:06:42 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-281577192 => generated 1514 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:06:43.908851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:43.926691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:43.927685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:43.933164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:43.935365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:43.935884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:43.936322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:43.937048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:43.937546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:43.937976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:44.053553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:44.054171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:44.066428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:44.067133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:44.067757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:44.068621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:44.069231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:44.069839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:44.096910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:06:44.190369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:44.206557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:44.207350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:44.207987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:44.409285 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b8e38693-57aa-4cc7-a873-395092e42809 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.504146 Oct 12 09:06:44.410990 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2762/5097] 10.222.0.40 () {58 vars in 1173 bytes} [Wed Oct 12 09:06:43 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:44.444649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:44.458092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:44.458593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.servers [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Removing options 'limit' from query {{(pid=127006) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 09:06:44.459345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:44.470611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:44.471353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:44.474314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:44.477329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:44.477777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:44.478265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:44.524088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:44.532265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:44.532864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:44.533524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:45.003114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:45.016130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:45.025872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:45.027249 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3e5def95-cf7e-4481-914b-3bad0d5f474c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.977631 Oct 12 09:06:45.028269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2336/5098] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:44 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:45.302703 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5da326fb-cd19-49b3-a4ec-0e8885b7554b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.865383 Oct 12 09:06:45.303669 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2763/5099] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 09:06:44 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:06:45.332075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:45.344113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:45.345573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:45.362358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:45.364189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:45.365910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:45.368758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:45.370062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:45.371296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:45.543334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:06:45.639147 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5afe60d0-ae15-491f-94f3-f7fe96a3f55a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.312689 Oct 12 09:06:45.652871 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2337/5100] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:06:45 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:06:45.658947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:45.664313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:45.664754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.servers [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Removing options 'limit' from query {{(pid=127006) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 09:06:45.665474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:45.678841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:45.679327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:45.679763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:45.683379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:45.683770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:45.684205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:45.741485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:06:45.811301 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-35b47826-b544-4de6-80ee-47e5620a2b44 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.156371 Oct 12 09:06:45.811904 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2764/5101] 10.222.0.40 () {58 vars in 1150 bytes} [Wed Oct 12 09:06:45 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:45.824725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:45.829832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:45.836082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:45.864585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:45.864810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:45.865345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:45.866193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:45.866740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:45.867279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:45.919778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:06:45.953041 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8dd00316-b5a4-4875-b2f9-c985a5468ed1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.132111 Oct 12 09:06:45.954581 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2338/5102] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:06:45 2022] GET /compute/v2.1/servers => generated 1010 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:45.970999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:45.982870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:45.995539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:46.046881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.050310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.050646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.051463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.051929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.055999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.058696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:46.059458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:46.076197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.076977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.077907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.078867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.079542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.080185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.208509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:06:46.305406 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b8ccb68-5d3c-4804-93d5-a93693de0b3a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.338685 Oct 12 09:06:46.314313 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2765/5103] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:06:45 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:46.325025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:46.333063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:46.334880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.servers [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Removing options 'limit' from query {{(pid=127006) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 09:06:46.335778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:46.352062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.352901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.353709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.354815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.355582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.356183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.436602 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e268d68c-7bfe-46bf-830b-59309bc8572e tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.120156 Oct 12 09:06:46.444765 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2766/5104] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 12 09:06:46 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:46.450765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:46.458295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:46.459338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-281577192', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:06:46.467465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:46.470085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.471072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.471714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.474295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.474892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.475431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.480778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:46.482263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:46.483670 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9ebcd2f9-e7fc-4167-b91d-5166bdbcb740 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.430192 Oct 12 09:06:46.507414 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2339/5105] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:46 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:46.712783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:06:46.918638 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-23ff8488-f1dc-46f8-961d-89daa8e2f662 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-281577192" status: 200 len: 345 microversion: 2.1 time: 0.471945 Oct 12 09:06:46.926727 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2767/5106] 10.222.0.40 () {58 vars in 1240 bytes} [Wed Oct 12 09:06:46 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-281577192 => generated 345 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:06:46.932733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b807cbe2-635d-4d23-b785-7438e3ec2be6 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:46.946343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b807cbe2-635d-4d23-b785-7438e3ec2be6 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:46.947052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b807cbe2-635d-4d23-b785-7438e3ec2be6 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:46.947501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b807cbe2-635d-4d23-b785-7438e3ec2be6 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:46.991879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b807cbe2-635d-4d23-b785-7438e3ec2be6 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Going to try to stop instance {{(pid=127007) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 09:06:47.076617 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b807cbe2-635d-4d23-b785-7438e3ec2be6 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "POST /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.144855 Oct 12 09:06:47.081580 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2340/5107] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:06:46 2022] POST /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:06:47.095724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:47.096356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:47.124542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:47.125041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:47.126208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:47.127184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:47.128019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:47.128591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:47.512619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:47.513320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:47.532103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:47.533095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:47.534981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:47.538932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:47.540297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:47.541783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:47.797353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:47.808113 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c24f3d60-a109-41ea-9e86-9818ba085735 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.721553 Oct 12 09:06:47.809334 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2768/5108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:47 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:47.890290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:47.908718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:47.911028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:47.914660 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15814891-9b8a-47b5-ba8f-3bb58da1741d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.404540 Oct 12 09:06:47.916663 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2341/5109] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:47 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:48.438605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-010322c9-dd04-460a-8c6c-3a999f2e25b5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: .version_select at 0x7f9843f510d0>, body: {"keypair": {"name": "tempest-keypair-665590538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlpPG5Zew9hKHmCuRuJhi6EgE3o4jvl0Xnq5R+13wFNlJV/KYMzXdM+Cl5oCqM/oJ8+PhsjhTgYLc9TdBeRmfgzeLR0lNSLR/T1pOUiORKQuL7EAgmxVtzf4mQJArm4CQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:48.459450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-010322c9-dd04-460a-8c6c-3a999f2e25b5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:06:48.471781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-010322c9-dd04-460a-8c6c-3a999f2e25b5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for user d9531ada325c4b868f3bcd62331ab827 and project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:06:48.507803 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-010322c9-dd04-460a-8c6c-3a999f2e25b5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074425 Oct 12 09:06:48.514164 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2769/5110] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:06:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:48.834675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:48.835822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:48.847137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:48.847826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:48.848269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:48.848978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:48.849452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:48.849880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:48.927554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1312668629", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17452c7f-90ad-4bcf-b31a-147277f04ea4"}], "security_groups": [{"name": "tempest-securitygroup--1481300941"}], "key_name": "tempest-keypair-1512472017", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:49.124768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] validate_networks() for [('17452c7f-90ad-4bcf-b31a-147277f04ea4', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:06:49.511200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:49.520347 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-28246012-9e4f-42a4-b35e-61223761b0de tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.691886 Oct 12 09:06:49.521041 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2342/5111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:48 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:49.526575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:49.527400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:49.534591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:49.535321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:49.535913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:49.536924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:49.539257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:49.539899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:49.546028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:49.964186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:49.979059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:49.981514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:49.983492 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c79ffbb1-edb1-452b-9c13-98d974185940 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.461150 Oct 12 09:06:49.989003 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2343/5112] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:49 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:50.070406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:06:50.070866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:06:50.071302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:06:50.071750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:06:50.072167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:06:50.092200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:50.092727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:50.093240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:50.094158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:50.094622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:50.095049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:50.128094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Getting quotas for project dba422df2993458fbdf1c11f80e605c5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:06:50.134100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Getting quotas for user f8ec618a633f454791d5989610c839ed and project dba422df2993458fbdf1c11f80e605c5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:06:50.147865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:06:50.150988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:06:50.224992 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b8cbe290-782f-4884-a435-7e51e72db043 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.302207 Oct 12 09:06:50.239262 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2770/5113] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:06:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:06:50.247053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5aa983cf-b5e3-4657-8239-1653aed99afe tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:50.248041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5aa983cf-b5e3-4657-8239-1653aed99afe tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:50.371029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5aa983cf-b5e3-4657-8239-1653aed99afe tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:50.380143 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5aa983cf-b5e3-4657-8239-1653aed99afe tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1238 microversion: 2.1 time: 0.146064 Oct 12 09:06:50.382947 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2344/5114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:50 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1238 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:50.545794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:50.546712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:50.558898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:50.559647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:50.562824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:50.565964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:50.567047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:50.568965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:50.615480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:51.017810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:51.019689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:51.033689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:51.034518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:51.035145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:51.036118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:51.037409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:51.038533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:51.124882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:51.135854 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d352c1f-0975-413e-b55f-ad857c4ef963 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.594091 Oct 12 09:06:51.136864 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2771/5115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:50 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:51.335317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:51.361749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:51.366952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:51.373089 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37950c67-6f31-4912-a124-1dce8f138340 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.357277 Oct 12 09:06:51.399993 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2345/5116] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:51 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:06:51.405272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:51.405916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:51.423760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:51.424534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:51.428889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:51.429852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:51.430785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:51.431802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:51.607271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:51.621036 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-179fb1da-ec5a-46d0-9d21-0519c19a443c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1290 microversion: 2.1 time: 0.220561 Oct 12 09:06:51.623513 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2772/5117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:51 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1290 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:51.745129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:51.749325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:51.760922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:51.763601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:51.764226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:51.769172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:51.769897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:51.770650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:51.811321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lazy-loading 'flavor' on Instance uuid a0dfc060-f11f-4e03-a257-156ae0786b5a {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:06:52.118737 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24c4da78-e192-4427-acf4-f721cca3b1da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/action" status: 200 len: 32 microversion: 2.1 time: 0.378952 Oct 12 09:06:52.121773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2346/5118] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:06:51 2022] POST /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:06:52.130930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:52.132520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:52.146663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:52.150290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:52.150953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:52.153114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:52.153993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:52.160792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:52.162371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:52.167669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:52.183624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:52.184148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:52.184596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:52.187981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:52.188470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:52.188917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:52.696160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:52.705349 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b7182857-322e-412a-966c-7ed4ab2da161 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.549388 Oct 12 09:06:52.706012 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2347/5119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:52 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:06:52.711028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:52.711712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:52.718157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:52.718913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:52.719554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:52.720455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:52.721199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:52.721665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:52.829252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:52.852926 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a1c1d12-1c52-4184-9edd-1db339b0f7ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.726121 Oct 12 09:06:52.854526 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2773/5120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:52 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:52.860747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:52.861710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:52.871130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:52.871955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:52.872587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:52.873733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:52.874888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:52.875565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:52.989896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:52.999459 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-70cc8f6f-e97a-4d3e-b758-911dc2186f5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1296 microversion: 2.1 time: 0.143654 Oct 12 09:06:53.000063 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2774/5121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:52 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1296 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:53.186603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:53.209417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:53.214695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:53.219150 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6df62ee1-8d18-4f27-a6d1-725d38c2da98 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.511732 Oct 12 09:06:53.222678 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2348/5122] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:52 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:53.698037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1445911802", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1fd12de-772c-4409-a55a-e4329af851c8"}], "security_groups": [{"name": "tempest-securitygroup--1856350251"}], "key_name": "tempest-keypair-665590538", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:53.728678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:53.729281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:53.736944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:53.748055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:53.748778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:53.749410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:53.750585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:53.750817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:54.083392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:54.098125 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-139ccfe6-c296-4a38-a900-e33482e5669d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.373343 Oct 12 09:06:54.101673 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2349/5123] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:53 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:54.116026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:54.119114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:54.136198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:54.136707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:54.137152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:54.137891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:54.138345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:54.138773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:54.493165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] validate_networks() for [('b1fd12de-772c-4409-a55a-e4329af851c8', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:06:54.633904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:54.656351 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4a3778fa-1264-4347-87cb-a9714ba27bc6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.553319 Oct 12 09:06:54.657392 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2350/5124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:54 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:54.671206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:54.676130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:54.694673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:54.695714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:54.696387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:54.699450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:54.700510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:54.702374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:55.246826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:55.262446 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f2b3faa9-2fb9-43f8-8fd7-c54399ddd71e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1364 microversion: 2.1 time: 0.603535 Oct 12 09:06:55.277546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2351/5125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:54 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1364 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:55.283602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:55.284255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:55.294512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:55.295011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:55.295730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:55.296441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:55.297894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:55.298876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:55.387262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:06:55.387947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:06:55.388436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:06:55.390014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:06:55.390445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:06:55.404072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:55.404920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:55.405370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:55.406214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:55.406670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:55.407105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:55.435035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:06:55.441601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for user d9531ada325c4b868f3bcd62331ab827 and project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:06:55.469897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:06:55.472376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:06:55.556388 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b8a7ede-1243-41d9-949a-c672e5c715e8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.863672 Oct 12 09:06:55.562758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2775/5126] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:06:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:06:55.568484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:55.569583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:55.596015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:55.598291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:55.598905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:55.599877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:55.601625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:55.602855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:55.884879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:56.328843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:56.339184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:56.345210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:56.348715 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c1c1ee6f-46f2-4544-b09f-9910c617005f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 1.084132 Oct 12 09:06:56.351231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2352/5127] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:55 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:56.367764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:56.368454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:56.382406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:56.383409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:56.384005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:56.384945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:56.385625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:56.387018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:56.553608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:56.564638 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4cc17af2-0bae-4486-9e8d-7a8760d74b5a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1245 microversion: 2.1 time: 0.211756 Oct 12 09:06:56.580059 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2353/5128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:56 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1245 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:56.585135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:56.588598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:56.590095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:56.598250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:56.598754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:56.599205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:56.600519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:56.601185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:56.601814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:56.601965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-48f921ff-327b-4167-898e-5f7efd3e6f3d tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 1.037731 Oct 12 09:06:56.619440 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2776/5129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:55 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:56.625604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:56.627227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:56.642191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:56.644436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:56.645170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:56.648117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:56.648869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:56.650036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:57.109278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:57.123304 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-af60424f-28da-4e31-bc23-4a0f622416b3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.540592 Oct 12 09:06:57.127836 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2354/5130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:56 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:57.137983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-21964a71-053a-4c51-89e7-2be0cc748060 req-3408ddff-3def-416b-b178-215d16250453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bb6b8a-b0bf-43f5-a523-c7f92aca6c89", "tag": "5bd3a43a-6337-4e95-a3ae-78bbccfeae04"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:06:57.167402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-21964a71-053a-4c51-89e7-2be0cc748060 req-3408ddff-3def-416b-b178-215d16250453 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:57.167901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-21964a71-053a-4c51-89e7-2be0cc748060 req-3408ddff-3def-416b-b178-215d16250453 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:57.168338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-21964a71-053a-4c51-89e7-2be0cc748060 req-3408ddff-3def-416b-b178-215d16250453 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:57.198321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-21964a71-053a-4c51-89e7-2be0cc748060 req-3408ddff-3def-416b-b178-215d16250453 service nova] Creating event network-changed:5bd3a43a-6337-4e95-a3ae-78bbccfeae04 for instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 on n-h1-858383-10 Oct 12 09:06:57.209496 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-21964a71-053a-4c51-89e7-2be0cc748060 req-3408ddff-3def-416b-b178-215d16250453 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080040 Oct 12 09:06:57.210318 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2355/5131] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:06:57.309652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:57.320139 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f0d0812-867c-4f57-ba87-162b9b24951b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1364 microversion: 2.1 time: 0.715681 Oct 12 09:06:57.320740 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2777/5132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:56 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1364 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:57.380893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:57.381896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:57.390571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:57.391472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:57.392139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:57.393151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:57.393858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:57.394840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:57.596434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:57.599308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:57.627985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:57.628556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:57.629006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:57.629962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:57.630213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:57.630636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:57.742775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:57.768583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:57.770413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:57.771643 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8977a1fb-ae3c-4467-aebb-84139ca5d333 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.396166 Oct 12 09:06:57.793476 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2356/5133] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:57 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:06:57.794364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:57.794986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:57.806084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:57.813578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:57.814354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:57.815512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:57.816253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:57.816920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:57.848760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:57.862419 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b1d874a-5ec7-452e-b073-5f4b5c20bb6c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1299 microversion: 2.1 time: 0.269385 Oct 12 09:06:57.865890 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2778/5134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:57 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1299 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:58.156622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:58.157347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:58.168480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:58.173608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:58.174242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:58.175008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:58.175553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:58.175990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:58.216382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:58.225694 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6282e4e-a866-4134-925c-7709fa6886df tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.445148 Oct 12 09:06:58.231681 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2357/5135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:57 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:58.345053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:58.346853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:58.359947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:58.360836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:58.364334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:58.365465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:58.366315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:58.371050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:59.055885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:59.069069 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7f10a630-ea30-43df-af7d-6d3573434947 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1364 microversion: 2.1 time: 0.727706 Oct 12 09:06:59.082959 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2358/5136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:58 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1364 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:59.092293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:59.093596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:59.101229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:59.102233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:59.103274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:59.104345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:59.105140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:59.105960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:59.125281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:59.128241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:06:59.149205 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-87a1ca8e-0986-4bd2-a20d-69ac2cfd5ba6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.997628 Oct 12 09:06:59.151044 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2779/5137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:58 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:59.162606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:59.164791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:59.172291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:59.172884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:59.173383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:59.174261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:59.174930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:59.175257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:59.280370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:59.290297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-62d9f8da-72ee-4974-8654-8984613d3c44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1299 microversion: 2.1 time: 0.137996 Oct 12 09:06:59.291712 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2780/5138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:59 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:59.297922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:06:59.298867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:06:59.305716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:59.306536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:59.306992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:59.307738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:06:59.308197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:06:59.308656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:06:59.568004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:59.576914 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0560e237-77da-455e-8ced-376c786cdf80 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.283428 Oct 12 09:06:59.577625 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2781/5139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:06:59 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:06:59.640099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:59.649821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:59.651513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:06:59.652777 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fac8a8d7-4ab4-4314-9641-afed77f2327f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.568315 Oct 12 09:06:59.653412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2359/5140] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:06:59 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:00.096756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:00.097306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:00.111309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:00.114747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:00.115538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:00.116507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:00.118120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:00.119070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:00.172577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:00.173376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:00.191935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:00.192704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:00.199931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:00.201744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:00.206444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:00.210057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:00.375143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:00.680943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:00.697095 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d6c5c03-5078-4a3f-9ea9-229f0b0a109e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1364 microversion: 2.1 time: 0.604165 Oct 12 09:07:00.698555 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2782/5141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:00 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1364 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:00.714422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:00.718354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:00.737138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:00.738172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:00.738935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:00.739900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:00.740611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:00.742364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:00.770138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:00.780858 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e90a8a66-fd0c-490d-a7f2-6849e50fec7a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.612523 Oct 12 09:07:00.781789 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2360/5142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:00 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:00.786532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:00.787496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:00.799066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:00.799826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:00.800414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:00.801316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:00.802509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:00.805722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:01.087295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:01.100982 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f49828f5-ee70-4168-9795-74941dcb8614 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 0.398095 Oct 12 09:07:01.102660 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2783/5143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:00 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:01.117357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:01.118321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:01.128164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:01.128656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:01.134075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:01.135421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:01.139057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:01.139714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:01.235151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:01.257580 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-014c6be7-231a-4084-b656-edcf58aa165a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.470234 Oct 12 09:07:01.259925 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2361/5144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:00 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:01.525476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:01.543640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:01.549198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:01.552302 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e8b35182-9dda-49c4-aba6-7fc83d5afee1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.446654 Oct 12 09:07:01.556140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2784/5145] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:01 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:01.578719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-493cd5e0-ddd8-44ac-9de2-c931553ca431 req-41dd4e9c-fe8a-4bcd-8a6e-2d321c48cc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "321062c0-31e6-40dd-b8f8-b6a1f8659bf4", "tag": "7ff6293b-abed-4fc9-bb37-7ca01d5a4bc0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:01.595952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-493cd5e0-ddd8-44ac-9de2-c931553ca431 req-41dd4e9c-fe8a-4bcd-8a6e-2d321c48cc4e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:01.596667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-493cd5e0-ddd8-44ac-9de2-c931553ca431 req-41dd4e9c-fe8a-4bcd-8a6e-2d321c48cc4e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:01.597317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-493cd5e0-ddd8-44ac-9de2-c931553ca431 req-41dd4e9c-fe8a-4bcd-8a6e-2d321c48cc4e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:01.616815 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-493cd5e0-ddd8-44ac-9de2-c931553ca431 req-41dd4e9c-fe8a-4bcd-8a6e-2d321c48cc4e service nova] Creating event network-changed:7ff6293b-abed-4fc9-bb37-7ca01d5a4bc0 for instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 on n-h2-858383-10 Oct 12 09:07:01.629925 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-493cd5e0-ddd8-44ac-9de2-c931553ca431 req-41dd4e9c-fe8a-4bcd-8a6e-2d321c48cc4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068667 Oct 12 09:07:01.642460 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2362/5146] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:01.725578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:01.726192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:01.741766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:01.745036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:01.745918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:01.746448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:01.753362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:01.753907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:01.808565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:01.809254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:01.817278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:01.818690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:01.819147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:01.819848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:01.820568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:01.821532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:02.034492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:02.052027 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1b0c160-cdbe-4e68-b937-b78953c80bda tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1364 microversion: 2.1 time: 0.328955 Oct 12 09:07:02.054928 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2785/5147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:01 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1364 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:02.130063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:02.131002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:02.143491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:02.144600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:02.145316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:02.149510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:02.150379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:02.151491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:02.304841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:02.317511 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-357b39f5-022b-48ea-9f17-b2ed9d0e10a3 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.512949 Oct 12 09:07:02.318999 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2363/5148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:01 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:02.325377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:02.326257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:02.334473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:02.335303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:02.335943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:02.338929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:02.340012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:02.340764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:02.464918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:02.483725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-48e9cdbc-c07b-4a34-990b-c2599069c0f7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 0.358733 Oct 12 09:07:02.484689 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2786/5149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:02 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:02.569103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:02.580687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:02.581686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:02.582314 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-80a54d7d-e63b-4fe7-a51b-9f2b213b988f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.261950 Oct 12 09:07:02.583724 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2364/5150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:02 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:02.606262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:02.609360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:02.609360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:02.609954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:02.610586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:02.611165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:02.953879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:02.971526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:02.974592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:02.976637 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d11e7dda-f463-4b68-b9dc-c762070fbcbb tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.399860 Oct 12 09:07:02.985493 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2787/5151] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:02 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:07:03.082175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:03.083837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:03.093475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:03.094656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:03.095335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:03.096193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:03.096836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:03.097493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:03.335686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:03.345188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-143b234f-f67f-4442-856f-cba98da296c6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1364 microversion: 2.1 time: 0.272104 Oct 12 09:07:03.346435 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2365/5152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:03 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:03.347244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:03.348497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:03.351941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:03.371984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:03.374046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:03.374733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:03.376005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:03.376675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:03.377327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:03.425964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:03.510058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:03.511273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:03.521109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:03.522147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:03.522844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:03.523808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:03.524855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:03.527028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:03.691929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:03.704438 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90cfd666-6e74-4173-a95c-d1142bfefac1 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.362346 Oct 12 09:07:03.705817 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2788/5153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:03 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:03.711869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:03.713073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:03.723741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:03.724506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:03.725195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:03.726172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:03.726841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:03.727497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:03.838437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:03.847170 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-002e64bd-3404-40fb-b39d-8206e4c0ea04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 0.343102 Oct 12 09:07:03.847877 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2366/5154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:03 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:04.003023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:04.004865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:04.015911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:04.023134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:04.023852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:04.024999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:04.025930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:04.026746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:04.214356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:04.227574 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24edde95-4b2c-4d77-99a1-b5039dbd0044 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.520195 Oct 12 09:07:04.235459 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2789/5155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:03 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:04.247435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-fb3e81a0-c893-466f-b28d-2e5a96931b35 req-c6d6740b-bc59-4b38-9af4-3df19746d479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bb6b8a-b0bf-43f5-a523-c7f92aca6c89", "name": "network-vif-plugged", "status": "completed", "tag": "5bd3a43a-6337-4e95-a3ae-78bbccfeae04"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:04.271733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fb3e81a0-c893-466f-b28d-2e5a96931b35 req-c6d6740b-bc59-4b38-9af4-3df19746d479 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:04.285016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fb3e81a0-c893-466f-b28d-2e5a96931b35 req-c6d6740b-bc59-4b38-9af4-3df19746d479 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:04.285715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fb3e81a0-c893-466f-b28d-2e5a96931b35 req-c6d6740b-bc59-4b38-9af4-3df19746d479 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:04.318917 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-fb3e81a0-c893-466f-b28d-2e5a96931b35 req-c6d6740b-bc59-4b38-9af4-3df19746d479 service nova] Creating event network-vif-plugged:5bd3a43a-6337-4e95-a3ae-78bbccfeae04 for instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 on n-h1-858383-10 Oct 12 09:07:04.351580 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-fb3e81a0-c893-466f-b28d-2e5a96931b35 req-c6d6740b-bc59-4b38-9af4-3df19746d479 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110940 Oct 12 09:07:04.353419 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2790/5156] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:04.389379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:04.402058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:04.421323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:04.421851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:04.422294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:04.438127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:04.438991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:04.440277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:04.940336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:04.956256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:04.964354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:04.969701 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ee834f1-7a9f-4e5d-be87-19cec62c94dd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.971113 Oct 12 09:07:04.984464 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2367/5157] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:03 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:07:04.999848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:05.000795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:05.008691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:05.009808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:05.010500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:05.011435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:05.012775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:05.013506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:05.283992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:05.301794 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0853be01-ef50-4afc-bedb-bffd8f7db03b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.306883 Oct 12 09:07:05.302399 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2368/5158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:04 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:05.317661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:05.318562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:05.330505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:05.331285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:05.331951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:05.332826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:05.337865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:05.338715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:05.418475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=16 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:05.450558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=24 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:05.519400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:05.522841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:05.534276 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e538e50d-e0ba-428f-b8c0-a20bf4b8e825 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1364 microversion: 2.1 time: 1.163174 Oct 12 09:07:05.537507 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d406028-84a0-4841-b446-d25eaafa4229 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 0.233760 Oct 12 09:07:05.539223 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2369/5159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:05 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:05.555358 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2791/5160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:04 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1364 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:05.555783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:05.555783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:05.575511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:05.576074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:05.576517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:05.577673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:05.578209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:05.580803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:05.783244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:05.797233 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8038acb-5b31-4d68-b0e7-56f5b9b4d9c3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.255774 Oct 12 09:07:05.797863 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2370/5161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:05 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:06.004052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:06.004894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:06.012725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.013514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.014624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.015496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.016413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.016999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.328570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:06.329756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:06.345076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.345691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.346209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.347147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.347632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.348180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.368006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:06.377864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:06.382148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:06.386527 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4e4c32c-bb39-4e8f-86c9-08e2a11f343e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.390446 Oct 12 09:07:06.391272 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2792/5162] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:05 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:06.565221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:06.568068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:06.571183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:06.582026 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5e18ce10-1f32-402d-95d5-226b0edfc398 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.257676 Oct 12 09:07:06.583268 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2371/5163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:06 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:06.584134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.584962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.587372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.588495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:06.588631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.589415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:06.590460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.592287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.596357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.597055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.597699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.598581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.599194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.599780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.950690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:06.959776 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b074d27-f2e6-4669-b747-b3c0aebdb12c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1550 microversion: 2.1 time: 0.374771 Oct 12 09:07:06.962593 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2372/5164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:06 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1550 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:06.968204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:06.969644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:06.979290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.980091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.980753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:06.981733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:06.982585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:06.983261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:07.118871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:07.131415 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61dfa41b-9ce0-473a-abd4-fa9106049d15 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 0.572128 Oct 12 09:07:07.140671 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2793/5165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:06 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:07.157310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1355524c-139b-41f1-9c24-8e77ae848270 req-4e27b01d-e4c3-4605-b8c5-d21a72afae94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-plugged", "status": "completed", "tag": "0130d9a3-e157-4705-a9b3-ac1d5261648d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:07.172674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1355524c-139b-41f1-9c24-8e77ae848270 req-4e27b01d-e4c3-4605-b8c5-d21a72afae94 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:07.175017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1355524c-139b-41f1-9c24-8e77ae848270 req-4e27b01d-e4c3-4605-b8c5-d21a72afae94 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:07.175768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1355524c-139b-41f1-9c24-8e77ae848270 req-4e27b01d-e4c3-4605-b8c5-d21a72afae94 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:07.198541 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1355524c-139b-41f1-9c24-8e77ae848270 req-4e27b01d-e4c3-4605-b8c5-d21a72afae94 service nova] Creating event network-vif-plugged:0130d9a3-e157-4705-a9b3-ac1d5261648d for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:07:07.215605 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1355524c-139b-41f1-9c24-8e77ae848270 req-4e27b01d-e4c3-4605-b8c5-d21a72afae94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073079 Oct 12 09:07:07.216888 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2794/5166] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:07.227513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:07.228108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:07.229393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:07.239617 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f0dde417-5a5a-4a84-b8ec-a31cf6bf11ad tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1521 microversion: 2.1 time: 0.273754 Oct 12 09:07:07.241712 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2373/5167] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:06 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:07.243491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:07.244057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:07.246717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:07.247809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:07.248962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:07.251095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:07.387294 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-386794df-b1cc-4ffd-bf0b-175e184ec344 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168435 Oct 12 09:07:07.388085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2795/5168] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:07:07 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:07.420190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:07.420852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:07.434055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:07.434546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:07.434983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:07.436644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:07.437102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:07.437557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:07.606450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:07.607606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:07.613978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:07.614743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:07.615651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:07.616590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:07.617202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:07.617963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:07.979548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:07.989274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:07.998852 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-290df9cb-1271-46dd-91c1-16e60e8ea171 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.397144 Oct 12 09:07:08.002578 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2796/5169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:07 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:08.007477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:08.010730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:08.013108 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-63ae7a81-7cc5-4100-9e0f-41f1cbdf67de tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.596829 Oct 12 09:07:08.014193 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2374/5170] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:07 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:08.162442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:08.163252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:08.194192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.195999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.196846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:08.198120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.200380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.202212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:08.269371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:08.270223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:08.285025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.285564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.290168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:08.290969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.291442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.291876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:08.618064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:08.637522 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e0712cec-621f-4fb9-9bd6-e2c7c24da857 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1498 microversion: 2.1 time: 0.370196 Oct 12 09:07:08.642391 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2375/5171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:08 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1498 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:08.666359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:08.674657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:08.676067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:08.682547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.683369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.684216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:08.685221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.685926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.686584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:08.717094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:08.757131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:08.764534 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7392b3b8-1c70-4de6-9f5a-73eb2add57e2 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.104196 Oct 12 09:07:08.766776 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2376/5172] 10.222.0.40 () {58 vars in 1154 bytes} [Wed Oct 12 09:07:08 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:08.783775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8752e4b1-23e8-40b6-ae18-ec3e917cf79f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:08.798124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8752e4b1-23e8-40b6-ae18-ec3e917cf79f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.800781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8752e4b1-23e8-40b6-ae18-ec3e917cf79f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.803582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8752e4b1-23e8-40b6-ae18-ec3e917cf79f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:08.876667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8752e4b1-23e8-40b6-ae18-ec3e917cf79f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Going to try to start instance {{(pid=127007) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 09:07:08.957470 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8752e4b1-23e8-40b6-ae18-ec3e917cf79f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "POST /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.181380 Oct 12 09:07:08.960614 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2377/5173] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:07:08 2022] POST /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:07:08.969381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:08.970359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:08.977027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.977819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.978527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:08.980426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:08.981070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:08.981747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:09.276508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:09.287618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5fa882ea-e0d6-4dcd-b4d3-37e607b97307 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 1.127962 Oct 12 09:07:09.289858 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2797/5174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:08 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:09.296117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:09.296991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:09.304201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:09.304877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:09.306434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:09.307159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:09.307618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:09.308046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:09.567105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:09.575092 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa955a36-c9a6-4beb-9a85-740cb5a9b0eb tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1507 microversion: 2.1 time: 0.610049 Oct 12 09:07:09.576248 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2378/5175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:08 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:09.593966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:09.594585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:09.600805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:09.601576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:09.602711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:09.603796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:09.604409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:09.604991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:09.612993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:09.627189 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4ba05d5-abb9-4a64-b377-3e5200ae14b6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.335890 Oct 12 09:07:09.662123 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2798/5176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:09 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:09.672600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-plugged", "status": "completed", "tag": "5a556884-14af-40aa-be30-df0ee72c6115"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-plugged", "status": "completed", "tag": "13c27b97-234d-48ad-a8c3-13ec4989dbd3"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-plugged", "status": "completed", "tag": "d7bed5e1-cb6a-4c20-8256-e65e5c1c223b"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-plugged", "status": "completed", "tag": "d9bc3848-a570-432c-a771-9ea92864ae86"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:09.706917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:09.711376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:09.712911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:09.743253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] Creating event network-vif-plugged:5a556884-14af-40aa-be30-df0ee72c6115 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:07:09.744704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] Creating event network-vif-plugged:13c27b97-234d-48ad-a8c3-13ec4989dbd3 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:07:09.746034 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] Creating event network-vif-plugged:d7bed5e1-cb6a-4c20-8256-e65e5c1c223b for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:07:09.748689 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] Creating event network-vif-plugged:d9bc3848-a570-432c-a771-9ea92864ae86 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:07:09.761337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-364b4932-63b7-4d9b-abb4-e930382445a1 req-504b4de3-e2bc-45aa-83c2-7c612e5f9b74 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.097519 Oct 12 09:07:09.762400 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2799/5177] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:10.207161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:10.232539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:10.234296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:10.235444 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c31e17a5-dd87-442c-9921-9b77c09c9046 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.658027 Oct 12 09:07:10.236065 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2379/5178] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:09 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:10.312246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:10.313228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:10.323446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:10.324280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:10.327042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:10.328128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:10.330540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:10.331530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:10.526636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-01ce5c32-7d53-4260-9ec8-dafbad62d72b req-5bb74789-8f6b-4e60-a484-7e6f3b35926c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bb6b8a-b0bf-43f5-a523-c7f92aca6c89", "tag": "5bd3a43a-6337-4e95-a3ae-78bbccfeae04"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:10.542328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-01ce5c32-7d53-4260-9ec8-dafbad62d72b req-5bb74789-8f6b-4e60-a484-7e6f3b35926c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:10.543064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-01ce5c32-7d53-4260-9ec8-dafbad62d72b req-5bb74789-8f6b-4e60-a484-7e6f3b35926c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:10.543727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-01ce5c32-7d53-4260-9ec8-dafbad62d72b req-5bb74789-8f6b-4e60-a484-7e6f3b35926c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:10.571640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-01ce5c32-7d53-4260-9ec8-dafbad62d72b req-5bb74789-8f6b-4e60-a484-7e6f3b35926c service nova] Creating event network-changed:5bd3a43a-6337-4e95-a3ae-78bbccfeae04 for instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 on n-h1-858383-10 Oct 12 09:07:10.584887 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-01ce5c32-7d53-4260-9ec8-dafbad62d72b req-5bb74789-8f6b-4e60-a484-7e6f3b35926c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.360629 Oct 12 09:07:10.586862 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2800/5179] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:07:10.601732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:10.602593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:10.620654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:10.625534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:10.625999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:10.626754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:10.627214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:10.627648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:10.842801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:10.853396 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-803788bf-6d0e-4a39-873e-299e548b8e6b tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1507 microversion: 2.1 time: 0.255136 Oct 12 09:07:10.873090 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2801/5180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:10 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:10.886396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:10.887367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:10.897902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:10.898612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:10.899974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:10.910191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:10.911013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:10.912716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:11.147671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:11.161868 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f516505-4f5b-4aff-9f7d-57c1fc560d7d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.287324 Oct 12 09:07:11.174956 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2802/5181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:10 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:11.278683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:11.279989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:11.291002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:11.292867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:11.293515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:11.298537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:11.301094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:11.301789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:11.582845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:11.594395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:11.597309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:11.598698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a61d679a-22c4-4611-8f07-c294929a449b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.338944 Oct 12 09:07:11.600528 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2803/5182] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:11 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:07:11.682626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:11.691622 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ff1bac6-e6cb-4884-a715-100dbbec8f92 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 1.383186 Oct 12 09:07:11.699578 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2380/5183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:10 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:11.797879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-881605dd-44fa-4248-aa3e-f1acd438c18a req-aa60c33a-14f9-42bd-9a32-4d0b8ec44af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-plugged", "status": "completed", "tag": "5edb8f6d-cf43-4ebd-aab9-43212685d426"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-plugged", "status": "completed", "tag": "06715f80-814d-47a5-9ea1-080893c72f5c"}, {"server_uuid": "321062c0-31e6-40dd-b8f8-b6a1f8659bf4", "name": "network-vif-plugged", "status": "completed", "tag": "7ff6293b-abed-4fc9-bb37-7ca01d5a4bc0"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:11.834354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-881605dd-44fa-4248-aa3e-f1acd438c18a req-aa60c33a-14f9-42bd-9a32-4d0b8ec44af0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:11.837363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-881605dd-44fa-4248-aa3e-f1acd438c18a req-aa60c33a-14f9-42bd-9a32-4d0b8ec44af0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:11.837984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-881605dd-44fa-4248-aa3e-f1acd438c18a req-aa60c33a-14f9-42bd-9a32-4d0b8ec44af0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:11.872941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-881605dd-44fa-4248-aa3e-f1acd438c18a req-aa60c33a-14f9-42bd-9a32-4d0b8ec44af0 service nova] Creating event network-vif-plugged:5edb8f6d-cf43-4ebd-aab9-43212685d426 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:07:11.873582 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-881605dd-44fa-4248-aa3e-f1acd438c18a req-aa60c33a-14f9-42bd-9a32-4d0b8ec44af0 service nova] Creating event network-vif-plugged:06715f80-814d-47a5-9ea1-080893c72f5c for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:07:11.874335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-881605dd-44fa-4248-aa3e-f1acd438c18a req-aa60c33a-14f9-42bd-9a32-4d0b8ec44af0 service nova] Creating event network-vif-plugged:7ff6293b-abed-4fc9-bb37-7ca01d5a4bc0 for instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 on n-h2-858383-10 Oct 12 09:07:11.884330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:11.884555 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-881605dd-44fa-4248-aa3e-f1acd438c18a req-aa60c33a-14f9-42bd-9a32-4d0b8ec44af0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.090866 Oct 12 09:07:11.886114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:11.886838 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2804/5184] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:11.918459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:11.919211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:11.923529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:11.924496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:11.942243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:11.942730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:12.220631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:12.222647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:12.236751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:12.237372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:12.238156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:12.239110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:12.239913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:12.241123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:12.638754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:12.652777 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a1e978b0-c788-4508-b70b-dbf893720428 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.460500 Oct 12 09:07:12.655036 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2805/5185] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:12 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:12.665574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:12.666983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:12.679878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:12.681094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:12.682020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:12.684226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:12.685124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:12.685911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:12.706282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:12.721364 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-be6f3e12-d9d7-47b9-b66c-acb00ab2a4d7 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1507 microversion: 2.1 time: 0.841560 Oct 12 09:07:12.722308 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2381/5186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:11 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1507 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:12.726950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:12.727557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:12.742636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:12.744352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:12.747274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:12.747884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:12.748775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:12.749249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:12.749678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:13.151241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:13.165343 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3139685-3cc6-4596-b1de-16da2afa0a94 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 0.441922 Oct 12 09:07:13.166362 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2382/5187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:12 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:13.190076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:13.200309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:13.201800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:13.202968 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7877665c-7b38-4ca1-8422-4c68ea83c093 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1874 microversion: 2.32 time: 0.546653 Oct 12 09:07:13.203872 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2806/5188] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:12 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1874 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:13.683010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:13.683715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:13.692064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:13.693402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:13.694631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:13.695370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:13.695830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:13.696257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:13.744701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:13.746383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:13.754563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:13.757105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:13.759369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:13.760250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:13.760723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:13.761153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:13.982369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:13.996932 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4ea1074e-dde9-48bc-bf9f-1bc9eaa0555c tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1511 microversion: 2.1 time: 0.256593 Oct 12 09:07:14.002235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:14.012513 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2807/5189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:13 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:14.013259 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7f0d444e-5c1e-41ca-bf32-86300577fb51 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.335749 Oct 12 09:07:14.021513 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2383/5190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:13 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:14.038175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:14.057530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:14.058307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.servers [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Removing options 'limit' from query {{(pid=127006) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 12 09:07:14.059273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:14.060875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.062008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.063946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.064966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.066601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.068868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.071112 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7a48dbf2-5709-460b-9b04-3a3b8ca95e86 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.043476 Oct 12 09:07:14.073999 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2808/5191] 10.222.0.40 () {58 vars in 1140 bytes} [Wed Oct 12 09:07:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:07:14.090065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:14.090950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:14.097170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.097933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.098525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.099389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.100043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.100678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.188623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:14.189356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:14.199805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.204719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.205621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.206598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.207247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.208097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.451186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:14.453852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:14.463069 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc1b6ff5-ab57-4582-8a91-5fbd60d5024a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1367 microversion: 2.1 time: 0.278539 Oct 12 09:07:14.479496 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2809/5192] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:14 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:14.494650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:14.496005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:14.509603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.510327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.511628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.512800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.513535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.514189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.652394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:14.665171 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30f3a335-801c-4fbb-9265-c2ad886fb877 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1511 microversion: 2.1 time: 0.580760 Oct 12 09:07:14.682422 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2384/5193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:14 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1511 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:14.698149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:14.698780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:14.732978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.736409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.736916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.737692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:14.738157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:14.738588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:14.991559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:15.001586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:15.003033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:15.009193 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8ec2b769-ec10-4af1-8f3d-f242f8b24925 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2828 microversion: 2.32 time: 0.526247 Oct 12 09:07:15.013132 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2810/5194] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:14 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2828 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:15.044347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:15.045316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:15.057043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:15.058672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:15.061193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:15.065555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:15.066310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:15.067844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:15.308099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:15.317360 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c209e974-a29a-4888-a42c-e949121d5f2f tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671" status: 200 len: 1513 microversion: 2.1 time: 0.625663 Oct 12 09:07:15.324454 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2385/5195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:14 2022] GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 => generated 1513 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:15.332971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:15.335699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:15.347275 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aaa0dbd5-bc46-4b03-a4e6-cc06f6fba3ec tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.307325 Oct 12 09:07:15.357166 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2811/5196] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 12 09:07:15 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf/os-interface => generated 1832 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:15.363097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:15.363705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:15.377277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:15.377811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:15.378243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:15.379452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:15.381937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:15.382681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:15.384467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:15.386258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:15.387977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:15.388626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:15.389291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:15.391286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:15.787431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:15.800196 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae91ef35-e87b-484e-bd65-8e34a336a656 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1511 microversion: 2.1 time: 0.438482 Oct 12 09:07:15.801717 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2812/5197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:15 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:15.812851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:15.820455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:15.828094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:15.841303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e886f558-cb88-4ba2-a468-6c233ec3027d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.515402 Oct 12 09:07:15.842906 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2386/5198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:15 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:15.871750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:15.872441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:15.873099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:15.875035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:15.875688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:15.876312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:15.893173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:15.904411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:15.905196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:16.271409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:16.272048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:16.273510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:16.274440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:16.274990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:16.275596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:16.480475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:16.649287 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e62f99a-bed8-4fed-b405-203b0baa709a tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.805083 Oct 12 09:07:16.669387 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2387/5199] 10.222.0.40 () {58 vars in 1154 bytes} [Wed Oct 12 09:07:15 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:16.674754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:16.675512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:16.683634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:16.684219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:16.684695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:16.685405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:16.685899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:16.686327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:17.082620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:17.095897 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-df44117b-591c-4dd6-b54c-5f099b15fbae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1511 microversion: 2.1 time: 0.424778 Oct 12 09:07:17.097401 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2388/5200] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:16 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:17.106690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:17.109767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:17.118830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:17.119976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:17.120770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:17.122040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:17.122984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:17.124189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:17.383300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:17.392690 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-abba4584-b2b7-45f0-8899-58a80f9e62ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1556 microversion: 2.1 time: 1.589662 Oct 12 09:07:17.393285 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2813/5201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:15 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1556 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:17.407672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:17.417602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:17.434215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:17.435024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:17.435491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:17.436248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:17.436871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:17.437543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:17.538722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:17.549147 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e23269c-5123-4795-8e43-fc7f36b73e8d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.449722 Oct 12 09:07:17.554137 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2389/5202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:17 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:17.563759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:17.566163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:17.585746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:17.586240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:17.586676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:17.587382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:17.587869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:17.588296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:18.004285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:18.012303 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-516b7b54-8f30-4736-ad9d-524526ae8fd0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671" status: 200 len: 1513 microversion: 2.1 time: 0.612651 Oct 12 09:07:18.021700 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2814/5203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:17 2022] GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 => generated 1513 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:18.036634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:18.037256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:18.052391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:18.052903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:18.053465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:18.054213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:18.054682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:18.055115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:18.069131 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5e14c55-7b6b-4a6d-9001-e113091fdb12 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.513242 Oct 12 09:07:18.069874 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2390/5204] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:07:17 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4/os-interface => generated 284 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:18.574723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:18.577334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:18.607364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:18.615660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:18.616239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:18.620003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:18.620493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:18.620933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:18.628697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:18.637705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a0e1e47-5896-48b5-a804-5acd3aef5083 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1511 microversion: 2.1 time: 0.604809 Oct 12 09:07:18.645709 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2815/5205] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:18 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1511 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:18.667086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-104e6a00-7c3c-43bb-8c88-87105d19c62c req-22dbf2e5-7316-4abf-87d6-f0d685807e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "tag": "06715f80-814d-47a5-9ea1-080893c72f5c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:18.690494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-104e6a00-7c3c-43bb-8c88-87105d19c62c req-22dbf2e5-7316-4abf-87d6-f0d685807e02 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:18.691254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-104e6a00-7c3c-43bb-8c88-87105d19c62c req-22dbf2e5-7316-4abf-87d6-f0d685807e02 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:18.691934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-104e6a00-7c3c-43bb-8c88-87105d19c62c req-22dbf2e5-7316-4abf-87d6-f0d685807e02 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:18.722679 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-104e6a00-7c3c-43bb-8c88-87105d19c62c req-22dbf2e5-7316-4abf-87d6-f0d685807e02 service nova] Creating event network-changed:06715f80-814d-47a5-9ea1-080893c72f5c for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:07:18.747176 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-104e6a00-7c3c-43bb-8c88-87105d19c62c req-22dbf2e5-7316-4abf-87d6-f0d685807e02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099613 Oct 12 09:07:18.748531 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2816/5206] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:18.758931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:18.772913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:18.802831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:18.817281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:18.817919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:18.818365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:18.819099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:18.824486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:18.825258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:18.900308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:18.992658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:19.006558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:19.007419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:19.008105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:19.192542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:19.209269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0f1fe9e7-8327-4330-a489-e731c2cd2465 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.639935 Oct 12 09:07:19.209895 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2391/5207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:18 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:19.378007 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9de7b08f-98ed-4b5d-92f6-657380b181e0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.627815 Oct 12 09:07:19.381544 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2817/5208] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:07:18 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:19.409050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:19.415094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:19.426457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:19.765902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:19.767330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:19.768062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:19.769629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:19.770284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:19.771040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:19.796152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:19.827963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:19.930815 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3a75e2fb-0d19-4b1a-9559-f5afc8f60d40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.525872 Oct 12 09:07:19.931838 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2392/5209] 10.222.0.40 () {58 vars in 1150 bytes} [Wed Oct 12 09:07:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:19.946341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:19.956064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:19.957111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:19.967504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:19.968316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:19.968952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:19.970069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:19.971176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:19.971800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:20.095733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:20.173021 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-83e3d7cf-c80c-4684-ad30-eae8dcfc93b3 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.230409 Oct 12 09:07:20.181213 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2818/5210] 10.222.0.40 () {58 vars in 1212 bytes} [Wed Oct 12 09:07:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:20.187376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:20.193197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:20.193907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:20.208541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:20.209071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:20.210028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:20.210388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:20.211080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:20.211608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:20.232343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:20.233479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:20.246400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:20.246911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:20.247836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:20.248778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:20.252752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:20.253405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:20.501428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:20.720155 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d233d97d-4340-490f-a82f-5ba587e557b8 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.536894 Oct 12 09:07:20.739681 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2393/5211] 10.222.0.40 () {58 vars in 1196 bytes} [Wed Oct 12 09:07:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:20.747117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:20.766974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:20.799609 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa79c406-1117-4c15-a81c-9804da6ef7da tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.571151 Oct 12 09:07:20.800213 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2819/5212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:20 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:20.827606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:20.831319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'name': '-281577192', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:20.870180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:20.872597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:20.873875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:20.874915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:20.875597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:20.876513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:21.142972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:21.307791 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b879d003-03ff-431a-bd04-14809855e8ac tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?name=-281577192" status: 200 len: 345 microversion: 2.1 time: 0.564978 Oct 12 09:07:21.308516 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2394/5213] 10.222.0.40 () {58 vars in 1156 bytes} [Wed Oct 12 09:07:20 2022] GET /compute/v2.1/servers?name=-281577192 => generated 345 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:21.321476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:21.329001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:21.339135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:21.363572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:21.368270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:21.369584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:21.370826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:21.372402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:21.387809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:21.504353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:21.602082 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f98a51f-5c14-4128-b4d7-27a8cf769f10 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.284684 Oct 12 09:07:21.603314 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2820/5214] 10.222.0.40 () {58 vars in 1154 bytes} [Wed Oct 12 09:07:21 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:21.625040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:21.638520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:21.639206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-28157719', 'deleted': False, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:07:21.667685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:21.669421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:21.669930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:21.671430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:21.673688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:21.675747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:21.825635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:21.826330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:21.836552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:21.846996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:21.848000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:21.850761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:21.851516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:21.852161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:21.870693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:07:21.980482 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d06512ba-e3d6-4339-9dfa-ba5868b3c602 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-28157719" status: 200 len: 345 microversion: 2.1 time: 0.367181 Oct 12 09:07:21.984809 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2395/5215] 10.222.0.40 () {58 vars in 1226 bytes} [Wed Oct 12 09:07:21 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-28157719 => generated 345 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:22.000304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:22.000819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:22.009942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:22.010511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:22.010957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:22.011678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:22.012415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:22.012863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:22.048308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:07:22.192137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7dc782aa-5e29-4f6c-99fe-bc348d7c8fbc tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 204 len: 0 microversion: 2.1 time: 0.196365 Oct 12 09:07:22.197040 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2396/5216] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:07:21 2022] DELETE /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:07:22.207581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1315734f-95e7-4337-b1d3-2404abfab64b req-3fe85055-47c7-47bb-a2d5-d97f7d26312f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "321062c0-31e6-40dd-b8f8-b6a1f8659bf4", "tag": "7ff6293b-abed-4fc9-bb37-7ca01d5a4bc0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:22.221027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1315734f-95e7-4337-b1d3-2404abfab64b req-3fe85055-47c7-47bb-a2d5-d97f7d26312f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:22.221608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1315734f-95e7-4337-b1d3-2404abfab64b req-3fe85055-47c7-47bb-a2d5-d97f7d26312f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:22.222049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1315734f-95e7-4337-b1d3-2404abfab64b req-3fe85055-47c7-47bb-a2d5-d97f7d26312f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:22.252128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1315734f-95e7-4337-b1d3-2404abfab64b req-3fe85055-47c7-47bb-a2d5-d97f7d26312f service nova] Creating event network-changed:7ff6293b-abed-4fc9-bb37-7ca01d5a4bc0 for instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 on n-h2-858383-10 Oct 12 09:07:22.260380 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1315734f-95e7-4337-b1d3-2404abfab64b req-3fe85055-47c7-47bb-a2d5-d97f7d26312f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060662 Oct 12 09:07:22.260380 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2397/5217] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:22.265977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:22.266705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:22.276619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:22.277115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:22.277619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:22.278646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:22.279168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:22.280332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:22.536699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:22.554255 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-56a7a1c1-596a-46b3-8a9d-86f647f5a9ee tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.732668 Oct 12 09:07:22.568573 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2821/5218] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:21 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:22.604673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:22.616432 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b703a7c6-6f84-48ba-a4b6-c0fecacd0fa1 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1517 microversion: 2.1 time: 0.352113 Oct 12 09:07:22.628396 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2398/5219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:22 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:23.582013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:23.585818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:23.611691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:23.613983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:23.614554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:23.615751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:23.616338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:23.616879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:23.641777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:23.643146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:23.659312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:23.659977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:23.660719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:23.661628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:23.662231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:23.662809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:24.178886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:24.190108 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8985bfc1-99ff-4bfb-8e00-cc8e1555492c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1737 microversion: 2.1 time: 0.612241 Oct 12 09:07:24.207145 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2822/5220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:23 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1737 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:24.601598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:24.609611 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6710cd02-042a-45b3-9795-b14fba4d65ae tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1517 microversion: 2.1 time: 0.972343 Oct 12 09:07:24.613908 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2399/5221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:23 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1517 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:25.214567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:25.215719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:25.229815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:25.230553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:25.231061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:25.232528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:25.233377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:25.234020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:25.419669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-75530db2-20a2-4496-8d85-0a50b297b25a req-9542932a-1752-4584-894b-826aa7f11b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b00d3f-4af5-42de-8153-8d96099b68af", "name": "network-vif-deleted", "tag": "aca56614-a2f4-4f83-8010-390a13896529"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:25.455631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75530db2-20a2-4496-8d85-0a50b297b25a req-9542932a-1752-4584-894b-826aa7f11b75 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:25.456380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75530db2-20a2-4496-8d85-0a50b297b25a req-9542932a-1752-4584-894b-826aa7f11b75 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:25.456979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75530db2-20a2-4496-8d85-0a50b297b25a req-9542932a-1752-4584-894b-826aa7f11b75 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:25.480830 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-75530db2-20a2-4496-8d85-0a50b297b25a req-9542932a-1752-4584-894b-826aa7f11b75 service nova] Creating event network-vif-deleted:aca56614-a2f4-4f83-8010-390a13896529 for instance e1b00d3f-4af5-42de-8153-8d96099b68af on n-h1-858383-10 Oct 12 09:07:25.529516 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-75530db2-20a2-4496-8d85-0a50b297b25a req-9542932a-1752-4584-894b-826aa7f11b75 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123052 Oct 12 09:07:25.530153 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2400/5222] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:07:25.636599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:25.637303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:25.652788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:25.653829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:25.654697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:25.655459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:25.658392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:25.659804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:25.753811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:25.754319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:25.761866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:25.768061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lazy-loading 'fault' on Instance uuid e1b00d3f-4af5-42de-8153-8d96099b68af {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:07:25.826391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:25.836437 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6dbffc14-176e-4a3f-84df-a39ea8bb7093 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1717 microversion: 2.1 time: 0.626185 Oct 12 09:07:25.855819 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2823/5223] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:25 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1717 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:26.019494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:26.031208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d0fdf7e-897e-427a-98c3-58a532c6a791 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 200 len: 1310 microversion: 2.1 time: 0.399117 Oct 12 09:07:26.031815 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2401/5224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:25 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 1310 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:26.095974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:26.096871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:26.105397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:26.106477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:26.107156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:26.108952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:26.110213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:26.110941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:26.280418 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Cannot 'detach_volume' instance a0dfc060-f11f-4e03-a257-156ae0786b5a while it is in vm_state rescued Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments/8050e02c-65a8-4092-a76f-1977f3aa68a8 HTTP/1.1 Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: exception: Cannot 'detach_volume' instance a0dfc060-f11f-4e03-a257-156ae0786b5a while it is in vm_state rescued Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': 'a0dfc060-f11f-4e03-a257-156ae0786b5a', 'id': '8050e02c-65a8-4092-a76f-1977f3aa68a8'} Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a0dfc060-f11f-4e03-a257-156ae0786b5a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a0dfc060-f11f-4e03-a257-156ae0786b5a while it is in vm_state rescued Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:26.284094 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:26.290310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:26.290310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:26.290310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:07:26.290310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:07:26.290310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a0dfc060-f11f-4e03-a257-156ae0786b5a while it is in vm_state rescued Oct 12 09:07:26.290310 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:26.292807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 409 to user: Cannot 'detach_volume' instance a0dfc060-f11f-4e03-a257-156ae0786b5a while it is in vm_state rescued {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:07:26.294095 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-288b7f4c-ea96-4d4b-8e68-48332e0a01d0 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments/8050e02c-65a8-4092-a76f-1977f3aa68a8" status: 409 len: 152 microversion: 2.1 time: 0.202247 Oct 12 09:07:26.304376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:26.305243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:26.312124 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2824/5225] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:07:26 2022] DELETE /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments/8050e02c-65a8-4092-a76f-1977f3aa68a8 => generated 152 bytes in 221 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:07:26.314641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:26.315347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:26.316126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:26.317072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:26.317775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:26.318545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:26.460450 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7b013b96-2b7d-4086-b0a2-d0d0b3b4b86c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.159861 Oct 12 09:07:26.470804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:26.471630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:26.476307 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2402/5226] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:07:26 2022] POST /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:07:26.485070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:26.486467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:26.488193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:26.491175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:26.492726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:26.494403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:27.060748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:27.061561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: e1b00d3f-4af5-42de-8153-8d96099b68af] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:27.068641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:27.069354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:27.069983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:27.070905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:27.071525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:27.072153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:27.102360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:27.111760 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] HTTP exception thrown: Instance e1b00d3f-4af5-42de-8153-8d96099b68af could not be found. Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Request method failure captured: Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af HTTP/1.1 Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoN_zRq4nSDtns2P-RAxtrUCjAbOFMgfFEGURTSCWy9q9GpURriXanQnNJBM7zYbsfDXJJ9JGY6KGhkUJCss_G8UgWlPM_v0QfEIeAIt1wC_oqF7wckGnVbCFn8F_Zv99Q1VdpjLzfh4nB0Ujh6ig0YZ2jF_Tmx89Nne39AKWsl8qqw Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2e71a3b13b224ff5a20dffa561b62aea Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e71a3b13b224ff5a20dffa561b62aea"}]}] Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2e71a3b13b224ff5a20dffa561b62aea Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListServerFiltersTestJSON-1467734407-project Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c7d8a6f2007b4f76b0633e048335ff3a Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListServerFiltersTestJSON-1467734407-project Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e1b00d3f-4af5-42de-8153-8d96099b68af could not be found. Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e1b00d3f-4af5-42de-8153-8d96099b68af'} Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b00d3f-4af5-42de-8153-8d96099b68af could not be found. Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b00d3f-4af5-42de-8153-8d96099b68af could not be found. Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:27.115602 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:27.120413 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:27.120413 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:27.120413 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:27.120413 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:07:27.120413 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:07:27.120413 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b00d3f-4af5-42de-8153-8d96099b68af could not be found. Oct 12 09:07:27.120413 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:27.125286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Returning 404 to user: Instance e1b00d3f-4af5-42de-8153-8d96099b68af could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:07:27.129379 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8819825d-f4a2-45ad-8acb-983ce48ff895 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af" status: 404 len: 111 microversion: 2.1 time: 0.073929 Oct 12 09:07:27.130369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-140717b2-b96e-4f71-9d54-ac610be9da75 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1725 microversion: 2.1 time: 0.661284 Oct 12 09:07:27.131135 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2403/5227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:27 2022] GET /compute/v2.1/servers/e1b00d3f-4af5-42de-8153-8d96099b68af => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:07:27.152151 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2825/5228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:26 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1725 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:27.158184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:27.161090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:27.171741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:27.172479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:27.173258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:27.174422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:27.175047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:27.175635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:27.210800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:07:27.285715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:27.320895 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d12cb0a5-8be5-4aaf-a2c4-b764c1d92adf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671" status: 204 len: 0 microversion: 2.1 time: 0.168518 Oct 12 09:07:27.322549 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2404/5229] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:07:27 2022] DELETE /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:07:27.332863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:27.334308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:27.344080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:27.345322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:27.346169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:27.347552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:27.348388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:27.348832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:27.358328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:28.000881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:28.014454 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-adbb0efe-f18b-4ccb-bbae-691ee6c47bdf tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671" status: 200 len: 1519 microversion: 2.1 time: 0.687135 Oct 12 09:07:28.015253 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2826/5230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:27 2022] GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 => generated 1519 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:28.160027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:28.160723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:28.179643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:28.179643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:28.179643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:28.179643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:28.179643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:28.179643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:28.447227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:28.459712 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b4e3f814-d47e-459d-adee-9c213da5d274 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1725 microversion: 2.1 time: 0.304800 Oct 12 09:07:28.460999 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2405/5231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:28 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:29.044907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:29.046478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:29.049726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:29.056210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:29.057106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:29.057797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:29.061499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:29.062621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:29.063324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:29.239803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:29.260251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06010533-c2ea-476f-a014-b6a60ab04824 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671" status: 200 len: 1519 microversion: 2.1 time: 0.218204 Oct 12 09:07:29.273468 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2827/5232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:29 2022] GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:29.488392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:29.490846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:29.502501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:29.503432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:29.504329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:29.505336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:29.506033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:29.506701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:30.005616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:30.014609 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37bc6205-a527-4daa-839b-aba4c35bd06c tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1725 microversion: 2.1 time: 0.530155 Oct 12 09:07:30.015204 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2406/5233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:29 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1725 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:30.287555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:30.289060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:30.312125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:30.315992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:30.316518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:30.322955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:30.323733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:30.324199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:30.880570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-45061d2c-c6c6-4c56-9bab-0e965e140537 req-04224271-e289-4155-b366-4581df832d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7717dae4-6939-4ec3-9879-eecba8e09671", "name": "network-vif-deleted", "tag": "7e5a3569-33ad-4566-bff0-6ff93c3ff0f4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:30.903109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45061d2c-c6c6-4c56-9bab-0e965e140537 req-04224271-e289-4155-b366-4581df832d11 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:30.903600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45061d2c-c6c6-4c56-9bab-0e965e140537 req-04224271-e289-4155-b366-4581df832d11 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:30.904041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-45061d2c-c6c6-4c56-9bab-0e965e140537 req-04224271-e289-4155-b366-4581df832d11 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:30.927080 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-45061d2c-c6c6-4c56-9bab-0e965e140537 req-04224271-e289-4155-b366-4581df832d11 service nova] Creating event network-vif-deleted:7e5a3569-33ad-4566-bff0-6ff93c3ff0f4 for instance 7717dae4-6939-4ec3-9879-eecba8e09671 on n-h2-858383-10 Oct 12 09:07:30.943367 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-45061d2c-c6c6-4c56-9bab-0e965e140537 req-04224271-e289-4155-b366-4581df832d11 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066529 Oct 12 09:07:30.944294 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2407/5234] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:07:31.039847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:31.040930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:31.062275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:31.068804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:31.069684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:31.070843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:31.071586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:31.072311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:31.280837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:31.294118 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1d1ea9ec-26ec-42d9-8954-4d8daabf08dd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671" status: 200 len: 1519 microversion: 2.1 time: 1.012134 Oct 12 09:07:31.295799 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2828/5235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:30 2022] GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 => generated 1519 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:31.607664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:31.624942 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-34549aa1-7385-485b-b6db-9d488e66d85e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1731 microversion: 2.1 time: 0.589887 Oct 12 09:07:31.626871 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2408/5236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:31 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1731 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:31.649036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:31.649756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:31.660723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:31.662965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:31.664160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:31.667064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:31.668049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:31.676877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:31.678066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:31.953880 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47028c9a-345c-49fa-ae61-c2ed7b1f22ca tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.308749 Oct 12 09:07:31.954495 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2829/5237] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:07:31 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-interface => generated 285 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:32.320231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:32.321857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: 7717dae4-6939-4ec3-9879-eecba8e09671] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:32.336501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=12 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:32.341030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:32.342976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:32.344859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:32.347740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:32.348430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:32.349084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:32.376426 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] HTTP exception thrown: Instance 7717dae4-6939-4ec3-9879-eecba8e09671 could not be found. Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Request method failure captured: Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 HTTP/1.1 Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoN_zRq4nSDtns2P-RAxtrUCjAbOFMgfFEGURTSCWy9q9GpURriXanQnNJBM7zYbsfDXJJ9JGY6KGhkUJCss_G8UgWlPM_v0QfEIeAIt1wC_oqF7wckGnVbCFn8F_Zv99Q1VdpjLzfh4nB0Ujh6ig0YZ2jF_Tmx89Nne39AKWsl8qqw Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 2e71a3b13b224ff5a20dffa561b62aea Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e71a3b13b224ff5a20dffa561b62aea"}]}] Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 2e71a3b13b224ff5a20dffa561b62aea Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ListServerFiltersTestJSON-1467734407-project Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c7d8a6f2007b4f76b0633e048335ff3a Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ListServerFiltersTestJSON-1467734407-project Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 7717dae4-6939-4ec3-9879-eecba8e09671 could not be found. Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '7717dae4-6939-4ec3-9879-eecba8e09671'} Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7717dae4-6939-4ec3-9879-eecba8e09671 could not be found. Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7717dae4-6939-4ec3-9879-eecba8e09671 could not be found. Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:32.378840 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:32.383367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:32.383367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:32.383367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:32.383367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:07:32.383367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:07:32.383367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7717dae4-6939-4ec3-9879-eecba8e09671 could not be found. Oct 12 09:07:32.383367 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:07:32.387524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Returning 404 to user: Instance 7717dae4-6939-4ec3-9879-eecba8e09671 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:07:32.388697 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97692b43-0c29-4f21-9675-fdfe692efee0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671" status: 404 len: 111 microversion: 2.1 time: 0.072721 Oct 12 09:07:32.389857 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2409/5238] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:32 2022] GET /compute/v2.1/servers/7717dae4-6939-4ec3-9879-eecba8e09671 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:07:32.404377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:32.409023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:32.427294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:32.428343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:32.430490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:32.432867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:32.433712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:32.434548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:32.517042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:07:32.734209 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-545d850b-30cf-4788-b0fe-732ebb5c7bcd tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 204 len: 0 microversion: 2.1 time: 0.339418 Oct 12 09:07:32.735300 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2830/5239] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:07:32 2022] DELETE /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:07:32.744555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:32.745495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:32.765129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:32.765601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:32.766026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:32.766876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:32.767361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:32.767794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:33.561122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:33.575206 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef3d0ccc-7a54-4987-bcd2-e387e5b94c40 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1517 microversion: 2.1 time: 0.835975 Oct 12 09:07:33.576679 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2410/5240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:32 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1517 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:34.622392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:34.623353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:34.634146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:34.637663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:34.638609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:34.639660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:34.640899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:34.653699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:34.655017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:35.115556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5978a7b3-0e23-4549-8cea-f893e3c976a2 req-80ffb206-e8d0-4042-ace1-5f4cbf47352e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dfc060-f11f-4e03-a257-156ae0786b5a", "tag": "417415df-add3-4998-83fb-ea2240f786bb"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:35.132921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5978a7b3-0e23-4549-8cea-f893e3c976a2 req-80ffb206-e8d0-4042-ace1-5f4cbf47352e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:35.139762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5978a7b3-0e23-4549-8cea-f893e3c976a2 req-80ffb206-e8d0-4042-ace1-5f4cbf47352e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:35.140496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5978a7b3-0e23-4549-8cea-f893e3c976a2 req-80ffb206-e8d0-4042-ace1-5f4cbf47352e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:35.185872 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5978a7b3-0e23-4549-8cea-f893e3c976a2 req-80ffb206-e8d0-4042-ace1-5f4cbf47352e service nova] Creating event network-changed:417415df-add3-4998-83fb-ea2240f786bb for instance a0dfc060-f11f-4e03-a257-156ae0786b5a on n-h1-858383-10 Oct 12 09:07:35.203560 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5978a7b3-0e23-4549-8cea-f893e3c976a2 req-80ffb206-e8d0-4042-ace1-5f4cbf47352e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091320 Oct 12 09:07:35.204933 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2411/5241] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:35.395009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:35.407537 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0acd7747-4fa0-4986-9b20-a896cfcbd782 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1517 microversion: 2.1 time: 0.804871 Oct 12 09:07:35.414132 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2831/5242] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:34 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1517 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:36.029300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a41dd878-e69f-4f5d-97c8-e0c8ce976b0a req-b6e88a1d-5413-490a-bea2-11e652cd1805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d871c37a-b6b2-4318-af2e-c29186080fb8", "name": "network-vif-deleted", "tag": "17b28c98-0d6c-4c2b-98b6-4b0309579074"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:36.056785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a41dd878-e69f-4f5d-97c8-e0c8ce976b0a req-b6e88a1d-5413-490a-bea2-11e652cd1805 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:36.057282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a41dd878-e69f-4f5d-97c8-e0c8ce976b0a req-b6e88a1d-5413-490a-bea2-11e652cd1805 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:36.057776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a41dd878-e69f-4f5d-97c8-e0c8ce976b0a req-b6e88a1d-5413-490a-bea2-11e652cd1805 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:36.077296 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a41dd878-e69f-4f5d-97c8-e0c8ce976b0a req-b6e88a1d-5413-490a-bea2-11e652cd1805 service nova] Creating event network-vif-deleted:17b28c98-0d6c-4c2b-98b6-4b0309579074 for instance d871c37a-b6b2-4318-af2e-c29186080fb8 on n-h2-858383-10 Oct 12 09:07:36.084357 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a41dd878-e69f-4f5d-97c8-e0c8ce976b0a req-b6e88a1d-5413-490a-bea2-11e652cd1805 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061845 Oct 12 09:07:36.085304 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2412/5243] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:36.444062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:36.444931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:36.463956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:36.464688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:36.466228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:36.468669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:36.471292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:36.472114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:36.580492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:36.583469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:36.584039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:36.584525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lazy-loading 'fault' on Instance uuid d871c37a-b6b2-4318-af2e-c29186080fb8 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:07:36.730138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a6f2007b4f76b0633e048335ff3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e71a3b13b224ff5a20dffa561b62aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:36.739108 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13a97f13-7e9a-438f-bef2-36a1cfe90199 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 200 len: 1310 microversion: 2.1 time: 0.300006 Oct 12 09:07:36.747900 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2832/5244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:36 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 1310 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:37.277622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-cb6c7360-1690-49f5-b439-a59b24ca1db4 req-f1256163-39b4-4b4a-a1fb-eb5cf1dde957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dfc060-f11f-4e03-a257-156ae0786b5a", "tag": "417415df-add3-4998-83fb-ea2240f786bb"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:37.299051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cb6c7360-1690-49f5-b439-a59b24ca1db4 req-f1256163-39b4-4b4a-a1fb-eb5cf1dde957 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:37.299433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cb6c7360-1690-49f5-b439-a59b24ca1db4 req-f1256163-39b4-4b4a-a1fb-eb5cf1dde957 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:37.299870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cb6c7360-1690-49f5-b439-a59b24ca1db4 req-f1256163-39b4-4b4a-a1fb-eb5cf1dde957 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:37.322692 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-cb6c7360-1690-49f5-b439-a59b24ca1db4 req-f1256163-39b4-4b4a-a1fb-eb5cf1dde957 service nova] Creating event network-changed:417415df-add3-4998-83fb-ea2240f786bb for instance a0dfc060-f11f-4e03-a257-156ae0786b5a on n-h1-858383-10 Oct 12 09:07:37.340102 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-cb6c7360-1690-49f5-b439-a59b24ca1db4 req-f1256163-39b4-4b4a-a1fb-eb5cf1dde957 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066983 Oct 12 09:07:37.341112 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2413/5245] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:37.768073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:37.768697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] [instance: d871c37a-b6b2-4318-af2e-c29186080fb8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:37.802884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:37.810810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:37.814111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:37.815221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:37.819060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:37.820983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:37.869249 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] HTTP exception thrown: Instance d871c37a-b6b2-4318-af2e-c29186080fb8 could not be found. Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Request method failure captured: Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 HTTP/1.1 Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoN_zRq4nSDtns2P-RAxtrUCjAbOFMgfFEGURTSCWy9q9GpURriXanQnNJBM7zYbsfDXJJ9JGY6KGhkUJCss_G8UgWlPM_v0QfEIeAIt1wC_oqF7wckGnVbCFn8F_Zv99Q1VdpjLzfh4nB0Ujh6ig0YZ2jF_Tmx89Nne39AKWsl8qqw Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2e71a3b13b224ff5a20dffa561b62aea Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2e71a3b13b224ff5a20dffa561b62aea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2e71a3b13b224ff5a20dffa561b62aea"}]}] Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2e71a3b13b224ff5a20dffa561b62aea Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1467734407 Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ListServerFiltersTestJSON-1467734407-project Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c7d8a6f2007b4f76b0633e048335ff3a Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ListServerFiltersTestJSON-1467734407-project Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance d871c37a-b6b2-4318-af2e-c29186080fb8 could not be found. Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'd871c37a-b6b2-4318-af2e-c29186080fb8'} Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d871c37a-b6b2-4318-af2e-c29186080fb8 could not be found. Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d871c37a-b6b2-4318-af2e-c29186080fb8 could not be found. Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:37.873206 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:37.878314 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:37.878314 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:37.878314 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:37.878314 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:07:37.878314 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:07:37.878314 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d871c37a-b6b2-4318-af2e-c29186080fb8 could not be found. Oct 12 09:07:37.878314 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:37.883650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] Returning 404 to user: Instance d871c37a-b6b2-4318-af2e-c29186080fb8 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:07:37.885952 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d041a80f-f941-43a8-a3eb-ed17dd21faf0 tempest-ListServerFiltersTestJSON-1467734407 tempest-ListServerFiltersTestJSON-1467734407-project] 10.222.0.40 "GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8" status: 404 len: 111 microversion: 2.1 time: 0.125609 Oct 12 09:07:37.888290 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2833/5246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:37 2022] GET /compute/v2.1/servers/d871c37a-b6b2-4318-af2e-c29186080fb8 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:07:44.556905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1527682481", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": "none"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:44.580148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:44.639173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:07:44.639630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:07:44.640136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:07:44.640621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:07:44.641064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:07:44.669707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:44.671199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:44.671919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:44.672986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:44.674088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:44.680453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:44.706724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:44.714301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:44.729602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:44.735325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Getting quotas for project 2c41c79fb5b640299533258e8a332869. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:07:44.743419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:44.757468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Getting quotas for user 8250bab4b74b4127abe3e20c6265a0a9 and project 2c41c79fb5b640299533258e8a332869. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:07:44.759358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:44.760337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:44.767418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:44.768251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:44.791755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:07:44.796020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:07:44.839840 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-977f158d-084d-4dfd-bb78-8fd1326dd6e8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/ips" status: 200 len: 146 microversion: 2.1 time: 0.137216 Oct 12 09:07:44.852691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2834/5247] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:07:44 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/ips => generated 146 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:44.866529 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ffbb26c9-724a-4eec-b262-690806f0b0e4 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.550811 Oct 12 09:07:44.868161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2414/5248] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 09:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 09:07:44.888177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1daac35-ea20-4c4c-a3eb-95dfa3a5970f tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:44.889949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1daac35-ea20-4c4c-a3eb-95dfa3a5970f tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:45.030831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1daac35-ea20-4c4c-a3eb-95dfa3a5970f tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:45.046718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1daac35-ea20-4c4c-a3eb-95dfa3a5970f tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:45.049889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1daac35-ea20-4c4c-a3eb-95dfa3a5970f tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:45.051113 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1daac35-ea20-4c4c-a3eb-95dfa3a5970f tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 200 len: 1281 microversion: 2.47 time: 0.167000 Oct 12 09:07:45.051737 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2835/5249] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:44 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:46.092735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:46.094258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:46.119746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:46.121426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:46.123990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:46.125400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:46.126112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:46.126931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:46.329270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:46.348632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:46.351064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:46.355083 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c54c9d8a-9130-4505-8b7e-da631e826b11 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 200 len: 1333 microversion: 2.47 time: 0.269835 Oct 12 09:07:46.357988 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2415/5250] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:46 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 1333 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:47.388155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:47.390394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:47.430950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:47.431206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:47.432027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:47.433371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:47.434702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:47.435500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:47.653864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:47.664176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:47.675645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:47.679655 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-576293a4-5fd1-46be-9c54-7e56d3cffdb1 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 200 len: 1339 microversion: 2.47 time: 0.296289 Oct 12 09:07:47.683750 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2836/5251] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:47 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:48.579450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39b7eca0-d881-4000-a001-22dae43d719a"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:48.582774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:48.600550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:48.601064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:48.602708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:48.603469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:48.606174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:48.607703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:48.712308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:48.713663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:48.727513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:48.727892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:48.732583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:48.733732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:48.734400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:48.735018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:49.147818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:49.162990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:49.166688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:49.173935 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0c2f9b14-a848-4061-8b18-ced73ae22356 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 200 len: 1339 microversion: 2.47 time: 0.465320 Oct 12 09:07:49.178684 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2837/5252] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:48 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 1339 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:07:49.203907 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bd0b94f7-6cd1-406b-8226-4aeaf85cce55 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629529 Oct 12 09:07:49.213765 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2416/5253] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:07:48 2022] POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:50.209734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:50.212755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:50.224874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:50.225698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:50.226290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:50.227183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:50.227894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:50.228513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:50.402939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:50.423172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:50.427441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:50.429648 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7baf9a66-3874-4259-9e09-086ee4cc9610 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 200 len: 1360 microversion: 2.47 time: 0.223559 Oct 12 09:07:50.430906 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2838/5254] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:50 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:50.462349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-673383975"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:50.465804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:50.479300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:50.479941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:50.480387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:50.481110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:50.481605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:50.482036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:50.770806 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-128dd083-a625-46b6-a6f3-495fc1411769 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "POST /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745/action" status: 202 len: 52 microversion: 2.47 time: 0.313600 Oct 12 09:07:50.781770 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2417/5255] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 09:07:50 2022] POST /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745/action => generated 52 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 12 09:07:50.793848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:50.794997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:50.807304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:50.807844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:50.809798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:50.811154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:50.811856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:50.812609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:50.846242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:07:51.043575 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-07fce70e-af5a-4aff-b4f3-07d6b281a45a tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 204 len: 0 microversion: 2.47 time: 0.252431 Oct 12 09:07:51.046349 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2839/5256] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:07:50 2022] DELETE /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:07:51.056593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:51.057427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:51.070467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:51.071222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:51.072474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:51.073404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:51.074677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:51.075362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:51.238789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:51.256437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:51.259650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:51.261877 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05e6fe48-3fff-4cd5-899d-0a0684e5d0f5 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 200 len: 1366 microversion: 2.47 time: 0.210888 Oct 12 09:07:51.263582 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2418/5257] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:51 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:52.295491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:52.297466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:52.309227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:52.319010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:52.320308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:52.323548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:52.324670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:52.325945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:52.495169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:52.514237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:52.515959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:52.517532 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b42d43fe-581d-46ba-aee9-80a6f96befc9 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 200 len: 1366 microversion: 2.47 time: 0.229196 Oct 12 09:07:52.531998 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2840/5258] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:52 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:53.554022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:53.554743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:53.571817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:53.576044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:53.576672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:53.577907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:53.578739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:53.579520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:53.811531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:53.824321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:53.827603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8250bab4b74b4127abe3e20c6265a0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c41c79fb5b640299533258e8a332869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:53.832133 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-051e1d17-135e-4bb6-a8a7-1d46fb26c477 tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 200 len: 1366 microversion: 2.47 time: 0.283467 Oct 12 09:07:53.836583 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2419/5259] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:53 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:07:54.872680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:54.873421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] [instance: 9450e3ef-4840-467e-8f4d-17d210ba3745] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:54.880631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:54.881136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:54.887685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:54.888603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:54.890316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:54.892368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:54.942138 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] HTTP exception thrown: Instance 9450e3ef-4840-467e-8f4d-17d210ba3745 could not be found. Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Request method failure captured: Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 HTTP/1.1 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoPgIwJr4aDwWUrCTLX-gp2HwpEED_ThjlSAXd4IXvl_qA_7jTB6tg8AqmNwS31RgGYb559bWHNlDuzNvq3HL5aWZhY6vH0DAtX1Lu0mu4UZn_j643BlesZZxBcKNPVpK2esNY847n_QfTKvAH82_MlQJWLzbxa8KDuSUeaPE-Nw8_Y Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 2c41c79fb5b640299533258e8a332869 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersAaction247Test-1402520213 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c41c79fb5b640299533258e8a332869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c41c79fb5b640299533258e8a332869"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c41c79fb5b640299533258e8a332869"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c41c79fb5b640299533258e8a332869"}]}] Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersAaction247Test-1402520213 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 2c41c79fb5b640299533258e8a332869 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersAaction247Test-1402520213 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersAaction247Test-1402520213-project Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 8250bab4b74b4127abe3e20c6265a0a9 Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersAaction247Test-1402520213-project Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 9450e3ef-4840-467e-8f4d-17d210ba3745 could not be found. Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '9450e3ef-4840-467e-8f4d-17d210ba3745'} Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9450e3ef-4840-467e-8f4d-17d210ba3745 could not be found. Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9450e3ef-4840-467e-8f4d-17d210ba3745 could not be found. Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:54.944327 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9450e3ef-4840-467e-8f4d-17d210ba3745 could not be found. Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] Returning 404 to user: Instance 9450e3ef-4840-467e-8f4d-17d210ba3745 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9aff07cc-d4cc-4db8-89fe-b9c51e5138bd tempest-ServersAaction247Test-1402520213 tempest-ServersAaction247Test-1402520213-project] 10.222.0.40 "GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745" status: 404 len: 111 microversion: 2.47 time: 0.077284 Oct 12 09:07:54.950948 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2841/5260] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:07:54 2022] GET /compute/v2.1/servers/9450e3ef-4840-467e-8f4d-17d210ba3745 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:07:56.050012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:56.051341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:56.070452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:56.074010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:56.079855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:56.081745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:56.083413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:56.085935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:56.088733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:56.091543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:56.166549 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef292bd2-9650-4a77-96f9-505911ebbc18 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4/ips" status: 200 len: 148 microversion: 2.1 time: 0.122564 Oct 12 09:07:56.171576 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2420/5261] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:07:56 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4/ips => generated 148 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:07:56.184268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18168f65-b4b0-46b1-a08a-62b9dee96235"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:07:56.187104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:56.190506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:56.196808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:56.197966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:56.198701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:56.200735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:56.201846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:56.202454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:56.209124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:56.417009 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Invalid volume: volume 18168f65-b4b0-46b1-a08a-62b9dee96235 is already attached to instances: b7ee6956-f9fb-408c-9eeb-e101fd460ec8 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4/os-volume_attachments HTTP/1.1 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 74 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: {"volumeAttachment": {"volumeId": "18168f65-b4b0-46b1-a08a-62b9dee96235"}} Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid volume: volume 18168f65-b4b0-46b1-a08a-62b9dee96235 is already attached to instances: b7ee6956-f9fb-408c-9eeb-e101fd460ec8 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': '321062c0-31e6-40dd-b8f8-b6a1f8659bf4', 'body': {'volumeAttachment': {'volumeId': '18168f65-b4b0-46b1-a08a-62b9dee96235'}}} Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 18168f65-b4b0-46b1-a08a-62b9dee96235 is already attached to instances: b7ee6956-f9fb-408c-9eeb-e101fd460ec8 Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:07:56.433762 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 18168f65-b4b0-46b1-a08a-62b9dee96235 is already attached to instances: b7ee6956-f9fb-408c-9eeb-e101fd460ec8 Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 18168f65-b4b0-46b1-a08a-62b9dee96235 is already attached to instances: b7ee6956-f9fb-408c-9eeb-e101fd460ec8 Oct 12 09:07:56.438355 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:07:56.440922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 400 to user: Invalid volume: volume 18168f65-b4b0-46b1-a08a-62b9dee96235 is already attached to instances: b7ee6956-f9fb-408c-9eeb-e101fd460ec8 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:07:56.442224 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ee71310-b7f3-4e4e-a92f-3b341e80a671 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.263146 Oct 12 09:07:56.452967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:56.454763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:56.459921 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2842/5262] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:07:56 2022] POST /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4/os-volume_attachments => generated 174 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:07:56.461784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:56.462562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:56.463238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:56.464205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:56.464851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:56.465565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:56.526407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:07:56.660238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:07:56.739397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a66b6146-ddeb-4425-9cd3-38fcbee9931c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 204 len: 0 microversion: 2.1 time: 0.288957 Oct 12 09:07:56.744989 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2421/5263] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:07:56 2022] DELETE /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:07:56.752272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:56.753116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:56.772146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:56.772663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:56.773194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:56.780103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:56.780692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:56.781223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:57.109246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:57.117907 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c77e3d8-6160-439c-af28-6e7f05455dc2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1680 microversion: 2.1 time: 0.371140 Oct 12 09:07:57.121234 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2843/5264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:56 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1680 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:07:58.150051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:58.151052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:58.194512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:58.198276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:58.204953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:58.206230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:58.207584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:58.208340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:58.778536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:07:58.801501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ddc1aebb-3e5e-4a07-acf4-4dbff3788fd3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1680 microversion: 2.1 time: 0.655014 Oct 12 09:07:58.806187 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2422/5265] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:58 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1680 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:07:59.826955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:07:59.828929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:07:59.851304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:59.851830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:59.853934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:07:59.856983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:07:59.857837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:07:59.858526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:00.540425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:00.555678 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-375e79f3-22b0-4732-b813-7d7b15ae6287 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1680 microversion: 2.1 time: 0.727376 Oct 12 09:08:00.556338 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2844/5266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:07:59 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1680 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:01.065857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4a771588-5a7a-40e7-9e8e-2148a0350fdf req-5c0154eb-8644-4f5b-94bd-c1a46207a948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321062c0-31e6-40dd-b8f8-b6a1f8659bf4", "name": "network-vif-deleted", "tag": "7ff6293b-abed-4fc9-bb37-7ca01d5a4bc0"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:01.099462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4a771588-5a7a-40e7-9e8e-2148a0350fdf req-5c0154eb-8644-4f5b-94bd-c1a46207a948 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:01.100259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4a771588-5a7a-40e7-9e8e-2148a0350fdf req-5c0154eb-8644-4f5b-94bd-c1a46207a948 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:01.100958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4a771588-5a7a-40e7-9e8e-2148a0350fdf req-5c0154eb-8644-4f5b-94bd-c1a46207a948 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:01.136194 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4a771588-5a7a-40e7-9e8e-2148a0350fdf req-5c0154eb-8644-4f5b-94bd-c1a46207a948 service nova] Creating event network-vif-deleted:7ff6293b-abed-4fc9-bb37-7ca01d5a4bc0 for instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 on n-h2-858383-10 Oct 12 09:08:01.161571 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4a771588-5a7a-40e7-9e8e-2148a0350fdf req-5c0154eb-8644-4f5b-94bd-c1a46207a948 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102981 Oct 12 09:08:01.168981 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2423/5267] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:01.583263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:01.583819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:01.600283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:01.600753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:01.601193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:01.601947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:01.602398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:01.605380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:01.671873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:01.672747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:01.673345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:01.673986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lazy-loading 'fault' on Instance uuid 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:08:01.986565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:02.001402 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc644ecc-4153-4d0c-acf6-4d2defd5c0f4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 200 len: 1331 microversion: 2.1 time: 0.422271 Oct 12 09:08:02.006515 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2845/5268] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:01 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 1331 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:02.612198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:02.613696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:02.620862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:02.621747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:02.622589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:02.623757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:02.624448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:02.625166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:03.029795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:03.031072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:03.042977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:03.047726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:03.059889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:03.061160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:03.061896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:03.062556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:03.091896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 HTTP/1.1 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '321062c0-31e6-40dd-b8f8-b6a1f8659bf4'} Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:03.093912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:03.098902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:03.098902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:03.098902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:03.098902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:08:03.098902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:08:03.098902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:08:03.098902 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:03.100717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:08:03.101851 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9c20f5ce-8e6e-4c79-a6f1-d617403fe536 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 404 len: 111 microversion: 2.1 time: 0.077500 Oct 12 09:08:03.102661 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2846/5269] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:03 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:08:03.112224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f93412e-f4cd-422c-ace5-789480ea33ef tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '.version_select at 0x7f984cc7d3a0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:03.159615 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f93412e-f4cd-422c-ace5-789480ea33ef tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665590538" status: 202 len: 0 microversion: 2.1 time: 0.051369 Oct 12 09:08:03.160343 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2847/5270] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 09:08:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665590538 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:08:03.627399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:03.645973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:03.654396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:03.658622 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8bc0c74b-5201-4ab1-b080-ae0179185736 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2947 microversion: 2.32 time: 1.051531 Oct 12 09:08:03.659452 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2424/5271] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:08:02 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2947 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:08:03.697792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:03.698412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:03.713097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:03.714250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:03.717169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:03.720564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:03.723594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:03.725005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:04.136771 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f78d5257-f74e-4d70-ae96-bdee54804b2a tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.444380 Oct 12 09:08:04.138628 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2848/5272] 10.222.0.40 () {60 vars in 1316 bytes} [Wed Oct 12 09:08:03 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf/os-interface => generated 1832 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:08:04.234579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-515d064d-234e-4398-ac36-08882a4951c7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:04.246646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-515d064d-234e-4398-ac36-08882a4951c7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:04.247660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-515d064d-234e-4398-ac36-08882a4951c7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:04.248361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-515d064d-234e-4398-ac36-08882a4951c7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:04.331705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-515d064d-234e-4398-ac36-08882a4951c7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Going to try to stop instance {{(pid=127007) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 09:08:04.442506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-515d064d-234e-4398-ac36-08882a4951c7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/action" status: 202 len: 0 microversion: 2.1 time: 0.211259 Oct 12 09:08:04.443751 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2425/5273] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:08:04 2022] POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:08:04.464834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:04.464834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:04.480995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:04.481871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:04.482727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:04.484180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:04.485297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:04.486422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:04.576273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:04.577303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:04.586840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:04.587572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:04.588244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:04.589519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:04.590162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:04.590788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:04.746860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lazy-loading 'services' on Instance uuid a0dfc060-f11f-4e03-a257-156ae0786b5a {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:08:04.845390 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30981c1c-0de8-4766-a71e-18b0a1388efc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments/8050e02c-65a8-4092-a76f-1977f3aa68a8" status: 202 len: 0 microversion: 2.1 time: 0.274937 Oct 12 09:08:04.850479 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2426/5274] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:08:04 2022] DELETE /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments/8050e02c-65a8-4092-a76f-1977f3aa68a8 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:08:04.865374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:04.868597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:04.880141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:04.881479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:04.882192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:04.883153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:04.883999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:04.884657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:04.948377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:04.957324 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a650b464-4225-411c-b4bc-402d1874ba37 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105083 Oct 12 09:08:04.962345 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2427/5275] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:04 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:04.966649 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-295c5edc-e2cd-411b-806c-a5474b7e8542 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.516620 Oct 12 09:08:04.967533 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2849/5276] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:04 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:05.514136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:05.515336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:05.526532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:05.528213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:05.529368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:05.530908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:05.531829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:05.532507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:05.670868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lazy-loading 'services' on Instance uuid b7ee6956-f9fb-408c-9eeb-e101fd460ec8 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:08:05.782938 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c87662f8-41a6-4e2a-960a-b0014340e4f1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments/18168f65-b4b0-46b1-a08a-62b9dee96235" status: 202 len: 0 microversion: 2.1 time: 0.279134 Oct 12 09:08:05.783767 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2428/5277] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:08:05 2022] DELETE /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments/18168f65-b4b0-46b1-a08a-62b9dee96235 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:08:05.795287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:05.801971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:05.812473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:05.814594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:05.815621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:05.816425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:05.817568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:05.819010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:05.820411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:05.876218 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7332e91e-4c5c-4779-8c06-b0acad60c071 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086875 Oct 12 09:08:05.889640 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2850/5278] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:05 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:05.974986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:05.977610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:05.985065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:05.986140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:05.988089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:05.989952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:05.990645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:05.991349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:05.999609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:06.000518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:06.007572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:06.008968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:06.009738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:06.011578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:06.012261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:06.012943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:06.096712 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba5bbe01-c140-4600-907e-35efc38d299e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126182 Oct 12 09:08:06.100559 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2429/5279] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:05 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:06.288328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:06.319941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-09c04071-3e13-4b90-a59e-02ae7060ef8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.325953 Oct 12 09:08:06.322863 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2851/5280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:05 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:06.902562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:06.909616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:06.933277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:06.934366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:06.935116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:06.939887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:06.941815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:06.943328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:07.068419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2b18555-f58c-4a8f-a701-1e7cc306b839 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170473 Oct 12 09:08:07.078725 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2430/5281] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:06 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:07.112583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:07.116069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:07.135150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:07.143468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:07.144196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:07.145400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:07.146078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:07.146736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:07.286155 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f9409fb-8a09-4720-ab25-f62378a16191 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177730 Oct 12 09:08:07.286769 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2852/5282] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:07 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:07.350968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:07.350968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:07.359805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:07.360314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:07.365919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:07.366873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:07.367372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:07.367826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:07.729637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:07.744597 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2bd570e6-60ab-4e77-8a38-4ff07fa64942 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.398465 Oct 12 09:08:07.749106 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2431/5283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:07 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:08.093115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:08.099538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:08.118541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:08.120702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:08.122621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:08.123669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:08.128855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:08.129685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:08.230103 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4646dbaa-5ebe-4a7f-a7cb-fec6707df0b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148451 Oct 12 09:08:08.231737 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2853/5284] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:08 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:08.299578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:08.303757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:08.322191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:08.323236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:08.325078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:08.326396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:08.327739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:08.331839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:08.416569 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ef975a3-a858-4b8d-a8f3-ac7b7b352a73 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121564 Oct 12 09:08:08.417401 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2432/5285] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:08 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:08.772989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:08.774009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:08.784248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:08.786169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:08.787540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:08.791808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:08.794171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:08.794904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:09.243713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:09.246540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:09.265103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:09.265698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:09.266228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:09.267027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:09.267566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:09.268404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:09.332043 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-889eea4b-767a-44a0-bf2e-49bca0426ac3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092287 Oct 12 09:08:09.333194 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2433/5286] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:09 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:09.434190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:09.436569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:09.443266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:09.443903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:09.444581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:09.445534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:09.446351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:09.447013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:09.490230 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ff2da303-2b31-4435-ac04-d9c60a4752e5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064594 Oct 12 09:08:09.496713 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2434/5287] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:09 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:09.628242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:09.643143 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-98a4bc55-2b18-4968-b4a4-5d6a44896993 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.874624 Oct 12 09:08:09.644358 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2854/5288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:08 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:10.345256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:10.348052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:10.366095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:10.368966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:10.370071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:10.372443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:10.374380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:10.376151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:10.453904 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-34673f23-0a4b-4a17-bc65-1ea3b63b49b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112998 Oct 12 09:08:10.461935 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2435/5289] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:10 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:10.503893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:10.506455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:10.520433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:10.520909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:10.524105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:10.525378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:10.526141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:10.530128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:10.608559 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5cf4ce98-1238-4836-9392-9f13e050ccfe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108921 Oct 12 09:08:10.613071 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2855/5290] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:10 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:10.667947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:10.669164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:10.687912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:10.688658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:10.689290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:10.690251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:10.697320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:10.697991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:10.733059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:11.518171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:11.531501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a463dcab-8f84-4dba-a24c-34abb52d18ef tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.867822 Oct 12 09:08:11.551114 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2436/5291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:10 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:11.565088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:11.567598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:11.586456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:11.590110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:11.591078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:11.592448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:11.593167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:11.593816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:11.644275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-208964434", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3fec18ad-8b81-4952-9c1c-566810bf84ac"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:11.678946 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8cf75b80-caa9-4c83-9f30-9fc5cff7f4d3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120494 Oct 12 09:08:11.679870 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2437/5292] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:11 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:11.686772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:11.689005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:11.696277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:11.697160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:11.713258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:11.714964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:11.715899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:11.717738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:11.762377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] validate_networks() for [('3fec18ad-8b81-4952-9c1c-566810bf84ac', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:08:11.785493 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6564d30c-dac3-48d7-99db-1e52fb870078 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104378 Oct 12 09:08:11.793113 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2438/5293] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:11 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:12.559780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:12.561075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:12.577073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:12.577874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:12.578490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:12.579488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:12.580101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:12.580738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:12.882849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:12.892973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:08:12.893953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:08:12.894588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:08:12.895187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:08:12.897092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:08:12.913831 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15ce84c1-55d3-4ab2-988a-6dbd4a68208b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.359456 Oct 12 09:08:12.935416 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2439/5294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:12 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:12.942497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:12.945397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:12.946267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:12.946970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:12.948112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:12.949703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:12.952643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:12.953335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:12.978118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:12.978697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:12.979293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:12.982764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:12.986486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:12.988272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:13.023613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Getting quotas for project 1602cfe15f5b4ae19a7d8eae051e85dd. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:08:13.035232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Getting quotas for user ddeca40dc28f4dd6a2d6213c6b2aaf95 and project 1602cfe15f5b4ae19a7d8eae051e85dd. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:08:13.071395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:08:13.077332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:08:13.078257 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2522bb76-7d8e-4cd3-9585-f39818b3d76f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141061 Oct 12 09:08:13.079579 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2440/5295] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:12 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:13.092312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:13.106023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:13.129898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:13.131083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:13.131952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:13.132902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:13.134123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:13.146168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:13.254320 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-54f6ff2d-b697-4064-b304-8e9d61f5fb86 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.863144 Oct 12 09:08:13.255598 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2856/5296] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:08:13.268288 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-90791b54-ff82-4140-b4fa-fa143012b25b tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187344 Oct 12 09:08:13.268900 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2441/5297] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:13 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:13.269671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bca877d2-9e3d-48d9-bb7d-60121fc335a9 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:13.270738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bca877d2-9e3d-48d9-bb7d-60121fc335a9 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:13.433005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bca877d2-9e3d-48d9-bb7d-60121fc335a9 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:13.445229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bca877d2-9e3d-48d9-bb7d-60121fc335a9 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1215 microversion: 2.1 time: 0.181674 Oct 12 09:08:13.446251 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2857/5298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:13 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:13.942294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:13.943445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:13.962033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:13.962809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:13.964678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:13.972135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:13.977472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:13.981866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.090909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:14.093234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:14.118789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.119313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.119885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.120653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.121093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.124721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.254410 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bce94490-81af-4dc9-a4f7-ec5d65e9addb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167673 Oct 12 09:08:14.262538 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2858/5299] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:14 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:08:14.281023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:14.283424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:14.308109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.308924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.309618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.312322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.314465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.319337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.435043 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51aeb33f-19f0-4070-8cd7-d0cdfba6b64d tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158200 Oct 12 09:08:14.436373 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2859/5300] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:14 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:08:14.471845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:14.473777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:14.483572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:14.489693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.493861 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba33656e-d7cd-405b-bfb7-c8e3de9e3ec6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.555605 Oct 12 09:08:14.494443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.495162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.496214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.511088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.512215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.519871 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2442/5301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:13 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:14.580094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:14.582773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:14.607081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:14.616876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.620105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.620556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.627584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.629025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.629779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.733521 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Cannot 'reboot' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e/action HTTP/1.1 Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 28 Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: {"reboot": {"type": "HARD"}} Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'reboot' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '94489241-3250-4449-8a11-25e5b88bc41e', 'body': {'reboot': {'type': 'HARD'}}} Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 94489241-3250-4449-8a11-25e5b88bc41e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:08:14.743180 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued Oct 12 09:08:14.748643 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.750524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 409 to user: Cannot 'reboot' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:08:14.752420 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-23a22858-2fa8-486c-adf2-7e7ec252ed65 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e/action" status: 409 len: 145 microversion: 2.1 time: 0.177858 Oct 12 09:08:14.755798 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2443/5302] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:08:14 2022] POST /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e/action => generated 145 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:08:14.765645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:14.784365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:14.812894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.813408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.813877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.814610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.814736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:14.815075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.815508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.826194 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8d29693d-4296-4fc8-a611-217fcc5070aa tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1219 microversion: 2.1 time: 0.358255 Oct 12 09:08:14.826835 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2860/5303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:14 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1219 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:14.896612 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Cannot 'rebuild' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e/action HTTP/1.1 Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 65 Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: exception: Cannot 'rebuild' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '94489241-3250-4449-8a11-25e5b88bc41e', 'body': {'rebuild': {'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308'}}} Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 94489241-3250-4449-8a11-25e5b88bc41e in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:08:14.901911 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued Oct 12 09:08:14.906874 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:14.911690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 409 to user: Cannot 'rebuild' instance 94489241-3250-4449-8a11-25e5b88bc41e while it is in vm_state rescued {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:08:14.918218 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-74864371-21f1-43f9-86ca-069021f0279a tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "POST /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e/action" status: 409 len: 146 microversion: 2.1 time: 0.157611 Oct 12 09:08:14.931204 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2444/5304] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:08:14 2022] POST /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e/action => generated 146 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 09:08:14.933618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:14.934380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:14.954479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.955368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.958801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.959628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:14.961750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:14.963548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:14.999245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:08:15.087998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:15.183626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c2da7118-6fb6-4495-afa9-4cc766bece5e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 204 len: 0 microversion: 2.1 time: 0.253938 Oct 12 09:08:15.187164 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2861/5305] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:08:14 2022] DELETE /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:08:15.196115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:15.196932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:15.217347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:15.217933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:15.218385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:15.219117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:15.219605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:15.220046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:15.275935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:15.278342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:15.310261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:15.313513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:15.315574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:15.334229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:15.335050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:15.339287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:15.483861 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-607141c3-e43d-4c81-bc40-a912da8bccbe tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211790 Oct 12 09:08:15.491032 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2862/5306] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:15 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:08:15.530357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:15.531982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:15.567512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:15.570913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:15.574258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:15.582407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:15.583280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:15.584534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:15.867419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:15.878203 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4df269e6-5934-4da9-ae51-8087a49a1145 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1691 microversion: 2.1 time: 0.686871 Oct 12 09:08:15.902883 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2445/5307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:15 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1691 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:15.919112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:15.919745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:15.955362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:15.955885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:15.956313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:15.964988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:15.965980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:15.966601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:16.306200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:16.315564 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05538262-7cc5-44f2-a981-bb6e8067dfe7 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1273 microversion: 2.1 time: 0.410983 Oct 12 09:08:16.316229 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2446/5308] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:15 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1273 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:16.406447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:16.432556 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a074f2ed-0e39-41e1-9b12-017357c4e77b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.913517 Oct 12 09:08:16.437266 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2863/5309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:15 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:16.502426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:16.504912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:16.522818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:16.523323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:16.523771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:16.524511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:16.534218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:16.534687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:16.641218 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e5a62063-ed65-44d5-8bbc-f5d3ad461f02 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142813 Oct 12 09:08:16.642451 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2447/5310] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:16 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:16.906113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:16.906872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:16.917249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:16.918079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:16.919954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:16.920791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:16.924600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:16.925169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:17.343702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:17.344317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:17.363751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:17.364264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:17.364717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:17.365464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:17.365933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:17.366359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:17.534858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:17.551094 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e2e48ff9-0311-429a-95e6-59cc8275b7d5 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1691 microversion: 2.1 time: 0.648193 Oct 12 09:08:17.552029 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2864/5311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:16 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1691 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:17.557462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:17.558391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:17.565655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:17.566505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:17.567111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:17.568253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:17.569243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:17.570017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:17.747984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:17.762221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ea889057-45d3-4315-bc1e-229ce840dcb5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 0.423638 Oct 12 09:08:17.763311 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2448/5312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:17 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:17.768450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:17.781183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:17.832627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:17.833133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:17.833608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:17.834350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:17.847680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:17.848224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:17.937961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:17.954509 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0e6f3af-af02-44dc-b780-b8eaad580c25 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.400116 Oct 12 09:08:17.955370 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2865/5313] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:17 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:17.968219 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-44903e19-d33c-4cd5-800d-e660c2658ff7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203605 Oct 12 09:08:17.968823 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2449/5314] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:17 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:18.580933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:18.582452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:18.597702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:18.598560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:18.601475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:18.604368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:18.605536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:18.607415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:18.787492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:18.788767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:18.802235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:18.803328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:18.805508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:18.807291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:18.809714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:18.810447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:19.061573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:19.076064 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-adab2c0f-d357-4408-a516-946a41fb6977 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1691 microversion: 2.1 time: 0.499510 Oct 12 09:08:19.079442 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2866/5315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:18 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1691 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:19.089680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:19.095268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:19.108267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:19.112925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:19.113671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:19.114788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:19.116964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:19.117934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:19.198990 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f0a44dad-893d-4327-b381-1f57fd8165a5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117981 Oct 12 09:08:19.207369 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2867/5316] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:19 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:19.219532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:19.221297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:19.233913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:19.242226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:19.242976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:19.243943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:19.244653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:19.245250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:19.675771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:19.694061 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c0138d5c-a293-46e7-b4fd-4a8e5a473700 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.484119 Oct 12 09:08:19.699428 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2868/5317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:19 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:19.744267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:19.756550 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2521b194-94c1-4781-ab93-ab1644b68af2 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 0.973143 Oct 12 09:08:19.761127 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2450/5318] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:18 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:20.105860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:20.107623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:20.119393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:20.120793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:20.121563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:20.122547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:20.124296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:20.126087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:20.214630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:20.217818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:20.227873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:20.228644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:20.231327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:20.232404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:20.234012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:20.234851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:20.280135 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db15ab82-b1c4-4339-ada5-99359e1ac783 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070618 Oct 12 09:08:20.288966 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2451/5319] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:20 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:08:20.729624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:20.730936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:20.739639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:20.740150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:20.740585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:20.741313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:20.742438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:20.742898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:21.227372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:21.237707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-020c27ac-39c3-4b9b-a14f-ce796ff03c22 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1691 microversion: 2.1 time: 1.138425 Oct 12 09:08:21.254361 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2869/5320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:20 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1691 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:21.261031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:21.265759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:21.287596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:21.288570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:21.292166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:21.293535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:21.294329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:21.295047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:21.597252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:21.608280 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f3a377e7-fbe4-41fa-b586-570b23f55f06 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.885117 Oct 12 09:08:21.608852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:21.626994 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2452/5321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:20 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:21.629734 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8db0971e-1219-4b43-bf7b-d7773eb3d932 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 0.373611 Oct 12 09:08:21.641324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:21.644786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:21.647427 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2870/5322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:21 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:21.675970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:21.676838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:21.679171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:21.680187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:21.680985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:21.681639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:21.732281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:21.752269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d05114ab-5490-4639-b086-f187c355fd34 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123893 Oct 12 09:08:21.753794 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2453/5323] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:21 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:22.002258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-41704cc9-f620-426a-9942-f58ef25772bc req-f599095c-e9f1-4928-bea5-5f34ce20dbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa59241-81a2-45c8-a83b-9439db569773", "tag": "e12b430b-a041-4203-bbc4-8fe2f5910ce1"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:22.021172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-41704cc9-f620-426a-9942-f58ef25772bc req-f599095c-e9f1-4928-bea5-5f34ce20dbf7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:22.024750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-41704cc9-f620-426a-9942-f58ef25772bc req-f599095c-e9f1-4928-bea5-5f34ce20dbf7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:22.025752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-41704cc9-f620-426a-9942-f58ef25772bc req-f599095c-e9f1-4928-bea5-5f34ce20dbf7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:22.063039 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-41704cc9-f620-426a-9942-f58ef25772bc req-f599095c-e9f1-4928-bea5-5f34ce20dbf7 service nova] Creating event network-changed:e12b430b-a041-4203-bbc4-8fe2f5910ce1 for instance daa59241-81a2-45c8-a83b-9439db569773 on n-h2-858383-10 Oct 12 09:08:22.080149 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-41704cc9-f620-426a-9942-f58ef25772bc req-f599095c-e9f1-4928-bea5-5f34ce20dbf7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073876 Oct 12 09:08:22.082182 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2871/5324] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:22.262158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:22.262975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:22.279795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:22.280615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:22.281170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:22.282126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:22.282790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:22.283506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:22.593430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:22.608135 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d3364ec-786f-45a2-8621-f0159061ef2e tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1623 microversion: 2.1 time: 0.350292 Oct 12 09:08:22.609199 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2454/5325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:22 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1623 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:22.641158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:22.642542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:22.660148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:22.661217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:22.668529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:22.671379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:22.673430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:22.674443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:22.676675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:22.677504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:22.678193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:22.679700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:22.680387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:22.682390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:22.687095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:22.687806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:22.975344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:23.099627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:23.113460 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13c69fd6-1142-42a5-8c4d-2978ca9d1c8d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.472257 Oct 12 09:08:23.114383 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2872/5326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:22 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:23.131865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:23.138695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:23.147727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:23.148231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:23.148680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:23.149416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:23.149910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:23.150353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:23.218223 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-21ef46ef-b3a1-4c89-8411-0b41ba5a90ad tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102693 Oct 12 09:08:23.218827 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2873/5327] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:08:23 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:08:23.344476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:23.345296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:23.355571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:23.357798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:23.359489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:23.361467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:23.362140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:23.362769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:23.422526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:08:23.443882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:23.522244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:23.535833 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15f35bfb-27aa-4bfb-8fc2-9933d887b92d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 0.875421 Oct 12 09:08:23.536735 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2455/5328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:22 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:23.591415 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-946c9961-0da5-4e44-a42d-229e9c9757aa tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 204 len: 0 microversion: 2.1 time: 0.250614 Oct 12 09:08:23.596264 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2874/5329] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:08:23 2022] DELETE /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:08:23.603219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:23.603219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:23.609409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:23.610137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:23.610499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:23.611275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:23.612247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:23.612247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:23.632292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:23.633117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:23.646885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:23.659569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:23.660105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:23.660918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:23.664860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:23.665659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:23.815721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:23.830127 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34c23aa6-2288-4ce4-b52c-e9fae579d320 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1623 microversion: 2.1 time: 0.200642 Oct 12 09:08:23.830767 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2875/5330] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:23 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1623 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:24.140413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:24.141028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:24.154381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:24.158536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:24.161239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:24.163240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:24.165602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:24.167911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:24.225466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:24.288308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:24.334301 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35a79255-3e9e-40b9-9e81-524a29aa8d2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1679 microversion: 2.1 time: 0.734405 Oct 12 09:08:24.336000 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2456/5331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:23 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1679 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:24.351113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-587da12b-1f37-4ed9-9364-cf9ea301c6a8 req-6a6a07b1-2f7e-4b5f-835e-3c2b30d350ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dfc060-f11f-4e03-a257-156ae0786b5a", "name": "network-vif-deleted", "tag": "417415df-add3-4998-83fb-ea2240f786bb"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:24.378277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-587da12b-1f37-4ed9-9364-cf9ea301c6a8 req-6a6a07b1-2f7e-4b5f-835e-3c2b30d350ad service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:24.380960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-587da12b-1f37-4ed9-9364-cf9ea301c6a8 req-6a6a07b1-2f7e-4b5f-835e-3c2b30d350ad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:24.382680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-587da12b-1f37-4ed9-9364-cf9ea301c6a8 req-6a6a07b1-2f7e-4b5f-835e-3c2b30d350ad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:24.446586 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-587da12b-1f37-4ed9-9364-cf9ea301c6a8 req-6a6a07b1-2f7e-4b5f-835e-3c2b30d350ad service nova] Creating event network-vif-deleted:417415df-add3-4998-83fb-ea2240f786bb for instance a0dfc060-f11f-4e03-a257-156ae0786b5a on n-h1-858383-10 Oct 12 09:08:24.471247 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-587da12b-1f37-4ed9-9364-cf9ea301c6a8 req-6a6a07b1-2f7e-4b5f-835e-3c2b30d350ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132552 Oct 12 09:08:24.472086 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2457/5332] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:24.566565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:24.567515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:24.569835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:24.574455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:24.574944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:24.575384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:24.576103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:24.576554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:24.576978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:24.580734 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d1f278ff-f508-4b01-b33e-09407d7de119 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.444292 Oct 12 09:08:24.585165 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2876/5333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:24 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:24.788510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:24.810667 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-674972da-9657-4f1f-8bc9-bcda02f0b4fe tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 0.253385 Oct 12 09:08:24.813616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2458/5334] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:24 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:24.857505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:24.858801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:24.868850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:24.874369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:24.874838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:24.875669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:24.876191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:24.877549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:25.028349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:25.051784 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-327e92c6-2424-478c-93c0-1dd8fd750e87 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1623 microversion: 2.1 time: 0.185108 Oct 12 09:08:25.053703 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2877/5335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:24 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1623 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:25.368915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:25.371769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:25.394234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:25.394657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:25.396865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:25.397622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:25.401085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:25.401856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:25.607422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:25.608043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:25.628191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:25.629087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:25.629796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:25.630735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:25.631398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:25.632037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:25.946877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:25.958075 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15107220-5152-4aad-bd64-006c6a38c0ea tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1679 microversion: 2.1 time: 0.600632 Oct 12 09:08:25.961370 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2459/5336] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:25 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1679 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:25.991940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:25.998444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:26.012036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:26.014674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:26.015413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:26.019260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:26.021464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:26.022870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:26.034366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:26.052012 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-860342ad-3e5d-4009-850a-990244c5a253 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.448640 Oct 12 09:08:26.063095 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2878/5337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:25 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:26.084443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:26.092605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:26.112986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:26.113887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:26.116112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:26.117111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:26.119633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:26.138488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:26.183711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:26.184331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:26.184777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:26.185239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lazy-loading 'fault' on Instance uuid a0dfc060-f11f-4e03-a257-156ae0786b5a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:08:26.331216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:26.340279 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d51901f-8705-48d7-a6d8-3c00a2cc57ad tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 200 len: 1336 microversion: 2.1 time: 0.259832 Oct 12 09:08:26.347406 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2879/5338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:26 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 1336 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:26.990711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:26.991623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:27.003877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:27.009102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:27.010301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:27.012763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:27.013736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:27.015216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:27.201601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:27.218906 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e8c1cd8-b929-4d42-b86e-1c9f6d768fcd tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 1.238473 Oct 12 09:08:27.221945 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2460/5339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:25 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:27.234346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:27.237353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:27.253270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:27.254072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:27.254837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:27.256808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:27.259414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:27.259901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:27.663942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:27.683366 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f64c1340-b80c-4ffb-9bed-a567a25ce4c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1679 microversion: 2.1 time: 0.698613 Oct 12 09:08:27.686411 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2880/5340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:26 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1679 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:27.695108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:27.695734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: a0dfc060-f11f-4e03-a257-156ae0786b5a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:27.712540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:27.713057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:27.716274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:27.717181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:27.717715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:27.720395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:27.768359 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Instance a0dfc060-f11f-4e03-a257-156ae0786b5a could not be found. Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a HTTP/1.1 Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance a0dfc060-f11f-4e03-a257-156ae0786b5a could not be found. Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a0dfc060-f11f-4e03-a257-156ae0786b5a'} Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dfc060-f11f-4e03-a257-156ae0786b5a could not be found. Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dfc060-f11f-4e03-a257-156ae0786b5a could not be found. Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:27.773653 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dfc060-f11f-4e03-a257-156ae0786b5a could not be found. Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:27.778170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 404 to user: Instance a0dfc060-f11f-4e03-a257-156ae0786b5a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:08:27.779845 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6fc2615b-2249-44ef-9753-61036e98c16f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a" status: 404 len: 111 microversion: 2.1 time: 0.089921 Oct 12 09:08:27.785018 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2881/5341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:27 2022] GET /compute/v2.1/servers/a0dfc060-f11f-4e03-a257-156ae0786b5a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:08:27.795714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43a0be8e-84e9-4613-9a6a-473adaa84674 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '.version_select at 0x7f9848ee2e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:27.822099 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43a0be8e-84e9-4613-9a6a-473adaa84674 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122695366" status: 202 len: 0 microversion: 2.1 time: 0.035512 Oct 12 09:08:27.823259 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2882/5342] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 09:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122695366 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:08:28.138596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:28.157386 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-63f01fc5-8a44-419d-a602-4ee82900c4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.933379 Oct 12 09:08:28.158285 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2461/5343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:27 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:28.254340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:28.276357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:28.296769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:28.298366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:28.299018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:28.300968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:28.301706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:28.302317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:28.496414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d1dc2841-c9d8-4157-b048-ad9084d8f4c8 req-b3408a6e-3f44-4666-8432-a049bd496143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee6956-f9fb-408c-9eeb-e101fd460ec8", "name": "network-vif-unplugged", "status": "completed", "tag": "8d97d239-c005-4658-b9d6-9836b9997de4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:28.522018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d1dc2841-c9d8-4157-b048-ad9084d8f4c8 req-b3408a6e-3f44-4666-8432-a049bd496143 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:28.522845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d1dc2841-c9d8-4157-b048-ad9084d8f4c8 req-b3408a6e-3f44-4666-8432-a049bd496143 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:28.523461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d1dc2841-c9d8-4157-b048-ad9084d8f4c8 req-b3408a6e-3f44-4666-8432-a049bd496143 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:28.609750 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d1dc2841-c9d8-4157-b048-ad9084d8f4c8 req-b3408a6e-3f44-4666-8432-a049bd496143 service nova] Creating event network-vif-unplugged:8d97d239-c005-4658-b9d6-9836b9997de4 for instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 on n-h1-858383-10 Oct 12 09:08:28.629781 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d1dc2841-c9d8-4157-b048-ad9084d8f4c8 req-b3408a6e-3f44-4666-8432-a049bd496143 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137550 Oct 12 09:08:28.631312 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2462/5344] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:08:28.718997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:28.722073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:28.742008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:28.743492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:28.744029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:28.746032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:28.746603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:28.748819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:28.902170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:28.910670 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86c0ef10-5500-45cd-898e-628227d3bbfc tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 0.665777 Oct 12 09:08:28.911658 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2883/5345] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:28 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:29.182278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:29.183241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:29.189415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:29.191280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:29.192013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:29.192656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:29.193634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:29.194275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:29.194995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:29.233495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:29.256821 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1997e7b4-c3ef-4671-b520-46e28ee78d05 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1679 microversion: 2.1 time: 0.542062 Oct 12 09:08:29.259098 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2463/5346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:28 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1679 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:29.707390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:29.725648 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d871857f-c262-481f-9401-d183043ed7ba tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.546948 Oct 12 09:08:29.742075 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2884/5347] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:29 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:29.742689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-47531f1e-3691-457f-b4a0-a7ed2d3f2d07 req-a63b88e3-9466-4d5c-91c5-647b81d15446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ee6956-f9fb-408c-9eeb-e101fd460ec8", "name": "network-vif-deleted", "tag": "8d97d239-c005-4658-b9d6-9836b9997de4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:29.773619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-47531f1e-3691-457f-b4a0-a7ed2d3f2d07 req-a63b88e3-9466-4d5c-91c5-647b81d15446 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:29.777888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-47531f1e-3691-457f-b4a0-a7ed2d3f2d07 req-a63b88e3-9466-4d5c-91c5-647b81d15446 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:29.780504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-47531f1e-3691-457f-b4a0-a7ed2d3f2d07 req-a63b88e3-9466-4d5c-91c5-647b81d15446 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:29.832875 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-47531f1e-3691-457f-b4a0-a7ed2d3f2d07 req-a63b88e3-9466-4d5c-91c5-647b81d15446 service nova] Creating event network-vif-deleted:8d97d239-c005-4658-b9d6-9836b9997de4 for instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 on n-h1-858383-10 Oct 12 09:08:29.843071 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-47531f1e-3691-457f-b4a0-a7ed2d3f2d07 req-a63b88e3-9466-4d5c-91c5-647b81d15446 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106286 Oct 12 09:08:29.846275 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2464/5348] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:08:29.945054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:29.945814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:29.960044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:29.982980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:29.984363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:29.986663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:29.993318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:29.994555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:30.285715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:30.286427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:30.308674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:30.309141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:30.309623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:30.310365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:30.318946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:30.319678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:30.358644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:30.360118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:30.360758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:30.361493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lazy-loading 'fault' on Instance uuid b7ee6956-f9fb-408c-9eeb-e101fd460ec8 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:08:30.420217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:30.429534 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-29d953b0-ed35-4fdf-8881-cb05d3b73479 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 200 len: 1330 microversion: 2.1 time: 0.149050 Oct 12 09:08:30.430454 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2465/5349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:30 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 1330 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:30.473668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:30.495964 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8beede5c-5651-4978-b92a-111cb5750aee tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 0.563718 Oct 12 09:08:30.499713 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2885/5350] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:29 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:30.754846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:30.755564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:30.774797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:30.775448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:30.775976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:30.776773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:30.781170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:30.782002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:30.912756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3d8267e2-d814-42a5-a22d-e24aa7a1c2f6 req-f7c71662-3aca-412d-a6c7-5e90a77b5d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa59241-81a2-45c8-a83b-9439db569773", "name": "network-vif-plugged", "status": "completed", "tag": "e12b430b-a041-4203-bbc4-8fe2f5910ce1"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:30.948057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d8267e2-d814-42a5-a22d-e24aa7a1c2f6 req-f7c71662-3aca-412d-a6c7-5e90a77b5d76 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:30.948797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d8267e2-d814-42a5-a22d-e24aa7a1c2f6 req-f7c71662-3aca-412d-a6c7-5e90a77b5d76 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:30.949060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d8267e2-d814-42a5-a22d-e24aa7a1c2f6 req-f7c71662-3aca-412d-a6c7-5e90a77b5d76 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:31.006623 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3d8267e2-d814-42a5-a22d-e24aa7a1c2f6 req-f7c71662-3aca-412d-a6c7-5e90a77b5d76 service nova] Creating event network-vif-plugged:e12b430b-a041-4203-bbc4-8fe2f5910ce1 for instance daa59241-81a2-45c8-a83b-9439db569773 on n-h2-858383-10 Oct 12 09:08:31.027369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3d8267e2-d814-42a5-a22d-e24aa7a1c2f6 req-f7c71662-3aca-412d-a6c7-5e90a77b5d76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118786 Oct 12 09:08:31.031464 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2886/5351] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:31.453090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:31.453840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:31.477412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:31.478892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:31.479524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:31.480425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:31.481052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:31.481785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:31.510886 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 HTTP/1.1 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'b7ee6956-f9fb-408c-9eeb-e101fd460ec8'} Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:31.515384 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:31.520160 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:31.520160 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:31.520160 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:31.520160 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:08:31.520160 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:08:31.520160 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:08:31.520160 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:31.524480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:08:31.525393 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89e2c8f3-d2de-4128-994b-c6830d2d7df5 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 404 len: 111 microversion: 2.1 time: 0.076706 Oct 12 09:08:31.526083 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2887/5352] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:31 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:08:31.537862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:31.538497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:31.558843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:31.561580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:31.562062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:31.562825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:31.563305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:31.563744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:31.663805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:31.683259 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77397b76-7cf6-47f0-952d-9c86ddd0a8f3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.932314 Oct 12 09:08:31.684191 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2466/5353] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:30 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:31.689112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0ee86ce6-f656-484c-a68b-58b82a57a6c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '.version_select at 0x7f9848dbcca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:31.731666 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0ee86ce6-f656-484c-a68b-58b82a57a6c9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-648713879" status: 202 len: 0 microversion: 2.1 time: 0.046284 Oct 12 09:08:31.732619 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2467/5354] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 09:08:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-648713879 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:08:32.175380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:32.184525 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3fa51ca1-3897-4bb2-8842-3667ba2f619e tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1315 microversion: 2.1 time: 0.650665 Oct 12 09:08:32.188718 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2888/5355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:31 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:32.708843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:32.709513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:32.724926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:32.725448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:32.725902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:32.738125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:32.739123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:32.739782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:33.215653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:33.216266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:33.228488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:33.230641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:33.232739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:33.234403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:33.236520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:33.237154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:33.636856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:33.647523 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-61800825-add7-44e1-ad07-ab1e233981da tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 0.942647 Oct 12 09:08:33.655533 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2468/5356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:32 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:33.706485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe88b139-30f0-4576-8cd9-17730138ce93 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: .version_select at 0x7f9843fe7a60>, body: {"keypair": {"name": "tempest-keypair-585665569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhkf//XQMjNyeXbyn+++3F80a9S/NzdgOdcXFFY+oI54C0z/lNf0Cx6qBG6qoK1TYee6a7XJHRZLI4vsNUxyEwAnsNVZD2cWHWaTd4slKx7EUOWxNdzb8lDeeSqDl27ow=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:33.732018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-fe88b139-30f0-4576-8cd9-17730138ce93 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:08:33.756776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-fe88b139-30f0-4576-8cd9-17730138ce93 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for user d9531ada325c4b868f3bcd62331ab827 and project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:08:33.813050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:33.817211 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe88b139-30f0-4576-8cd9-17730138ce93 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127160 Oct 12 09:08:33.817860 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2469/5357] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:08:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 12 09:08:33.826098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ba612b3c-b121-4365-8816-768455ca9f6f tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1504 microversion: 2.1 time: 0.614254 Oct 12 09:08:33.827328 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2889/5358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:33 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1504 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:33.853227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:33.853227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:33.858682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:33.859323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:33.859907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:33.860809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:33.861641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:33.862975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:34.036330 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bac42b86-2795-45ce-8a23-42be7c85f4d1 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "DELETE /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.189816 Oct 12 09:08:34.040133 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2470/5359] 10.222.0.40 () {58 vars in 1296 bytes} [Wed Oct 12 09:08:33 2022] DELETE /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773/os-server-password => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:08:34.049602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:34.050132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:34.068450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:34.068959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:34.085243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:34.091280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:34.093217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:34.093704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:34.174838 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5ce81cc3-a3ce-402c-b233-db62a927eba6 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.129275 Oct 12 09:08:34.180687 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2890/5360] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 12 09:08:34 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773/os-server-password => generated 16 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:08:34.186463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:34.186993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:34.193567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:34.195582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:34.196300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:34.197770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:34.198635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:34.199575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:34.238760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:08:34.293058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:34.412349 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3e98be20-62ca-45bd-b13f-bcc8660dcfe5 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "DELETE /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 204 len: 0 microversion: 2.1 time: 0.228849 Oct 12 09:08:34.414110 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2471/5361] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:08:34 2022] DELETE /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:08:34.422773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:34.423412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:34.445003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:34.445524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:34.445964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:34.446680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:34.447135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:34.447595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:34.719775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:34.720675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:34.736012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:34.736697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:34.737220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:34.739563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:34.740101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:34.741386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:35.090604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:35.099543 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fbf0b71b-0fca-4909-9ad0-0439e62e4cc3 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1510 microversion: 2.1 time: 0.680715 Oct 12 09:08:35.100789 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2891/5362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:34 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1510 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:36.126402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:36.127692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:36.153775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:36.153775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:36.153775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:36.153775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:36.160952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:36.161561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:36.230023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:36.246501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-69b41a30-036c-44cd-8c72-a7cd78ed6ee7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1725 microversion: 2.1 time: 1.531495 Oct 12 09:08:36.264685 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2472/5363] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:34 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1725 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:36.857492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:36.868313 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cb92132c-53de-48bf-afc9-2f232d4394d0 tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1510 microversion: 2.1 time: 0.745612 Oct 12 09:08:36.873768 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2892/5364] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:36 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1510 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:37.274295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:37.274925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:37.299427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:37.300031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:37.300500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:37.304014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:37.304504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:37.305235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:37.598509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d978c2bb-3180-44f4-8ffe-6cd74ed5c063 req-c155e7cc-f36a-42be-af76-1056f1025e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa59241-81a2-45c8-a83b-9439db569773", "name": "network-vif-deleted", "tag": "e12b430b-a041-4203-bbc4-8fe2f5910ce1"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:37.630020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d978c2bb-3180-44f4-8ffe-6cd74ed5c063 req-c155e7cc-f36a-42be-af76-1056f1025e5d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:37.632734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d978c2bb-3180-44f4-8ffe-6cd74ed5c063 req-c155e7cc-f36a-42be-af76-1056f1025e5d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:37.634534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d978c2bb-3180-44f4-8ffe-6cd74ed5c063 req-c155e7cc-f36a-42be-af76-1056f1025e5d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:37.681528 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d978c2bb-3180-44f4-8ffe-6cd74ed5c063 req-c155e7cc-f36a-42be-af76-1056f1025e5d service nova] Creating event network-vif-deleted:e12b430b-a041-4203-bbc4-8fe2f5910ce1 for instance daa59241-81a2-45c8-a83b-9439db569773 on n-h2-858383-10 Oct 12 09:08:37.701282 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d978c2bb-3180-44f4-8ffe-6cd74ed5c063 req-c155e7cc-f36a-42be-af76-1056f1025e5d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114726 Oct 12 09:08:37.710649 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2893/5365] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:37.901726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:37.902749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:37.918669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:37.920320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:37.920844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:37.922968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:37.923636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:37.924244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:37.927703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:37.948802 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7dca5ac1-156b-4345-9ad3-ae4640f60294 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1702 microversion: 2.1 time: 0.677577 Oct 12 09:08:37.965684 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2473/5366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:37 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1702 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:37.982702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-48dd6212-ef9c-4a65-ae68-3bf853e79edf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:37.993061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:37.993579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:37.994020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:37.994553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lazy-loading 'fault' on Instance uuid daa59241-81a2-45c8-a83b-9439db569773 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:08:37.999979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48dd6212-ef9c-4a65-ae68-3bf853e79edf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:38.003237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48dd6212-ef9c-4a65-ae68-3bf853e79edf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:38.006062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48dd6212-ef9c-4a65-ae68-3bf853e79edf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:38.061598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-48dd6212-ef9c-4a65-ae68-3bf853e79edf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Going to try to start instance {{(pid=127007) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 09:08:38.156675 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-48dd6212-ef9c-4a65-ae68-3bf853e79edf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/action" status: 202 len: 0 microversion: 2.1 time: 0.180796 Oct 12 09:08:38.158873 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2474/5367] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:08:37 2022] POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:08:38.175710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:38.176714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:38.196888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:38.197411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:38.197947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:38.202654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:38.203396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:38.204738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:38.321376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeca40dc28f4dd6a2d6213c6b2aaf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1602cfe15f5b4ae19a7d8eae051e85dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:38.329529 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9b45ca48-5126-49cb-bfd0-fd3faad5368c tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 200 len: 1305 microversion: 2.1 time: 0.432184 Oct 12 09:08:38.348260 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2894/5368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:37 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 1305 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:39.184848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:39.211368 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-733aac40-94df-497a-8f2f-7e5d0accdf0d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1711 microversion: 2.1 time: 1.047057 Oct 12 09:08:39.212848 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2475/5369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:38 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1711 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:39.352476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:39.353759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] [instance: daa59241-81a2-45c8-a83b-9439db569773] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:39.363697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:39.364477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:39.365071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:39.366128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:39.367335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:39.367940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:39.386300 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] HTTP exception thrown: Instance daa59241-81a2-45c8-a83b-9439db569773 could not be found. Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Request method failure captured: Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 HTTP/1.1 Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoP7zEeDpysmQ1aF4yyi0EzMDp9LM1YqY0G3jCFSNl5AUbdAtUsPBcwkxCCJhtF_UFKRQdwZOp3t-hr2LFQE8D8WpceRO4_diVWgADqgExZfpH_dmYK7r4Ho2eZvvQmut_gam2QKGNzj9B4kjoskdaqE_QR_0E8qBukvG5yF-cqA1Ng Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1602cfe15f5b4ae19a7d8eae051e85dd Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerPasswordTestJSON-856841823 Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1602cfe15f5b4ae19a7d8eae051e85dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1602cfe15f5b4ae19a7d8eae051e85dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1602cfe15f5b4ae19a7d8eae051e85dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1602cfe15f5b4ae19a7d8eae051e85dd"}]}] Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerPasswordTestJSON-856841823 Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1602cfe15f5b4ae19a7d8eae051e85dd Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerPasswordTestJSON-856841823 Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerPasswordTestJSON-856841823-project Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: ddeca40dc28f4dd6a2d6213c6b2aaf95 Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerPasswordTestJSON-856841823-project Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance daa59241-81a2-45c8-a83b-9439db569773 could not be found. Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'daa59241-81a2-45c8-a83b-9439db569773'} Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa59241-81a2-45c8-a83b-9439db569773 could not be found. Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa59241-81a2-45c8-a83b-9439db569773 could not be found. Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:39.388651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:39.394583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:39.394583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:39.394583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:39.394583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:08:39.394583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:08:39.394583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa59241-81a2-45c8-a83b-9439db569773 could not be found. Oct 12 09:08:39.394583 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:39.395167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] Returning 404 to user: Instance daa59241-81a2-45c8-a83b-9439db569773 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:08:39.396361 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df74c750-1780-42c3-b0d4-126fad4c498d tempest-ServerPasswordTestJSON-856841823 tempest-ServerPasswordTestJSON-856841823-project] 10.222.0.40 "GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773" status: 404 len: 111 microversion: 2.1 time: 0.047761 Oct 12 09:08:39.407117 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2895/5370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:39 2022] GET /compute/v2.1/servers/daa59241-81a2-45c8-a83b-9439db569773 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:08:40.247204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:40.248494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:40.257619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:40.258276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:40.258713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:40.259616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:40.260911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:40.261564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:41.321255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:41.321907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:41.332587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:41.337295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:41.340044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:41.341304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:41.342022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:41.353534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:41.437507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:08:41.447083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:41.583850 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7805fb97-f377-4b51-826d-be6cff7a26ba tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 204 len: 0 microversion: 2.1 time: 0.265197 Oct 12 09:08:41.589553 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2896/5371] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:08:41 2022] DELETE /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:08:41.599458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:41.600782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:41.611618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:41.612751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:41.613541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:41.614577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:41.615283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:41.615944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:42.050336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:42.058915 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42f36e7b-8d51-4d02-a5aa-22247fbc37f6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1507 microversion: 2.1 time: 0.466410 Oct 12 09:08:42.062194 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2897/5372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:41 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:42.096928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:42.117911 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-34cbbeb3-c77f-479b-bc27-a087653fe991 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1711 microversion: 2.1 time: 1.871417 Oct 12 09:08:42.121642 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2476/5373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:40 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1711 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:42.972664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1165338719", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1fd12de-772c-4409-a55a-e4329af851c8"}], "security_groups": [{"name": "tempest-securitygroup--222529918"}], "key_name": "tempest-keypair-585665569", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:43.084579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:43.085354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:43.099354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:43.100786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:43.102444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:43.105682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:43.107625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:43.109139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:43.261412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] validate_networks() for [('b1fd12de-772c-4409-a55a-e4329af851c8', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:08:43.499260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:43.514732 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a4a31ca-93ef-4af1-ae13-2b790db185a6 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1507 microversion: 2.1 time: 0.434429 Oct 12 09:08:43.537865 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2477/5374] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:43 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:43.544581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:43.545209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:43.555754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:43.556358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:43.556874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:43.557991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:43.558641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:43.559362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:43.768723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:44.022070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:44.038665 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c2b81d22-4cf5-4de1-ab26-c332247610e0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1711 microversion: 2.1 time: 0.499539 Oct 12 09:08:44.039272 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2478/5375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:43 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1711 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:44.302974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:08:44.304134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:08:44.304876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:08:44.305546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:08:44.306208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:08:44.330344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:44.336607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:44.337565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:44.339395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:44.340242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:44.343762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:44.411312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:08:44.438705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for user d9531ada325c4b868f3bcd62331ab827 and project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:08:44.496019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:08:44.498573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:08:44.549538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:44.550410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:44.564188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:44.575464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:44.576312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:44.579178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:44.585308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:44.586131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:44.631108 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a6c4af7-6b5f-4d0e-bf6e-9f6c38a588d6 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.663400 Oct 12 09:08:44.632671 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2898/5376] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:08:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:08:44.652392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7eb75aa0-8488-4e05-84c5-eb249f2d2019 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:44.653303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7eb75aa0-8488-4e05-84c5-eb249f2d2019 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:44.892947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7eb75aa0-8488-4e05-84c5-eb249f2d2019 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:44.919341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7eb75aa0-8488-4e05-84c5-eb249f2d2019 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1241 microversion: 2.1 time: 0.279524 Oct 12 09:08:44.922653 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2899/5377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:44 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1241 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:45.063077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:45.063718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:45.073829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:45.074336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:45.077380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:45.095748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:45.096257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:45.096710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:45.395075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:45.410671 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ba631f9a-3bc1-4949-a857-0e8e15ea9427 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1715 microversion: 2.1 time: 0.350812 Oct 12 09:08:45.411343 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2900/5378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:45 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1715 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:45.796646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:45.819050 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-255beeab-b7df-4f42-9413-6161fc522fbd tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1507 microversion: 2.1 time: 1.270204 Oct 12 09:08:45.820227 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2479/5379] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:44 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1507 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:45.943604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:45.944024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:45.962049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:45.962785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:45.963328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:45.964276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:45.964924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:45.965565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:46.106535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c1d5cbec-494c-46f1-8e5a-b65b5c3b3dae req-ba3bfc3d-0c6e-4711-be89-cb903c624efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94489241-3250-4449-8a11-25e5b88bc41e", "name": "network-vif-deleted", "tag": "5720f721-2c6e-4882-bcc8-3efd0b063765"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:46.120278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:46.129215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c1d5cbec-494c-46f1-8e5a-b65b5c3b3dae req-ba3bfc3d-0c6e-4711-be89-cb903c624efd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:46.136993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c1d5cbec-494c-46f1-8e5a-b65b5c3b3dae req-ba3bfc3d-0c6e-4711-be89-cb903c624efd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:46.137426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c1d5cbec-494c-46f1-8e5a-b65b5c3b3dae req-ba3bfc3d-0c6e-4711-be89-cb903c624efd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:46.163759 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c1d5cbec-494c-46f1-8e5a-b65b5c3b3dae req-ba3bfc3d-0c6e-4711-be89-cb903c624efd service nova] Creating event network-vif-deleted:5720f721-2c6e-4882-bcc8-3efd0b063765 for instance 94489241-3250-4449-8a11-25e5b88bc41e on n-h1-858383-10 Oct 12 09:08:46.174199 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c1d5cbec-494c-46f1-8e5a-b65b5c3b3dae req-ba3bfc3d-0c6e-4711-be89-cb903c624efd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068900 Oct 12 09:08:46.174895 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2480/5380] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:46.191187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:46.201794 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34d9e2c0-1a61-46f9-928b-f0df7d068c96 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1293 microversion: 2.1 time: 0.262477 Oct 12 09:08:46.203092 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2901/5381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:45 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1293 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:46.847299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:46.851312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:46.880764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:46.886811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:46.887267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:46.901964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:46.902872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:46.905266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:47.040469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:47.040916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:47.052913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:47.053717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lazy-loading 'fault' on Instance uuid 94489241-3250-4449-8a11-25e5b88bc41e {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:08:47.170365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:47.180839 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9fbcfef5-f7d6-4562-846d-9afa5c7321fe tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 200 len: 1311 microversion: 2.1 time: 0.341411 Oct 12 09:08:47.189168 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2481/5382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:46 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 1311 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:47.231826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:47.233135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:47.263393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:47.263801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:47.264515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:47.265246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:47.265730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:47.266171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:47.569156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:47.580842 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14241d23-9b4f-4cd1-a981-a6ab37e415b9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1299 microversion: 2.1 time: 0.355683 Oct 12 09:08:47.583554 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2902/5383] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:47 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1299 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:48.219796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:48.221105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 94489241-3250-4449-8a11-25e5b88bc41e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:48.239301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:48.239783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:48.250123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:48.253112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:48.254163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:48.255432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:48.317029 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Instance 94489241-3250-4449-8a11-25e5b88bc41e could not be found. Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e HTTP/1.1 Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 94489241-3250-4449-8a11-25e5b88bc41e could not be found. Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '94489241-3250-4449-8a11-25e5b88bc41e'} Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94489241-3250-4449-8a11-25e5b88bc41e could not be found. Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94489241-3250-4449-8a11-25e5b88bc41e could not be found. Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:48.322113 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:48.326457 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:48.326457 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:48.326457 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:48.326457 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:48.326457 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:08:48.326457 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:08:48.326457 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94489241-3250-4449-8a11-25e5b88bc41e could not be found. Oct 12 09:08:48.326457 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:08:48.328974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 404 to user: Instance 94489241-3250-4449-8a11-25e5b88bc41e could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:08:48.336469 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5fb83b29-7955-48e8-bd06-28e5ac4208ea tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e" status: 404 len: 111 microversion: 2.1 time: 0.119364 Oct 12 09:08:48.337024 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2482/5384] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:48 2022] GET /compute/v2.1/servers/94489241-3250-4449-8a11-25e5b88bc41e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:08:48.344204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:48.344692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:48.370820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:48.371456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:48.373867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:48.374664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:48.375142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:48.375578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:48.440241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:08:48.605842 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e8bc9c6-d6ff-4c68-b9d8-b69edb8ebf28 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "DELETE /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 204 len: 0 microversion: 2.1 time: 0.264782 Oct 12 09:08:48.607548 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2903/5385] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:08:48 2022] DELETE /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:08:48.609635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:48.610549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:48.619398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:48.621984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:48.624577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:48.625753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:48.630055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:48.630783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:48.638360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:48.640786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:48.656443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:48.658592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:48.659311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:48.661733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:48.662624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:48.664961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:48.938050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:48.946427 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b411fea-41b5-4e12-9923-84c90594f24c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1299 microversion: 2.1 time: 0.340705 Oct 12 09:08:48.950431 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2483/5386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:48 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1299 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:49.062313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:49.074750 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-868141ed-c335-46be-871a-5013915c0935 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.452013 Oct 12 09:08:49.078751 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2904/5387] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:48 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:49.977818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:49.978439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:49.994226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:49.995871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:49.997396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:49.999672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:50.001759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:50.003840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:50.100589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:50.101994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:50.109855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:50.121857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:50.122797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:50.123651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:50.124229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:50.124877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:50.409519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:50.483397 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c246a66f-16c7-49a9-be03-c0c9a9406a27 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.379790 Oct 12 09:08:50.484256 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2905/5388] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:50 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:50.749292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:50.766269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-242317e4-c0cd-47c8-b6d6-130ad7cd7618 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 0.797680 Oct 12 09:08:50.767089 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2484/5389] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:49 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:51.507199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:51.507812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:51.527007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:51.527573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:51.527948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:51.528666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:51.529118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:51.534877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:51.789006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:51.789627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:51.806566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:51.807152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:51.807591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:51.808293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:51.810090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:51.812612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:52.219618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:52.240748 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f86180c7-5b8c-4334-8ce7-0ae1973eb2dc tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.737850 Oct 12 09:08:52.244154 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2906/5390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:51 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:52.348896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:52.360076 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-268d1e94-740f-49ec-9d9d-22776d25a91b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 0.574949 Oct 12 09:08:52.364026 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2485/5391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:51 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:53.283717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:53.285168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:53.296971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:53.298750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:53.300518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:53.303582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:53.304353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:53.305277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:53.389753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:53.391122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:53.407307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:53.408185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:53.408836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:53.409834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:53.410514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:53.411152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:53.587724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:53.598103 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4062b739-6c0e-4140-9ecb-cd42d174a468 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1522 microversion: 2.1 time: 0.320128 Oct 12 09:08:53.602110 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2907/5392] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:53 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:53.729334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-809e1bae-0300-4674-acd8-72013ac6909d req-ed16c595-1be7-4487-afa0-d6163789a628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8", "tag": "53efe0ae-1ebc-4805-b9d0-c0bfbecdaeb4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:53.751977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-809e1bae-0300-4674-acd8-72013ac6909d req-ed16c595-1be7-4487-afa0-d6163789a628 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:53.755854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-809e1bae-0300-4674-acd8-72013ac6909d req-ed16c595-1be7-4487-afa0-d6163789a628 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:53.759224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-809e1bae-0300-4674-acd8-72013ac6909d req-ed16c595-1be7-4487-afa0-d6163789a628 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:53.784635 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-809e1bae-0300-4674-acd8-72013ac6909d req-ed16c595-1be7-4487-afa0-d6163789a628 service nova] Creating event network-changed:53efe0ae-1ebc-4805-b9d0-c0bfbecdaeb4 for instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 on n-h2-858383-10 Oct 12 09:08:53.793872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:53.796829 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-809e1bae-0300-4674-acd8-72013ac6909d req-ed16c595-1be7-4487-afa0-d6163789a628 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070500 Oct 12 09:08:53.799879 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2908/5393] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:08:53.832987 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d542d002-4a45-44ab-893a-471e21610f4b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 0.446699 Oct 12 09:08:53.837928 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2486/5394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:53 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:54.634814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:54.642076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:54.645747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:54.687341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:54.687905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:54.689298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:54.690825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:54.694607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:54.695885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:54.859781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:54.861241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:54.880729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:54.889108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:54.892364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:54.893866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:54.895773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:54.897344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:54.897513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:55.022507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884b8a3752594dfeb0d546c73a843481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d50dff5e638459c9776ffc01c813b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:55.037578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d215ebe7-bb6d-4e32-acfd-d187c793adb8 tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 200 len: 1306 microversion: 2.1 time: 0.401385 Oct 12 09:08:55.038502 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2909/5395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:54 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 1306 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:56.080562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:56.081148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] [instance: 527f2061-c9c7-4dca-a23e-cecca8f2189b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:56.088555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:56.089304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:56.089945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:56.090830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:56.091635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:56.092168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:56.118160 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] HTTP exception thrown: Instance 527f2061-c9c7-4dca-a23e-cecca8f2189b could not be found. Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Request method failure captured: Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b HTTP/1.1 Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoLoo6mxjgNJ_bjSa8twIHzTMDBmZEclhPcPTJwS0xsSVGP_jx0FRbRs4IDR5_qKWTY9L0l_MnSOCKTPDnilJxiTD93HlCOwB1eryRzih-0GDPU7OUtminRuzKHrYrdXXdA9z6jiPWe6smMLIPhNl7XGXhvcm7J5to5oCIXrTNvj4Ww Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d50dff5e638459c9776ffc01c813b6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d50dff5e638459c9776ffc01c813b6e"}]}] Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 4d50dff5e638459c9776ffc01c813b6e Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1652967693 Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 884b8a3752594dfeb0d546c73a843481 Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1652967693-project Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 527f2061-c9c7-4dca-a23e-cecca8f2189b could not be found. Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '527f2061-c9c7-4dca-a23e-cecca8f2189b'} Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527f2061-c9c7-4dca-a23e-cecca8f2189b could not be found. Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527f2061-c9c7-4dca-a23e-cecca8f2189b could not be found. Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:56.120449 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:08:56.126016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:56.126016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:08:56.126016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:08:56.126016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:08:56.126016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:08:56.126016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:08:56.126016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527f2061-c9c7-4dca-a23e-cecca8f2189b could not be found. Oct 12 09:08:56.126016 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:08:56.134318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] Returning 404 to user: Instance 527f2061-c9c7-4dca-a23e-cecca8f2189b could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:08:56.135566 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8361c633-7c3b-4370-90d8-1cc7561c6c8f tempest-ServerRescueNegativeTestJSON-1652967693 tempest-ServerRescueNegativeTestJSON-1652967693-project] 10.222.0.40 "GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b" status: 404 len: 111 microversion: 2.1 time: 0.059249 Oct 12 09:08:56.136331 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2910/5396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:56 2022] GET /compute/v2.1/servers/527f2061-c9c7-4dca-a23e-cecca8f2189b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:08:56.225010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-bc0fad76-8c15-4211-88d3-f1a1f51ee058 req-76a91646-6ebe-443d-9389-acec0658ff7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527f2061-c9c7-4dca-a23e-cecca8f2189b", "name": "network-vif-deleted", "tag": "5b4ea9b8-e2ea-4552-9336-0b2d64292ac6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:08:56.249006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bc0fad76-8c15-4211-88d3-f1a1f51ee058 req-76a91646-6ebe-443d-9389-acec0658ff7b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:56.257553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bc0fad76-8c15-4211-88d3-f1a1f51ee058 req-76a91646-6ebe-443d-9389-acec0658ff7b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:56.258341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bc0fad76-8c15-4211-88d3-f1a1f51ee058 req-76a91646-6ebe-443d-9389-acec0658ff7b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:56.307162 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-bc0fad76-8c15-4211-88d3-f1a1f51ee058 req-76a91646-6ebe-443d-9389-acec0658ff7b service nova] Creating event network-vif-deleted:5b4ea9b8-e2ea-4552-9336-0b2d64292ac6 for instance 527f2061-c9c7-4dca-a23e-cecca8f2189b on n-h1-858383-10 Oct 12 09:08:56.327934 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-bc0fad76-8c15-4211-88d3-f1a1f51ee058 req-76a91646-6ebe-443d-9389-acec0658ff7b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107615 Oct 12 09:08:56.328568 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2911/5397] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:08:56.510866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:56.514626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:08:56.519958 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-738a1044-6bcd-43b9-aacf-d685a2195a44 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 1.665795 Oct 12 09:08:56.520552 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2487/5398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:54 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:08:57.544026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:57.545541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:57.557604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:57.564151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:57.564714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:57.565589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:57.566303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:57.566977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:58.591337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:08:58.601522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68ec28b7-94db-49bb-aeb3-79e11b7559a1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 1.062010 Oct 12 09:08:58.602818 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2912/5399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:57 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:08:59.629345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:08:59.630089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:08:59.647366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:59.648635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:59.649095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:08:59.651028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:08:59.651507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:08:59.653666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:00.219262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:00.232355 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ee2f134-75c6-4cfc-ad6d-6f420e3b42b8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 0.604437 Oct 12 09:09:00.247865 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2488/5400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:08:59 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:01.256187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:01.257132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:01.260176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:01.272341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:01.274092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:01.275003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:01.282205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:01.297228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:01.300365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:01.783239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:01.787036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:01.805333 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bc9dc794-c127-402c-ba9c-48bc7a81d249 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 0.549367 Oct 12 09:09:01.808947 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2913/5401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:01 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:02.646705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-91d42c94-94bc-4af7-8756-5c1b66c3bc9a req-fe91de3c-8f56-4d9e-856c-b13aca5d1ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8", "name": "network-vif-plugged", "status": "completed", "tag": "53efe0ae-1ebc-4805-b9d0-c0bfbecdaeb4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:02.676542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-91d42c94-94bc-4af7-8756-5c1b66c3bc9a req-fe91de3c-8f56-4d9e-856c-b13aca5d1ccf service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:02.677031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-91d42c94-94bc-4af7-8756-5c1b66c3bc9a req-fe91de3c-8f56-4d9e-856c-b13aca5d1ccf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:02.677470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-91d42c94-94bc-4af7-8756-5c1b66c3bc9a req-fe91de3c-8f56-4d9e-856c-b13aca5d1ccf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:02.708451 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-91d42c94-94bc-4af7-8756-5c1b66c3bc9a req-fe91de3c-8f56-4d9e-856c-b13aca5d1ccf service nova] Creating event network-vif-plugged:53efe0ae-1ebc-4805-b9d0-c0bfbecdaeb4 for instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 on n-h2-858383-10 Oct 12 09:09:02.720366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-91d42c94-94bc-4af7-8756-5c1b66c3bc9a req-fe91de3c-8f56-4d9e-856c-b13aca5d1ccf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077825 Oct 12 09:09:02.728533 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2489/5402] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:09:02.829572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:02.830795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:02.847523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:02.850195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:02.850703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:02.851448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:02.851913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:02.857552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:03.364470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:03.380732 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05e89c76-f7d9-4953-8862-87ab9eabc353 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 0.555967 Oct 12 09:09:03.381343 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2914/5403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:02 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:04.408247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:04.409769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:04.418107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:04.419027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:04.419703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:04.420634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:04.421340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:04.422017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:04.709030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:04.722407 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9d3211a-244a-4fdb-bd62-e7736e3df1e0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1366 microversion: 2.1 time: 0.318338 Oct 12 09:09:04.737625 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2490/5404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:04 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:05.746054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:05.747353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:05.769091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:05.770668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:05.772682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:05.774892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:05.775688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:05.778351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:06.391347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:06.409981 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5b46b65-9962-49c1-93f9-904693171a67 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1555 microversion: 2.1 time: 0.665239 Oct 12 09:09:06.426056 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2915/5405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:05 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1555 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:06.444056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:06.444727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:06.458789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:06.459302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:06.459734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:06.460612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:06.461028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:06.470227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:06.701342 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc8bcc6f-5fac-4ea5-8f84-10669ce71622 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.264510 Oct 12 09:09:06.709749 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2491/5406] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:09:06 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:09:08.107866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-540761366", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": "none"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:08.173890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:09:08.174731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:09:08.175606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:09:08.176364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:09:08.177118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:09:08.188441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:08.189211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:08.189887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:08.190833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:08.191472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:08.192094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:08.211910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Getting quotas for project 62f3201ec5504ed9862d41eb56a8203e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:09:08.218203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Getting quotas for user d62caef7784c4f8097408b6474209526 and project 62f3201ec5504ed9862d41eb56a8203e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:09:08.233869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:09:08.236874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:09:08.293758 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61d7568d-5d9a-419e-8fcd-a52013e0fac4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.414787 Oct 12 09:09:08.295481 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2916/5407] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 09:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 09:09:08.309689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-98550cd5-0a15-4b27-af05-a945d491cd40 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:08.311682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-98550cd5-0a15-4b27-af05-a945d491cd40 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:09.018270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-98550cd5-0a15-4b27-af05-a945d491cd40 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:09.029771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-98550cd5-0a15-4b27-af05-a945d491cd40 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:09.031583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-98550cd5-0a15-4b27-af05-a945d491cd40 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:09.036713 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-98550cd5-0a15-4b27-af05-a945d491cd40 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6" status: 200 len: 1277 microversion: 2.47 time: 0.733872 Oct 12 09:09:09.038791 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2492/5408] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:08 2022] GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 => generated 1277 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:09.178352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-910701342", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": "none"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:09.302161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:09:09.302594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:09:09.306326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:09:09.306832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:09:09.310309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:09:09.352292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:09.352790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:09.353246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:09.354092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:09.354562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:09.354989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:09.414640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Getting quotas for project 62f3201ec5504ed9862d41eb56a8203e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:09:09.436589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Getting quotas for user d62caef7784c4f8097408b6474209526 and project 62f3201ec5504ed9862d41eb56a8203e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:09:09.495401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:09:09.498052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:09:09.613797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c67a794-3c5b-47ca-859f-375270369c1b tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.440744 Oct 12 09:09:09.615507 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2917/5409] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 09:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 09:09:09.627325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-38eec80e-b779-4be7-8d98-976aa4ebc942 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:09.630713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-38eec80e-b779-4be7-8d98-976aa4ebc942 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:09.787336 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-38eec80e-b779-4be7-8d98-976aa4ebc942 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "PUT /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 991 microversion: 2.47 time: 0.161343 Oct 12 09:09:09.789282 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2493/5410] 10.222.0.40 () {62 vars in 1297 bytes} [Wed Oct 12 09:09:09 2022] PUT /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 991 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:09:09.814336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-77c1f5b5-3c6e-44b6-a887-2b4e1d83af62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:09.815534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-77c1f5b5-3c6e-44b6-a887-2b4e1d83af62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:10.053945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-77c1f5b5-3c6e-44b6-a887-2b4e1d83af62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:10.067617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-77c1f5b5-3c6e-44b6-a887-2b4e1d83af62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:10.070277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-77c1f5b5-3c6e-44b6-a887-2b4e1d83af62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:10.071839 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-77c1f5b5-3c6e-44b6-a887-2b4e1d83af62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1277 microversion: 2.47 time: 0.261867 Oct 12 09:09:10.074232 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2918/5411] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:09 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:11.109113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:11.143665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:11.153828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:11.154621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:11.155300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:11.156296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:11.156915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:11.157758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:11.493660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:11.532275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:11.536569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:11.541301 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-645f1119-b89e-4345-97af-2c2f6957166c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1273 microversion: 2.47 time: 0.438178 Oct 12 09:09:11.547398 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2494/5412] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:11 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1273 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:11.585398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-83dc7239-d971-4834-80b7-edf593f0cf57 req-53522936-b826-468e-bd44-a5a239d763e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8", "tag": "53efe0ae-1ebc-4805-b9d0-c0bfbecdaeb4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:11.614583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83dc7239-d971-4834-80b7-edf593f0cf57 req-53522936-b826-468e-bd44-a5a239d763e1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:11.626463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83dc7239-d971-4834-80b7-edf593f0cf57 req-53522936-b826-468e-bd44-a5a239d763e1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:11.628906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-83dc7239-d971-4834-80b7-edf593f0cf57 req-53522936-b826-468e-bd44-a5a239d763e1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:11.670737 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-83dc7239-d971-4834-80b7-edf593f0cf57 req-53522936-b826-468e-bd44-a5a239d763e1 service nova] Creating event network-changed:53efe0ae-1ebc-4805-b9d0-c0bfbecdaeb4 for instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 on n-h2-858383-10 Oct 12 09:09:11.694970 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-83dc7239-d971-4834-80b7-edf593f0cf57 req-53522936-b826-468e-bd44-a5a239d763e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114424 Oct 12 09:09:11.696144 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2919/5413] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:09:12.069041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1212167916", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:12.209372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] validate_networks() for [('db20ff19-aaa6-4ac8-a95b-8f318e726303', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:09:12.579094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:12.580266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:12.592395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:12.595811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:12.596545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:12.601431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:12.602149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:12.602751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:12.725928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:12.735734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:12.752048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:12.756870 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e6ae832-58f0-4209-b736-4969ba9510a4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1335 microversion: 2.47 time: 0.182286 Oct 12 09:09:12.766728 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2920/5414] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:12 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:13.410977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:09:13.412314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:09:13.413069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:09:13.414019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:09:13.414787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:09:13.457189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:13.459848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:13.461082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:13.462597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:13.468500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:13.469594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:13.519900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Getting quotas for project 8673309873b24f8aa5fb718c090802b8. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:09:13.527168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Getting quotas for user 91c384d54b214325a005f53899826f4e and project 8673309873b24f8aa5fb718c090802b8. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:09:13.545201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:09:13.553634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:09:13.653932 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d7005bc0-6d05-45e1-962d-770ffa0c989f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.701170 Oct 12 09:09:13.685714 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2495/5415] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:09:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:09:13.694131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8d251e7-a606-4779-9fa0-e5d960a03237 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:13.694905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8d251e7-a606-4779-9fa0-e5d960a03237 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:13.796351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:13.798158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:13.816126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:13.821108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:13.821882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:13.825724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:13.826620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:13.827655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:13.915361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d8d251e7-a606-4779-9fa0-e5d960a03237 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:13.924384 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8d251e7-a606-4779-9fa0-e5d960a03237 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1223 microversion: 2.1 time: 0.236935 Oct 12 09:09:13.934173 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2921/5416] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:13 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1223 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:13.964946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:13.978049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:13.979527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:13.983972 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f74c3932-c1e6-40a0-8f9f-533c0309ee5f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1335 microversion: 2.47 time: 0.198004 Oct 12 09:09:13.985208 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2496/5417] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:13 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1335 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:14.956115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:14.957955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:15.006261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.008233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.015634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:15.016889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:15.025841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.028442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.028948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.032578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.038456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.038921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.040670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.043752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.045033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.048974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.258085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:15.264086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:15.304204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-81d21da2-b39f-4184-aa3b-515843fc9078 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1275 microversion: 2.1 time: 0.353474 Oct 12 09:09:15.305174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:15.306444 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2922/5418] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:14 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1275 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:15.306682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:15.307938 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6df03c24-b800-4a02-b6eb-7f849b5d1d62 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1356 microversion: 2.47 time: 0.297266 Oct 12 09:09:15.308619 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2497/5419] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:15 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1356 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:15.337342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:15.341172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:15.347869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.348436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.348934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.349737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.350285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.350776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.467608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:09:15.469753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:09:15.472042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:09:15.472589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:09:15.473693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:09:15.638943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:15.674198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.675424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.683246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.685761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.688443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.691685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.855758 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a109cd7b-de55-4bad-8a99-5edd3df6fa56 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "POST /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175/action" status: 202 len: 1078 microversion: 2.47 time: 0.519706 Oct 12 09:09:15.875827 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2923/5420] 10.222.0.40 () {62 vars in 1319 bytes} [Wed Oct 12 09:09:15 2022] POST /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175/action => generated 1078 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 12 09:09:15.882739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:15.883428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:15.895153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.896270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.897864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:15.898819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:15.901760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:15.902512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:16.315023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:16.329745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:16.331122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:16.346876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:16.357929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:16.359119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:16.360470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:16.363625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:16.364613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:16.368205 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2fca1a55-a6ed-43d0-acbd-aa5163f0e1eb tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.485921 Oct 12 09:09:16.369153 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2498/5421] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:15 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:16.384731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:16.385324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:16.588669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:16.606792 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e71da46e-08cf-41c3-b087-378b06f1daf1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1281 microversion: 2.1 time: 0.281651 Oct 12 09:09:16.617843 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2924/5422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:16 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1281 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:17.401665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:17.402138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:17.407525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:17.420779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:17.421190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:17.421665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:17.422386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:17.428731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:17.429657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:17.632368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:17.633075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:17.639775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:17.640573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:17.641228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:17.642204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:17.642869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:17.643507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:17.667517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:17.681929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:17.683999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:17.687657 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-725779ef-93cc-40e9-b0ff-fb5d7462ba57 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.291178 Oct 12 09:09:17.690388 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2499/5423] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:17 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:17.774483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:17.787699 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cbe376e2-0940-4f83-b205-7c00ad842e1f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1281 microversion: 2.1 time: 0.159255 Oct 12 09:09:17.808203 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2925/5424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:17 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1281 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:18.724286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:18.725542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:18.738447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:18.740736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:18.741181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:18.745560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:18.746256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:18.746888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:18.782914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:18.784873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:18.795565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:18.796677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:18.797634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:18.798936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:18.799696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:18.800937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:18.999132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lazy-loading 'services' on Instance uuid 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:09:19.181420 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec231833-77f9-4461-b3c4-81087336ded3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/os-volume_attachments/39b7eca0-d881-4000-a001-22dae43d719a" status: 202 len: 0 microversion: 2.1 time: 0.402304 Oct 12 09:09:19.189588 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2926/5425] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:09:18 2022] DELETE /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/os-volume_attachments/39b7eca0-d881-4000-a001-22dae43d719a => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:09:19.204270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:19.211155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:19.242142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:19.243979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:19.245885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:19.250993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:19.251727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:19.252955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:19.379670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:19.468611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:19.483422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:19.485164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:19.489814 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c34597cb-fe52-4fe1-a3ae-97c6340160a7 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.773700 Oct 12 09:09:19.515387 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2500/5426] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:18 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:19.780972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:19.796709 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-636680c8-df0e-4ad8-ba69-ccd46b22bdf0 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1323 microversion: 2.1 time: 0.605006 Oct 12 09:09:19.800420 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2927/5427] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:19 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1323 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:19.876474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8a257b43-b958-4cd9-b395-2793435bf3ee req-c1b4e1ef-da57-4fa9-af76-fc21e294b503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b451f0-75be-42f1-b111-efe92f481438", "tag": "a83a9047-abf9-472f-878a-40c6a24980b9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:19.895768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8a257b43-b958-4cd9-b395-2793435bf3ee req-c1b4e1ef-da57-4fa9-af76-fc21e294b503 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:19.899695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8a257b43-b958-4cd9-b395-2793435bf3ee req-c1b4e1ef-da57-4fa9-af76-fc21e294b503 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:19.900501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8a257b43-b958-4cd9-b395-2793435bf3ee req-c1b4e1ef-da57-4fa9-af76-fc21e294b503 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:19.933515 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8a257b43-b958-4cd9-b395-2793435bf3ee req-c1b4e1ef-da57-4fa9-af76-fc21e294b503 service nova] Creating event network-changed:a83a9047-abf9-472f-878a-40c6a24980b9 for instance b5b451f0-75be-42f1-b111-efe92f481438 on n-h1-858383-10 Oct 12 09:09:19.944934 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8a257b43-b958-4cd9-b395-2793435bf3ee req-c1b4e1ef-da57-4fa9-af76-fc21e294b503 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073138 Oct 12 09:09:19.948191 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2501/5428] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:09:20.523063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:20.524156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:20.552582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:20.553365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:20.554181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:20.555641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:20.556299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:20.556896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:20.823729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:20.824928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:20.842448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:20.843221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:20.843864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:20.845021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:20.845685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:20.846672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:20.946864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:20.964026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:20.966244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:20.967918 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-993948fe-1f62-4bd8-8bcd-7cac50aa1bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.449429 Oct 12 09:09:20.982634 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2928/5429] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:20 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:21.376460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:21.392013 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7568a7c-9819-4462-a440-3be4ff83f1ff tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1323 microversion: 2.1 time: 0.572920 Oct 12 09:09:21.394767 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2502/5430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:20 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:22.005276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:22.006547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:22.021197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:22.026884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:22.030202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:22.034456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:22.037808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:22.038605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:22.214119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:22.252025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:22.256214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:22.260437 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0eae9f49-1fa5-45cc-a227-c802dba73f96 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.263856 Oct 12 09:09:22.263008 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2929/5431] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:21 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:22.422368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:22.423002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:22.434312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:22.434996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:22.437580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:22.438434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:22.442124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:22.442687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:22.967798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:22.994612 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f217365f-5650-4789-bdfd-c2c5335e2048 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1323 microversion: 2.1 time: 0.574392 Oct 12 09:09:22.998652 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2503/5432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:22 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1323 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:23.291540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:23.292459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:23.313262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:23.314403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:23.315686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:23.316623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:23.317258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:23.319939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:23.536880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:23.549619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:23.551753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:23.553613 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-07c04eb3-cbf9-4d28-9c55-07ccaf255bb1 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.266114 Oct 12 09:09:23.554774 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2930/5433] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:23 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:24.022679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:24.023459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:24.028209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:24.032014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:24.037085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:24.037841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:24.038501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:24.039412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:24.040026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:24.040622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:24.490394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:24.503528 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6f1261ad-3dc5-479e-932c-54c53c51b268 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1323 microversion: 2.1 time: 0.480107 Oct 12 09:09:24.504189 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2504/5434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:24 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1323 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:24.580381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:24.585926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:24.591567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=16 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:24.602139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:24.602633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:24.603073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:24.603824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:24.604262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:24.604689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:24.760387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:24.762981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:24.771297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:24.778081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:24.794969 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c939b323-260d-47e1-8cf0-28e62cfc74e8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.218473 Oct 12 09:09:24.795886 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2931/5435] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:24 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:25.527377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:25.528000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:25.549464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:25.549464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:25.549464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:25.549464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:25.549464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:25.549464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:25.822499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:25.823788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:25.834656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:25.836300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:25.837626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:25.838573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:25.839197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:25.839987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:25.922582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:25.935500 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9dc5d3c0-3264-4239-b783-f0e8d546f365 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1323 microversion: 2.1 time: 0.412227 Oct 12 09:09:25.960174 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2505/5436] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:25 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1323 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:26.004723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:26.019010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:26.020881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:26.023716 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-27c0f423-1ffb-4884-919c-5634203a36cd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.207024 Oct 12 09:09:26.024505 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2932/5437] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:25 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:26.965536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:26.966332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:26.983961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:26.987508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:26.988314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:26.989151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:26.989759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:26.991001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:27.050547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:27.051964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:27.065491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:27.069896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:27.070601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:27.071851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:27.072517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:27.075483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:27.174825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:27.187073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:27.189883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:27.191329 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78adfe0b-3baa-4be3-858d-880b2331ad07 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.145536 Oct 12 09:09:27.191880 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2933/5438] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:27 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:27.279974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1f96b061-7129-43bd-aea0-c3f12da9867c req-cadbb789-9e9d-4542-a857-7b12539d087c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b451f0-75be-42f1-b111-efe92f481438", "name": "network-vif-plugged", "status": "completed", "tag": "a83a9047-abf9-472f-878a-40c6a24980b9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:27.297840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1f96b061-7129-43bd-aea0-c3f12da9867c req-cadbb789-9e9d-4542-a857-7b12539d087c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:27.299722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1f96b061-7129-43bd-aea0-c3f12da9867c req-cadbb789-9e9d-4542-a857-7b12539d087c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:27.300846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1f96b061-7129-43bd-aea0-c3f12da9867c req-cadbb789-9e9d-4542-a857-7b12539d087c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:27.328305 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1f96b061-7129-43bd-aea0-c3f12da9867c req-cadbb789-9e9d-4542-a857-7b12539d087c service nova] Creating event network-vif-plugged:a83a9047-abf9-472f-878a-40c6a24980b9 for instance b5b451f0-75be-42f1-b111-efe92f481438 on n-h1-858383-10 Oct 12 09:09:27.349197 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1f96b061-7129-43bd-aea0-c3f12da9867c req-cadbb789-9e9d-4542-a857-7b12539d087c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073298 Oct 12 09:09:27.354680 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2934/5439] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:09:27.372717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cbf2e897-36a7-4317-888c-fa9e356f56d8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:27.397294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf2e897-36a7-4317-888c-fa9e356f56d8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:27.398140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf2e897-36a7-4317-888c-fa9e356f56d8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:27.398756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbf2e897-36a7-4317-888c-fa9e356f56d8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:27.414607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:27.424952 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7a9724ce-fade-4abf-a7f3-9888cd1b6e51 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1323 microversion: 2.1 time: 0.462048 Oct 12 09:09:27.426152 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2506/5440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:26 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:27.475525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cbf2e897-36a7-4317-888c-fa9e356f56d8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Going to try to stop instance {{(pid=127006) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 09:09:27.576296 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cbf2e897-36a7-4317-888c-fa9e356f56d8 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/action" status: 202 len: 0 microversion: 2.1 time: 0.211987 Oct 12 09:09:27.579102 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2935/5441] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:09:27 2022] POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:09:27.588295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:27.589270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:27.599458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:27.602033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:27.603889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:27.605557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:27.607640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:27.608471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:28.220410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:28.221171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:28.228016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:28.228504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:28.230653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:28.233011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:28.233746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:28.234330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:28.272913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:28.292890 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-149715da-07e3-44e5-aa4d-aa21a2ece2e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1679 microversion: 2.1 time: 0.709401 Oct 12 09:09:28.301492 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2507/5442] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:27 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1679 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:28.350229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:28.361651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:28.363418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:28.364817 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a004adf2-7306-4a04-b76d-a77b250315c3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.149638 Oct 12 09:09:28.365456 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2936/5443] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:28 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:28.449736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:28.450867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:28.458583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:28.459235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:28.459761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:28.460985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:28.461690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:28.462347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:28.781159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:28.791144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:28.806798 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d80bec75-daeb-4c56-943a-801538ba1a38 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1323 microversion: 2.1 time: 0.360729 Oct 12 09:09:28.811501 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2508/5444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:28 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:29.338441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:29.343557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:29.357201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:29.372170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:29.373766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:29.375487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:29.376219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:29.376910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:29.393905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:29.394803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:29.411902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:29.412736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:29.413304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:29.414748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:29.416114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:29.417756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:29.530569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:29.541912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:29.544004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:29.545411 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8b48a906-84ab-4690-9866-60e1c9e82349 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.157267 Oct 12 09:09:29.546553 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2509/5445] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:29 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:29.831021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:29.831936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:29.849938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:29.850504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:29.852426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:29.856172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:29.857922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:29.859853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:30.189879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:30.208817 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-026f2d05-054e-4de9-ae69-c956613deb3e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1519 microversion: 2.1 time: 0.381755 Oct 12 09:09:30.210088 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2510/5446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:29 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1519 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:30.237019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:30.239387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:30.250650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:30.256268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:30.256965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:30.257933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:30.258826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:30.259792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:30.312998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lazy-loading 'flavor' on Instance uuid b5b451f0-75be-42f1-b111-efe92f481438 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:09:30.373943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:30.393418 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bfe54da1-31ca-48b2-a5e9-8bf4298e7d03 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1679 microversion: 2.1 time: 1.064138 Oct 12 09:09:30.396339 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2937/5447] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:29 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1679 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:30.511143 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8d703b4-d42c-4566-8e1d-31b94fe5a5a7 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action" status: 200 len: 32 microversion: 2.1 time: 0.274807 Oct 12 09:09:30.516705 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2511/5448] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:09:30 2022] POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:09:30.525375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:30.528671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:30.561477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:30.572968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:30.573776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:30.573914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:30.577774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:30.581406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:30.583972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:30.584499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:30.597866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:30.598355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:30.602969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:30.604030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:30.610493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:30.612241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:30.778520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:30.790837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:30.792621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:30.798947 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c26cab22-5abe-40b3-baa9-8387d0ac9f5d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.230545 Oct 12 09:09:30.800159 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2512/5449] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:30 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:31.162969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:31.173556 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a895a09-de68-47fa-b40d-b37dde667d6e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.655808 Oct 12 09:09:31.174745 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2938/5450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:30 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:31.419862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:31.422155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:31.430260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:31.431031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:31.431662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:31.432805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:31.433424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:31.434042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:31.699691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:31.712833 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82aee698-b379-46da-b2b0-6f79828a9636 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1679 microversion: 2.1 time: 0.298178 Oct 12 09:09:31.713803 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2513/5451] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:31 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1679 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:31.830360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:31.831616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:31.843498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:31.854794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:31.856251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:31.864049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:31.867429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:31.869471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:31.870941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:32.160904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:32.169611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:32.177356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:32.178647 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b61f1f2f-1f2d-4b30-a8ed-d29630699bc8 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.353238 Oct 12 09:09:32.179208 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2939/5452] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:31 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:32.198153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:32.199023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:32.205881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:32.206717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:32.207340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:32.208382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:32.208981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:32.209698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:32.704945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:32.718851 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dd52e26d-70f7-4fd9-8b1b-a103f2182459 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.524482 Oct 12 09:09:32.720292 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2514/5453] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:32 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:32.741206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:32.742107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:32.757361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:32.758213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:32.759733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:32.761589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:32.767260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:32.768051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:33.038115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:33.052079 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eac7a7b7-c434-43d8-9f71-51e894743751 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1679 microversion: 2.1 time: 0.315855 Oct 12 09:09:33.068740 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2940/5454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:32 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1679 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:33.206018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:33.206763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:33.214312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:33.214468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:33.215183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:33.216349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:33.217467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:33.218264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:33.358944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:33.370920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:33.381135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:33.386855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-131fa744-3e9a-4849-9853-c91cb8c1e18c tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.182939 Oct 12 09:09:33.389411 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2515/5455] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:33 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:33.747972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:33.748861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:33.756138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:33.757071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:33.757829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:33.759334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:33.759959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:33.760586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:34.006754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:34.017190 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f04ce4d-59ea-4703-87c3-9fb9ef38b786 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.274342 Oct 12 09:09:34.034306 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2941/5456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:33 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:34.077289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:34.078776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:34.088108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:34.089118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:34.089960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:34.091907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:34.092858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:34.093577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:34.398852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:34.407476 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6d8abdd-b230-447e-95d2-2c4c274c1c84 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1679 microversion: 2.1 time: 0.334915 Oct 12 09:09:34.414565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:34.415739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:34.416163 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2516/5457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:34 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1679 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:34.434067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:34.434067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:34.434067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:34.434067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:34.434067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:34.434067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:34.558990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:34.568780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:34.579209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:34.580876 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-772968b1-b111-4b27-b22d-ddb7c3ecdd23 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.170486 Oct 12 09:09:34.582134 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2942/5458] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:34 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:35.042018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:35.042971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:35.050735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:35.051661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:35.052289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:35.053472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:35.054123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:35.054778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:35.298322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:35.309206 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d4fc9243-b633-42bb-aa41-5d02d52157e1 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.271094 Oct 12 09:09:35.310158 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2517/5459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:35 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:35.443045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:35.443841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:35.458074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:35.458576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:35.459011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:35.459740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:35.460205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:35.460635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:35.608716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:35.609849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:35.621965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:35.623001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:35.625553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:35.626633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:35.628397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:35.629077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:35.733218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:35.753299 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3e5cffc-f437-434f-95c3-d62e65e8de3c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1679 microversion: 2.1 time: 0.314583 Oct 12 09:09:35.769997 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2943/5460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:35 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1679 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:35.782891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:35.810271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:35.813390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:35.816520 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4c5476a8-036f-4af5-aece-3fd08c5c6803 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.212049 Oct 12 09:09:35.820350 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2518/5461] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:35 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:36.336474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:36.337237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:36.346528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:36.351863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:36.353480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:36.354482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:36.355067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:36.355593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:36.785498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:36.786120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:36.793827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:36.794316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:36.794753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:36.795454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:36.795902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:36.796324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:37.053204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:37.063809 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a573ba9-3d03-4df4-ae91-2cdf3b87d70f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.732338 Oct 12 09:09:37.064657 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2944/5462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:36 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:37.070170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:37.071199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:37.080104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:37.081000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:37.081688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:37.082604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:37.083233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:37.083818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:37.182605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:37.194981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:37.196986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:37.198480 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42beb086-4f19-462d-b8e4-f66be19f7f19 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.132682 Oct 12 09:09:37.199283 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2945/5463] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:37 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:37.220641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:37.240855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-df18033d-4dee-45bb-adce-63ed2f270025 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1679 microversion: 2.1 time: 0.459165 Oct 12 09:09:37.258221 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2519/5464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:36 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1679 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:38.087975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:38.089331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:38.099264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.099741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.100306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.100937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.101402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.101872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.226907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:38.227524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:38.236693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.237195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.237678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.238391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.238845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.239270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.250867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:38.259184 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7118f7c6-cb8c-4d82-9680-662e58157e0c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.175122 Oct 12 09:09:38.260426 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2946/5465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:38 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:38.283614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:38.284486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:38.303151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.303648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.304091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.312803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.313496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.314103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.338101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:38.346508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:38.347933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:38.349373 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db93a996-13fe-4158-93c5-95be90b80403 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.127583 Oct 12 09:09:38.361590 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2520/5466] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:38 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:38.470137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:38.478195 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ace5252e-8a3d-4b6a-aaac-5f5a17cdd027 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1656 microversion: 2.1 time: 0.199586 Oct 12 09:09:38.479083 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2947/5467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:38 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1656 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:38.501674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bcca73ba-4737-4209-841e-a0c4e283c042 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:38.509204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcca73ba-4737-4209-841e-a0c4e283c042 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.509918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcca73ba-4737-4209-841e-a0c4e283c042 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.510592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bcca73ba-4737-4209-841e-a0c4e283c042 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.536745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bcca73ba-4737-4209-841e-a0c4e283c042 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Going to try to start instance {{(pid=127007) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 09:09:38.587285 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bcca73ba-4737-4209-841e-a0c4e283c042 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/action" status: 202 len: 0 microversion: 2.1 time: 0.089612 Oct 12 09:09:38.588489 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2521/5468] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:09:38 2022] POST /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:09:38.597943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:38.600128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:38.608947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.609483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.610017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.610989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:38.611455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:38.612080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:38.642922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:38.868193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:38.879231 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-426cc97d-adac-4cbc-ada7-1e6e30f8b21d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1665 microversion: 2.1 time: 0.286325 Oct 12 09:09:38.879903 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2948/5469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:38 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1665 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:39.285652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:39.286369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:39.298422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:39.299123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:39.302010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:39.302769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:39.310059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:39.310420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:39.362098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:39.380774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:39.383712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:39.400375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:39.401308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:39.401953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:39.403110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:39.403954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:39.405374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:39.650282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:39.665841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:39.668138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:39.669536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29f0c659-5611-417b-b2ee-4fce5e24f706 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.295433 Oct 12 09:09:39.673090 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2949/5470] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:39 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:39.721082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:39.743432 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2bf5f9ce-4978-4751-b51c-8e609cf8a177 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.463388 Oct 12 09:09:39.769883 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2522/5471] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:39 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:39.903862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:39.904493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:39.913733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:39.914242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:39.914693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:39.915420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:39.915884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:39.916376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:40.283193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:40.296523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1147068a-00cd-4896-ad85-85cc7a80543f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1665 microversion: 2.1 time: 0.396895 Oct 12 09:09:40.302091 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2950/5472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:39 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1665 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:40.699845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:40.701241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:40.712266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:40.712719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:40.714772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:40.717885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:40.718367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:40.718818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:40.766840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:40.768385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:40.781708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:40.782554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:40.783215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:40.805552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:40.808255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:40.812982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:40.900842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:40.912227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:40.918585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:40.921733 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-21bc9208-854d-41ee-9516-96ffcca68c6d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.226204 Oct 12 09:09:40.922678 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2523/5473] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:40 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:41.168931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:41.190059 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2221c46-abf0-4699-8f5c-80a3f037be25 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.427248 Oct 12 09:09:41.190920 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2951/5474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:40 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:41.325747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:41.326896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:41.336198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:41.336897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:41.337392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:41.338226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:41.338741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:41.339233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:41.538147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:41.549205 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-92d35395-a389-4c8c-8044-23a910c90c0c tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1669 microversion: 2.1 time: 0.228739 Oct 12 09:09:41.565477 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2524/5475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:41 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:09:41.968113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:41.969894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:41.979062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:41.979961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:41.980710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:41.981652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:41.982266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:41.983187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:42.071011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:42.082903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:42.084960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:42.086241 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e53d87a0-1cc4-45d6-9dcc-e0e944e2a707 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.138917 Oct 12 09:09:42.087214 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2952/5476] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:41 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:42.217909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:42.219354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:42.227598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:42.228366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:42.229194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:42.230111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:42.230861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:42.231500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:42.409164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:42.417849 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d71d9d62-eb75-4c83-900d-717274962429 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.204707 Oct 12 09:09:42.418421 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2525/5477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:42 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:43.114323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:43.114936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:43.126729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:43.129132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:43.129846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:43.130793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:43.141398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:43.141398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:43.238656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:43.253217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:43.255973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:43.259419 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-540ad2ec-c8ef-4f59-8c01-870c7e4c40fe tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.149134 Oct 12 09:09:43.261321 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2953/5478] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:43 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:43.460880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:43.461400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:43.481359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:43.482296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:43.503546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:43.507093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:43.521654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:43.524969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:43.525995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:43.529089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:43.560716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:43.561228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:43.573629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:43.573629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:43.573629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:43.573629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:43.606865 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f35716a-a4df-4e1a-aa7e-10dc7d673562 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/ips" status: 200 len: 149 microversion: 2.1 time: 0.131005 Oct 12 09:09:43.617485 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2954/5479] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:09:43 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/ips => generated 149 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:09:43.870302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:43.883329 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7ab80ac-dac0-48b6-a486-07a8bddc86bf tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.445002 Oct 12 09:09:43.884924 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2526/5480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:43 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:44.299328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:44.301971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:44.317771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:44.318458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:44.319565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:44.320455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:44.321090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:44.321726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:44.476973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:44.489039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:44.496157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:44.497359 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d048fac7-d61e-4532-bf1f-d3f91407d78f tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.203404 Oct 12 09:09:44.497957 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2955/5481] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:44 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:44.908244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:44.909844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:44.926730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:44.930274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:44.931685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:44.938277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:44.938939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:44.942192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:45.262078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:45.271232 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35ec2c78-4d5c-4628-b8be-88cbeb71dff6 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.366991 Oct 12 09:09:45.272334 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2527/5482] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:44 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:45.543348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:45.544915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:45.553532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:45.554312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:45.555765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:45.558675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:45.559372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:45.560019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:45.665644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:45.678364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:45.680413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:45.682491 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f6f6738e-9823-4a62-b9c1-6e75d459ba91 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.144242 Oct 12 09:09:45.691288 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2956/5483] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:45 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:46.267364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f12de6d9-87be-4a74-b883-29999170ce50"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:09:46.270644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:46.279334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:46.280092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:46.280688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:46.281653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:46.282265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:46.282873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:46.299075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:46.299929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:46.312873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:46.314006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:46.316074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:46.316962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:46.317951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:46.320177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:46.535237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:46.543506 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ddb18a35-b62e-4a41-9cbb-6272f77adf3b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.248420 Oct 12 09:09:46.544086 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2957/5484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:46 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:46.714327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:46.714933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:46.725215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:46.725670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:46.726106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:46.726810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:46.727279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:46.727703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:46.855727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:46.873170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:46.881066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:46.882977 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-db2292f0-c04b-473b-ad5d-ffd45d4ecbe6 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1365 microversion: 2.47 time: 0.172290 Oct 12 09:09:46.883621 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2958/5485] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:46 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:47.575805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:47.577964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:47.605046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:47.606996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:47.608702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:47.611476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:47.613268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:47.614777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:47.878751 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1007326d-cdb9-4c64-885e-df9d72c6d53f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.615804 Oct 12 09:09:47.880269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2528/5486] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:09:46 2022] POST /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 194 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:09:47.916416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:47.918330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:47.931415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=60 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:47.944411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:47.947647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:47.948376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:47.960800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:47.965872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:47.966570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:48.084360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:48.089310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:48.097020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:48.099532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:48.101417 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c41d9a3-3333-44e0-bf8e-b0d0acf71486 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1371 microversion: 2.47 time: 0.190190 Oct 12 09:09:48.101664 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cbde68da-15f7-4483-a543-60bcd8de9bbe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.537286 Oct 12 09:09:48.102205 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2959/5487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:47 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:48.111002 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2529/5488] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:47 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:09:49.136644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:49.137535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:49.138260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:49.138870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:49.166930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:49.166930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:49.178933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:49.180038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:49.186633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:49.187443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:49.187906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:49.188568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:49.189230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:49.190199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:49.208799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:49.217871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:49.309110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:49.319672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:49.321596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:49.323402 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-813dd7f1-c307-4897-9875-cb1eb1a6febd tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1371 microversion: 2.47 time: 0.197443 Oct 12 09:09:49.324282 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2530/5489] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:49 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:49.609732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:49.620736 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-417f4e61-fe89-41b1-ba6b-9e6280a1aa76 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.494053 Oct 12 09:09:49.622862 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2960/5490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:49 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:50.350358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:50.354864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:50.368701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:50.369198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:50.369691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:50.371886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:50.372362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:50.372799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:50.523173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:50.531785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:50.533237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:50.534452 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c782c07-9537-452a-b008-02aa6a07132a tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1371 microversion: 2.47 time: 0.188073 Oct 12 09:09:50.535043 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2531/5491] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:50 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:50.652216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:50.652829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:50.665572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:50.666869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:50.669518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:50.670890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:50.671559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:50.672605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:50.951237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:50.959349 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4d9aff9-0a58-4404-bd59-8f7765cfaa1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.310945 Oct 12 09:09:50.971330 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2961/5492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:50 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:51.567430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:51.568692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:51.576907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:51.589502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:51.590210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:51.591168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:51.591828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:51.592472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:51.716816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:51.727051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:51.728525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:51.739226 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6520065e-e2ca-44f4-9527-465953f64f8d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1356 microversion: 2.47 time: 0.166316 Oct 12 09:09:51.753866 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2532/5493] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:51 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:51.772490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:51.777724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:51.778613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Searching by: {'deleted': False, 'project_id': '62f3201ec5504ed9862d41eb56a8203e'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:09:51.796172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:51.796419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:51.796847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:51.797610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:51.798069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:51.798495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:51.987240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:51.987866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:52.003776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:52.004290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:52.004746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:52.005502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:52.005965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:52.006398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:52.088627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:09:52.364002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:52.381666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:52.384353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:52.390570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-727c954f-d19c-49c4-a08d-2d93b9c147fe tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.407247 Oct 12 09:09:52.391174 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2533/5494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:51 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:52.398978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:52.401744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:52.460561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:52.470142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:52.533104 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be81c577-fe08-4379-bf28-425d96aac056 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.764482 Oct 12 09:09:52.533816 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2962/5495] 10.222.0.40 () {60 vars in 1187 bytes} [Wed Oct 12 09:09:51 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:52.577202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:52.577782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:52.595974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:52.598781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:52.600188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:52.607857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:52.616498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:52.621149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:52.677119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:09:52.800027 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f29b699d-a30c-4660-a3ca-c8264ac260f3 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 204 len: 0 microversion: 2.47 time: 0.229924 Oct 12 09:09:52.802386 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2534/5496] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:09:52 2022] DELETE /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:09:52.811329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:52.812817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:52.824748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:52.831116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:52.831959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:52.833135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:52.833935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:52.834642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:53.091644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:53.109415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:53.115638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:53.118148 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f552291f-9852-4ce8-a9ad-54e9c5a3eac2 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1362 microversion: 2.47 time: 0.311559 Oct 12 09:09:53.120214 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2963/5497] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:52 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:53.421341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:53.422109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:53.430955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:53.444524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:53.444524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:53.444524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:53.444524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:53.444524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:53.830007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:53.839463 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65277515-a205-475f-a01e-e4e1af29f1dd tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.422797 Oct 12 09:09:53.859817 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2535/5498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:53 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:54.148790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:54.150034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:54.179613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:54.180080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:54.180526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:54.190512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:54.191181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:54.191644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:54.222832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:54.335382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:54.348299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:54.350011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:54.351320 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-32dc15ff-c939-49b7-82fe-77fba3a5aa41 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1362 microversion: 2.47 time: 0.206655 Oct 12 09:09:54.369851 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2964/5499] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:54 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:54.871615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:54.872272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:54.884913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:54.885613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:54.886060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:54.886777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:54.887236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:54.887671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:54.904246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:09:55.110952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:55.120477 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9cddcec9-c215-413e-8355-75c7e478190f tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.257254 Oct 12 09:09:55.127095 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2536/5500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:54 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:55.384280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:55.384909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:55.399906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:55.400810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:55.406224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:55.409783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:55.410478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:55.411114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:55.491698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:55.492253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:55.500368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:55.501161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lazy-loading 'fault' on Instance uuid e82ac3cc-45d8-4dac-987b-1c8169915175 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:09:55.642418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:55.654818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:55.656288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:55.657557 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0b08be8-81cf-4411-9ae5-3335c049d80d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 200 len: 1367 microversion: 2.47 time: 0.277335 Oct 12 09:09:55.659421 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2965/5501] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:55 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:56.154849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:56.156303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:56.174795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:56.175362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:56.178356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:56.179412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:56.180809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:56.202482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:56.507483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:56.516275 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5d27ba3f-419a-441d-9654-22e211862cf2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.369515 Oct 12 09:09:56.516872 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2537/5502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:56 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:56.691695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:56.692373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: e82ac3cc-45d8-4dac-987b-1c8169915175] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:56.701052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:56.701826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:56.702428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:56.704269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:56.704942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:56.705923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:56.737376 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] HTTP exception thrown: Instance e82ac3cc-45d8-4dac-987b-1c8169915175 could not be found. Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Request method failure captured: Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 HTTP/1.1 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoQzn1Xmxj0L7dWPSGCjuGQ3_jUgIjtCI0rTvmDXYYUEx4iqtpl2R7U9xSsTwJjUigSGzRdU-pYzHUDvkY_uRiWgNvplE-kK3bPg5xyMSXxd_8AHta9cB7kDKZTP9MvdVP-_fOUZeKvHuyPgxPq6SP8WUNaSYETLMdb69d2g6F3uego Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 62f3201ec5504ed9862d41eb56a8203e Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerShowV247Test-600588743 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62f3201ec5504ed9862d41eb56a8203e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62f3201ec5504ed9862d41eb56a8203e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62f3201ec5504ed9862d41eb56a8203e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62f3201ec5504ed9862d41eb56a8203e"}]}] Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerShowV247Test-600588743 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 62f3201ec5504ed9862d41eb56a8203e Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerShowV247Test-600588743 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerShowV247Test-600588743-project Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d62caef7784c4f8097408b6474209526 Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerShowV247Test-600588743-project Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance e82ac3cc-45d8-4dac-987b-1c8169915175 could not be found. Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'e82ac3cc-45d8-4dac-987b-1c8169915175'} Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82ac3cc-45d8-4dac-987b-1c8169915175 could not be found. Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82ac3cc-45d8-4dac-987b-1c8169915175 could not be found. Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:09:56.739382 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:09:56.745350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:09:56.745350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:09:56.745350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:09:56.745350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:09:56.745350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:09:56.745350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82ac3cc-45d8-4dac-987b-1c8169915175 could not be found. Oct 12 09:09:56.745350 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:09:56.747075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Returning 404 to user: Instance e82ac3cc-45d8-4dac-987b-1c8169915175 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:09:56.748158 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e57a3b4d-410e-49a4-8612-f7ade0b7de05 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175" status: 404 len: 111 microversion: 2.47 time: 0.060693 Oct 12 09:09:56.749307 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2966/5503] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:56 2022] GET /compute/v2.1/servers/e82ac3cc-45d8-4dac-987b-1c8169915175 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:09:56.758376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:56.759202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:56.766242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:56.767115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:56.767747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:56.768689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:56.769347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:56.769990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:56.803715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:09:56.950142 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-405a3b8f-fab4-4def-ac57-bf0d0f59b095 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6" status: 204 len: 0 microversion: 2.47 time: 0.196406 Oct 12 09:09:56.953901 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2538/5504] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:09:56 2022] DELETE /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 09:09:56.959048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:56.959913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:56.968850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:56.969700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:56.970202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:56.970972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:56.971982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:56.972507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:57.059277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:57.073490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:57.075844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:57.077037 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05bb3129-33e8-4766-8a31-a64b82d7439d tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6" status: 200 len: 1362 microversion: 2.47 time: 0.122076 Oct 12 09:09:57.077886 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2967/5505] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:56 2022] GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 => generated 1362 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:57.541106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:57.542646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:57.557318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:57.557785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:57.561528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:57.566341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:57.568240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:57.569098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:57.773639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:57.783624 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-505bc2da-ba02-4c06-bad4-58d8fb1e55a2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.247744 Oct 12 09:09:57.801365 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2539/5506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:57 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:58.102260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:58.102941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:58.111512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:58.112190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:58.112724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:58.113832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:58.114656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:58.115325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:58.208831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:58.218938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:58.221056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:58.222693 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-10ff7789-9d7d-4396-9db8-fca93a8a4be4 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6" status: 200 len: 1362 microversion: 2.47 time: 0.124389 Oct 12 09:09:58.223836 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2968/5507] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:58 2022] GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 => generated 1362 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:09:58.810145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:58.811504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:58.821311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:58.831777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:58.834731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:58.837877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:58.838666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:58.839379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:59.137055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:59.151093 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-50426d65-9f43-476d-83d6-9c24a83dba8b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.346011 Oct 12 09:09:59.152125 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2540/5508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:09:58 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:09:59.258125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:09:59.259108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:09:59.266246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:59.266979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:59.267889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:59.268968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:09:59.269695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:09:59.270181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:09:59.343602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:59.361530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:59.363186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:09:59.364700 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-669b3ec3-b4fa-4bc3-838b-f6c582037ac0 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6" status: 200 len: 1362 microversion: 2.47 time: 0.112243 Oct 12 09:09:59.365663 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2969/5509] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:09:59 2022] GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 => generated 1362 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:00.174436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:00.175063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:00.183709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:00.184564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:00.191536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:00.193196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:00.193974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:00.194422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:00.370720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:00.380469 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8886b64a-77d9-4f27-a687-250683a61013 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1525 microversion: 2.1 time: 0.209990 Oct 12 09:10:00.394033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:00.394559 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2541/5510] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:00 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1525 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:00.394914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:00.405032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:00.405944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:00.406600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:00.407573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:00.408257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:00.408896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:00.450846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:00.451718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:00.452416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:00.453484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lazy-loading 'fault' on Instance uuid ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:10:00.516032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:00.527097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:00.530069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd62caef7784c4f8097408b6474209526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f3201ec5504ed9862d41eb56a8203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:00.531799 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f982adb5-f7cf-433d-b178-796ba56f7ded tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6" status: 200 len: 1367 microversion: 2.47 time: 0.142756 Oct 12 09:10:00.532645 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2970/5511] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:00 2022] GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:10:01.406302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:01.407593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:01.415366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:01.416191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:01.416852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:01.418091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:01.418720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:01.419396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:01.564866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:01.566744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] [instance: ab2e9ab6-0d6c-493c-914b-598ed79ec9f6] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:01.587719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:01.588557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:01.589210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:01.590178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:01.590832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:01.591678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:01.610062 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] HTTP exception thrown: Instance ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 could not be found. Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Request method failure captured: Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 HTTP/1.1 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoQzn1Xmxj0L7dWPSGCjuGQ3_jUgIjtCI0rTvmDXYYUEx4iqtpl2R7U9xSsTwJjUigSGzRdU-pYzHUDvkY_uRiWgNvplE-kK3bPg5xyMSXxd_8AHta9cB7kDKZTP9MvdVP-_fOUZeKvHuyPgxPq6SP8WUNaSYETLMdb69d2g6F3uego Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.47 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 62f3201ec5504ed9862d41eb56a8203e Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerShowV247Test-600588743 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62f3201ec5504ed9862d41eb56a8203e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62f3201ec5504ed9862d41eb56a8203e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62f3201ec5504ed9862d41eb56a8203e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62f3201ec5504ed9862d41eb56a8203e"}]}] Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerShowV247Test-600588743 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 62f3201ec5504ed9862d41eb56a8203e Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerShowV247Test-600588743 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerShowV247Test-600588743-project Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d62caef7784c4f8097408b6474209526 Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerShowV247Test-600588743-project Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 could not be found. Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'ab2e9ab6-0d6c-493c-914b-598ed79ec9f6'} Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 could not be found. Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 could not be found. Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:01.612265 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:01.617661 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:01.617661 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:01.617661 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:01.617661 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:10:01.617661 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:10:01.617661 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 could not be found. Oct 12 09:10:01.617661 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:01.620802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] Returning 404 to user: Instance ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:10:01.622754 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a5827815-a639-4796-81b9-904f5969e393 tempest-ServerShowV247Test-600588743 tempest-ServerShowV247Test-600588743-project] 10.222.0.40 "GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6" status: 404 len: 111 microversion: 2.47 time: 0.066123 Oct 12 09:10:01.624372 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2971/5512] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:01 2022] GET /compute/v2.1/servers/ab2e9ab6-0d6c-493c-914b-598ed79ec9f6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:10:01.655158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:01.671580 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86f85327-2b65-4d6c-9cde-db568d9737da tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1505 microversion: 2.1 time: 0.268352 Oct 12 09:10:01.672201 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2542/5513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:01 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:01.699814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9dfb3b08-bca0-4d9d-8e8d-52593f65793c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Action: 'create', calling method: .version_select at 0x7f9843ef9ee0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1857743591", "description": "tempest-description-1655082586"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:01.874874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:02.064238 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9dfb3b08-bca0-4d9d-8e8d-52593f65793c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.369535 Oct 12 09:10:02.072939 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2972/5514] 10.222.0.40 () {60 vars in 1180 bytes} [Wed Oct 12 09:10:01 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:02.081403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1857743591"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:02.083063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:02.094115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:02.094972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:02.095787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:02.097075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:02.098303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:02.099058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:02.681016 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.network.security_group_api [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Adding security group 568514c1-da74-4239-b4a5-5a0716dcc1aa to port a83a9047-abf9-472f-878a-40c6a24980b9 Oct 12 09:10:03.282132 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a37a204b-e847-4b95-88e4-07cd9d725dc5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action" status: 202 len: 0 microversion: 2.1 time: 1.207536 Oct 12 09:10:03.283148 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2543/5515] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:10:02 2022] POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action => generated 0 bytes in 1209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:10:03.287622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:03.294961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1857743591"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:03.295751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:03.297890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=72 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:03.308030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-6cf29a84-d9fb-4a1b-88de-85a4f265ecb6 req-b47ca2ef-5025-42a4-9618-42ed75e65bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b451f0-75be-42f1-b111-efe92f481438", "tag": "a83a9047-abf9-472f-878a-40c6a24980b9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:03.336065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6cf29a84-d9fb-4a1b-88de-85a4f265ecb6 req-b47ca2ef-5025-42a4-9618-42ed75e65bc2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:03.338017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6cf29a84-d9fb-4a1b-88de-85a4f265ecb6 req-b47ca2ef-5025-42a4-9618-42ed75e65bc2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:03.341122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6cf29a84-d9fb-4a1b-88de-85a4f265ecb6 req-b47ca2ef-5025-42a4-9618-42ed75e65bc2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:03.347256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:03.352835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:03.353289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:03.354155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:03.354679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:03.355032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:03.370069 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-6cf29a84-d9fb-4a1b-88de-85a4f265ecb6 req-b47ca2ef-5025-42a4-9618-42ed75e65bc2 service nova] Creating event network-changed:a83a9047-abf9-472f-878a-40c6a24980b9 for instance b5b451f0-75be-42f1-b111-efe92f481438 on n-h1-858383-10 Oct 12 09:10:03.384753 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-6cf29a84-d9fb-4a1b-88de-85a4f265ecb6 req-b47ca2ef-5025-42a4-9618-42ed75e65bc2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079072 Oct 12 09:10:03.386744 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2544/5516] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:10:03.669535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f12de6d9-87be-4a74-b883-29999170ce50"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:03.672192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:03.683017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:03.683717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:03.684251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:03.697768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:03.698880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:03.699420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:03.847224 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Invalid volume: volume f12de6d9-87be-4a74-b883-29999170ce50 is already attached to instances: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments HTTP/1.1 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 74 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: {"volumeAttachment": {"volumeId": "f12de6d9-87be-4a74-b883-29999170ce50"}} Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid volume: volume f12de6d9-87be-4a74-b883-29999170ce50 is already attached to instances: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': '3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8', 'body': {'volumeAttachment': {'volumeId': 'f12de6d9-87be-4a74-b883-29999170ce50'}}} Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f12de6d9-87be-4a74-b883-29999170ce50 is already attached to instances: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:10:03.859682 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f12de6d9-87be-4a74-b883-29999170ce50 is already attached to instances: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f12de6d9-87be-4a74-b883-29999170ce50 is already attached to instances: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 400 to user: Invalid volume: volume f12de6d9-87be-4a74-b883-29999170ce50 is already attached to instances: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:10:03.864855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e0703237-4cd7-4707-9cba-25d71c436bee tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.198550 Oct 12 09:10:03.869909 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2545/5517] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:10:03 2022] POST /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:10:04.050003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:04.050522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:04.082204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:04.082671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:04.083180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:04.084150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:04.084819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:04.085528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:04.156961 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.network.security_group_api [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Removing security group 568514c1-da74-4239-b4a5-5a0716dcc1aa from port a83a9047-abf9-472f-878a-40c6a24980b9 Oct 12 09:10:04.280043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lazy-loading 'services' on Instance uuid 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:10:04.419495 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d7bdafd-1616-4368-86ce-91166e8c3aa9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments/f12de6d9-87be-4a74-b883-29999170ce50" status: 202 len: 0 microversion: 2.1 time: 0.375275 Oct 12 09:10:04.424054 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2546/5518] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:10:04 2022] DELETE /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments/f12de6d9-87be-4a74-b883-29999170ce50 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:10:04.439214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:04.443272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:04.472410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:04.474641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:04.475590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:04.476637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:04.479483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:04.481029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:04.552806 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bca58c0a-4c72-4363-997a-6ad31935db80 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127304 Oct 12 09:10:04.553871 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2547/5519] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:04 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:05.577905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:05.581021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:05.596706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:05.598274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:05.598978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:05.599895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:05.600527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:05.601263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:05.700639 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4bf016e-477e-4bad-80ca-a0001470c269 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action" status: 202 len: 0 microversion: 2.1 time: 2.413571 Oct 12 09:10:05.703477 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2973/5520] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:10:03 2022] POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action => generated 0 bytes in 2417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:10:05.714546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0ec757c6-6a1f-47c9-a3f0-6d44443d3085 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Action: 'create', calling method: .version_select at 0x7f9843fc0310>, body: {"pool": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:05.727098 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aee5f09f-a4a0-4109-af8d-5b3e4177b1e7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157240 Oct 12 09:10:05.727098 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2548/5521] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:05 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:05.749856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-6a6ed865-9f8a-4092-880f-ef0d9183e16f req-39553270-7ed4-4f4a-9a33-7345619f9baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b451f0-75be-42f1-b111-efe92f481438", "tag": "a83a9047-abf9-472f-878a-40c6a24980b9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:05.781117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6a6ed865-9f8a-4092-880f-ef0d9183e16f req-39553270-7ed4-4f4a-9a33-7345619f9baf service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:05.781642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6a6ed865-9f8a-4092-880f-ef0d9183e16f req-39553270-7ed4-4f4a-9a33-7345619f9baf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:05.782085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-6a6ed865-9f8a-4092-880f-ef0d9183e16f req-39553270-7ed4-4f4a-9a33-7345619f9baf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:05.823809 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-6a6ed865-9f8a-4092-880f-ef0d9183e16f req-39553270-7ed4-4f4a-9a33-7345619f9baf service nova] Creating event network-changed:a83a9047-abf9-472f-878a-40c6a24980b9 for instance b5b451f0-75be-42f1-b111-efe92f481438 on n-h1-858383-10 Oct 12 09:10:05.841178 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-6a6ed865-9f8a-4092-880f-ef0d9183e16f req-39553270-7ed4-4f4a-9a33-7345619f9baf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098127 Oct 12 09:10:05.843099 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2549/5522] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:10:06.743763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:06.753804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:06.784303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:06.788520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:06.788929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:06.798042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:06.798992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:06.799631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:06.914699 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4da56ea4-b6d8-4f87-8a30-e13065535706 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165540 Oct 12 09:10:06.914699 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2550/5523] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:06 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:07.925935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:07.929863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:07.937671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:07.938599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:07.939221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:07.940107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:07.940827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:07.941425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:08.025090 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-17d06c3d-04cc-4d58-a793-d22503b3fafc tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102724 Oct 12 09:10:08.027803 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2551/5524] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:07 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:08.260146 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0ec757c6-6a1f-47c9-a3f0-6d44443d3085 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.551440 Oct 12 09:10:08.262133 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2974/5525] 10.222.0.40 () {60 vars in 1170 bytes} [Wed Oct 12 09:10:05 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:10:08.276861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.8"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:08.280787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:08.291304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:08.291304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:08.291647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:08.292502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:08.293908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:08.295032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:08.317987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:08.333242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "refresh_cache-b5b451f0-75be-42f1-b111-efe92f481438" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 09:10:08.333905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquired lock "refresh_cache-b5b451f0-75be-42f1-b111-efe92f481438" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 09:10:09.041351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:09.045231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:09.057110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:09.057630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:09.058233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:09.058760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:09.059215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:09.059780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:09.101641 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05d19eb8-b49a-4535-bc40-756baa358950 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065662 Oct 12 09:10:09.107186 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2975/5526] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:09 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:10:10.202042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Building network info cache for instance {{(pid=127007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 09:10:10.720981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:10.721656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:10.737526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:10.738033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:10.738477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:10.739220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:10.739682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:10.740115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:10.861186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:10:11.187800 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6bd34c0-abf2-40b0-b465-179bb77763d9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "DELETE /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 204 len: 0 microversion: 2.32 time: 1.085019 Oct 12 09:10:11.195835 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2976/5527] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:10:10 2022] DELETE /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 09:10:11.207978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:11.214363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:11.234178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:11.236868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:11.237719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:11.238655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:11.239970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:11.244910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:11.319036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Updating instance_info_cache with network_info: [{"id": "a83a9047-abf9-472f-878a-40c6a24980b9", "address": "fa:16:3e:3f:5e:59", "network": {"id": "db20ff19-aaa6-4ac8-a95b-8f318e726303", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1697229953-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8673309873b24f8aa5fb718c090802b8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa83a9047-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 09:10:11.337095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Releasing lock "refresh_cache-b5b451f0-75be-42f1-b111-efe92f481438" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 09:10:11.338058 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4bd2d727-92ce-4a1a-bf61-131905a9045c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action" status: 202 len: 0 microversion: 2.1 time: 3.067648 Oct 12 09:10:11.338709 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2552/5528] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:10:08 2022] POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action => generated 0 bytes in 3069 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 09:10:11.345620 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7bf8cb49-4673-408f-90d4-780434fa8b20 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148017 Oct 12 09:10:11.356102 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2977/5529] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:11 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:11.366496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:11.367201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:11.384617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2e77a197-3a15-4898-8570-0052a14e8374 req-ea746826-bb5f-4957-a144-2f8c68a0f70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b451f0-75be-42f1-b111-efe92f481438", "tag": "a83a9047-abf9-472f-878a-40c6a24980b9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:11.387755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:11.390392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:11.390932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:11.391663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:11.392128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:11.394936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:11.424713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2e77a197-3a15-4898-8570-0052a14e8374 req-ea746826-bb5f-4957-a144-2f8c68a0f70e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:11.426099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2e77a197-3a15-4898-8570-0052a14e8374 req-ea746826-bb5f-4957-a144-2f8c68a0f70e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:11.432487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2e77a197-3a15-4898-8570-0052a14e8374 req-ea746826-bb5f-4957-a144-2f8c68a0f70e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:11.475050 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2e77a197-3a15-4898-8570-0052a14e8374 req-ea746826-bb5f-4957-a144-2f8c68a0f70e service nova] Creating event network-changed:a83a9047-abf9-472f-878a-40c6a24980b9 for instance b5b451f0-75be-42f1-b111-efe92f481438 on n-h1-858383-10 Oct 12 09:10:11.499438 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2e77a197-3a15-4898-8570-0052a14e8374 req-ea746826-bb5f-4957-a144-2f8c68a0f70e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156054 Oct 12 09:10:11.508052 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2553/5530] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:11.524924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.8"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:11.938690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:11.946207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:11.946848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:11.948198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:11.949029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:11.952298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:11.954070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:12.177412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:12.189031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:12.193889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:12.197329 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f8a186e9-3b93-429d-84a5-59f6cf26bc29 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2953 microversion: 2.32 time: 0.840196 Oct 12 09:10:12.213463 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2978/5531] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:11 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2953 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:12.367494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:12.370043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:12.392970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:12.394093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:12.394639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:12.395458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:12.396170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:12.396826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:12.493360 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e573dc77-a79f-482b-962d-f3bb6690f704 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130276 Oct 12 09:10:12.515259 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2979/5532] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:12 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:12.741229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "refresh_cache-b5b451f0-75be-42f1-b111-efe92f481438" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 09:10:12.741229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquired lock "refresh_cache-b5b451f0-75be-42f1-b111-efe92f481438" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 09:10:13.237571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:13.238225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:13.248748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:13.252611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:13.254325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:13.255270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:13.260489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:13.261205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:13.613116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:13.630311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:13.633300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:13.638331 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fad50053-b794-4ae8-a3bc-e1ac0445c684 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2953 microversion: 2.32 time: 0.407851 Oct 12 09:10:13.641613 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2980/5533] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:13 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2953 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:13.652270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:13.657946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:13.682849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:13.683785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:13.684464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:13.685458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:13.686140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:13.686770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:13.754216 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06f0e7e7-7f60-4f0d-bdbe-e630d0e442a7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111302 Oct 12 09:10:13.760982 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2981/5534] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:13 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:10:13.857687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:13.858633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:13.872344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:13.873398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:13.877216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:13.878581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:13.879308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:13.879974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:13.909828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:13.932911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:10:14.081015 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2809508-23f3-49a4-ace8-3f3ad4382cd0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 204 len: 0 microversion: 2.1 time: 0.229139 Oct 12 09:10:14.085083 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2982/5535] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:10:13 2022] DELETE /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:10:14.096948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:14.097938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:14.113964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:14.114461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:14.114904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:14.116537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:14.117013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:14.117726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:14.368508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Building network info cache for instance {{(pid=127007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 12 09:10:14.627110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:14.638156 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8ca815ba-fe2d-47bf-9820-3458b85453eb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1680 microversion: 2.1 time: 0.549666 Oct 12 09:10:14.641514 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2983/5536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:14 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1680 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:14.652258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:14.658214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:14.674474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:14.677952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:14.679541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:14.683275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:14.684839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:14.689053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:14.742914 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a5f5515-4b4c-4e1d-98c6-3ea9ce7fe5d1 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099859 Oct 12 09:10:14.743746 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2984/5537] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:10:14 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:10:14.749365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1ab198bf-e80b-4ac5-b4c9-670ec06a76a6 req-6398bf1e-0f73-4e46-93eb-127fd9bf9ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b451f0-75be-42f1-b111-efe92f481438", "tag": "a83a9047-abf9-472f-878a-40c6a24980b9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:14.788694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ab198bf-e80b-4ac5-b4c9-670ec06a76a6 req-6398bf1e-0f73-4e46-93eb-127fd9bf9ee9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:14.789933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ab198bf-e80b-4ac5-b4c9-670ec06a76a6 req-6398bf1e-0f73-4e46-93eb-127fd9bf9ee9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:14.790977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1ab198bf-e80b-4ac5-b4c9-670ec06a76a6 req-6398bf1e-0f73-4e46-93eb-127fd9bf9ee9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:14.823066 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1ab198bf-e80b-4ac5-b4c9-670ec06a76a6 req-6398bf1e-0f73-4e46-93eb-127fd9bf9ee9 service nova] Creating event network-changed:a83a9047-abf9-472f-878a-40c6a24980b9 for instance b5b451f0-75be-42f1-b111-efe92f481438 on n-h1-858383-10 Oct 12 09:10:14.836653 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1ab198bf-e80b-4ac5-b4c9-670ec06a76a6 req-6398bf1e-0f73-4e46-93eb-127fd9bf9ee9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090808 Oct 12 09:10:14.837870 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2985/5538] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:14.843942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:14.844961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:14.852563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:14.853271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:14.854168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:14.861772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:14.864450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:14.864450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:15.309928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:15.324280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:15.327446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:15.334919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a8832883-8532-4e97-beaa-2ee47fd877cd tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2953 microversion: 2.32 time: 0.492449 Oct 12 09:10:15.336040 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2986/5539] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:14 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2953 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:15.345797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:15.347892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:15.365264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:15.366044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:15.367937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:15.368841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:15.373816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:15.374622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:15.456828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:10:15.807621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-998e5f86-e994-40f9-831c-4cd0225f25e7 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 204 len: 0 microversion: 2.1 time: 0.467161 Oct 12 09:10:15.809991 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2987/5540] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:10:15 2022] DELETE /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:10:15.815936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:15.816896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:15.825984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:15.826798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:15.827491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:15.828421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:15.829053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:15.829696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:16.255936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:16.271041 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5864adfb-238c-432e-b22b-f77351ef9dec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1680 microversion: 2.1 time: 0.459502 Oct 12 09:10:16.272220 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2988/5541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:15 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1680 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:16.289392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:16.290425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:16.300342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:16.301090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:16.301995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:16.306063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:16.306816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:16.307446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:16.356505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Updating instance_info_cache with network_info: [{"id": "a83a9047-abf9-472f-878a-40c6a24980b9", "address": "fa:16:3e:3f:5e:59", "network": {"id": "db20ff19-aaa6-4ac8-a95b-8f318e726303", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1697229953-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8673309873b24f8aa5fb718c090802b8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa83a9047-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 12 09:10:16.379505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Releasing lock "refresh_cache-b5b451f0-75be-42f1-b111-efe92f481438" {{(pid=127007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 09:10:16.386361 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-67ffdc31-7f12-44b1-b3a8-07e52bdffecc tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action" status: 202 len: 0 microversion: 2.1 time: 4.875506 Oct 12 09:10:16.395274 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2554/5542] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:10:11 2022] POST /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438/action => generated 0 bytes in 4886 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 12 09:10:16.407795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:16.416732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:16.437596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:16.440364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:16.441686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:16.443974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:16.444702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:16.445707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:16.641079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:16.665862 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f0e8c43-5cee-4c2d-ac3f-a4d4984f5c02 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1675 microversion: 2.1 time: 0.377551 Oct 12 09:10:16.683953 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2989/5543] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:16 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1675 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:16.700043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b7327e7-6615-4aef-a138-fbe34b8d19f3 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '.version_select at 0x7f98488b3af0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:17.101858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:17.136611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:17.148426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:17.149858 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a19c6cb4-fed2-4c6a-b6db-60e58041da04 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2953 microversion: 2.32 time: 0.753378 Oct 12 09:10:17.162960 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2555/5544] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:16 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2953 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:17.303434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:17.304179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:17.314174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:17.322412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:17.324491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:17.326418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:17.332325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:17.333171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:17.916948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:17.926077 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5851b947-bc0b-4c5b-bc73-cdeae5f53ba7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1680 microversion: 2.1 time: 0.630751 Oct 12 09:10:17.938555 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2556/5545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:17 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1680 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:17.943963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:17.945291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:17.958060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:17.958562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:17.959006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:17.959722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:17.960179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:17.960605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:18.643631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:18.651751 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-84dd0b8d-29d1-47ae-a7a3-1e19cfaa0608 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1675 microversion: 2.1 time: 0.711510 Oct 12 09:10:18.662782 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2557/5546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:17 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1675 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:18.691457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:18.695081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:18.709500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:18.715100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:18.715737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:18.716172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:18.716925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:18.719662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:18.721465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:18.972884 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b7327e7-6615-4aef-a138-fbe34b8d19f3 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/d7c8a82e-4be2-48bf-9d3e-18443d362271" status: 202 len: 0 microversion: 2.1 time: 2.287671 Oct 12 09:10:18.973529 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2990/5547] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 09:10:16 2022] DELETE /compute/v2.1/os-floating-ips/d7c8a82e-4be2-48bf-9d3e-18443d362271 => generated 0 bytes in 2289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:10:18.981983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5f48b427-26ca-4754-89bf-9bc47ca95401 req-788b11a7-3dfd-4df5-8f16-3dd2e601f95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-unplugged", "status": "completed", "tag": "0130d9a3-e157-4705-a9b3-ac1d5261648d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:19.012096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5f48b427-26ca-4754-89bf-9bc47ca95401 req-788b11a7-3dfd-4df5-8f16-3dd2e601f95f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:19.015505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5f48b427-26ca-4754-89bf-9bc47ca95401 req-788b11a7-3dfd-4df5-8f16-3dd2e601f95f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:19.016066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5f48b427-26ca-4754-89bf-9bc47ca95401 req-788b11a7-3dfd-4df5-8f16-3dd2e601f95f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:19.040976 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5f48b427-26ca-4754-89bf-9bc47ca95401 req-788b11a7-3dfd-4df5-8f16-3dd2e601f95f service nova] Creating event network-vif-unplugged:0130d9a3-e157-4705-a9b3-ac1d5261648d for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:19.051330 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5f48b427-26ca-4754-89bf-9bc47ca95401 req-788b11a7-3dfd-4df5-8f16-3dd2e601f95f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076465 Oct 12 09:10:19.052912 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2991/5548] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:19.074875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:19.079679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:19.098169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:19.099615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:19.101868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:19.103422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:19.106059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:19.106798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:19.260757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:19.272701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-454abff9-210a-4bb8-b7d4-cc9bec09fe89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1613 microversion: 2.1 time: 0.211579 Oct 12 09:10:19.275900 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2992/5549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:19 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1613 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:19.282540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61e81d82-cf3f-436b-90f2-068b5d1c1fe5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '.version_select at 0x7f9843e99310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:19.600563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:19.623972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:19.625677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:19.634130 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a44a22d6-2528-4b44-ab8c-deaf8c553b26 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2932 microversion: 2.32 time: 0.969883 Oct 12 09:10:19.634738 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2558/5550] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:18 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2932 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:19.676669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:19.677308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:19.696523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:19.697058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:19.697608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:19.698345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:19.698800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:19.699229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:19.780670 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61e81d82-cf3f-436b-90f2-068b5d1c1fe5 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/568514c1-da74-4239-b4a5-5a0716dcc1aa" status: 202 len: 0 microversion: 2.1 time: 0.503628 Oct 12 09:10:19.781840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2993/5551] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 09:10:19 2022] DELETE /compute/v2.1/os-security-groups/568514c1-da74-4239-b4a5-5a0716dcc1aa => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:10:19.794500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:19.795406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:19.806265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:19.807111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:19.807789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:19.809028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:19.810208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:19.811284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:19.864620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:10:20.074470 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6ae4490-dd44-4f4a-b56a-ca1d14efc72e tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 204 len: 0 microversion: 2.1 time: 0.267390 Oct 12 09:10:20.080927 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2994/5552] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:10:19 2022] DELETE /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:10:20.089717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:20.090430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:20.147316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:20.152214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:20.154853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:20.159543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:20.162619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:20.163194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:20.874149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:20.903325 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f90bed2-9847-4ec5-a8c4-321f4f71ba1c tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1511 microversion: 2.1 time: 0.817890 Oct 12 09:10:20.922909 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2995/5553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:20 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1511 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:20.934811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:20.942793 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f549269b-4458-4389-bba3-163aba53fdf3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1675 microversion: 2.1 time: 1.270483 Oct 12 09:10:20.943390 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2559/5554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:19 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1675 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:20.951432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:20.952050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:20.977809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:20.978325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:20.978921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:20.979647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:20.980103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:20.980536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:21.526742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:21.529606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:21.565706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:21.566579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:21.567197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:21.568103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:21.571011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:21.571659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:21.805029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:21.813132 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-272e2824-e8b2-42db-9abb-0201a1a4b57b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 200 len: 1613 microversion: 2.1 time: 0.888632 Oct 12 09:10:21.839587 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2996/5555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:20 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 1613 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:21.852330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-unplugged", "status": "completed", "tag": "5a556884-14af-40aa-be30-df0ee72c6115"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-unplugged", "status": "completed", "tag": "13c27b97-234d-48ad-a8c3-13ec4989dbd3"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-unplugged", "status": "completed", "tag": "d9bc3848-a570-432c-a771-9ea92864ae86"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-unplugged", "status": "completed", "tag": "5edb8f6d-cf43-4ebd-aab9-43212685d426"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-unplugged", "status": "completed", "tag": "06715f80-814d-47a5-9ea1-080893c72f5c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:21.885092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:21.891907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:21.892719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:21.920469 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Creating event network-vif-unplugged:5a556884-14af-40aa-be30-df0ee72c6115 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:21.923719 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Creating event network-vif-unplugged:13c27b97-234d-48ad-a8c3-13ec4989dbd3 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:21.928215 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Creating event network-vif-unplugged:d9bc3848-a570-432c-a771-9ea92864ae86 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:21.928914 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Creating event network-vif-unplugged:5edb8f6d-cf43-4ebd-aab9-43212685d426 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:21.930117 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] Creating event network-vif-unplugged:06715f80-814d-47a5-9ea1-080893c72f5c for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:21.947872 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-344c6387-b730-4468-bdd4-2693d3c9ac80 req-da83d23e-f8b6-4d79-8a7a-e9f9e47a3be5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.106520 Oct 12 09:10:21.961333 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2997/5556] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:21.967049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-592b1bce-91ab-4e35-a950-4dba2d0bafc0 req-2f4cbbc8-a557-45c6-83c7-1c6497a81a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8", "name": "network-vif-deleted", "tag": "53efe0ae-1ebc-4805-b9d0-c0bfbecdaeb4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:22.013001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-592b1bce-91ab-4e35-a950-4dba2d0bafc0 req-2f4cbbc8-a557-45c6-83c7-1c6497a81a0e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:22.013791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-592b1bce-91ab-4e35-a950-4dba2d0bafc0 req-2f4cbbc8-a557-45c6-83c7-1c6497a81a0e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:22.014421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-592b1bce-91ab-4e35-a950-4dba2d0bafc0 req-2f4cbbc8-a557-45c6-83c7-1c6497a81a0e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:22.033376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:22.033931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:22.038082 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-592b1bce-91ab-4e35-a950-4dba2d0bafc0 req-2f4cbbc8-a557-45c6-83c7-1c6497a81a0e service nova] Creating event network-vif-deleted:53efe0ae-1ebc-4805-b9d0-c0bfbecdaeb4 for instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 on n-h2-858383-10 Oct 12 09:10:22.051004 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-592b1bce-91ab-4e35-a950-4dba2d0bafc0 req-2f4cbbc8-a557-45c6-83c7-1c6497a81a0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087895 Oct 12 09:10:22.055104 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2998/5557] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:22.063022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:22.083245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:22.084340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:22.086127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:22.093745 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9e76bd84-2b76-465a-85f1-fbf8fd87c352 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2911 microversion: 2.32 time: 1.146574 Oct 12 09:10:22.098765 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2560/5558] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:20 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2911 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:22.116515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:22.118259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:22.119207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:22.123890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:22.127627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:22.129245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:22.148389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:22.149096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:22.186239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:22.189819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:22.192246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:22.197478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:22.200216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:22.200802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:22.525028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:22.548449 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d329c1c-407e-4948-84aa-980ecfb8d696 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1607 microversion: 2.1 time: 0.436511 Oct 12 09:10:22.559261 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2561/5559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:22 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1607 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:22.848745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:22.849714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:22.864625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:22.867916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:22.869656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:22.871636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:22.873631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:22.874326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:22.911218 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 HTTP/1.1 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8'} Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:22.913037 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:22.918562 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:22.918562 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:22.918562 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:22.918562 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:10:22.918562 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:10:22.918562 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:10:22.918562 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:22.923957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:10:22.925118 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6981ae9f-fe94-4cf6-9344-ed581b7456e2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 404 len: 111 microversion: 2.1 time: 0.087505 Oct 12 09:10:22.932094 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2562/5560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:22 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:10:22.958300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8b40f458-e436-4a99-a100-31f2e180b411 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '.version_select at 0x7f9848b9dc10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:22.989219 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8b40f458-e436-4a99-a100-31f2e180b411 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585665569" status: 202 len: 0 microversion: 2.1 time: 0.055675 Oct 12 09:10:22.989977 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2563/5561] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 09:10:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585665569 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:10:23.091354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:23.113428 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a696b46-aefa-4aaf-9f4c-638d05a7a5a9 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1511 microversion: 2.1 time: 1.056565 Oct 12 09:10:23.117405 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 2999/5562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:22 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1511 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:23.133888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:23.134531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:23.147310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:23.154578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:23.155139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:23.155912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:23.156432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:23.156861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:23.588634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:23.589721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:23.612092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:23.614495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:23.619956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:23.622842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:23.624767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:23.625823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:23.767549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:23.768716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:23.769400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:23.770747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lazy-loading 'fault' on Instance uuid 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:10:23.895477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:23.913691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:23.915441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:23.920048 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-402c09c5-1902-408d-843c-c4b821e49dd4 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2865 microversion: 2.32 time: 0.793903 Oct 12 09:10:23.923533 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2564/5563] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:23 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2865 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:24.152341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-62f1b110-411e-4feb-b9eb-f376694897ba req-2d9a2380-5d9c-4d93-8ced-a336764d8f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bb6b8a-b0bf-43f5-a523-c7f92aca6c89", "name": "network-vif-deleted", "tag": "5bd3a43a-6337-4e95-a3ae-78bbccfeae04"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:24.189177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:24.198004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-62f1b110-411e-4feb-b9eb-f376694897ba req-2d9a2380-5d9c-4d93-8ced-a336764d8f28 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:24.198865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-62f1b110-411e-4feb-b9eb-f376694897ba req-2d9a2380-5d9c-4d93-8ced-a336764d8f28 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:24.199301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-62f1b110-411e-4feb-b9eb-f376694897ba req-2d9a2380-5d9c-4d93-8ced-a336764d8f28 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:24.201339 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bd204f50-a23d-4e35-a6bd-15490d5490de tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 200 len: 1328 microversion: 2.1 time: 0.617978 Oct 12 09:10:24.210440 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3000/5564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:23 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 1328 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:24.237579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:24.238761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:24.246287 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-62f1b110-411e-4feb-b9eb-f376694897ba req-2d9a2380-5d9c-4d93-8ced-a336764d8f28 service nova] Creating event network-vif-deleted:5bd3a43a-6337-4e95-a3ae-78bbccfeae04 for instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 on n-h1-858383-10 Oct 12 09:10:24.264466 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-62f1b110-411e-4feb-b9eb-f376694897ba req-2d9a2380-5d9c-4d93-8ced-a336764d8f28 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111864 Oct 12 09:10:24.266691 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2565/5565] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:24.286932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:24.294555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:24.298954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:24.302086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:24.308901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:24.310535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:24.957162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:24.960523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:24.982661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:24.983169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:24.984170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:24.984383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:24.984762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:24.992426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:25.448948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:25.470654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:25.471022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:25.473720 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed9b3aa0-d383-4bd2-b648-f6e8dfdee4b9 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2865 microversion: 2.32 time: 0.521633 Oct 12 09:10:25.501585 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2566/5566] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:24 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2865 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:25.516672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05770163-d566-4ef5-abd0-86a035801c87 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: .version_select at 0x7f9848cbcb80>, body: {"keypair": {"name": "tempest-keypair-1608012977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGcE6cwbnIeYlD5yn9Z+TIQ3F2s1na5pZVSTpq+j35nSKUeyAMPD/kNjFlrkWLervuzj1ICbQUXZG2gOkWs6EnyzbAEBTczJ0LATzQnaZZKkZmJKOwgj94U+oJFV19+1Q=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:25.549078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-05770163-d566-4ef5-abd0-86a035801c87 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:10:25.565310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-05770163-d566-4ef5-abd0-86a035801c87 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for user d9531ada325c4b868f3bcd62331ab827 and project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:10:25.605881 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05770163-d566-4ef5-abd0-86a035801c87 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102455 Oct 12 09:10:25.607353 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2567/5567] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:10:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:25.626630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:25.627382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:25.649594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:25.651246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:25.656952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:25.658559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:25.659699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:25.662304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:25.716730 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] HTTP exception thrown: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Request method failure captured: Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 HTTP/1.1 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoOhpWX5N8Hcfw2TFn8mPz9PiEnUPir8X6AOJMuIgrkJL5GppRyqV1E6Lkk7L4v1Z7nqwRORYmfIXOLQb8pL_qjMVRRjUrIrARmjnFntI0hY9F8CoKNoHbaVT-QAhyOR1dDvlL9z0-L89cHSn10TRbs6UXb3kVr5gRyZXibd8af-_-U Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}] Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f8ec618a633f454791d5989610c839ed Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '04bb6b8a-b0bf-43f5-a523-c7f92aca6c89'} Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:25.721855 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:25.727606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:25.727606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:25.727606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:25.727606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:10:25.727606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:10:25.727606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:10:25.727606 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:10:25.731487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Returning 404 to user: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:10:25.732686 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b9eb543-163c-48f8-854c-24a90c393a94 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 404 len: 111 microversion: 2.1 time: 0.124074 Oct 12 09:10:25.738314 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2568/5568] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:25 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:10:25.748338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-01db401f-6ecf-4c63-ba08-93e0aba9d464 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '.version_select at 0x7f9848b9d310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:25.787159 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-01db401f-6ecf-4c63-ba08-93e0aba9d464 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512472017" status: 202 len: 0 microversion: 2.1 time: 0.047243 Oct 12 09:10:25.798527 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2569/5569] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 09:10:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512472017 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:10:25.955677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:25.970246 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2067ce46-ad83-4a64-affb-fc7ed2c261e2 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1469 microversion: 2.1 time: 1.758291 Oct 12 09:10:25.975139 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3001/5570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:24 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1469 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:25.992370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b82fb763-60ce-4280-b8eb-73f764dca4d5 req-2ec762e7-8482-418a-bd4b-adb82d69044c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-deleted", "tag": "06715f80-814d-47a5-9ea1-080893c72f5c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:26.015616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b82fb763-60ce-4280-b8eb-73f764dca4d5 req-2ec762e7-8482-418a-bd4b-adb82d69044c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:26.018050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b82fb763-60ce-4280-b8eb-73f764dca4d5 req-2ec762e7-8482-418a-bd4b-adb82d69044c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:26.021067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b82fb763-60ce-4280-b8eb-73f764dca4d5 req-2ec762e7-8482-418a-bd4b-adb82d69044c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:26.056541 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b82fb763-60ce-4280-b8eb-73f764dca4d5 req-2ec762e7-8482-418a-bd4b-adb82d69044c service nova] Creating event network-vif-deleted:06715f80-814d-47a5-9ea1-080893c72f5c for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:26.097124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b82fb763-60ce-4280-b8eb-73f764dca4d5 req-2ec762e7-8482-418a-bd4b-adb82d69044c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107375 Oct 12 09:10:26.099800 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2570/5571] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:26.508224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:26.509169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:26.521817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:26.522643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:26.524143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:26.528348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:26.529874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:26.530821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:27.001027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:27.001762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:27.028337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:27.035402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:27.036101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:27.042507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:27.048011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:27.049008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:27.184796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:27.192868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:27.195692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:27.196184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lazy-loading 'fault' on Instance uuid b5b451f0-75be-42f1-b111-efe92f481438 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:10:27.354639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c384d54b214325a005f53899826f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8673309873b24f8aa5fb718c090802b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:27.376152 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c48b24a2-cd37-4f6b-98a0-3eaf1e4d1a0b tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 200 len: 1313 microversion: 2.1 time: 0.376235 Oct 12 09:10:27.379712 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2571/5572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:26 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:27.445353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:27.470101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:27.484267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:27.487889 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95047c8b-db6e-4542-a2b0-73c23bbfb0bc tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2578 microversion: 2.32 time: 0.981958 Oct 12 09:10:27.489145 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3002/5573] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:26 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2578 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:28.150941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f233a77f-ede1-4e19-9a00-0f74a9fdad4a req-011557ff-34dc-4b1a-be18-540d97d31422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b451f0-75be-42f1-b111-efe92f481438", "name": "network-vif-deleted", "tag": "a83a9047-abf9-472f-878a-40c6a24980b9"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-deleted", "tag": "5edb8f6d-cf43-4ebd-aab9-43212685d426"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:28.176859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f233a77f-ede1-4e19-9a00-0f74a9fdad4a req-011557ff-34dc-4b1a-be18-540d97d31422 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:28.177352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f233a77f-ede1-4e19-9a00-0f74a9fdad4a req-011557ff-34dc-4b1a-be18-540d97d31422 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:28.179582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f233a77f-ede1-4e19-9a00-0f74a9fdad4a req-011557ff-34dc-4b1a-be18-540d97d31422 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:28.232575 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f233a77f-ede1-4e19-9a00-0f74a9fdad4a req-011557ff-34dc-4b1a-be18-540d97d31422 service nova] Creating event network-vif-deleted:a83a9047-abf9-472f-878a-40c6a24980b9 for instance b5b451f0-75be-42f1-b111-efe92f481438 on n-h1-858383-10 Oct 12 09:10:28.233001 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f233a77f-ede1-4e19-9a00-0f74a9fdad4a req-011557ff-34dc-4b1a-be18-540d97d31422 service nova] Creating event network-vif-deleted:5edb8f6d-cf43-4ebd-aab9-43212685d426 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:28.269745 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f233a77f-ede1-4e19-9a00-0f74a9fdad4a req-011557ff-34dc-4b1a-be18-540d97d31422 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.122595 Oct 12 09:10:28.270369 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2572/5574] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:28.401789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:28.402728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] [instance: b5b451f0-75be-42f1-b111-efe92f481438] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:28.417601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:28.419489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:28.420376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:28.422892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:28.423590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:28.425624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:28.460970 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] HTTP exception thrown: Instance b5b451f0-75be-42f1-b111-efe92f481438 could not be found. Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Request method failure captured: Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 HTTP/1.1 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoQ3V74iOISI-DwIsiRFPDOx_LZyjl990MqHiLugLL6aHFFeRXPI0cHqykXM3iZDn6y7yMMbTxs-AkmGlC5hNvl-LB27at8Z6iIq3VSW-gVovb45R9a_9sUwGO0MITD2QrX3r4X-ZUBb4mqJ9oYB4BXp5Y1mHsiGc5Y3ZG952Fm0ZEI Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8673309873b24f8aa5fb718c090802b8 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2123246705 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8673309873b24f8aa5fb718c090802b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8673309873b24f8aa5fb718c090802b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8673309873b24f8aa5fb718c090802b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8673309873b24f8aa5fb718c090802b8"}]}] Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2123246705 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8673309873b24f8aa5fb718c090802b8 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2123246705 Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerRescueTestJSONUnderV235-2123246705-project Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 91c384d54b214325a005f53899826f4e Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2123246705-project Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance b5b451f0-75be-42f1-b111-efe92f481438 could not be found. Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'b5b451f0-75be-42f1-b111-efe92f481438'} Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b451f0-75be-42f1-b111-efe92f481438 could not be found. Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b451f0-75be-42f1-b111-efe92f481438 could not be found. Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:28.464454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:10:28.468839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:28.468839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:10:28.468839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:10:28.468839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:10:28.468839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:10:28.468839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:10:28.468839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b451f0-75be-42f1-b111-efe92f481438 could not be found. Oct 12 09:10:28.468839 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:10:28.471192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] Returning 404 to user: Instance b5b451f0-75be-42f1-b111-efe92f481438 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:10:28.472297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2cc32167-94b4-4b5f-a764-179c8e43f628 tempest-ServerRescueTestJSONUnderV235-2123246705 tempest-ServerRescueTestJSONUnderV235-2123246705-project] 10.222.0.40 "GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438" status: 404 len: 111 microversion: 2.1 time: 0.076092 Oct 12 09:10:28.477624 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3003/5575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:28 2022] GET /compute/v2.1/servers/b5b451f0-75be-42f1-b111-efe92f481438 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:10:28.525659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:28.526505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:28.538610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:28.541807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:28.542389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:28.543858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:28.545244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:28.550027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:29.842089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:29.852355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:29.863067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:29.867485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:29.871415 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b93c332-0a6a-49e3-90d4-6988e235d8ca tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2418 microversion: 2.32 time: 1.351052 Oct 12 09:10:29.873707 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2573/5576] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:28 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2418 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:29.986089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2e627b4-3af8-44a8-bd07-04a966643c4f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'create', calling method: .version_select at 0x7f9843e99ee0>, body: {"keypair": {"name": "tempest-keypair-366402146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfZ1TOXXxZfHUH64r2SpL9ZK8XMRqrkMJei/7u8JNvVCRtF0OFCu/4CU/n3L8rBg1UkEKmjiWpgKGvSzyWrELehHkDNpXptcxct9qcejH0NaPpmsmpqLepeNOszFno1CA=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:30.031044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d2e627b4-3af8-44a8-bd07-04a966643c4f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Getting quotas for project dba422df2993458fbdf1c11f80e605c5. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:10:30.045944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d2e627b4-3af8-44a8-bd07-04a966643c4f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Getting quotas for user f8ec618a633f454791d5989610c839ed and project dba422df2993458fbdf1c11f80e605c5. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:10:30.098247 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2e627b4-3af8-44a8-bd07-04a966643c4f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116199 Oct 12 09:10:30.105557 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3004/5577] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:10:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:30.308433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4abde161-0396-420d-80d7-896f6e2c5b7e req-961b7850-d52c-4d1c-b530-169c96d1312e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-deleted", "tag": "13c27b97-234d-48ad-a8c3-13ec4989dbd3"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:30.328820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4abde161-0396-420d-80d7-896f6e2c5b7e req-961b7850-d52c-4d1c-b530-169c96d1312e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:30.329321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4abde161-0396-420d-80d7-896f6e2c5b7e req-961b7850-d52c-4d1c-b530-169c96d1312e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:30.329790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4abde161-0396-420d-80d7-896f6e2c5b7e req-961b7850-d52c-4d1c-b530-169c96d1312e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:30.377401 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4abde161-0396-420d-80d7-896f6e2c5b7e req-961b7850-d52c-4d1c-b530-169c96d1312e service nova] Creating event network-vif-deleted:13c27b97-234d-48ad-a8c3-13ec4989dbd3 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:30.390273 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4abde161-0396-420d-80d7-896f6e2c5b7e req-961b7850-d52c-4d1c-b530-169c96d1312e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083436 Oct 12 09:10:30.390967 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2574/5578] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:30.904696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:30.905432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:30.915436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:30.924057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:30.924841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:30.925866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:30.926467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:30.927016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:31.522864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:31.535190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:31.542672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:31.547110 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1ff32348-2f69-4f7d-a0fb-a3fd5b272b9c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 2168 microversion: 2.32 time: 0.646711 Oct 12 09:10:31.548637 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3005/5579] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:30 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 2168 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:32.453892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-eded7f4c-281c-49e0-ace7-3e2f21e59ef3 req-b0093d7b-1d04-4aa1-a945-ef44dc1e74bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-deleted", "tag": "0130d9a3-e157-4705-a9b3-ac1d5261648d"}, {"server_uuid": "04b7c698-857c-44ed-baa8-b13ecfdd15bf", "name": "network-vif-deleted", "tag": "d9bc3848-a570-432c-a771-9ea92864ae86"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:32.496620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-eded7f4c-281c-49e0-ace7-3e2f21e59ef3 req-b0093d7b-1d04-4aa1-a945-ef44dc1e74bf service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:32.500309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-eded7f4c-281c-49e0-ace7-3e2f21e59ef3 req-b0093d7b-1d04-4aa1-a945-ef44dc1e74bf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:32.502339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-eded7f4c-281c-49e0-ace7-3e2f21e59ef3 req-b0093d7b-1d04-4aa1-a945-ef44dc1e74bf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:32.523481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-606331075", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1fd12de-772c-4409-a55a-e4329af851c8"}], "security_groups": [{"name": "tempest-securitygroup--2045279564"}], "key_name": "tempest-keypair-1608012977", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:32.579146 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-eded7f4c-281c-49e0-ace7-3e2f21e59ef3 req-b0093d7b-1d04-4aa1-a945-ef44dc1e74bf service nova] Creating event network-vif-deleted:0130d9a3-e157-4705-a9b3-ac1d5261648d for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:32.579893 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-eded7f4c-281c-49e0-ace7-3e2f21e59ef3 req-b0093d7b-1d04-4aa1-a945-ef44dc1e74bf service nova] Creating event network-vif-deleted:d9bc3848-a570-432c-a771-9ea92864ae86 for instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf on n-h2-858383-10 Oct 12 09:10:32.625372 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-eded7f4c-281c-49e0-ace7-3e2f21e59ef3 req-b0093d7b-1d04-4aa1-a945-ef44dc1e74bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.172349 Oct 12 09:10:32.626072 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2575/5580] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:32.669370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:32.670782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:32.704271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:32.710883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:32.713688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:32.714747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:32.718050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:32.720817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:32.973764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:32.988135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:32.989522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:32.990729 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5e3ae69f-f8d4-4c97-9df4-67f934feee7d tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.336318 Oct 12 09:10:32.991452 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2576/5581] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:32 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:33.133596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] validate_networks() for [('b1fd12de-772c-4409-a55a-e4329af851c8', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:10:33.895442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:34.037431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:34.038054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:34.069712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:34.075503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:34.080713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:34.083635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:34.084626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:34.092153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:34.752051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:34.775356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:34.776818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:34.778061 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9126fba1-c170-4799-94e5-7d1ad61ef6e1 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.761491 Oct 12 09:10:34.802419 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2577/5582] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:34 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:34.876649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:10:34.877070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:10:34.877568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:10:34.877975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:10:34.878398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:10:34.903598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:34.907715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:34.908480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:34.910360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:34.912584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:34.914824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:34.963998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:10:34.989773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Getting quotas for user d9531ada325c4b868f3bcd62331ab827 and project 9524a43c39d444e48cdc56d7e7ffef45. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:10:35.040789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:10:35.057270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:10:35.236102 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-429081a8-9154-464a-86f1-59be9bf2cc2e tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.717090 Oct 12 09:10:35.241531 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3006/5583] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:10:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:10:35.250025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c5fee47-dc0b-4878-a374-b03daaf6d4a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:35.252158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c5fee47-dc0b-4878-a374-b03daaf6d4a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:35.462615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-732168565", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17452c7f-90ad-4bcf-b31a-147277f04ea4"}], "security_groups": [{"name": "tempest-securitygroup--201302881"}], "key_name": "tempest-keypair-366402146", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:35.501213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c5fee47-dc0b-4878-a374-b03daaf6d4a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:35.511382 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c5fee47-dc0b-4878-a374-b03daaf6d4a0 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1241 microversion: 2.1 time: 0.264939 Oct 12 09:10:35.516071 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2578/5584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:35 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1241 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:35.811604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:35.812635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:35.827057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:35.832103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:35.832293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] validate_networks() for [('17452c7f-90ad-4bcf-b31a-147277f04ea4', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:10:35.832895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:35.843712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:35.846034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:35.847234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:36.105958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:36.126963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:36.128419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:36.129675 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bfd9e218-9382-4eaa-b17e-d9a6c551f05f tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.322697 Oct 12 09:10:36.130260 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2579/5585] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:35 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:10:36.542211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f3e97f7c-354c-4ce7-9040-a9769c0f0c1b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:36.542836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f3e97f7c-354c-4ce7-9040-a9769c0f0c1b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:36.675777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f3e97f7c-354c-4ce7-9040-a9769c0f0c1b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:36.685703 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f3e97f7c-354c-4ce7-9040-a9769c0f0c1b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1241 microversion: 2.1 time: 0.149314 Oct 12 09:10:36.690213 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2580/5586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:36 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:37.158977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:37.159591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:37.173593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:37.174835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:37.175284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:37.177234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:37.177733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:37.179899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:37.274936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:37.291146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:37.292962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:37.295044 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eaaf1eac-8386-4eb3-949f-4eba434a2909 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.139912 Oct 12 09:10:37.311169 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2581/5587] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:37 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:10:37.714918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:37.715625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:37.729713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:37.730363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:37.733396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:37.735628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:37.737501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:37.739389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:37.947210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:37.974559 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37f6a6e9-6231-47c5-b849-c293fadb9401 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1237 microversion: 2.1 time: 0.260925 Oct 12 09:10:37.979636 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2582/5588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:37 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1237 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:38.036083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:10:38.037662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:10:38.038401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:10:38.040009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:10:38.040636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:10:38.066199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:38.066956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:38.068132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:38.070886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:38.071579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:38.072872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:38.141262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Getting quotas for project dba422df2993458fbdf1c11f80e605c5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:10:38.173508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Getting quotas for user f8ec618a633f454791d5989610c839ed and project dba422df2993458fbdf1c11f80e605c5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:10:38.216041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:10:38.228287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:10:38.327135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:38.327957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:38.341817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:38.342753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:38.346100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:38.347315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:38.348353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:38.349950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:38.369604 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1e3cc8f7-afd9-4262-9488-30179bbfdb6d tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.912167 Oct 12 09:10:38.375922 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3007/5589] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:10:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 2919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:10:38.402769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d2b524ae-33b9-481d-9683-2df69b2300fe tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:38.403402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d2b524ae-33b9-481d-9683-2df69b2300fe tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:38.602673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:38.625538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:38.632697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:38.634415 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7004df5-d06d-4f77-8e79-ba609810b227 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.311306 Oct 12 09:10:38.638546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2583/5590] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:38 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:38.639378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d2b524ae-33b9-481d-9683-2df69b2300fe tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:38.691167 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d2b524ae-33b9-481d-9683-2df69b2300fe tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1236 microversion: 2.1 time: 0.287318 Oct 12 09:10:38.701207 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3008/5591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:38 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1236 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:39.003055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:39.003741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:39.032365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:39.037246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:39.038208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:39.047983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:39.048555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:39.054751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:39.483929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d04718d7-15d1-4464-8a09-f0c4f0f6b5b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Action: 'create', calling method: .version_select at 0x7f984881f550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2097222838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi9bCx4jNvLNAZyvcff5LmdXgYr0yrG5eCNG6c8y1j9p0WJj8DH/dIxURSxZgK2Iv3u1NNyYGh0RAG7cFLbBipyyN78OAAyLjMuS8P0LnCxtabq+R9sudY8NYbxF92TrQ=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:39.522897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d04718d7-15d1-4464-8a09-f0c4f0f6b5b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Getting quotas for project dae3fa763c174899bd7caff7453f3de8. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:10:39.562188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d04718d7-15d1-4464-8a09-f0c4f0f6b5b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Getting quotas for user 4d4a1b8ae1f94acca3723e99355aba38 and project dae3fa763c174899bd7caff7453f3de8. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:10:39.606412 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d04718d7-15d1-4464-8a09-f0c4f0f6b5b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.965856 Oct 12 09:10:39.616218 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2584/5592] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:10:38 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:39.684171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:39.686230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:39.696355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:39.702267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:39.705474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:39.706410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:39.708915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:39.710948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:40.039400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:40.049912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:40.051453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:40.079056 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-229c1669-7790-43b5-a7e7-37167333372c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.400065 Oct 12 09:10:40.094009 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2585/5593] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:39 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:10:40.130947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:40.131807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:40.175240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:40.175757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:40.182794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:40.187702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:40.191761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:40.196926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:40.638296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:40.648154 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e43eb9fe-bf9f-4687-bca8-8490838f04f6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1232 microversion: 2.1 time: 0.550172 Oct 12 09:10:40.653614 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2586/5594] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:40 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1232 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:40.704731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:40.715003 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-872d6578-fca4-49f6-91db-dd092bf7f90c tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1311 microversion: 2.1 time: 1.718225 Oct 12 09:10:40.736103 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3009/5595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:38 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1311 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:41.108896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:41.109769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:41.118402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:41.120121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:41.122662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:41.125922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:41.127042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:41.128150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:41.359744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:41.375885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:41.379455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:41.385355 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-003e1ddf-81bf-44db-a90b-ef6f5e51c07c tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.279421 Oct 12 09:10:41.388244 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2587/5596] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:41 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:41.689526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:41.690303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:41.707934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:41.710993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:41.713167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:41.715993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:41.719996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:41.720682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:41.748721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:41.751674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:41.764991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:41.766216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:41.768300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:41.769231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:41.772796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:41.773719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:41.934832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:41.950221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:41.959475 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b690e1a0-91ec-462c-827d-80a3bb4591e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1294 microversion: 2.1 time: 0.282772 Oct 12 09:10:41.962995 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-43fe43bf-ef53-4d05-94c9-fb4d9263eb40 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1299 microversion: 2.1 time: 0.224629 Oct 12 09:10:41.973469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3010/5597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:41 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1294 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:41.986178 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2588/5598] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:41 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1299 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:42.419172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:42.420170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:42.432017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:42.433396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:42.434916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:42.436577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:42.438844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:42.441723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:42.831188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:42.868535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:42.879727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:42.886773 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-921827d0-fa6c-42f2-9a93-ea56e0a9a24e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.468418 Oct 12 09:10:42.887467 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3011/5599] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:42 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:42.995636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:42.996255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:43.001081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:43.001989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:43.015962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:43.030314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:43.031231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:43.031739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:43.032194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:43.032929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:43.033387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:43.033943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:43.035215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:43.035689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:43.036127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:43.037691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:43.780225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:43.801895 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cb367658-6303-4cff-b688-cbf1e003e886 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1294 microversion: 2.1 time: 0.805219 Oct 12 09:10:43.807796 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2589/5600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:42 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1294 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:43.899650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:43.908930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-702d01d6-9dfd-44c8-b170-c00c2b1009a9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 0.918604 Oct 12 09:10:43.913279 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3012/5601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:42 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:43.929709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:43.930799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:43.943785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:43.944646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:43.946222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:43.947362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:43.949966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:43.952632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:44.342037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:44.368256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:44.374799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:44.379448 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9a2fa0ee-fbed-449d-85c8-febae1e8e604 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.461816 Oct 12 09:10:44.397631 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2590/5602] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:43 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:44.830817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:44.831928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:44.848294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:44.849337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:44.852840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:44.854938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:44.856179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:44.858009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:44.944813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:44.945986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:44.968387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:44.971246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:44.973092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:44.974766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:44.976333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:44.982280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:45.350748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:45.366197 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5e7cf115-a00a-4af3-924a-438251e1574a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 0.424671 Oct 12 09:10:45.378230 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2591/5603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:44 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:45.411390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:45.412384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:45.424359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:45.429100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:45.429808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:45.430770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:45.432002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:45.433885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:45.590901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:45.608853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:45.614436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:45.616072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-76717734-d6a3-4d49-b792-93d1d1f5f2a2 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.210324 Oct 12 09:10:45.620838 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2592/5604] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:45 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:10:46.010202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c3e1f4b5-d9dd-447d-96a8-182feb6834e3 req-86afb18a-af66-4d56-ad30-64165a6e4075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4560c0f5-8d33-4495-a3c6-5597b176a35d", "tag": "edbc1528-772b-4e7c-95cd-5f20ce270c47"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:46.030183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:46.039593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c3e1f4b5-d9dd-447d-96a8-182feb6834e3 req-86afb18a-af66-4d56-ad30-64165a6e4075 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:46.041618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c3e1f4b5-d9dd-447d-96a8-182feb6834e3 req-86afb18a-af66-4d56-ad30-64165a6e4075 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:46.042398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c3e1f4b5-d9dd-447d-96a8-182feb6834e3 req-86afb18a-af66-4d56-ad30-64165a6e4075 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:46.074463 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c3e1f4b5-d9dd-447d-96a8-182feb6834e3 req-86afb18a-af66-4d56-ad30-64165a6e4075 service nova] Creating event network-changed:edbc1528-772b-4e7c-95cd-5f20ce270c47 for instance 4560c0f5-8d33-4495-a3c6-5597b176a35d on n-h1-858383-10 Oct 12 09:10:46.086417 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c3e1f4b5-d9dd-447d-96a8-182feb6834e3 req-86afb18a-af66-4d56-ad30-64165a6e4075 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076923 Oct 12 09:10:46.089271 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2593/5605] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:10:46.103817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:46.119566 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a51ff7c1-e9fe-43a2-8b3b-3637a59dc866 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 1.295454 Oct 12 09:10:46.121100 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3013/5606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:44 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:46.392338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:46.393206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:46.410963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:46.411633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:46.412161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:46.412974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:46.415562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:46.417117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:46.648949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:46.649841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:46.662145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:46.670379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:46.671044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:46.672048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:46.674376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:46.679671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:46.842875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:46.863465 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-092e4a12-0d67-4a64-93fe-7f56392a0b90 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 0.475755 Oct 12 09:10:46.877760 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2594/5607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:46 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:47.144055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:47.144962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:47.176184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:47.180927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:47.182228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:47.193176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:47.196133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:47.196630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:47.205613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:47.212731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:47.220062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:47.233704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4db97e3a-4f42-44b4-862a-2d041ce44e2b tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.582250 Oct 12 09:10:47.241844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3014/5608] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:46 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:47.256890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:47.888584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:47.889268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:47.902039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:47.902532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:47.905967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:47.906747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:47.907196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:47.907633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:48.132010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:48.319056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:48.337564 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3dc8677d-f0be-4123-8d1f-0d5660df20fb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 1.198014 Oct 12 09:10:48.353527 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2595/5609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:47 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:48.365119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:48.365798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:48.394858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:48.396345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:48.396839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:48.401668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:48.402218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:48.402680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:48.658889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=18 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:48.684728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:48.706415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:48.710629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:48.714565 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7d3d385b-a0f8-48a7-b061-6e757442ca48 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.364910 Oct 12 09:10:48.715378 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2596/5610] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:48 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:49.358670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:49.370977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:49.371608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:49.383935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:49.384701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-afda5da5-3c7d-4233-8a4b-3b0da7533fb9 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 1.494152 Oct 12 09:10:49.397937 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3015/5611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:47 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:49.398997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:49.403259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:49.404475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:49.405106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:49.405780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:49.572722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=12 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:49.745757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:49.746983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:49.764785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:49.765399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:49.765903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:49.775021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:49.779011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:49.781405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:50.090384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:50.107539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:50.109828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:50.113740 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-62369d10-d55e-4fee-aa67-dbd427f3794e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.373266 Oct 12 09:10:50.117572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3016/5612] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:49 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:10:50.315754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:50.335950 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-325b69e6-dabe-44d6-b037-a53b6904c876 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 0.968825 Oct 12 09:10:50.339727 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2597/5613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:49 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:50.411284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:50.412038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:50.426577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:50.432585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:50.433599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:50.435695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:50.444749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:50.445255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:51.146377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:51.147546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:51.169404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:51.181217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:51.182382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:51.184217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:51.186577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:51.188275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:51.374962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:51.404251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:51.407551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:51.412555 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-06d6d633-cc0e-4433-9e53-c80eb62e183e tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.271356 Oct 12 09:10:51.414065 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2598/5614] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:51 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:51.420958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:51.433334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:51.456773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:51.460573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:51.461091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:51.463835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:51.464327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:51.464871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:51.483664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:51.493614 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e1a46462-c49a-4323-88ec-09240c82918b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 1.086355 Oct 12 09:10:51.494280 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3017/5615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:50 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:51.826844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:51.848962 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba34daf6-35cf-4d8b-8f13-ad0c05290beb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 0.433488 Oct 12 09:10:51.851891 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2599/5616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:51 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:52.445358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:52.446701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:52.465142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:52.468204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:52.468833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:52.471216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:52.471909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:52.472518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:52.503210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=94 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:10:52.520819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:52.521605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:52.536407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:52.545903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:52.552311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:52.563020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:52.563972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:52.564633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:53.575128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:53.584067 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-adf64d46-8d20-45ff-a828-60546d9a3143 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 1.067408 Oct 12 09:10:53.621466 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2600/5617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:52 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:53.628047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9b4af12e-84a2-4f03-bf4c-9e3ab1734fda req-9b2fcc07-62e4-4f50-8bdb-712f86abb91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f90057-6208-4a50-b0d3-e2060bf816d1", "tag": "8c3d9e5d-195e-45ee-b961-d42a948d23b1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:53.670303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9b4af12e-84a2-4f03-bf4c-9e3ab1734fda req-9b2fcc07-62e4-4f50-8bdb-712f86abb91d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:53.674173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9b4af12e-84a2-4f03-bf4c-9e3ab1734fda req-9b2fcc07-62e4-4f50-8bdb-712f86abb91d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:53.676612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9b4af12e-84a2-4f03-bf4c-9e3ab1734fda req-9b2fcc07-62e4-4f50-8bdb-712f86abb91d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:53.724804 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9b4af12e-84a2-4f03-bf4c-9e3ab1734fda req-9b2fcc07-62e4-4f50-8bdb-712f86abb91d service nova] Creating event network-changed:8c3d9e5d-195e-45ee-b961-d42a948d23b1 for instance c2f90057-6208-4a50-b0d3-e2060bf816d1 on n-h2-858383-10 Oct 12 09:10:53.764567 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9b4af12e-84a2-4f03-bf4c-9e3ab1734fda req-9b2fcc07-62e4-4f50-8bdb-712f86abb91d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142847 Oct 12 09:10:53.768361 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2601/5618] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:53.782687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:53.787888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:53.805750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:53.807981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:53.809153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:53.812062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:53.813850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:53.814620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:54.170188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:54.181251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:54.191339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:54.192699 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b565c605-3985-442d-bd5c-76c0f0f38e77 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 1.752300 Oct 12 09:10:54.193334 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3018/5619] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:52 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:54.635616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:54.636419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:54.644356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:54.655950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:54.656651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:54.657697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:54.658303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:54.659821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:55.146903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:55.167885 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4d22796-4352-4213-9897-fa6e5591bd41 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 1.393461 Oct 12 09:10:55.182867 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2602/5620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:53 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:55.220013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:55.220636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:55.241313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:55.243436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:55.243807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:55.247561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:55.250249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:55.250926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:55.439902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:55.454917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:55.467885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:55.469068 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b761681a-e2dc-49b7-a2b9-a1186cfcac40 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.253907 Oct 12 09:10:55.469668 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2603/5621] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:55 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:10:56.203501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:56.204878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:56.215022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:56.216558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:56.217621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:56.218536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:56.219173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:56.219802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:56.582125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:56.590500 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a35f8fe-9e2a-4d6f-910e-9ea71bdd6c88 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 1.958770 Oct 12 09:10:56.605675 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3019/5622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:54 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:56.609341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:56.622429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:56.636424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:56.638350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:56.638997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:56.640934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:56.642404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:56.645334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:56.751205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:56.759744 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b058e8f8-c0c3-4f3d-ad69-976fef51ba79 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 0.564899 Oct 12 09:10:56.780655 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2604/5623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:56 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:56.995573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:57.006453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:57.023195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:57.027121 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6f70d204-5679-481d-81db-0f62d1fa1ed6 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.431171 Oct 12 09:10:57.030085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3020/5624] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:56 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:57.615170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:57.615887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:57.631548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:57.632691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:57.636598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:57.637603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:57.638247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:57.638963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:57.796154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:57.798147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:57.814660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:57.817973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:57.823021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:57.825327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:57.827395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:57.829723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:58.079236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:58.098906 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d612cce5-2f4c-4aaa-9152-6a28e0ecfd89 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 0.486051 Oct 12 09:10:58.103099 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2605/5625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:57 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:10:58.117004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:58.119541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:58.152041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:58.154377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:58.158238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:58.161745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:58.164801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:58.166832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:58.546277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:58.563076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:58.567160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:58.569354 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-423385de-9009-4f7a-8686-039ace63e285 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.464082 Oct 12 09:10:58.572680 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2606/5626] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:10:58 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:10:58.801472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:10:58.850166 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f9b51ec-d3d3-4292-bad1-0016c4c476dd tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 1.048100 Oct 12 09:10:58.855769 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3021/5627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:57 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:10:58.948254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b6350111-3b63-4be3-b588-ae69c54f9020 req-48c6b61a-a48d-4ae4-97e3-f353ccbb2556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4560c0f5-8d33-4495-a3c6-5597b176a35d", "name": "network-vif-plugged", "status": "completed", "tag": "edbc1528-772b-4e7c-95cd-5f20ce270c47"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:58.974334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6350111-3b63-4be3-b588-ae69c54f9020 req-48c6b61a-a48d-4ae4-97e3-f353ccbb2556 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:58.979998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6350111-3b63-4be3-b588-ae69c54f9020 req-48c6b61a-a48d-4ae4-97e3-f353ccbb2556 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:58.983701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b6350111-3b63-4be3-b588-ae69c54f9020 req-48c6b61a-a48d-4ae4-97e3-f353ccbb2556 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:59.032465 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b6350111-3b63-4be3-b588-ae69c54f9020 req-48c6b61a-a48d-4ae4-97e3-f353ccbb2556 service nova] Creating event network-vif-plugged:edbc1528-772b-4e7c-95cd-5f20ce270c47 for instance 4560c0f5-8d33-4495-a3c6-5597b176a35d on n-h1-858383-10 Oct 12 09:10:59.058872 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b6350111-3b63-4be3-b588-ae69c54f9020 req-48c6b61a-a48d-4ae4-97e3-f353ccbb2556 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.479921 Oct 12 09:10:59.061888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2607/5628] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:10:59.125337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:10:59.126307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:10:59.148835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:59.152093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:59.156309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:59.157807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:10:59.161881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:10:59.162561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:10:59.288713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-540091167-access_point-580331726", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "0b8a16fb-1fc5-42f6-833c-4e273a438f1d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2097222838", "security_groups": [{"name": "tempest-secgroup_access--1020710229"}, {"name": "tempest-secgroup_general--1758278071"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:10:59.840113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] validate_networks() for [('0b8a16fb-1fc5-42f6-833c-4e273a438f1d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:11:00.767822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:00.784606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f77de39-d6de-4648-bbd8-8bbbaa9034ff tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 1.661417 Oct 12 09:11:00.788418 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3022/5629] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:10:59 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:00.803687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:00.809795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:00.827249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:00.831216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:00.832223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:00.834282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:00.837761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:00.840879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:00.948810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:00.963503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:00.966022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:00.982425 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-41b19440-7eaf-4c42-86ef-5579f6c23054 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.178457 Oct 12 09:11:01.010688 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3023/5630] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:00 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:01.020879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:01.022301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:01.038916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:01.042949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:01.045357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:01.048423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:01.049105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:01.049784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:01.238585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:01.250029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a582aa01-5fe0-4593-bb37-da541fe4b888 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 0.235415 Oct 12 09:11:01.251201 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3024/5631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:01 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:01.813006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:01.814098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:01.828511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:01.829006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:01.829463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:01.840458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:01.843127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:01.843669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:02.241987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:11:02.243074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:11:02.243936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:11:02.244585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:11:02.245302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:11:02.274341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:02.277654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:02.278405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:02.281642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:02.282348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:02.282890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:02.348284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Getting quotas for project dae3fa763c174899bd7caff7453f3de8. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:11:02.359549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Getting quotas for user 4d4a1b8ae1f94acca3723e99355aba38 and project dae3fa763c174899bd7caff7453f3de8. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:11:02.405671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:11:02.417172 n-d-858383-10 devstack@n-api.service[127007]: WARNING nova.utils [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-540091167-access_point-580331726 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-540091167-acc Oct 12 09:11:02.429587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:11:02.519755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:02.528930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47317691-a157-4601-a95a-bd94d8da3fc8 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1367 microversion: 2.1 time: 0.720210 Oct 12 09:11:02.533473 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3025/5632] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:01 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1367 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:02.552039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:02.553761 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-73ffd0f8-fa8f-493d-858a-73df6d2533de tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 3.269143 Oct 12 09:11:02.554970 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2608/5633] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:10:59 2022] POST /compute/v2.1/servers => generated 458 bytes in 3271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:11:02.558362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:02.569315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:02.570316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:02.572034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:02.573895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:02.574409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:02.576863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:02.602665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:02.610875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:02.628063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:02.640863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:02.641726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:02.642588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:02.648776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:02.649326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:02.947153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:02.969728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:02.971676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:02.972914 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ddebbd7-c298-4d50-9e05-df2c8bedf269 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.438277 Oct 12 09:11:02.982308 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3026/5634] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:02 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:02.992980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ee2182c3-9c08-4d4c-a5c2-ce16c1882409 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:02.995209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ee2182c3-9c08-4d4c-a5c2-ce16c1882409 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:03.121967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ee2182c3-9c08-4d4c-a5c2-ce16c1882409 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:03.133747 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ee2182c3-9c08-4d4c-a5c2-ce16c1882409 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1293 microversion: 2.1 time: 0.150284 Oct 12 09:11:03.144059 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3027/5635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:02 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:03.327787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:03.338422 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-357ffd1f-3694-4460-8e4f-8650053765cf tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 0.762937 Oct 12 09:11:03.342127 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2609/5636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:02 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:03.553298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:03.554207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:03.569857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:03.570712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:03.572941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:03.573880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:03.574695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:03.579114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:03.788356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5dc375a3-6689-4272-9000-4791818028f9 req-d5523869-1b36-4d75-ab66-3c0ee87febeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f90057-6208-4a50-b0d3-e2060bf816d1", "name": "network-vif-plugged", "status": "completed", "tag": "8c3d9e5d-195e-45ee-b961-d42a948d23b1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:03.823347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5dc375a3-6689-4272-9000-4791818028f9 req-d5523869-1b36-4d75-ab66-3c0ee87febeb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:03.824038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5dc375a3-6689-4272-9000-4791818028f9 req-d5523869-1b36-4d75-ab66-3c0ee87febeb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:03.824622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5dc375a3-6689-4272-9000-4791818028f9 req-d5523869-1b36-4d75-ab66-3c0ee87febeb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:03.865188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5dc375a3-6689-4272-9000-4791818028f9 req-d5523869-1b36-4d75-ab66-3c0ee87febeb service nova] Creating event network-vif-plugged:8c3d9e5d-195e-45ee-b961-d42a948d23b1 for instance c2f90057-6208-4a50-b0d3-e2060bf816d1 on n-h2-858383-10 Oct 12 09:11:03.896926 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5dc375a3-6689-4272-9000-4791818028f9 req-d5523869-1b36-4d75-ab66-3c0ee87febeb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112749 Oct 12 09:11:03.897593 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2610/5637] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:11:04.010347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:04.011133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:04.016595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:04.024751 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-213b44ed-7d74-4e9f-8540-aaa7c1c3b9b3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1556 microversion: 2.1 time: 0.475811 Oct 12 09:11:04.025471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3028/5638] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:03 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1556 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:04.032937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:04.033914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:04.035180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:04.035180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:04.035453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:04.035672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:04.053299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:04.054635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:04.064877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:04.069069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:04.070117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:04.070810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:04.071783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:04.072526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:04.075702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:04.308520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:04.332992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:04.337700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:04.346119 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45f4f316-df07-4a97-a726-cf8f733fe655 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.341289 Oct 12 09:11:04.346734 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2611/5639] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:04 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:04.392968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:04.397982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:04.418255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:04.421533 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e96368c8-4ec0-447a-bf20-e2219a0cc676 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.372489 Oct 12 09:11:04.429966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3029/5640] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:11:04 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-interface => generated 284 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:04.444248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:04.446129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:04.453587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:04.454276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:04.455081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:04.467726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:04.468433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:04.476442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:04.477003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:04.477376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:04.491432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:04.499017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:04.499563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:04.816571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:04.843342 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed7c2881-3c2a-4e10-bcfd-a145e09a73ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1345 microversion: 2.1 time: 0.461386 Oct 12 09:11:04.847205 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2612/5641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:04 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1345 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:04.889067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:04.897838 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-204d18d0-d153-4d09-98fc-5d3bb44823b6 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1361 microversion: 2.1 time: 0.466522 Oct 12 09:11:04.912725 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3030/5642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:04 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1361 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:05.376836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:05.377493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:05.395412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:05.396217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:05.396518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:05.397322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:05.397879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:05.398495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:05.436556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1153541846", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "aead2c2a-35b6-425d-9ad4-5f03f4e3f26c"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:05.570364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] validate_networks() for [('aead2c2a-35b6-425d-9ad4-5f03f4e3f26c', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:11:05.666972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:05.690876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:05.702173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f81f250849084de1827de11047258a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c9cafab43e40b1bb7d5e51f0a737fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:05.709090 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5eed6f4-a788-40a8-ab29-15bc61f36f83 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 200 len: 1604 microversion: 2.32 time: 0.332428 Oct 12 09:11:05.713422 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3031/5643] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:05 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:11:05.881650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:05.887861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:05.898937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:05.899792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:05.900479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:05.901383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:05.902185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:05.902791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:06.078806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:06.118581 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f67e8401-f24c-48a6-a992-4dbb799b40c7 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1351 microversion: 2.1 time: 0.244893 Oct 12 09:11:06.127175 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3032/5644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:05 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1351 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:11:06.142144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:06.149035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:06.172197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:06.175534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:06.177407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:06.180205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:06.181707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:06.182851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:06.522934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:06.538001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac679cbc-b035-45d5-892d-fc7fcf5ff30b tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1547 microversion: 2.1 time: 0.405911 Oct 12 09:11:06.538622 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3033/5645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:06 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1547 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:06.562527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:06.563313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:06.571433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:06.572339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:06.572926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:06.574023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:06.574708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:06.575279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:06.894692 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d33eca6-ec62-4974-89fa-56e2e23ef389 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.336371 Oct 12 09:11:06.895738 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3034/5646] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:11:06 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-interface => generated 285 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:11:06.900905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:06.902281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:06.919837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:06.920567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:06.921300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:06.928228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:06.928800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:06.929258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:06.982761 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] HTTP exception thrown: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Request method failure captured: Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf HTTP/1.1 Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoMVBvvo8QK0gHlJ746tGdFv25_XNKXM8R0tUVi0JS_Te5z7jvAQnbivH_Nh7gxziNspbAKkvk4BlA4YJINKmP4NcOtTfl-fGrbg1a2nQWvF0ucB_FfQMC26r3RmDfPwXiHGuimA8kIwGgGhYA-GTqN6Hg777jvgENBxozEddJJ1YZM Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 01c9cafab43e40b1bb7d5e51f0a737fe Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01c9cafab43e40b1bb7d5e51f0a737fe"}]}] Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 01c9cafab43e40b1bb7d5e51f0a737fe Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TaggedBootDevicesTest-802611614-project Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f81f250849084de1827de11047258a5d Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TaggedBootDevicesTest-802611614-project Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '04b7c698-857c-44ed-baa8-b13ecfdd15bf'} Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:06.984444 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Returning 404 to user: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:06.988585 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3beefdd-5821-4b22-81a3-4343a8024754 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 404 len: 111 microversion: 2.32 time: 0.089231 Oct 12 09:11:06.991710 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3035/5647] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:06 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:11:07.010963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-063291a6-c977-4d3b-aa8e-78029a874778 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '.version_select at 0x7f9843becb80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:07.045957 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-063291a6-c977-4d3b-aa8e-78029a874778 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203918891" status: 204 len: 0 microversion: 2.32 time: 0.052997 Oct 12 09:11:07.051469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3036/5648] 10.222.0.40 () {60 vars in 1262 bytes} [Wed Oct 12 09:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203918891 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:11:07.149787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:07.150844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:07.169722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:07.172724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:07.174734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:07.176625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:07.180763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:07.181917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:07.661420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:11:07.662207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:11:07.662869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:11:07.663409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:11:07.664107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:11:07.702764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:07.704101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:07.704533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:07.706903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:07.707370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:07.712050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:07.763730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Getting quotas for project 57a91e465b6246ae9fe4d06a0dd5f1f1. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:11:07.785525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Getting quotas for user 8eeeae550b634f56ab59aaf287cfe46b and project 57a91e465b6246ae9fe4d06a0dd5f1f1. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:11:07.818379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:11:07.820718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:11:07.917253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:07.932216 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ddd08dfe-83e7-431d-ba75-c20d55b18f2e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1471 microversion: 2.1 time: 0.786645 Oct 12 09:11:07.943660 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-91cdd3a9-7e8e-4185-95d0-415fc8156875 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.882070 Oct 12 09:11:07.947486 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3037/5649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:07 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1471 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:11:07.953844 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2613/5650] 10.222.0.40 () {62 vars in 1188 bytes} [Wed Oct 12 09:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 09:11:07.966133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3501cd8b-5645-4fe0-9bd1-32c1c8255bcb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:07.966133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3501cd8b-5645-4fe0-9bd1-32c1c8255bcb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:08.852901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d3ddb656-02fb-4c23-8839-57c7326cc57e req-08922c33-2ce9-4ada-95c0-1be266592c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4560c0f5-8d33-4495-a3c6-5597b176a35d", "tag": "edbc1528-772b-4e7c-95cd-5f20ce270c47"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:08.875738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3ddb656-02fb-4c23-8839-57c7326cc57e req-08922c33-2ce9-4ada-95c0-1be266592c6d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:08.876501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3ddb656-02fb-4c23-8839-57c7326cc57e req-08922c33-2ce9-4ada-95c0-1be266592c6d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:08.877173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3ddb656-02fb-4c23-8839-57c7326cc57e req-08922c33-2ce9-4ada-95c0-1be266592c6d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:08.925824 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d3ddb656-02fb-4c23-8839-57c7326cc57e req-08922c33-2ce9-4ada-95c0-1be266592c6d service nova] Creating event network-changed:edbc1528-772b-4e7c-95cd-5f20ce270c47 for instance 4560c0f5-8d33-4495-a3c6-5597b176a35d on n-h1-858383-10 Oct 12 09:11:08.950514 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d3ddb656-02fb-4c23-8839-57c7326cc57e req-08922c33-2ce9-4ada-95c0-1be266592c6d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.617499 Oct 12 09:11:08.953923 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2614/5651] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:08.970493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:08.985474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:09.019359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:09.020024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:09.020650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:09.022494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:09.024261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:09.024896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:09.133502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3501cd8b-5645-4fe0-9bd1-32c1c8255bcb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:09.157835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3501cd8b-5645-4fe0-9bd1-32c1c8255bcb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:09.168344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3501cd8b-5645-4fe0-9bd1-32c1c8255bcb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:09.174152 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3501cd8b-5645-4fe0-9bd1-32c1c8255bcb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1262 microversion: 2.26 time: 1.221627 Oct 12 09:11:09.179206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3038/5652] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:07 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1262 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:10.208845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:10.210506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:10.226884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:10.227703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:10.229204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:10.231396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:10.232715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:10.234379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:10.261219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:10.303173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:10.339978 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-91508f4b-39be-43ec-a9ba-811a3b7664a1 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1471 microversion: 2.1 time: 1.381172 Oct 12 09:11:10.357129 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2615/5653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:08 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1471 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:10.581899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:10.615132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:10.616696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:10.618100 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4e813dbb-ba0c-4332-93a0-6ed3e1730e02 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1332 microversion: 2.26 time: 0.415582 Oct 12 09:11:10.618937 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3039/5654] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:10 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1332 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:11:11.364996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:11.366213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:11.399872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:11.400545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:11.401055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:11.401882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:11.402368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:11.402806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:11.408172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:11.644332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:11.645611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:11.659637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:11.668219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:11.679162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:11.680340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:11.682068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:11.682729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:12.023220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:12.037960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:12.039446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:12.047192 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-accc486b-d808-4489-86a3-5f84834da440 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1320 microversion: 2.26 time: 0.405167 Oct 12 09:11:12.052962 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3040/5655] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:11 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 09:11:12.264107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-968ee65b-b2a0-4ebe-a069-9cff58245e5c req-1047b9a0-d530-4714-8688-e2fde40751fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f90057-6208-4a50-b0d3-e2060bf816d1", "tag": "8c3d9e5d-195e-45ee-b961-d42a948d23b1"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:12.299177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-968ee65b-b2a0-4ebe-a069-9cff58245e5c req-1047b9a0-d530-4714-8688-e2fde40751fc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:12.299950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-968ee65b-b2a0-4ebe-a069-9cff58245e5c req-1047b9a0-d530-4714-8688-e2fde40751fc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:12.301770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-968ee65b-b2a0-4ebe-a069-9cff58245e5c req-1047b9a0-d530-4714-8688-e2fde40751fc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:12.324325 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-968ee65b-b2a0-4ebe-a069-9cff58245e5c req-1047b9a0-d530-4714-8688-e2fde40751fc service nova] Creating event network-changed:8c3d9e5d-195e-45ee-b961-d42a948d23b1 for instance c2f90057-6208-4a50-b0d3-e2060bf816d1 on n-h2-858383-10 Oct 12 09:11:12.360632 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-968ee65b-b2a0-4ebe-a069-9cff58245e5c req-1047b9a0-d530-4714-8688-e2fde40751fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112750 Oct 12 09:11:12.363655 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3041/5656] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:12.555631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:12.565757 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-72dbaa15-e555-4176-bb20-e48079c7d821 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1471 microversion: 2.1 time: 1.204903 Oct 12 09:11:12.577900 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2616/5657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:11 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1471 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:13.087142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:13.088529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:13.102865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:13.114383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:13.114874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:13.115633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:13.116096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:13.116701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:13.588734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:13.589517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:13.605345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:13.606723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:13.607418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:13.608299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:13.608890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:13.609546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:13.889205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:13.901424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:13.902930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:13.904085 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2b5a84e1-754e-4873-90cb-3e6be232486f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1362 microversion: 2.26 time: 0.822168 Oct 12 09:11:13.904655 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3042/5658] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:13 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1362 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:14.286027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:14.300724 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ef69941-29c3-476d-9c51-dbaf4e0a1b55 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1471 microversion: 2.1 time: 0.716284 Oct 12 09:11:14.301968 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2617/5659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:13 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1471 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:14.426721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e3dff60c-bf79-4dba-a3b3-b2466b59c0b4 req-24b7fda3-c640-4d4b-9802-46df5054b52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc893eb-327b-4365-ab8a-b5373a41799c", "tag": "c5e5cf7a-c295-470a-9f7e-f50110a59f77"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:14.460436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e3dff60c-bf79-4dba-a3b3-b2466b59c0b4 req-24b7fda3-c640-4d4b-9802-46df5054b52e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:14.460948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e3dff60c-bf79-4dba-a3b3-b2466b59c0b4 req-24b7fda3-c640-4d4b-9802-46df5054b52e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:14.461385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e3dff60c-bf79-4dba-a3b3-b2466b59c0b4 req-24b7fda3-c640-4d4b-9802-46df5054b52e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:14.485407 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e3dff60c-bf79-4dba-a3b3-b2466b59c0b4 req-24b7fda3-c640-4d4b-9802-46df5054b52e service nova] Creating event network-changed:c5e5cf7a-c295-470a-9f7e-f50110a59f77 for instance 2bc893eb-327b-4365-ab8a-b5373a41799c on n-h1-858383-10 Oct 12 09:11:14.513068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e3dff60c-bf79-4dba-a3b3-b2466b59c0b4 req-24b7fda3-c640-4d4b-9802-46df5054b52e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090651 Oct 12 09:11:14.514691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3043/5660] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:14.935612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:14.936231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:14.954310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:14.956910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:14.957357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:14.958196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:14.960896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:14.963900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:15.339024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:15.340235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:15.349225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:15.368980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:15.376112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:15.378615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:15.379569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:15.381307 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94b1778a-08dd-447f-993c-0eef4f95211b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1362 microversion: 2.26 time: 0.451122 Oct 12 09:11:15.382147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:15.386626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:15.405485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:15.406246 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2618/5661] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:14 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:15.407828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:16.420787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:16.421402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:16.436793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:16.450290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:16.452323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:16.452783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:16.457605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:16.460231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:16.460688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:16.506976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:16.525468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-615f4885-d797-4b60-b4ce-9d74aef977b3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1471 microversion: 2.1 time: 1.192766 Oct 12 09:11:16.527387 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3044/5662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:15 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1471 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:16.950834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:16.976937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:16.981563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:16.985852 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d490c19b-9eae-461f-8527-26f464b5a28d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1362 microversion: 2.26 time: 0.568825 Oct 12 09:11:16.986694 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2619/5663] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:16 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1362 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:17.205599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cbb72c6f-49aa-4739-935a-d27f18f36099 req-ae016de4-3fce-4dc8-98cd-83c86436e5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da292f1-89d7-4eb0-9f1a-49eac9b9627b", "tag": "26bd61f3-e7e0-4c12-88af-164e48704298"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:17.228719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbb72c6f-49aa-4739-935a-d27f18f36099 req-ae016de4-3fce-4dc8-98cd-83c86436e5dd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:17.229208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbb72c6f-49aa-4739-935a-d27f18f36099 req-ae016de4-3fce-4dc8-98cd-83c86436e5dd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:17.229699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbb72c6f-49aa-4739-935a-d27f18f36099 req-ae016de4-3fce-4dc8-98cd-83c86436e5dd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:17.258826 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cbb72c6f-49aa-4739-935a-d27f18f36099 req-ae016de4-3fce-4dc8-98cd-83c86436e5dd service nova] Creating event network-changed:26bd61f3-e7e0-4c12-88af-164e48704298 for instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b on n-h2-858383-10 Oct 12 09:11:17.264074 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cbb72c6f-49aa-4739-935a-d27f18f36099 req-ae016de4-3fce-4dc8-98cd-83c86436e5dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062850 Oct 12 09:11:17.268969 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3045/5664] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:17.554788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:17.558859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:17.575396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:17.576312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:17.577809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:17.578809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:17.579468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:17.580106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:17.737164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:17.804991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=12 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:17.922048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:17.932510 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65227269-2754-4aaf-a407-110f7182737e tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1471 microversion: 2.1 time: 0.387751 Oct 12 09:11:17.933642 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2620/5665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:17 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:18.013878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:18.015154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:18.027829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:18.031558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:18.033484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:18.035602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:18.036958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:18.037650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:18.202271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:18.203331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:18.224874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:18.225620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:18.226210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:18.230963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:18.231646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:18.232238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:18.270547 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] HTTP exception thrown: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Request method failure captured: Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf HTTP/1.1 Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoMVBvvo8QK0gHlJ746tGdFv25_XNKXM8R0tUVi0JS_Te5z7jvAQnbivH_Nh7gxziNspbAKkvk4BlA4YJINKmP4NcOtTfl-fGrbg1a2nQWvF0ucB_FfQMC26r3RmDfPwXiHGuimA8kIwGgGhYA-GTqN6Hg777jvgENBxozEddJJ1YZM Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 01c9cafab43e40b1bb7d5e51f0a737fe Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01c9cafab43e40b1bb7d5e51f0a737fe"}]}] Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 01c9cafab43e40b1bb7d5e51f0a737fe Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TaggedBootDevicesTest-802611614-project Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f81f250849084de1827de11047258a5d Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TaggedBootDevicesTest-802611614-project Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '04b7c698-857c-44ed-baa8-b13ecfdd15bf'} Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:11:18.272776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.276137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.295079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Returning 404 to user: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:18.296360 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b5f3e61e-d605-4693-aa13-4554c31e6e51 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "DELETE /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 404 len: 111 microversion: 2.32 time: 0.098744 Oct 12 09:11:18.298491 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2621/5666] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:11:18 2022] DELETE /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 12 09:11:18.317617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:18.318967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] [instance: 04b7c698-857c-44ed-baa8-b13ecfdd15bf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:18.351333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:18.353460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:18.354194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:18.355167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:18.357489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:18.361942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:18.418067 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] HTTP exception thrown: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Request method failure captured: Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf HTTP/1.1 Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoMVBvvo8QK0gHlJ746tGdFv25_XNKXM8R0tUVi0JS_Te5z7jvAQnbivH_Nh7gxziNspbAKkvk4BlA4YJINKmP4NcOtTfl-fGrbg1a2nQWvF0ucB_FfQMC26r3RmDfPwXiHGuimA8kIwGgGhYA-GTqN6Hg777jvgENBxozEddJJ1YZM Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.32 Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 01c9cafab43e40b1bb7d5e51f0a737fe Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_01c9cafab43e40b1bb7d5e51f0a737fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01c9cafab43e40b1bb7d5e51f0a737fe"}]}] Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 01c9cafab43e40b1bb7d5e51f0a737fe Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TaggedBootDevicesTest-802611614 Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TaggedBootDevicesTest-802611614-project Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f81f250849084de1827de11047258a5d Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TaggedBootDevicesTest-802611614-project Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '04b7c698-857c-44ed-baa8-b13ecfdd15bf'} Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:18.423130 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.426335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:18.426335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:18.426335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:18.426335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:11:18.426335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:11:18.426335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. Oct 12 09:11:18.426335 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:18.429271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] Returning 404 to user: Instance 04b7c698-857c-44ed-baa8-b13ecfdd15bf could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:18.430527 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7795e9b-fee8-49a3-9095-44b8e5809314 tempest-TaggedBootDevicesTest-802611614 tempest-TaggedBootDevicesTest-802611614-project] 10.222.0.40 "GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf" status: 404 len: 111 microversion: 2.32 time: 0.127603 Oct 12 09:11:18.435672 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2622/5667] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:18 2022] GET /compute/v2.1/servers/04b7c698-857c-44ed-baa8-b13ecfdd15bf => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:11:18.439005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:18.457638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:18.463939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:18.465164 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2fad9f46-2b84-4ed9-b85f-851fd8db5144 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1362 microversion: 2.26 time: 0.456543 Oct 12 09:11:18.470005 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3046/5668] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:18 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:18.955187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:18.956440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:18.972149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:18.977686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:18.979488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:18.980427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:18.984931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:18.985585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:19.291250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3854e1ae-b7d6-4d5f-92d7-463c01d6f08d req-f4444373-8224-442a-8132-ae2126bc9198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc893eb-327b-4365-ab8a-b5373a41799c", "name": "network-vif-plugged", "status": "completed", "tag": "c5e5cf7a-c295-470a-9f7e-f50110a59f77"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:19.309066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:19.311152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:19.314347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3854e1ae-b7d6-4d5f-92d7-463c01d6f08d req-f4444373-8224-442a-8132-ae2126bc9198 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:19.315052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3854e1ae-b7d6-4d5f-92d7-463c01d6f08d req-f4444373-8224-442a-8132-ae2126bc9198 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:19.315673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3854e1ae-b7d6-4d5f-92d7-463c01d6f08d req-f4444373-8224-442a-8132-ae2126bc9198 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:19.318844 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d1073c5-3067-44cc-bb1a-56e84b25b9f5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1471 microversion: 2.1 time: 0.366226 Oct 12 09:11:19.323261 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2623/5669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:18 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:19.333124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3854e1ae-b7d6-4d5f-92d7-463c01d6f08d req-f4444373-8224-442a-8132-ae2126bc9198 service nova] Creating event network-vif-plugged:c5e5cf7a-c295-470a-9f7e-f50110a59f77 for instance 2bc893eb-327b-4365-ab8a-b5373a41799c on n-h1-858383-10 Oct 12 09:11:19.344998 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3854e1ae-b7d6-4d5f-92d7-463c01d6f08d req-f4444373-8224-442a-8132-ae2126bc9198 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058270 Oct 12 09:11:19.346340 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3047/5670] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:11:19.505571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:19.506936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:19.521168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:19.522820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:19.524090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:19.526768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:19.527483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:19.528193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:19.814755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:19.827796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:19.829784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:19.831571 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-222dbacc-2ec1-4f87-9ece-c6b274064aa7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1362 microversion: 2.26 time: 0.337254 Oct 12 09:11:19.832134 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2624/5671] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:19 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:20.347244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:20.347900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:20.359195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:20.363348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:20.370576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:20.371512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:20.372148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:20.372721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:20.632474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:20.640333 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3853f711-18ab-4a36-a056-d1cce54f356b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1471 microversion: 2.1 time: 0.299058 Oct 12 09:11:20.640912 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3048/5672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:20 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:20.858120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:20.858787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:20.867196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:20.873602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:20.874266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:20.879536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:20.880023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:20.880462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:21.244467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:21.260462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:21.262608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:21.264171 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-925068b6-c76a-4981-87f9-763be9d1d007 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1362 microversion: 2.26 time: 0.409996 Oct 12 09:11:21.278302 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2625/5673] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:20 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:21.666749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:21.667846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:21.677154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:21.677947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:21.678651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:21.679705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:21.681134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:21.681748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:21.964793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:21.976961 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c09cd23-f187-4fe7-bbc3-11f0c863d9b9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1642 microversion: 2.1 time: 0.314041 Oct 12 09:11:21.978147 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3049/5674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:21 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1642 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:22.003559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:22.005308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:22.014442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:22.015367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:22.016423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:22.017810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:22.018537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:22.019553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:22.235428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:22.247029 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bfb67fdc-9455-4e72-9594-0eaab8680f3c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1642 microversion: 2.1 time: 0.247862 Oct 12 09:11:22.248439 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2626/5675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:21 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1642 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:22.269509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:22.273238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:22.287365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:22.287950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:22.289848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:22.292684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:22.293268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:22.294124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:22.297946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:22.299250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:22.318054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:22.318587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:22.319027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:22.319755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:22.320216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:22.320649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:22.505021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:22.515394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:22.517317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:22.518981 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8647ab93-ff74-486e-936c-438a4c2a0c2b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1362 microversion: 2.26 time: 0.228171 Oct 12 09:11:22.520420 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2627/5676] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:22 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:22.939817 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5dc503dd-b1fa-4df7-91cc-4c4f0c15d06b tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1795 microversion: 2.1 time: 0.673975 Oct 12 09:11:22.943790 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3050/5677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:11:22 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1795 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:23.234626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-087049cf-1c17-4663-ab02-b2c0b320f74e req-2a012981-8da3-4319-99dc-bdad2ee6ae1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da292f1-89d7-4eb0-9f1a-49eac9b9627b", "name": "network-vif-plugged", "status": "completed", "tag": "26bd61f3-e7e0-4c12-88af-164e48704298"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:23.259144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-087049cf-1c17-4663-ab02-b2c0b320f74e req-2a012981-8da3-4319-99dc-bdad2ee6ae1e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:23.260255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-087049cf-1c17-4663-ab02-b2c0b320f74e req-2a012981-8da3-4319-99dc-bdad2ee6ae1e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:23.261585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-087049cf-1c17-4663-ab02-b2c0b320f74e req-2a012981-8da3-4319-99dc-bdad2ee6ae1e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:23.289662 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-087049cf-1c17-4663-ab02-b2c0b320f74e req-2a012981-8da3-4319-99dc-bdad2ee6ae1e service nova] Creating event network-vif-plugged:26bd61f3-e7e0-4c12-88af-164e48704298 for instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b on n-h2-858383-10 Oct 12 09:11:23.301248 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-087049cf-1c17-4663-ab02-b2c0b320f74e req-2a012981-8da3-4319-99dc-bdad2ee6ae1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069948 Oct 12 09:11:23.304231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2628/5678] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:23.549281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:23.550169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:23.563373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:23.563978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:23.566034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:23.581099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:23.584886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:23.594105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:24.057041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:24.069874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:24.077691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:24.079273 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-026d06c3-23ec-4df8-9e3b-18b94dd5128b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1362 microversion: 2.26 time: 0.535299 Oct 12 09:11:24.080665 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3051/5679] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:23 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:25.112388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:25.114370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:25.133331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.134209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.136477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.137787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.143034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.143646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.457945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:25.466466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:25.472451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:25.473884 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-61f86c3a-fed4-4388-9362-8842f48dd472 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1545 microversion: 2.26 time: 0.368222 Oct 12 09:11:25.486573 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2629/5680] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:25 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1545 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:25.515075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9843bec550>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:25.526793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.527536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.528177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.528824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:25.535371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.536086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.536670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.537561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.538166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.538741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.592702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.593708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.594364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.615818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.616477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.617065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.660204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:25.679145 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f0150e29-b04a-427f-8bb4-bbde3e8848d7 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-805738454" status: 201 len: 0 microversion: 2.26 time: 0.169195 Oct 12 09:11:25.685597 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3052/5681] 10.222.0.40 () {62 vars in 1377 bytes} [Wed Oct 12 09:11:25 2022] PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-805738454 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 12 09:11:25.690640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-af76dc81-beec-4810-9737-62ef7119b99b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9848ba4160>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:25.699254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af76dc81-beec-4810-9737-62ef7119b99b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.699737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af76dc81-beec-4810-9737-62ef7119b99b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.700170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af76dc81-beec-4810-9737-62ef7119b99b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.740047 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-af76dc81-beec-4810-9737-62ef7119b99b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-805738454" status: 204 len: 0 microversion: 2.26 time: 0.053278 Oct 12 09:11:25.741258 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2630/5682] 10.222.0.40 () {60 vars in 1358 bytes} [Wed Oct 12 09:11:25 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-805738454 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 09:11:25.751770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9843e87430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:25.765906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.775119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.782151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.783951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:25.830911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.831421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.831867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.854090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.854605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.855064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.899051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.899626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.900352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.942057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:25.960683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-58ce20c4-8047-450c-a510-cd4b7a4f61be tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 204 len: 0 microversion: 2.26 time: 0.214233 Oct 12 09:11:25.961367 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3053/5683] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 12 09:11:25 2022] DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:11:25.972526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e7be45aa-60b8-4ae3-a9ec-579381eb9dc0 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9848b9d160>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:25.982407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7be45aa-60b8-4ae3-a9ec-579381eb9dc0 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:25.983540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7be45aa-60b8-4ae3-a9ec-579381eb9dc0 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:25.984691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7be45aa-60b8-4ae3-a9ec-579381eb9dc0 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:25.999493 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e7be45aa-60b8-4ae3-a9ec-579381eb9dc0 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 200 len: 12 microversion: 2.26 time: 0.031561 Oct 12 09:11:26.006646 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2631/5684] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 09:11:25 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:26.019472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9843d65790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:26.066311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.066832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.067280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.067777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:26.100029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.101873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.103828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.105476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.107751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.110573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.201289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.201838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.202293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.235913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.236408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.236851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.268522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:26.292644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:26.331339 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-691b3fdc-9ac1-466e-becf-b33a51d6be1d tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-1293047804" status: 201 len: 0 microversion: 2.26 time: 0.324023 Oct 12 09:11:26.332197 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3054/5685] 10.222.0.40 () {62 vars in 1380 bytes} [Wed Oct 12 09:11:26 2022] PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-1293047804 => generated 0 bytes in 325 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 12 09:11:26.343882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2cc058cc-aea6-48eb-930d-0409875f604b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f984894e9d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:26.354902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc058cc-aea6-48eb-930d-0409875f604b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.355387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc058cc-aea6-48eb-930d-0409875f604b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.355894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc058cc-aea6-48eb-930d-0409875f604b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.367975 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2cc058cc-aea6-48eb-930d-0409875f604b tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 200 len: 36 microversion: 2.26 time: 0.029376 Oct 12 09:11:26.369615 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2632/5686] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 09:11:26 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 36 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:26.381951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9848983430>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:26.402095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.402663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.404647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.405964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:26.426305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.429844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.430464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.431803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.432267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.433701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.480332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.480818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.481241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.530220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:26.551970 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d91628c-f1b4-49a4-9ce5-4a03c2028c96 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-1293047804" status: 204 len: 0 microversion: 2.26 time: 0.176382 Oct 12 09:11:26.553178 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3055/5687] 10.222.0.40 () {60 vars in 1364 bytes} [Wed Oct 12 09:11:26 2022] DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-1293047804 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:11:26.563078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97fd468f-8903-4458-a5fd-c3daf08f1bfb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f984cbd4280>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:26.572870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97fd468f-8903-4458-a5fd-c3daf08f1bfb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.573618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97fd468f-8903-4458-a5fd-c3daf08f1bfb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.574222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97fd468f-8903-4458-a5fd-c3daf08f1bfb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.586084 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97fd468f-8903-4458-a5fd-c3daf08f1bfb tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 200 len: 12 microversion: 2.26 time: 0.028397 Oct 12 09:11:26.587447 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2633/5688] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 09:11:26 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 12 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:11:26.598258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9843d4e0d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:26.613063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.614374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.616218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.619035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:26.634794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.636335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.638630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.641411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.642099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.643398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.698502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.699213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.701670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.764664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:26.794671 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8898e8ff-088c-4429-9d39-e74ec73c9d9f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 204 len: 0 microversion: 2.26 time: 0.200519 Oct 12 09:11:26.795680 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3056/5689] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 12 09:11:26 2022] DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:11:26.813179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9848ba4280>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:26.827316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.828062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.828676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.836845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:26.846056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.846755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.847341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.848196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.848788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.849357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.885089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.886001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.886902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.914067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.915790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.916412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.939731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d6b532f8-83d3-4203-8772-c38ece18205f req-16b7963b-999c-4061-8eb7-7aa05a6272df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc893eb-327b-4365-ab8a-b5373a41799c", "tag": "c5e5cf7a-c295-470a-9f7e-f50110a59f77"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:26.953618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d6b532f8-83d3-4203-8772-c38ece18205f req-16b7963b-999c-4061-8eb7-7aa05a6272df service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:26.954020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d6b532f8-83d3-4203-8772-c38ece18205f req-16b7963b-999c-4061-8eb7-7aa05a6272df service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:26.954452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d6b532f8-83d3-4203-8772-c38ece18205f req-16b7963b-999c-4061-8eb7-7aa05a6272df service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:26.971761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:26.986759 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d6b532f8-83d3-4203-8772-c38ece18205f req-16b7963b-999c-4061-8eb7-7aa05a6272df service nova] Creating event network-changed:c5e5cf7a-c295-470a-9f7e-f50110a59f77 for instance 2bc893eb-327b-4365-ab8a-b5373a41799c on n-h1-858383-10 Oct 12 09:11:26.992618 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-40ebe096-c8ed-43d7-a863-b908bc12dcc9 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-997454672" status: 201 len: 0 microversion: 2.26 time: 0.184951 Oct 12 09:11:26.993909 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2634/5690] 10.222.0.40 () {62 vars in 1377 bytes} [Wed Oct 12 09:11:26 2022] PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-997454672 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 12 09:11:27.000993 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d6b532f8-83d3-4203-8772-c38ece18205f req-16b7963b-999c-4061-8eb7-7aa05a6272df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065466 Oct 12 09:11:27.004576 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3057/5691] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:11:27.011610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9848b9d3a0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:27.023228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.024095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.024879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.025618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:27.033602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.034583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.035449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.036663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.037408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.038314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.044517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:27.087954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.088771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.089409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.102874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.103886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.104521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.150139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:27.192810 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c6db373-e02a-4da6-a330-706d30609f67 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-1481637667" status: 201 len: 0 microversion: 2.26 time: 0.190970 Oct 12 09:11:27.199518 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2635/5692] 10.222.0.40 () {62 vars in 1380 bytes} [Wed Oct 12 09:11:26 2022] PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-1481637667 => generated 0 bytes in 196 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 12 09:11:27.210145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9843dbef70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:27.236089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.236646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.237117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.237763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:27.281384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.281854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.285048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.285712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.291019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.292743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.387749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.388249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.388695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.444319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:27.476645 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69d303a7-acff-4d0b-a9c0-b13a4e1c0b86 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 204 len: 0 microversion: 2.26 time: 0.274592 Oct 12 09:11:27.481069 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3058/5693] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 12 09:11:27 2022] DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:11:27.489586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49037641-16cc-4308-9603-e8a770e3b0f2 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9848ba4280>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:27.519440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49037641-16cc-4308-9603-e8a770e3b0f2 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.525904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49037641-16cc-4308-9603-e8a770e3b0f2 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.526430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49037641-16cc-4308-9603-e8a770e3b0f2 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.542768 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-49037641-16cc-4308-9603-e8a770e3b0f2 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 200 len: 12 microversion: 2.26 time: 0.060040 Oct 12 09:11:27.550196 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2636/5694] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 09:11:27 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 12 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:11:27.561939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9843a87af0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:27.574203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.574738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.590109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.590762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:27.608796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.609284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.626157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.629818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.634191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.636478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.712754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.717144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.717977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.748304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:27.787627 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9db90c67-b1e4-4b73-a5ad-535212c58f7f tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 204 len: 0 microversion: 2.26 time: 0.231497 Oct 12 09:11:27.789319 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3059/5695] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 12 09:11:27 2022] DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:11:27.799077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f984cce9430>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:27.822581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.823195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.823732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.824285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:27.846430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.847042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.847557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.848903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.849744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.850471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.919994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.920798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.921268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.951294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:27.951786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:27.952276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:27.987666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:28.027203 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97dcde2a-2bb9-4f9b-bd7b-a62ac67f50e3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-128002623" status: 201 len: 0 microversion: 2.26 time: 0.232137 Oct 12 09:11:28.028347 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2637/5696] 10.222.0.40 () {62 vars in 1377 bytes} [Wed Oct 12 09:11:27 2022] PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-128002623 => generated 0 bytes in 234 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 12 09:11:28.038363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f98487f8e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:28.058100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.058728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.059290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.059782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:28.069325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.069860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.070307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.071184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.071819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.072255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.134149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.134649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.135089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.176198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.176681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.177115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.220662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:28.262080 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-99f89bd8-aaf2-4b10-93cc-2769a14a1831 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-1973426123" status: 201 len: 0 microversion: 2.26 time: 0.227542 Oct 12 09:11:28.267229 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3060/5697] 10.222.0.40 () {62 vars in 1380 bytes} [Wed Oct 12 09:11:28 2022] PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags/tempest-tag-1973426123 => generated 0 bytes in 233 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 12 09:11:28.272720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Action: 'update_all', calling method: .version_select at 0x7f9848a54a60>, body: {"tags": ["tempest-tag-1778074826", "tempest-tag-76594359"]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:28.310206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.315154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.317174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.318404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:28.336844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.341339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.341917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.343457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.344533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.347642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.439864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.441545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.443394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.493181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:28.532485 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2db29b19-fcda-4f52-9179-d14e353d3f84 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 200 len: 60 microversion: 2.26 time: 0.263914 Oct 12 09:11:28.539331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2638/5698] 10.222.0.40 () {62 vars in 1312 bytes} [Wed Oct 12 09:11:28 2022] PUT /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 60 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:28.543605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e50c2d81-20be-4894-bfa2-26643b4d74a3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f9843e1d940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:28.555727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e50c2d81-20be-4894-bfa2-26643b4d74a3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.556262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e50c2d81-20be-4894-bfa2-26643b4d74a3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.560047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e50c2d81-20be-4894-bfa2-26643b4d74a3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.579003 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e50c2d81-20be-4894-bfa2-26643b4d74a3 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 200 len: 60 microversion: 2.26 time: 0.039687 Oct 12 09:11:28.580975 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3061/5699] 10.222.0.40 () {60 vars in 1292 bytes} [Wed Oct 12 09:11:28 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 60 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:11:28.594404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '.version_select at 0x7f984cd08670>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:28.611609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.613219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.615032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.615640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:28.635992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.637913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.638614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.641463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.642043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.642486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.712516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.717046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.720529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.758593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'flavor' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:28.832895 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c64a623f-04da-41b8-ac4d-7d4c3533fdfc tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags" status: 204 len: 0 microversion: 2.26 time: 0.244392 Oct 12 09:11:28.838474 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2639/5700] 10.222.0.40 () {60 vars in 1295 bytes} [Wed Oct 12 09:11:28 2022] DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:11:28.849717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:28.850559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:28.866068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.866746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.873963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.874945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:28.875570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:28.876152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:28.931545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:11:29.100553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3852c372-0302-43e4-8e22-f77f72dc4ebe tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 204 len: 0 microversion: 2.26 time: 0.254702 Oct 12 09:11:29.103956 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3062/5701] 10.222.0.40 () {60 vars in 1280 bytes} [Wed Oct 12 09:11:28 2022] DELETE /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 09:11:29.117252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:29.117758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:29.141594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:29.142138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:29.142592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:29.147296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:29.153163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:29.157327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:29.450311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:29.476973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:29.488946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:29.494470 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6333025c-c903-4e3d-b870-7e2dcd6d23df tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1551 microversion: 2.26 time: 0.385849 Oct 12 09:11:29.511261 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2640/5702] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:29 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1551 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:30.528529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:30.529992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:30.547170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:30.561037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:30.561902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:30.571419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:30.572273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:30.578691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:31.020482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:31.029091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:31.030575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:31.035943 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-185ef217-751c-48fe-b958-728aa2b5ae33 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1551 microversion: 2.26 time: 0.513014 Oct 12 09:11:31.036544 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3063/5703] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:30 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1551 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:31.594741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-953e78e6-a555-4e8f-8597-c0e907b4e3da req-f75bb3db-7968-43fc-b0ce-e2905e206b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da292f1-89d7-4eb0-9f1a-49eac9b9627b", "name": "network-vif-deleted", "tag": "26bd61f3-e7e0-4c12-88af-164e48704298"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:31.622112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-953e78e6-a555-4e8f-8597-c0e907b4e3da req-f75bb3db-7968-43fc-b0ce-e2905e206b0e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:31.622627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-953e78e6-a555-4e8f-8597-c0e907b4e3da req-f75bb3db-7968-43fc-b0ce-e2905e206b0e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:31.629063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-953e78e6-a555-4e8f-8597-c0e907b4e3da req-f75bb3db-7968-43fc-b0ce-e2905e206b0e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:31.678121 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-953e78e6-a555-4e8f-8597-c0e907b4e3da req-f75bb3db-7968-43fc-b0ce-e2905e206b0e service nova] Creating event network-vif-deleted:26bd61f3-e7e0-4c12-88af-164e48704298 for instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b on n-h2-858383-10 Oct 12 09:11:31.691822 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-953e78e6-a555-4e8f-8597-c0e907b4e3da req-f75bb3db-7968-43fc-b0ce-e2905e206b0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107450 Oct 12 09:11:31.696757 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2641/5704] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:32.067994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:32.069828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:32.086644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:32.089043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:32.096346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:32.097369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:32.110219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:32.110939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:32.174656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:32.177204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:32.178291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:32.181265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lazy-loading 'fault' on Instance uuid 7da292f1-89d7-4eb0-9f1a-49eac9b9627b {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:11:32.256085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:32.269611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:32.271825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8eeeae550b634f56ab59aaf287cfe46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a91e465b6246ae9fe4d06a0dd5f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:11:32.273075 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39a9ae47-a6e7-4058-a0ac-525fe3567680 tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 200 len: 1352 microversion: 2.26 time: 0.210162 Oct 12 09:11:32.276099 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3064/5705] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:32 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 1352 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 09:11:33.308067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:33.309478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] [instance: 7da292f1-89d7-4eb0-9f1a-49eac9b9627b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:33.324036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:33.324729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:33.325481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:33.326231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:33.328985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:33.329488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:33.363027 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] HTTP exception thrown: Instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b could not be found. Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Request method failure captured: Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b HTTP/1.1 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoSoCgfFaxHkUmLnoJlCyV7IzlcvGgotO5C2fFdDgIiRWYg5bK3rLBCbpjnFte_eHQqf4ic5_-23utf1cAyIOeOH2fA6wl-0y5FwCX-l5m1g3r7ot_zrmXU2UfdD9wE31-PHXTyT1EjxreYhxQBvCby3ZgGVJGXWdIUJQqthJimspF0 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Openstack-Nova-Api-Version: 2.26 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 57a91e465b6246ae9fe4d06a0dd5f1f1 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerTagsTestJSON-690475094 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57a91e465b6246ae9fe4d06a0dd5f1f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/57a91e465b6246ae9fe4d06a0dd5f1f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_57a91e465b6246ae9fe4d06a0dd5f1f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57a91e465b6246ae9fe4d06a0dd5f1f1"}]}] Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerTagsTestJSON-690475094 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 57a91e465b6246ae9fe4d06a0dd5f1f1 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerTagsTestJSON-690475094 Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerTagsTestJSON-690475094-project Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 8eeeae550b634f56ab59aaf287cfe46b Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerTagsTestJSON-690475094-project Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b could not be found. Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '7da292f1-89d7-4eb0-9f1a-49eac9b9627b'} Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b could not be found. Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b could not be found. Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:33.367627 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b could not be found. Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] Returning 404 to user: Instance 7da292f1-89d7-4eb0-9f1a-49eac9b9627b could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c5a94cb-bac1-4e13-b30d-2e859f3c97da tempest-ServerTagsTestJSON-690475094 tempest-ServerTagsTestJSON-690475094-project] 10.222.0.40 "GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b" status: 404 len: 111 microversion: 2.26 time: 0.067571 Oct 12 09:11:33.375543 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2642/5706] 10.222.0.40 () {60 vars in 1277 bytes} [Wed Oct 12 09:11:33 2022] GET /compute/v2.1/servers/7da292f1-89d7-4eb0-9f1a-49eac9b9627b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:11:37.596577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:37.597698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:37.606992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:37.611408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:37.614508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:37.614968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:37.615713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:37.616176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:37.616601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:37.692367 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ca9e12e-4236-4129-9ea8-8db7ca116a9a tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/ips" status: 200 len: 149 microversion: 2.1 time: 0.099674 Oct 12 09:11:37.693450 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3065/5707] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:11:37 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/ips => generated 149 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:40.674400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9b79521-fbe2-434a-8516-83f5f3ba87de"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:40.678476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:40.700324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:40.702126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:40.704843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:40.705854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:40.707531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:40.708808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:41.227410 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f58e252b-6419-4efd-ad5a-b91052529b2f tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "POST /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558107 Oct 12 09:11:41.228361 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2643/5708] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:11:40 2022] POST /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:43.772227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a65e5299-972b-41e8-8924-f565d7049ecc tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Action: 'create', calling method: .version_select at 0x7f9843e99a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1526203053", "metadata": {"Type": "work"}}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:44.370575 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a65e5299-972b-41e8-8924-f565d7049ecc tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.244140 Oct 12 09:11:44.371805 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3066/5709] 10.222.0.40 () {60 vars in 1156 bytes} [Wed Oct 12 09:11:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1246 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 09:11:44.388060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e26d9808-40ee-4349-bbba-3d24525f2da1 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Calling method '.version_select at 0x7f9843f2f280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:44.571722 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e26d9808-40ee-4349-bbba-3d24525f2da1 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1" status: 200 len: 353 microversion: 2.1 time: 0.187266 Oct 12 09:11:44.579166 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3067/5710] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:11:44 2022] GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 => generated 353 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:44.667643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:44.668236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:44.687675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:44.705935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:44.705935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:44.705935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:44.706373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:44.716087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:44.821610 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b87a028-bb78-44c7-8601-a7abb3bae976 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/ips" status: 200 len: 146 microversion: 2.1 time: 0.794043 Oct 12 09:11:44.829713 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2644/5711] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:11:44 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/ips => generated 146 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:11:45.594024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2d1c7ad2-3684-4059-9e84-db1b63b37146 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Calling method '.version_select at 0x7f9843aeaca0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:46.185675 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2d1c7ad2-3684-4059-9e84-db1b63b37146 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1" status: 200 len: 353 microversion: 2.1 time: 0.595908 Oct 12 09:11:46.193025 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3068/5712] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:11:45 2022] GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 => generated 353 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:47.200776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cfb5e42d-a340-4a28-af14-2dda82632d3b tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Calling method '.version_select at 0x7f9843d64940>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:47.358899 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cfb5e42d-a340-4a28-af14-2dda82632d3b tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1" status: 200 len: 354 microversion: 2.1 time: 0.162452 Oct 12 09:11:47.372439 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2645/5713] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:11:47 2022] GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:47.373962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3940fae5-c519-400e-9ad6-d4f39e7b062e tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Calling method '.version_select at 0x7f9843dbe700>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:47.604103 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3940fae5-c519-400e-9ad6-d4f39e7b062e tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1" status: 200 len: 354 microversion: 2.1 time: 0.234631 Oct 12 09:11:47.625622 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3069/5714] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:11:47 2022] GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:47.628656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d5f8cb1-c2a7-4b6b-a6bd-057bb54e355a tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Calling method '.version_select at 0x7f984894e9d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:47.753084 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d5f8cb1-c2a7-4b6b-a6bd-057bb54e355a tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1" status: 202 len: 0 microversion: 2.1 time: 0.132183 Oct 12 09:11:47.753764 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2646/5715] 10.222.0.40 () {58 vars in 1248 bytes} [Wed Oct 12 09:11:47 2022] DELETE /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:11:47.763524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3be0d1c5-fd1a-43ad-b178-4e735f302fe4 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Calling method '.version_select at 0x7f9843dbe5e0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:47.775159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:47.775935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:47.984594 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3be0d1c5-fd1a-43ad-b178-4e735f302fe4 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1" status: 200 len: 353 microversion: 2.1 time: 0.225045 Oct 12 09:11:47.991735 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3070/5716] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:11:47 2022] GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 => generated 353 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:48.142422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38d3dfa7-10a8-4ae1-9847-f8b35ae1d4d7"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:48.145565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:48.161363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=62 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:48.172721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:48.173288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:48.173785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:48.174571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:48.201055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:48.202428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:49.000919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c34c78c-fdac-44e9-ae94-d3c7e0dc63d2 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Calling method '.version_select at 0x7f9843aea940>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:49.056052 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a5794167-466c-416e-af2f-c506f0f510d9 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915130 Oct 12 09:11:49.066663 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2647/5717] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:11:48 2022] POST /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:49.312424 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c34c78c-fdac-44e9-ae94-d3c7e0dc63d2 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1" status: 200 len: 353 microversion: 2.1 time: 0.315892 Oct 12 09:11:49.313568 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3071/5718] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:11:48 2022] GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 => generated 353 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:11:50.328467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc8dfdcc-8d7c-4085-8b06-e10f84764508 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Calling method '.version_select at 0x7f9843dd4a60>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:52.486006 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-bc8dfdcc-8d7c-4085-8b06-e10f84764508 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] HTTP exception thrown: Volume 5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 could not be found. Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc8dfdcc-8d7c-4085-8b06-e10f84764508 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Request method failure captured: Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 HTTP/1.1 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoTO2LeB-NFqEocc1CMPDFJP6A5DZ5rXdMGlM9pd4IM8MJzE7nQrNlPBfVMxgEXa9ghHQKStwcEyLBwGIu9j1pPIjicO_akf0Pg9LX_lDN311MqBcZPO2TQP9MEYg6Wbm627eGJWYj6cJ4T8H5etdjpZxBNxjNUyP-zYoDenEbbtuC0 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 62afe03efc054c348be43df821c062f8 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesGetTestJSON-1741579944 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62afe03efc054c348be43df821c062f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62afe03efc054c348be43df821c062f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62afe03efc054c348be43df821c062f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62afe03efc054c348be43df821c062f8"}]}] Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesGetTestJSON-1741579944 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 62afe03efc054c348be43df821c062f8 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesGetTestJSON-1741579944 Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesGetTestJSON-1741579944-project Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: ccd8797e2ce14bb0afc771a7d3b4589b Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesGetTestJSON-1741579944-project Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: method: Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: exception: Volume 5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 could not be found. Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1'} Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 could not be found. (HTTP 404) (Request-ID: req-a4a4607c-f73f-4c7c-9a70-48c9b1f32e7d) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 09:11:52.490960 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 could not be found. Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 could not be found. Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 could not be found. Oct 12 09:11:52.495138 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:52.500976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc8dfdcc-8d7c-4085-8b06-e10f84764508 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] Returning 404 to user: Volume 5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:52.502855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc8dfdcc-8d7c-4085-8b06-e10f84764508 tempest-VolumesGetTestJSON-1741579944 tempest-VolumesGetTestJSON-1741579944-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1" status: 404 len: 109 microversion: 2.1 time: 2.178686 Oct 12 09:11:52.509920 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2648/5719] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:11:50 2022] GET /compute/v2.1/os-volumes/5b90dd8b-8c01-41ff-954b-fb2d6a4d58b1 => generated 109 bytes in 2185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:11:56.592068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5704893e-f729-48e3-9fb8-0a168ae5ed98 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1261739141", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:56.596324 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-5704893e-f729-48e3-9fb8-0a168ae5ed98 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] HTTP exception thrown: min_count must be <= max_count Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5704893e-f729-48e3-9fb8-0a168ae5ed98 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Request method failure captured: Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 184 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoTb8cObdoaD4-ty2g81a6WMIj8YLSpDM1zzHybVz40kzz24JeP8OUaLCbrDzudqTIfGFfyBMnSz94AzDCdV3KCSzQRd1yqo-OV30SpPQQv0keuk3FeQ7XYD-9NsFETP140pF_mYMDRPbJzvZPvK7zHt69sSRXYV6uCmExbj1JqPiaQ Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}] Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 043d8b949008434ca761dd5b70181c17 Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1261739141", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: exception: min_count must be <= max_count Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1261739141', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 12 09:11:56.599263 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.610503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5704893e-f729-48e3-9fb8-0a168ae5ed98 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Returning 400 to user: min_count must be <= max_count {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:56.611903 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5704893e-f729-48e3-9fb8-0a168ae5ed98 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.486986 Oct 12 09:11:56.612660 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3072/5720] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:11:56 2022] POST /compute/v2.1/servers => generated 74 bytes in 489 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 12 09:11:56.881345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-262cf8d9-0431-4f71-ac30-3f73d5b6adab tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1978600952", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "max_count": 0}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-262cf8d9-0431-4f71-ac30-3f73d5b6adab tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Request method failure captured: Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 168 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoTb8cObdoaD4-ty2g81a6WMIj8YLSpDM1zzHybVz40kzz24JeP8OUaLCbrDzudqTIfGFfyBMnSz94AzDCdV3KCSzQRd1yqo-OV30SpPQQv0keuk3FeQ7XYD-9NsFETP140pF_mYMDRPbJzvZPvK7zHt69sSRXYV6uCmExbj1JqPiaQ Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}] Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 043d8b949008434ca761dd5b70181c17 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1978600952", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "max_count": 0}} Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1978600952', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'max_count': 0}}} Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 0 Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:11:56.888206 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 12 09:11:56.892400 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:56.896813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-262cf8d9-0431-4f71-ac30-3f73d5b6adab tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:56.897974 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-262cf8d9-0431-4f71-ac30-3f73d5b6adab tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021206 Oct 12 09:11:56.900873 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2649/5721] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:11:56 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:11:57.174293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-623d8ad2-4a24-4699-b234-863078893748 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-905803248", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "max_count": 2.5}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-623d8ad2-4a24-4699-b234-863078893748 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Request method failure captured: Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 169 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoTb8cObdoaD4-ty2g81a6WMIj8YLSpDM1zzHybVz40kzz24JeP8OUaLCbrDzudqTIfGFfyBMnSz94AzDCdV3KCSzQRd1yqo-OV30SpPQQv0keuk3FeQ7XYD-9NsFETP140pF_mYMDRPbJzvZPvK7zHt69sSRXYV6uCmExbj1JqPiaQ Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}] Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 043d8b949008434ca761dd5b70181c17 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-905803248", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "max_count": 2.5}} Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-905803248', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'max_count': 2.5}}} Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 2.5 Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:11:57.187005 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-623d8ad2-4a24-4699-b234-863078893748 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:57.190941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-623d8ad2-4a24-4699-b234-863078893748 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023268 Oct 12 09:11:57.206253 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3073/5722] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:11:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:11:57.347788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d3482858-3f55-4d3e-80e2-b45e424404f9 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2018585505", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 0}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d3482858-3f55-4d3e-80e2-b45e424404f9 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Request method failure captured: Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 168 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoTb8cObdoaD4-ty2g81a6WMIj8YLSpDM1zzHybVz40kzz24JeP8OUaLCbrDzudqTIfGFfyBMnSz94AzDCdV3KCSzQRd1yqo-OV30SpPQQv0keuk3FeQ7XYD-9NsFETP140pF_mYMDRPbJzvZPvK7zHt69sSRXYV6uCmExbj1JqPiaQ Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}] Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 043d8b949008434ca761dd5b70181c17 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2018585505", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 0}} Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2018585505', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'min_count': 0}}} Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi 0 Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:11:57.353111 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 12 09:11:57.356992 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.361734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d3482858-3f55-4d3e-80e2-b45e424404f9 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:57.364193 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d3482858-3f55-4d3e-80e2-b45e424404f9 tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021300 Oct 12 09:11:57.378679 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2650/5723] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:11:57 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:11:57.515123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02dc73d5-cf3b-4098-923f-494f63a4fa4d tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-176963824", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 2.5}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02dc73d5-cf3b-4098-923f-494f63a4fa4d tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Request method failure captured: Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 169 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoTb8cObdoaD4-ty2g81a6WMIj8YLSpDM1zzHybVz40kzz24JeP8OUaLCbrDzudqTIfGFfyBMnSz94AzDCdV3KCSzQRd1yqo-OV30SpPQQv0keuk3FeQ7XYD-9NsFETP140pF_mYMDRPbJzvZPvK7zHt69sSRXYV6uCmExbj1JqPiaQ Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_45c2da5bc2ed4386acf0cfceece93f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/45c2da5bc2ed4386acf0cfceece93f87"}]}] Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 45c2da5bc2ed4386acf0cfceece93f87 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-95154850 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 043d8b949008434ca761dd5b70181c17 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-95154850-project Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-176963824", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "min_count": 2.5}} Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-176963824', 'imageRef': '3816cc90-eecd-445f-9498-be8ec212c308', 'flavorRef': '452', 'min_count': 2.5}}} Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi 2.5 Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:11:57.522137 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02dc73d5-cf3b-4098-923f-494f63a4fa4d tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:11:57.529115 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02dc73d5-cf3b-4098-923f-494f63a4fa4d tempest-MultipleCreateNegativeTestJSON-95154850 tempest-MultipleCreateNegativeTestJSON-95154850-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012892 Oct 12 09:11:57.535153 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3074/5724] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:11:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:11:59.953092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:11:59.954010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:11:59.973165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:59.975645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=5,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:11:59.983559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:59.984522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:59.987756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:11:59.989604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:11:59.992311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:11:59.992988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:00.210242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lazy-loading 'services' on Instance uuid 4560c0f5-8d33-4495-a3c6-5597b176a35d {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:12:00.358034 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c98c6ca2-5a04-4f73-a179-778440b87372 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments/b9b79521-fbe2-434a-8516-83f5f3ba87de" status: 202 len: 0 microversion: 2.1 time: 0.407443 Oct 12 09:12:00.360039 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2651/5725] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:11:59 2022] DELETE /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments/b9b79521-fbe2-434a-8516-83f5f3ba87de => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:12:00.374846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:00.378965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:00.395884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:00.397551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:00.402210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:00.403880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:00.404752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:00.405407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:00.480136 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a8f710af-dcff-40fc-9433-6f835aaa0445 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115386 Oct 12 09:12:00.485357 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3075/5726] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:00 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:01.493852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:01.496995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:01.508101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:01.508995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:01.509724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:01.510662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:01.511347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:01.512299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:01.551205 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7b27570c-78f1-4a33-9949-7b0de555e874 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062304 Oct 12 09:12:01.552485 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2652/5727] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:01 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:02.567131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:02.569328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:02.584665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:02.585174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:02.598557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:02.599356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:02.606729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:02.607453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:02.711481 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6e609043-d505-432a-806c-0ba01dacca48 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147989 Oct 12 09:12:02.719970 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3076/5728] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:02 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:03.726772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:03.731423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:03.749389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:03.752298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:03.752829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:03.754119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:03.757661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:03.758220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:03.875626 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d6d4e5b-4d18-4c34-8226-c145166a03cf tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154418 Oct 12 09:12:03.878918 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2653/5729] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:03 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:04.890986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:04.893803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:04.928955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:04.930450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:04.934295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:04.940716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:04.941498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:04.942861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:05.085577 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b9c22cd9-e17b-4ba1-847e-2d0e82d95141 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191352 Oct 12 09:12:05.087343 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3077/5730] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:04 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:12:06.100673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:06.103464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:06.131568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:06.132171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:06.132682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:06.133410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:06.133934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:06.134364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:06.235581 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7737cb35-4a0b-42ce-9294-b7d3683ba01d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138876 Oct 12 09:12:06.238856 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2654/5731] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:06 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:06.445339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:06.453326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:06.481098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:06.483903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:06.484368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:06.485105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:06.501745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:06.502354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:06.577252 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80a10ea1-6ac0-4fee-9307-5058e6145fe2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137999 Oct 12 09:12:06.578349 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3078/5732] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:06 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:06.590849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:06.591672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:06.608937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:06.609659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:06.610284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:06.611183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:06.612040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:06.612666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:06.722999 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65ade074-b412-4c05-87b8-3829675d1622 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/38d3dfa7-10a8-4ae1-9847-f8b35ae1d4d7" status: 200 len: 194 microversion: 2.1 time: 0.137336 Oct 12 09:12:06.729759 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2655/5733] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Oct 12 09:12:06 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/38d3dfa7-10a8-4ae1-9847-f8b35ae1d4d7 => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:07.262055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:07.267200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:07.291062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:07.291564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:07.291997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:07.292717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:07.309790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:07.311571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:07.476549 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f54366d-8ef8-4e43-8198-f509737edbec tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217906 Oct 12 09:12:07.487980 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3079/5734] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:07 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:08.492625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:08.500131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:08.523325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:08.523883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:08.532559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:08.534661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:08.536028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:08.539620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:08.657719 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c383759-1d47-449a-9eb8-9e0f73b59fa2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171064 Oct 12 09:12:08.664639 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2656/5735] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:08 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:09.671226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:09.673464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:09.695061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:09.695613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:09.696105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:09.714080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:09.714839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:09.715571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:09.858322 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38f22857-0420-4d0d-b45b-4a789ac8c773 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191569 Oct 12 09:12:09.872789 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3080/5736] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:09 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:10.876176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72c84476-8015-445e-a48d-f8887ebdb2f5"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:10.877911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:10.882480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:10.884281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:10.910603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:10.911140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:10.919898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:10.920417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:10.921362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:10.922164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:10.922620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:10.923602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:10.926746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:10.932463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:10.933062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:10.933785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:11.020345 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6cebc0ef-eb63-43e7-bd90-25784b055184 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149302 Oct 12 09:12:11.031874 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3081/5737] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:10 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:12:11.514242 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0acc79e8-995d-43ac-b92e-e4e1a3281d00 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "POST /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647784 Oct 12 09:12:11.514922 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2657/5738] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:12:10 2022] POST /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:12.032578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:12.034815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:12.058339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:12.058857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:12.059304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:12.060036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:12.060500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:12.060963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:12.128916 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a120cad2-44cb-4e4a-9899-25b60ce4145b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100366 Oct 12 09:12:12.134493 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3082/5739] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:12 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:12:12.287736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:12.293253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:12.305594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:12.308957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:12.309740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:12.313582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:12.314301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:12.314953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:12.420200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:12:12.587941 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dd762649-90a1-462e-bc37-bcfb87b1c248 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 204 len: 0 microversion: 2.1 time: 0.308156 Oct 12 09:12:12.588871 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2658/5740] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:12:12 2022] DELETE /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:12:12.614873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:12.619879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:12.636498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:12.645311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:12.646239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:12.647244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:12.647952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:12.648901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:13.230494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:13.239031 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-273639dc-64f9-49cc-bba7-d85b107ba4a3 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1681 microversion: 2.1 time: 0.645300 Oct 12 09:12:13.239627 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3083/5741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:12 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1681 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:14.269313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:14.270091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:14.296609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:14.297153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:14.299637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:14.304640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:14.305756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:14.308722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:15.324132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1318413131", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "1a09a480-c1df-4716-92f2-d5b8cb081d0c"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:15.401401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:15.430429 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dfef555a-910f-400d-8e3c-5326b3737710 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1681 microversion: 2.1 time: 1.155140 Oct 12 09:12:15.437162 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2659/5742] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:14 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1681 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:15.481718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] validate_networks() for [('1a09a480-c1df-4716-92f2-d5b8cb081d0c', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:12:16.474520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:16.475220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:16.499379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:16.501239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:16.503803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:16.506557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:16.507944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:16.511123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:17.083192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:17.105002 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-12b82486-e6fe-4b1f-b304-53a13dca225d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1681 microversion: 2.1 time: 0.648576 Oct 12 09:12:17.107139 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2660/5743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:16 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1681 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:18.137276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:18.139029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:18.157941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:18.161853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:18.164816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:18.165894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:18.169199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:18.175115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:19.035355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:12:19.035837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:12:19.036243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:12:19.036654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:12:19.037219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:12:19.055975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:19.057725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:19.058407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:19.064396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:19.065142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:19.065953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:19.096077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:19.105876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Getting quotas for project a328e2ffac2a494e9161232273ca330a. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:12:19.110298 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc569896-7131-46e5-9aef-68230a83332b tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1681 microversion: 2.1 time: 0.977789 Oct 12 09:12:19.112092 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2661/5744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:18 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1681 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:19.157113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Getting quotas for user 115169275d84466a9b9dd7b46417cc43 and project a328e2ffac2a494e9161232273ca330a. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:12:19.201007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:12:19.203772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:12:19.332667 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f974fbb-f46f-4960-99f9-e69780576ba4 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.775875 Oct 12 09:12:19.340986 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3084/5745] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:12:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:12:19.346662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-820d8710-fb26-4d35-a026-9511decfd167 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:19.347295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-820d8710-fb26-4d35-a026-9511decfd167 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:19.673341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-820d8710-fb26-4d35-a026-9511decfd167 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:19.684100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-820d8710-fb26-4d35-a026-9511decfd167 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1214 microversion: 2.1 time: 0.341881 Oct 12 09:12:19.705142 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2662/5746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:19 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1214 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:20.140415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:20.156311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:20.194768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:20.203102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:20.204232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:20.212608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:20.213515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:20.215587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:20.962059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-15de3380-a299-4b65-b4cf-56c8ebcab1ca req-1e5db686-9e1b-4941-888f-34b8119b0ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4560c0f5-8d33-4495-a3c6-5597b176a35d", "name": "network-vif-deleted", "tag": "edbc1528-772b-4e7c-95cd-5f20ce270c47"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:20.994507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-15de3380-a299-4b65-b4cf-56c8ebcab1ca req-1e5db686-9e1b-4941-888f-34b8119b0ab2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:20.998195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-15de3380-a299-4b65-b4cf-56c8ebcab1ca req-1e5db686-9e1b-4941-888f-34b8119b0ab2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:20.998853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-15de3380-a299-4b65-b4cf-56c8ebcab1ca req-1e5db686-9e1b-4941-888f-34b8119b0ab2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:21.034571 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-15de3380-a299-4b65-b4cf-56c8ebcab1ca req-1e5db686-9e1b-4941-888f-34b8119b0ab2 service nova] Creating event network-vif-deleted:edbc1528-772b-4e7c-95cd-5f20ce270c47 for instance 4560c0f5-8d33-4495-a3c6-5597b176a35d on n-h1-858383-10 Oct 12 09:12:21.055081 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-15de3380-a299-4b65-b4cf-56c8ebcab1ca req-1e5db686-9e1b-4941-888f-34b8119b0ab2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.938951 Oct 12 09:12:21.063094 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3085/5747] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:21.075987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:21.082740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:21.110625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:21.111820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:21.118122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:21.119127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:21.121175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:21.121881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:21.332810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9531ada325c4b868f3bcd62331ab827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9524a43c39d444e48cdc56d7e7ffef45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:21.341137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2929c02-aab5-4ad0-af01-7b21e474f8d1 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 200 len: 1326 microversion: 2.1 time: 1.206495 Oct 12 09:12:21.349339 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2663/5748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:20 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 1326 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:21.433718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:21.450311 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7360e42-9ef9-4077-89bc-16e77d5845ab tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1266 microversion: 2.1 time: 0.385563 Oct 12 09:12:21.454921 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3086/5749] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:21 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:22.373074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:22.374458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:22.390271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:22.391102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:22.391723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:22.392626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:22.393261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:22.393908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:22.430799 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d HTTP/1.1 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '4560c0f5-8d33-4495-a3c6-5597b176a35d'} Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:22.445475 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:22.449952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:22.449952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:22.449952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:22.449952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:22.449952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:22.449952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:22.449952 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:22.451512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:22.454882 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e64fd378-5771-4577-bf02-3bbb8ccd44c4 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 404 len: 111 microversion: 2.1 time: 0.086386 Oct 12 09:12:22.456634 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2664/5750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:22 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:22.470598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e9c0da8-70f3-4cf8-a7be-bd2160604d3d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '.version_select at 0x7f9843df5c10>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:22.480786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:22.484587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:22.502336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:22.502876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:22.511377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:22.513881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:22.517357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:22.518604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:22.530340 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e9c0da8-70f3-4cf8-a7be-bd2160604d3d tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608012977" status: 202 len: 0 microversion: 2.1 time: 0.067428 Oct 12 09:12:22.536450 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3087/5751] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 09:12:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608012977 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:12:22.570043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:22.714333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:22.723109 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0112daa9-93cf-47f8-99b2-1a10970094f6 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1272 microversion: 2.1 time: 0.250122 Oct 12 09:12:22.725027 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2665/5752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:22 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:23.751198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:23.752842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:23.780524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:23.781554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:23.782255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:23.783691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:23.785827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:23.787681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:23.851925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-163752872", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "9cd9e8be-f05c-4b91-89ed-77b3230d5d7d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2097222838", "security_groups": []}, "os:scheduler_hints": {"different_host": ["2bc893eb-327b-4365-ab8a-b5373a41799c"]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:23.978954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] validate_networks() for [('9cd9e8be-f05c-4b91-89ed-77b3230d5d7d', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:12:24.180746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:24.192972 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-103b427c-c205-4521-95ab-1beb2f345623 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1272 microversion: 2.1 time: 0.445956 Oct 12 09:12:24.215834 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3088/5753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:23 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1272 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:25.223830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:25.224495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:25.243702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:25.245575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:25.246049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:25.251094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:25.251835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:25.252289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:25.595976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:12:25.596519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:12:25.597009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:12:25.597610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:12:25.598135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:12:25.622895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:25.623351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:25.623800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:25.624535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:25.624996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:25.637482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:25.682557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Getting quotas for project dae3fa763c174899bd7caff7453f3de8. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:12:25.698633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Getting quotas for user 4d4a1b8ae1f94acca3723e99355aba38 and project dae3fa763c174899bd7caff7453f3de8. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:12:25.732615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:12:25.741276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:12:25.870652 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e6f42eae-2a86-448d-9e54-caf8058f417c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.022971 Oct 12 09:12:25.873316 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2666/5754] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:12:23 2022] POST /compute/v2.1/servers => generated 361 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:12:25.885752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7893f79f-89c0-4641-b232-e94f2e503fb9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:25.887074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7893f79f-89c0-4641-b232-e94f2e503fb9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:26.274813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:26.311482 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e26496b8-f224-49d2-926d-06cfcf401b71 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1314 microversion: 2.1 time: 1.092380 Oct 12 09:12:26.314572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3089/5755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:25 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1314 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:26.509921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7893f79f-89c0-4641-b232-e94f2e503fb9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:26.517545 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7893f79f-89c0-4641-b232-e94f2e503fb9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1241 microversion: 2.1 time: 0.637889 Oct 12 09:12:26.521143 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2667/5756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:25 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1241 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:27.339866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:27.340711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:27.351816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:27.360614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:27.361637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:27.362573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:27.365119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:27.366519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:27.543635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:27.544802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:27.558266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:27.558765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:27.559212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:27.559934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:27.560399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:27.560834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:27.770170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:27.780836 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c48ed63-6ea5-4e41-892a-04ac46e0828f tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1314 microversion: 2.1 time: 0.443992 Oct 12 09:12:27.797852 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3090/5757] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:27 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:27.811053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a37ed3c0-7b3d-4d37-a7ce-ac644e6ba3a2 req-6644d71e-129a-4751-859a-59d5ad0f82d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308c7885-36bd-4e34-9f7f-fa93f035283a", "tag": "e6a202fc-566b-4fae-bc30-da207576927b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:27.842056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a37ed3c0-7b3d-4d37-a7ce-ac644e6ba3a2 req-6644d71e-129a-4751-859a-59d5ad0f82d0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:27.846122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:27.855339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a37ed3c0-7b3d-4d37-a7ce-ac644e6ba3a2 req-6644d71e-129a-4751-859a-59d5ad0f82d0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:27.855804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a37ed3c0-7b3d-4d37-a7ce-ac644e6ba3a2 req-6644d71e-129a-4751-859a-59d5ad0f82d0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:27.863744 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6610d54b-fdd6-4bd2-b1ac-bbfea2a08068 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1293 microversion: 2.1 time: 0.324124 Oct 12 09:12:27.864928 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2668/5758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:27 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1293 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:27.897967 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a37ed3c0-7b3d-4d37-a7ce-ac644e6ba3a2 req-6644d71e-129a-4751-859a-59d5ad0f82d0 service nova] Creating event network-changed:e6a202fc-566b-4fae-bc30-da207576927b for instance 308c7885-36bd-4e34-9f7f-fa93f035283a on n-h2-858383-10 Oct 12 09:12:27.911439 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a37ed3c0-7b3d-4d37-a7ce-ac644e6ba3a2 req-6644d71e-129a-4751-859a-59d5ad0f82d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112061 Oct 12 09:12:27.920792 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3091/5759] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:28.804810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:28.805672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:28.815151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:28.820561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:28.821140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:28.822776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:28.824080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:28.825127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:28.891429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:28.892864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:28.905215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:28.907903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:28.910918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:28.911923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:28.912607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:28.913283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:29.061919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:29.074707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c2328fed-5f76-46c2-afcb-14faf5203ccf tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.187607 Oct 12 09:12:29.076582 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3092/5760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:28 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:29.422845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:29.438134 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-331f483b-c977-46f8-acdb-910a0d185683 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1314 microversion: 2.1 time: 0.637354 Oct 12 09:12:29.456164 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2669/5761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:28 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:30.099528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:30.100162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:30.117215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:30.118919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:30.126099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:30.131843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:30.132526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:30.134072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:30.134706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:30.135297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:30.471173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:30.472437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:30.482254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:30.490370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:30.501129 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aafd35a4-553f-47bc-95c9-ee066ed656d4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.405652 Oct 12 09:12:30.501999 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3093/5762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:30 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:30.516829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:30.527782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:30.528323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:30.532554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:30.536751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:30.538286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:30.541129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.002903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:31.003419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:31.005656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:31.014586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.015378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.018626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.019880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.020960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.023118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.063904 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d HTTP/1.1 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '4560c0f5-8d33-4495-a3c6-5597b176a35d'} Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:31.071196 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:31.075341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-59cd603c-e59c-4408-b5fb-3e1c1efe32b7 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 404 len: 111 microversion: 2.1 time: 0.074234 Oct 12 09:12:31.076773 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3094/5763] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:12:30 2022] DELETE /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:12:31.086134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:31.086845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 4560c0f5-8d33-4495-a3c6-5597b176a35d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:31.104527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.115864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.119363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.120305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.121000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.122468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.195236 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d HTTP/1.1 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '4560c0f5-8d33-4495-a3c6-5597b176a35d'} Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:31.200639 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.205081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:31.205081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:31.205081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:31.205081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:31.205081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:31.205081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. Oct 12 09:12:31.205081 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:31.205081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 4560c0f5-8d33-4495-a3c6-5597b176a35d could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:31.220228 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-35090e34-ba73-4f31-91b7-aef5a5f319fb tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d" status: 404 len: 111 microversion: 2.1 time: 0.142257 Oct 12 09:12:31.222125 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3095/5764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:31 2022] GET /compute/v2.1/servers/4560c0f5-8d33-4495-a3c6-5597b176a35d => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:31.357407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:31.362640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:31.390626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.394084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.400650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.402457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.406604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.408636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.526126 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61243963-3605-4602-95c0-083b7696a850 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.172930 Oct 12 09:12:31.526743 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3096/5765] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:31 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments => generated 371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:12:31.541798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:31.556097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:31.574222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.574730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.575185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.575913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.576375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.576808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.743538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:31.752442 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-362597f5-bad9-497e-8f8e-b2274da861b6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.214564 Oct 12 09:12:31.753251 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3097/5766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:31 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:31.766880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:31.767672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:31.782916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.783690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.785899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.786817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.788942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.789722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.868915 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8503568-ff57-4b52-a08d-ed5ab4d917eb tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/38d3dfa7-10a8-4ae1-9847-f8b35ae1d4d7" status: 200 len: 194 microversion: 2.1 time: 0.114407 Oct 12 09:12:31.874440 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3098/5767] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Oct 12 09:12:31 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/38d3dfa7-10a8-4ae1-9847-f8b35ae1d4d7 => generated 194 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:31.886618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:31.897098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:31.903972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.904476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.904922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:31.905675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:31.906139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:31.906569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:32.099325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lazy-loading 'services' on Instance uuid c2f90057-6208-4a50-b0d3-e2060bf816d1 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:12:32.336287 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad4d32c2-571e-4d77-8c2c-adc351faf6f5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/38d3dfa7-10a8-4ae1-9847-f8b35ae1d4d7" status: 202 len: 0 microversion: 2.1 time: 0.453385 Oct 12 09:12:32.337006 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3099/5768] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:12:31 2022] DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/38d3dfa7-10a8-4ae1-9847-f8b35ae1d4d7 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:12:32.549586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:32.561416 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-500d2545-9857-4827-bf3e-811edcd74cd7 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1314 microversion: 2.1 time: 2.098626 Oct 12 09:12:32.563607 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2670/5769] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:30 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1314 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:32.790037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:32.796101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:32.806600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:32.808295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:32.808973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:32.810135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:32.810807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:32.811921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:33.431647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:33.441407 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8f8b7a8-96c5-4999-a5ed-ac3d90402c9b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.665954 Oct 12 09:12:33.442049 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3100/5770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:32 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:33.590123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:33.590745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:33.602893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:33.606075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:33.606554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:33.607304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:33.611576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:33.613906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:34.416627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:34.428796 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-73f25a85-e015-420c-a9bd-2611c5f4672c tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1314 microversion: 2.1 time: 0.844468 Oct 12 09:12:34.433938 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2671/5771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:33 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1314 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:34.473248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:34.474728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:34.488610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:34.489610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:34.490874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:34.492242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:34.494691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:34.495596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:34.878809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:34.911844 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67c4bc33-2c4f-4875-a0f2-a67890cf6374 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.444753 Oct 12 09:12:34.913739 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3101/5772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:34 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:35.457302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:35.458838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:35.490586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:35.493250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:35.495063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:35.495922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:35.498021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:35.499315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:35.656090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:35.666385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b530715d-031f-459b-935d-2c4f034015ef req-8e702b16-a371-4265-9877-20e6bb66293a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e72f56c9-ec97-4036-8169-492534242aab", "tag": "2b86fa1f-a31a-4fcf-96e3-f13ecc06df17"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:35.689604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b530715d-031f-459b-935d-2c4f034015ef req-8e702b16-a371-4265-9877-20e6bb66293a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:35.690906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b530715d-031f-459b-935d-2c4f034015ef req-8e702b16-a371-4265-9877-20e6bb66293a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:35.693569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b530715d-031f-459b-935d-2c4f034015ef req-8e702b16-a371-4265-9877-20e6bb66293a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:35.726332 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b530715d-031f-459b-935d-2c4f034015ef req-8e702b16-a371-4265-9877-20e6bb66293a service nova] Creating event network-changed:2b86fa1f-a31a-4fcf-96e3-f13ecc06df17 for instance e72f56c9-ec97-4036-8169-492534242aab on n-h2-858383-10 Oct 12 09:12:35.738001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b530715d-031f-459b-935d-2c4f034015ef req-8e702b16-a371-4265-9877-20e6bb66293a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076973 Oct 12 09:12:35.740195 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3102/5773] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:35.760739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c9eab0fd-1bdb-4ce9-acb1-e2ed51b8936e req-ddc8e6c1-6ecf-4a25-9035-791d60385e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308c7885-36bd-4e34-9f7f-fa93f035283a", "name": "network-vif-plugged", "status": "completed", "tag": "e6a202fc-566b-4fae-bc30-da207576927b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:35.793530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c9eab0fd-1bdb-4ce9-acb1-e2ed51b8936e req-ddc8e6c1-6ecf-4a25-9035-791d60385e4b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:35.796138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c9eab0fd-1bdb-4ce9-acb1-e2ed51b8936e req-ddc8e6c1-6ecf-4a25-9035-791d60385e4b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:35.796868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c9eab0fd-1bdb-4ce9-acb1-e2ed51b8936e req-ddc8e6c1-6ecf-4a25-9035-791d60385e4b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:35.853369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c9eab0fd-1bdb-4ce9-acb1-e2ed51b8936e req-ddc8e6c1-6ecf-4a25-9035-791d60385e4b service nova] Creating event network-vif-plugged:e6a202fc-566b-4fae-bc30-da207576927b for instance 308c7885-36bd-4e34-9f7f-fa93f035283a on n-h2-858383-10 Oct 12 09:12:35.864052 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c9eab0fd-1bdb-4ce9-acb1-e2ed51b8936e req-ddc8e6c1-6ecf-4a25-9035-791d60385e4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109253 Oct 12 09:12:35.871557 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3103/5774] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:12:35.941461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:35.942557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:35.957657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:35.959490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:35.960026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:35.963245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:35.963970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:35.964473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:36.168917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:36.185297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ab2de0be-cec0-4e83-9b33-90e4345b31ff tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.247484 Oct 12 09:12:36.206222 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3104/5775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:35 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:36.517632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=10 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:36.879802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:36.902325 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ef3310d-6ed8-4d7e-87f9-9165dab1a499 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1314 microversion: 2.1 time: 1.448710 Oct 12 09:12:36.907667 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2672/5776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:35 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1314 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:37.229222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:37.229962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:37.264861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:37.271102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:37.273341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:37.277584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:37.284518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:37.285239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:37.743741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:37.758948 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89236c28-55a2-4912-8e66-2919512cafe9 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.549981 Oct 12 09:12:37.760836 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3105/5777] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:37 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:37.932973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:37.934522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:37.970951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:37.973152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:37.974209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:37.978141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:37.978832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:37.979483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:38.608763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:38.623029 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bfb8e391-de78-42aa-bad5-8985550fde39 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1314 microversion: 2.1 time: 0.696247 Oct 12 09:12:38.630923 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2673/5778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:37 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:38.786703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:38.788624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:38.810930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:38.812862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:38.814649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:38.817156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:38.819241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:38.821573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.140256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:39.155879 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d6d2a73-f1e3-4c91-9a39-2f1bae21437b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.368255 Oct 12 09:12:39.159692 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3106/5779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:38 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:39.382230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:39.382834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:39.401178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.401992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.403254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.405547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.408256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.409317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.460656 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 HTTP/1.1 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8'} Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:39.466845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.471134 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.472946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:39.477545 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ca9fae3b-3a9a-4d17-bc12-2344a5cf9669 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 404 len: 111 microversion: 2.1 time: 0.098847 Oct 12 09:12:39.480352 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2674/5780] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:12:39 2022] DELETE /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:39.486509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:39.487124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:39.499447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.502281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.502762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.509167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.510021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.511558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.599772 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 HTTP/1.1 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8'} Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:39.611876 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.615658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.615658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:39.615658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:39.615658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:39.615658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:39.615658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. Oct 12 09:12:39.615658 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.615658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:39.620027 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe12f63e-bc8e-47c0-bcf7-4df0779fb407 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8" status: 404 len: 111 microversion: 2.1 time: 0.137321 Oct 12 09:12:39.627035 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3107/5781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:39 2022] GET /compute/v2.1/servers/3f60e87a-c7cb-4ef9-b61f-5e492f0ad0c8 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:39.636619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:39.637577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:39.654518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.658035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:39.659326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.660022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:39.662452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.665751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.666256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.669790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.692902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.694123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.696139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.704336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.704963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.706814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.764592 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 HTTP/1.1 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '321062c0-31e6-40dd-b8f8-b6a1f8659bf4'} Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:39.796478 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.799875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:39.801101 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc0edd1c-f86b-477f-ac75-bada58a90105 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 404 len: 111 microversion: 2.1 time: 0.170062 Oct 12 09:12:39.809189 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2675/5782] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:12:39 2022] DELETE /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:39.863480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:39.864952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: 321062c0-31e6-40dd-b8f8-b6a1f8659bf4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:39.898390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.898969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.902562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.912163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:39.913811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:39.917870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:39.950984 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 HTTP/1.1 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '321062c0-31e6-40dd-b8f8-b6a1f8659bf4'} Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:39.955491 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.959155 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:39.959155 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:39.959155 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:39.959155 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:39.959155 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:39.959155 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. Oct 12 09:12:39.959155 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:39.966086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance 321062c0-31e6-40dd-b8f8-b6a1f8659bf4 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:39.969088 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae22a5c1-4c6a-4037-9832-b981183b34f2 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4" status: 404 len: 111 microversion: 2.1 time: 0.155666 Oct 12 09:12:39.979933 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2676/5783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:39 2022] GET /compute/v2.1/servers/321062c0-31e6-40dd-b8f8-b6a1f8659bf4 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:40.183551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:40.186994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:40.227435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:40.228988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:40.231994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:40.234198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:40.237227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:40.240973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:40.411229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:40.431136 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7716e8ba-aab9-489a-8080-8c7f4573f938 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1497 microversion: 2.1 time: 0.782025 Oct 12 09:12:40.450424 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3108/5784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:39 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1497 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:40.555500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:40.568836 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-292e2321-b0f0-4a67-a9d8-eaf25bffb597 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.388206 Oct 12 09:12:40.576104 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2677/5785] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:40 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:41.606225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:41.607123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:41.626223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:41.633479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:41.633957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:41.635015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:41.635983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:41.640977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:42.025456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:42.055412 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aebcc7fe-0b35-4fcb-b5a1-198cedc2cac8 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.457067 Oct 12 09:12:42.058648 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3109/5786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:41 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:43.081360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:43.083762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:43.092941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:43.095608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:43.097766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:43.099948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:43.101950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:43.103897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:43.344050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:43.354402 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d0c440e1-9305-4146-81a8-dbf3a4fc10f3 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.277632 Oct 12 09:12:43.374142 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2678/5787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:43 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:43.736344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a854c57a-bc25-4be7-b544-2dca24c6c23b req-ed0226b6-cb21-4894-9a70-2396e2e03b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72f56c9-ec97-4036-8169-492534242aab", "name": "network-vif-plugged", "status": "completed", "tag": "2b86fa1f-a31a-4fcf-96e3-f13ecc06df17"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:43.788012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a854c57a-bc25-4be7-b544-2dca24c6c23b req-ed0226b6-cb21-4894-9a70-2396e2e03b22 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:43.791568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a854c57a-bc25-4be7-b544-2dca24c6c23b req-ed0226b6-cb21-4894-9a70-2396e2e03b22 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:43.792121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a854c57a-bc25-4be7-b544-2dca24c6c23b req-ed0226b6-cb21-4894-9a70-2396e2e03b22 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:43.867995 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a854c57a-bc25-4be7-b544-2dca24c6c23b req-ed0226b6-cb21-4894-9a70-2396e2e03b22 service nova] Creating event network-vif-plugged:2b86fa1f-a31a-4fcf-96e3-f13ecc06df17 for instance e72f56c9-ec97-4036-8169-492534242aab on n-h2-858383-10 Oct 12 09:12:43.891881 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a854c57a-bc25-4be7-b544-2dca24c6c23b req-ed0226b6-cb21-4894-9a70-2396e2e03b22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159720 Oct 12 09:12:43.892511 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3110/5788] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:44.043234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:44.043789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:44.057232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:44.057759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:44.058201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:44.058906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:44.072601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:44.073228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:44.190677 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-421e1d9c-b24d-43d7-9b4a-0ccd10cda37f tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/72c84476-8015-445e-a48d-f8887ebdb2f5" status: 200 len: 194 microversion: 2.1 time: 0.151946 Oct 12 09:12:44.192739 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2679/5789] 10.222.0.40 () {58 vars in 1413 bytes} [Wed Oct 12 09:12:44 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/72c84476-8015-445e-a48d-f8887ebdb2f5 => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:12:44.207464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:44.208606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:44.240297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:44.241318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:44.241964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:44.244934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:44.245666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:44.246265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:44.381741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:44.382921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:44.397192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:44.398453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:44.399636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:44.402742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:44.403505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:44.406244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:44.462913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lazy-loading 'services' on Instance uuid c2f90057-6208-4a50-b0d3-e2060bf816d1 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:12:44.623667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:44.633084 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-307db717-1f3d-47b8-a626-b01fb688378a tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.256542 Oct 12 09:12:44.640528 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2680/5790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:44 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:44.677930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-99a792d2-43e1-4183-99ee-d900813b5277 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/72c84476-8015-445e-a48d-f8887ebdb2f5" status: 202 len: 0 microversion: 2.1 time: 0.472865 Oct 12 09:12:44.680798 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3111/5791] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:12:44 2022] DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments/72c84476-8015-445e-a48d-f8887ebdb2f5 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:12:45.665465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:45.666953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:45.678650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:45.681427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:45.684147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:45.685785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:45.688731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:45.689461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:45.938683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:45.955523 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0edb06cb-f76c-4792-93f4-d76e78f3db14 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1299 microversion: 2.1 time: 0.294343 Oct 12 09:12:45.956992 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2681/5792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:45 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:46.533149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:46.534673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:46.553982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:46.556733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:46.557135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:46.557903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:46.560356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:46.562737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:46.639251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:12:46.689679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:46.897896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24b10c39-1dda-47ab-9ecc-6b6d7fb39cb5 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "DELETE /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 204 len: 0 microversion: 2.1 time: 0.369789 Oct 12 09:12:46.898767 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3112/5793] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:12:46 2022] DELETE /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:12:46.907103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:46.907752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:46.925234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:46.925867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:46.926400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:46.927169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:46.927655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:46.928103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:46.991390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:46.992550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:47.000836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:47.001640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:47.002296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:47.003241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:47.004069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:47.004713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:47.419993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:47.429160 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2e3316ab-b782-454d-b352-c532348d097c tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1472 microversion: 2.1 time: 0.450596 Oct 12 09:12:47.429875 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3113/5794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:46 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:47.454658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:47.455302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:47.465793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:47.467876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:47.468666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:47.469579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:47.470285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:47.470927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:47.534531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:47.546277 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7df5b273-ee6b-4eb8-bba8-6e94107ee184 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1503 microversion: 2.1 time: 0.643291 Oct 12 09:12:47.550338 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2682/5795] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:46 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1503 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:47.884957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:47.904584 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51ca5fb2-5a6d-48d6-a4df-c7f26d815f09 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1472 microversion: 2.1 time: 0.447088 Oct 12 09:12:47.926108 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3114/5796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:47 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1472 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:47.932820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:47.934586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:47.952664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:47.953479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:47.955237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:47.956069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:47.957699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:47.959420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:48.205413 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9adf9a25-c47d-440c-9157-23813bfa288c tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1625 microversion: 2.1 time: 0.272777 Oct 12 09:12:48.207786 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2683/5797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:47 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1625 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:48.237735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:48.239504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:48.252055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:48.252560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:48.264127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:48.265236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:48.266176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:48.283147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:48.571299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:48.571918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:48.585125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:48.587888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:48.588341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:48.589079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:48.603985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:48.604836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:48.765879 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6f26d38f-624b-4505-8626-d7b603dab94f tempest-TestSecurityGroupsBasicOps-725856265 tempest-TestSecurityGroupsBasicOps-725856265-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1913 microversion: 2.1 time: 0.533401 Oct 12 09:12:48.766471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3115/5798] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:48 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1913 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:49.050446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:49.051077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:49.065737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:49.066260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:49.066701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:49.067425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:49.067878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:49.068302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:49.166741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:12:49.272910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:49.287091 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b36a58a6-89cd-4ec7-b6ff-16c358492272 tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1503 microversion: 2.1 time: 0.719969 Oct 12 09:12:49.293765 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2684/5799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:48 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1503 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:12:49.391437 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a5c374b-e99d-4137-a0eb-46fb627e3201 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 204 len: 0 microversion: 2.1 time: 0.341552 Oct 12 09:12:49.395128 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3116/5800] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:12:49 2022] DELETE /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:12:49.403939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:49.404985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:49.417769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:49.423699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:49.424506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:49.431495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:49.432804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:49.433713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:50.002535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:50.011152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:12:50.015528 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a622f00-26e2-420f-aa6d-c26aad6a1e12 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1478 microversion: 2.1 time: 0.615910 Oct 12 09:12:50.020598 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2685/5801] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:49 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1478 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:50.318998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:50.320944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:50.346589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:50.348452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:50.353331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:50.354258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:50.361561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:50.362046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:50.515538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:50.516797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:50.538265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:50.544105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:50.545270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:50.547888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:50.551909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:50.555577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:50.613585 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 HTTP/1.1 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'b7ee6956-f9fb-408c-9eeb-e101fd460ec8'} Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:50.616472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.620541 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.623481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:50.625296 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-559b6e7a-1e42-4c77-bec9-a193cb4d1b04 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 404 len: 111 microversion: 2.1 time: 0.114699 Oct 12 09:12:50.629249 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2686/5802] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:12:50 2022] DELETE /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:12:50.645402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:50.648761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] [instance: b7ee6956-f9fb-408c-9eeb-e101fd460ec8] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:50.691292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:50.697547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:50.698053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:50.698500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:50.702722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:50.707567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:50.707964 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9ac4b138-a636-4cf4-9f88-f20a4e6407db tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1461 microversion: 2.1 time: 0.390353 Oct 12 09:12:50.717228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:50.732248 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3117/5803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:50 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1461 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:50.784663 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] HTTP exception thrown: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Request method failure captured: Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 HTTP/1.1 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoNRUgeuNYp5_NzJd09-l3-qVYn0noulqvMbfnztNt9RKYX3oKRAwf2eMLyDV-m7rWJ0kFD2oU7ai45TaiAMmsLjT92_1yDWDJICBBsz-n3kF0EX7k4YZTPmbk_MN0uhGd_2moYLPEYpI4KtUGHURivjZAOwUN43EHfxIY45f8EX9cs Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9524a43c39d444e48cdc56d7e7ffef45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9524a43c39d444e48cdc56d7e7ffef45"}]}] Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 9524a43c39d444e48cdc56d7e7ffef45 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-353150584 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: d9531ada325c4b868f3bcd62331ab827 Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeNegativeTest-353150584-project Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'b7ee6956-f9fb-408c-9eeb-e101fd460ec8'} Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:50.789559 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] Returning 404 to user: Instance b7ee6956-f9fb-408c-9eeb-e101fd460ec8 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:50.793958 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8ef22e69-d751-4c3c-8d08-4b0dddb1b540 tempest-AttachVolumeNegativeTest-353150584 tempest-AttachVolumeNegativeTest-353150584-project] 10.222.0.40 "GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8" status: 404 len: 111 microversion: 2.1 time: 0.155614 Oct 12 09:12:50.796199 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2687/5804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:50 2022] GET /compute/v2.1/servers/b7ee6956-f9fb-408c-9eeb-e101fd460ec8 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:51.043836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:51.054302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:51.077430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:51.078391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:51.081886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:51.083027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:51.086489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:51.091439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:51.439041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:51.453204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aca964e9-2902-4933-9e8f-d9f37690e657 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1478 microversion: 2.1 time: 0.409549 Oct 12 09:12:51.474957 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3118/5805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:51 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1478 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:51.738755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:51.740345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:51.756981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:51.758491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:51.766280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:51.768016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:51.770494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:51.777856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:51.785625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cbfb1456-0dcf-4a75-961a-ca0f2c0b4ab9 req-6ed6610a-8c4b-4b3a-abcf-66bee2f9dcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308c7885-36bd-4e34-9f7f-fa93f035283a", "name": "network-vif-deleted", "tag": "e6a202fc-566b-4fae-bc30-da207576927b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:51.825975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbfb1456-0dcf-4a75-961a-ca0f2c0b4ab9 req-6ed6610a-8c4b-4b3a-abcf-66bee2f9dcd6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:51.826470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbfb1456-0dcf-4a75-961a-ca0f2c0b4ab9 req-6ed6610a-8c4b-4b3a-abcf-66bee2f9dcd6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:51.826899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cbfb1456-0dcf-4a75-961a-ca0f2c0b4ab9 req-6ed6610a-8c4b-4b3a-abcf-66bee2f9dcd6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:51.870120 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cbfb1456-0dcf-4a75-961a-ca0f2c0b4ab9 req-6ed6610a-8c4b-4b3a-abcf-66bee2f9dcd6 service nova] Creating event network-vif-deleted:e6a202fc-566b-4fae-bc30-da207576927b for instance 308c7885-36bd-4e34-9f7f-fa93f035283a on n-h2-858383-10 Oct 12 09:12:51.875621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cbfb1456-0dcf-4a75-961a-ca0f2c0b4ab9 req-6ed6610a-8c4b-4b3a-abcf-66bee2f9dcd6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093602 Oct 12 09:12:51.876674 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3119/5806] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:12:52.091962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115169275d84466a9b9dd7b46417cc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a328e2ffac2a494e9161232273ca330a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:52.106819 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bd0b569f-7cee-48a5-8fe1-be8f250ded4e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 200 len: 1461 microversion: 2.1 time: 0.372487 Oct 12 09:12:52.117778 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2688/5807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:51 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 1461 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:52.489965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:52.490822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:52.554965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:52.555782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:52.558245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:52.565560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:52.566357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:52.566990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:53.143690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:53.144301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] [instance: 308c7885-36bd-4e34-9f7f-fa93f035283a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:53.163039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:53.174298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:53.180712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:53.188368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:53.196670 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4435314-ab25-4d39-8a36-38cffdae3479 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1478 microversion: 2.1 time: 0.719754 Oct 12 09:12:53.197268 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3120/5808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:52 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1478 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:53.197829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:53.198728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:53.206165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:53.240610 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] HTTP exception thrown: Instance 308c7885-36bd-4e34-9f7f-fa93f035283a could not be found. Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Request method failure captured: Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a HTTP/1.1 Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoTpghauLoZOAmnL0E9tig_ySOL5j1fo8A8P5xvtb_2YOpGQwBinLRYasJCeaOvtNXbls_-WuO5vg3QxD9lfgqc_zbeYzXbED3WY-Ttnkza3qrvuvQ7ff4yoxUc528fsMeQut-E8J_WTTN7y1coYINB-0zj62bxxd-ropdKqkcDuo0Y Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a328e2ffac2a494e9161232273ca330a Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesActionsTest-1738228594 Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a328e2ffac2a494e9161232273ca330a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a328e2ffac2a494e9161232273ca330a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a328e2ffac2a494e9161232273ca330a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a328e2ffac2a494e9161232273ca330a"}]}] Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesActionsTest-1738228594 Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a328e2ffac2a494e9161232273ca330a Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesActionsTest-1738228594 Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesActionsTest-1738228594-project Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 115169275d84466a9b9dd7b46417cc43 Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesActionsTest-1738228594-project Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 308c7885-36bd-4e34-9f7f-fa93f035283a could not be found. Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '308c7885-36bd-4e34-9f7f-fa93f035283a'} Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308c7885-36bd-4e34-9f7f-fa93f035283a could not be found. Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308c7885-36bd-4e34-9f7f-fa93f035283a could not be found. Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:53.242888 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:53.246919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:53.246919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:53.246919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:53.246919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:53.246919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:53.246919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308c7885-36bd-4e34-9f7f-fa93f035283a could not be found. Oct 12 09:12:53.246919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:12:53.254174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] Returning 404 to user: Instance 308c7885-36bd-4e34-9f7f-fa93f035283a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:53.256292 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-35c0a4e2-858d-4822-ba6b-5af229d8737e tempest-VolumesActionsTest-1738228594 tempest-VolumesActionsTest-1738228594-project] 10.222.0.40 "GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a" status: 404 len: 111 microversion: 2.1 time: 0.116504 Oct 12 09:12:53.259885 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2689/5809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:53 2022] GET /compute/v2.1/servers/308c7885-36bd-4e34-9f7f-fa93f035283a => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:54.227587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:54.228215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:54.246111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:54.247557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:54.248038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:54.252187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:54.255622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:54.256604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:54.299749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-08fdcc85-a4d6-4738-a2dc-cd3f9c39be97 req-8af6211f-e8de-4bf9-b16b-cc156ab4393e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72f56c9-ec97-4036-8169-492534242aab", "name": "network-vif-deleted", "tag": "2b86fa1f-a31a-4fcf-96e3-f13ecc06df17"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:12:54.330365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-08fdcc85-a4d6-4738-a2dc-cd3f9c39be97 req-8af6211f-e8de-4bf9-b16b-cc156ab4393e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:54.333224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-08fdcc85-a4d6-4738-a2dc-cd3f9c39be97 req-8af6211f-e8de-4bf9-b16b-cc156ab4393e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:54.334076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-08fdcc85-a4d6-4738-a2dc-cd3f9c39be97 req-8af6211f-e8de-4bf9-b16b-cc156ab4393e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:54.375690 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-08fdcc85-a4d6-4738-a2dc-cd3f9c39be97 req-8af6211f-e8de-4bf9-b16b-cc156ab4393e service nova] Creating event network-vif-deleted:2b86fa1f-a31a-4fcf-96e3-f13ecc06df17 for instance e72f56c9-ec97-4036-8169-492534242aab on n-h2-858383-10 Oct 12 09:12:54.388391 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-08fdcc85-a4d6-4738-a2dc-cd3f9c39be97 req-8af6211f-e8de-4bf9-b16b-cc156ab4393e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095010 Oct 12 09:12:54.389797 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2690/5810] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:12:54.527741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:54.550725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a51eea8d-599e-41db-a91a-86c154b046f4 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 200 len: 1478 microversion: 2.1 time: 0.330789 Oct 12 09:12:54.568186 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3121/5811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:54 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 1478 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:55.441381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:55.444503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:55.462765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:55.467806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:55.468612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:55.475557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:55.476484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:55.477088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:55.555167 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d093766-4c88-4978-a378-9d6fe2e970ff tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120089 Oct 12 09:12:55.559762 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2691/5812] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:55 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:12:55.582412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:55.583037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: e72f56c9-ec97-4036-8169-492534242aab] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:55.596632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:55.600517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:55.601371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:55.602396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:55.603026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:55.603497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:55.642867 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] HTTP exception thrown: Instance e72f56c9-ec97-4036-8169-492534242aab could not be found. Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Request method failure captured: Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab HTTP/1.1 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoSJqhBzYjZg2iQMb-90XueDHP-3-t-PsnnfYzuAWPae82qq6L92VcObwpFSUq7MPEO4B2vsWVh4NVMrrMWSzvS7n0dWsv-hSL0rCRcCmF-49JP3aI3TiNKplKisjM6T7PU-8nnQ6TJgFuQFowEhTuKtf7jmYfvVPQfeyKF8B_Lg5Ro Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: dae3fa763c174899bd7caff7453f3de8 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-540091167 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dae3fa763c174899bd7caff7453f3de8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dae3fa763c174899bd7caff7453f3de8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dae3fa763c174899bd7caff7453f3de8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dae3fa763c174899bd7caff7453f3de8"}]}] Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestSecurityGroupsBasicOps-540091167 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: dae3fa763c174899bd7caff7453f3de8 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-540091167 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestSecurityGroupsBasicOps-540091167-project Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 4d4a1b8ae1f94acca3723e99355aba38 Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestSecurityGroupsBasicOps-540091167-project Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance e72f56c9-ec97-4036-8169-492534242aab could not be found. Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'e72f56c9-ec97-4036-8169-492534242aab'} Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72f56c9-ec97-4036-8169-492534242aab could not be found. Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72f56c9-ec97-4036-8169-492534242aab could not be found. Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:12:55.647318 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72f56c9-ec97-4036-8169-492534242aab could not be found. Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Returning 404 to user: Instance e72f56c9-ec97-4036-8169-492534242aab could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:12:55.651183 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a5bc51a3-93c3-409e-abce-e32707c9896b tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab" status: 404 len: 111 microversion: 2.1 time: 0.071142 Oct 12 09:12:55.656386 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3122/5813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:55 2022] GET /compute/v2.1/servers/e72f56c9-ec97-4036-8169-492534242aab => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:12:55.747730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:55.750412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:55.761107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:55.761245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:55.762409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:55.763144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:55.763611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:55.764838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:55.805912 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6afa1115-c213-4976-a2ba-57315131beb3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061215 Oct 12 09:12:55.812067 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2692/5814] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:12:55 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:12:55.911318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:55.912172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:55.921543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:55.922463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:55.923078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:55.923951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:55.924564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:55.925298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:55.956106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:12:56.091474 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d686ca4-a88f-4995-b015-59db5e8dd366 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 204 len: 0 microversion: 2.1 time: 0.183683 Oct 12 09:12:56.093155 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3123/5815] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:12:55 2022] DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:12:56.104157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:56.105521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:56.116906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:56.120528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:56.122238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:56.123234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:56.125487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:56.126657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:56.719087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:56.756692 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-89c3d41f-da9b-4f8c-bf2c-0a0c4e1427e5 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1672 microversion: 2.1 time: 0.658500 Oct 12 09:12:56.766074 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2693/5816] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:56 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1672 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:57.793880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:57.795824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:57.814825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:57.815482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:57.815929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:57.816686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:57.817148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:57.825395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:58.613716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:12:58.625925 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2bb87030-9d10-4400-a5ad-e6f790495e24 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1672 microversion: 2.1 time: 0.837645 Oct 12 09:12:58.630462 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3124/5817] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:57 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1672 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:12:59.655879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:12:59.656493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:12:59.679829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:59.682883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:59.683385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:12:59.684145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:12:59.684616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:12:59.688929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:00.200716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:13:00.213411 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f3ec1480-fff4-4727-a470-5a6fa16eff2e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1672 microversion: 2.1 time: 0.559098 Oct 12 09:13:00.215994 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2694/5818] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:12:59 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1672 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:13:01.246574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:01.247920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:01.251421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:13:01.278006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:01.278766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:01.279366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:01.280252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:01.280867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:01.286696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:01.618655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:13:01.646081 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b96e11ac-677f-475e-b328-5eecf6461a5e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1605 microversion: 2.1 time: 0.405231 Oct 12 09:13:01.649324 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3125/5819] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:01 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1605 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:13:02.268282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e2140c47-e5a4-42fe-966a-157fe715769e req-c3240489-deca-4463-b7ae-e0936ab25c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f90057-6208-4a50-b0d3-e2060bf816d1", "name": "network-vif-deleted", "tag": "8c3d9e5d-195e-45ee-b961-d42a948d23b1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:13:02.287153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=50 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:13:02.307163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e2140c47-e5a4-42fe-966a-157fe715769e req-c3240489-deca-4463-b7ae-e0936ab25c4f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:02.309368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e2140c47-e5a4-42fe-966a-157fe715769e req-c3240489-deca-4463-b7ae-e0936ab25c4f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:02.310116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e2140c47-e5a4-42fe-966a-157fe715769e req-c3240489-deca-4463-b7ae-e0936ab25c4f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:02.377182 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e2140c47-e5a4-42fe-966a-157fe715769e req-c3240489-deca-4463-b7ae-e0936ab25c4f service nova] Creating event network-vif-deleted:8c3d9e5d-195e-45ee-b961-d42a948d23b1 for instance c2f90057-6208-4a50-b0d3-e2060bf816d1 on n-h2-858383-10 Oct 12 09:13:02.403122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e2140c47-e5a4-42fe-966a-157fe715769e req-c3240489-deca-4463-b7ae-e0936ab25c4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140275 Oct 12 09:13:02.403756 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2695/5820] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:02.671107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:02.672967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:02.696426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:02.699898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:02.701087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:02.707489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:02.708326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:02.708931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:02.766040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:13:02.811425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:02.811979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:02.812437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:02.816353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lazy-loading 'fault' on Instance uuid c2f90057-6208-4a50-b0d3-e2060bf816d1 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:13:02.933050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ec618a633f454791d5989610c839ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba422df2993458fbdf1c11f80e605c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:13:02.947282 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b991e7db-ee77-4072-948a-0267008a8293 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 200 len: 1326 microversion: 2.1 time: 0.280648 Oct 12 09:13:02.952440 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3126/5821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:02 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 1326 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:13:03.983448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:03.985001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:03.994776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:03.995546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:04.015548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:04.017850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:04.018579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:04.019240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:04.114563 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] HTTP exception thrown: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Request method failure captured: Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 HTTP/1.1 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoOhpWX5N8Hcfw2TFn8mPz9PiEnUPir8X6AOJMuIgrkJL5GppRyqV1E6Lkk7L4v1Z7nqwRORYmfIXOLQb8pL_qjMVRRjUrIrARmjnFntI0hY9F8CoKNoHbaVT-QAhyOR1dDvlL9z0-L89cHSn10TRbs6UXb3kVr5gRyZXibd8af-_-U Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}] Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f8ec618a633f454791d5989610c839ed Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'c2f90057-6208-4a50-b0d3-e2060bf816d1'} Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:04.125311 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:04.132741 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:04.132741 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:04.132741 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:04.132741 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:13:04.132741 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:13:04.132741 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:04.132741 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:04.138080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Returning 404 to user: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:13:04.141951 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-abab0981-0888-4530-9256-c609e955eea0 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 404 len: 111 microversion: 2.1 time: 0.168008 Oct 12 09:13:04.146222 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2696/5822] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:03 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:13:04.153139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35e6338e-634d-41cf-b3c3-91bdd622c8b2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '.version_select at 0x7f9843f2f1f0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:04.203637 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-35e6338e-634d-41cf-b3c3-91bdd622c8b2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366402146" status: 202 len: 0 microversion: 2.1 time: 0.054266 Oct 12 09:13:04.204703 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3127/5823] 10.222.0.40 () {58 vars in 1218 bytes} [Wed Oct 12 09:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366402146 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:13:10.225214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:10.231788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c2063b9f-775e-4ca5-b294-122b6d800e81 req-dd995a23-6192-4a5c-852d-c7a721c86357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc893eb-327b-4365-ab8a-b5373a41799c", "tag": "c5e5cf7a-c295-470a-9f7e-f50110a59f77"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:13:10.235216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:10.249014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:10.254851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:10.256073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c2063b9f-775e-4ca5-b294-122b6d800e81 req-dd995a23-6192-4a5c-852d-c7a721c86357 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:10.257865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:10.258288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c2063b9f-775e-4ca5-b294-122b6d800e81 req-dd995a23-6192-4a5c-852d-c7a721c86357 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:10.258608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:10.259070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:10.259236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c2063b9f-775e-4ca5-b294-122b6d800e81 req-dd995a23-6192-4a5c-852d-c7a721c86357 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:10.259495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:10.274534 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c2063b9f-775e-4ca5-b294-122b6d800e81 req-dd995a23-6192-4a5c-852d-c7a721c86357 service nova] Creating event network-changed:c5e5cf7a-c295-470a-9f7e-f50110a59f77 for instance 2bc893eb-327b-4365-ab8a-b5373a41799c on n-h1-858383-10 Oct 12 09:13:10.282716 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c2063b9f-775e-4ca5-b294-122b6d800e81 req-dd995a23-6192-4a5c-852d-c7a721c86357 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055774 Oct 12 09:13:10.286227 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3128/5824] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:10.318321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:13:10.479562 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7ed6325c-6a74-47cd-a4a5-0e92ec6176a6 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 204 len: 0 microversion: 2.1 time: 0.257650 Oct 12 09:13:10.486019 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2697/5825] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:13:10 2022] DELETE /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:13:10.492912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:10.493945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:10.512942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:10.522022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:10.522484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:10.528227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:10.529024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:10.530830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:10.915808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:13:10.926545 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1217158d-1b1e-42c4-9161-7bc12cfa1cfc tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1766 microversion: 2.1 time: 0.439314 Oct 12 09:13:10.942456 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3129/5826] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:10 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1766 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:13:11.952383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:11.953725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:11.984328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:11.985065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:11.985961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:11.991852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:11.992508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:11.993118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:12.682815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:13:12.691340 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-00c03ab7-f263-4ae1-a330-6f4a96153dd5 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1766 microversion: 2.1 time: 0.743718 Oct 12 09:13:12.691929 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2698/5827] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:11 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1766 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:13:13.327827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-da3e20a1-7803-4fc4-b609-ef95b22542ba req-2130b478-6152-409c-b284-8efedbd00bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc893eb-327b-4365-ab8a-b5373a41799c", "name": "network-vif-deleted", "tag": "c5e5cf7a-c295-470a-9f7e-f50110a59f77"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:13:13.363508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-da3e20a1-7803-4fc4-b609-ef95b22542ba req-2130b478-6152-409c-b284-8efedbd00bbb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:13.367819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-da3e20a1-7803-4fc4-b609-ef95b22542ba req-2130b478-6152-409c-b284-8efedbd00bbb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:13.368335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-da3e20a1-7803-4fc4-b609-ef95b22542ba req-2130b478-6152-409c-b284-8efedbd00bbb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:13.412804 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-da3e20a1-7803-4fc4-b609-ef95b22542ba req-2130b478-6152-409c-b284-8efedbd00bbb service nova] Creating event network-vif-deleted:c5e5cf7a-c295-470a-9f7e-f50110a59f77 for instance 2bc893eb-327b-4365-ab8a-b5373a41799c on n-h1-858383-10 Oct 12 09:13:13.428600 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-da3e20a1-7803-4fc4-b609-ef95b22542ba req-2130b478-6152-409c-b284-8efedbd00bbb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104857 Oct 12 09:13:13.434034 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3130/5828] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:13.720262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:13.720873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:13.743354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:13.746072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:13.751277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:13.752537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:13.756688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:13.759461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:13.903766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:13.904269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:13.904717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:13.908377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lazy-loading 'fault' on Instance uuid 2bc893eb-327b-4365-ab8a-b5373a41799c {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:13:14.041726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4a1b8ae1f94acca3723e99355aba38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae3fa763c174899bd7caff7453f3de8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:13:14.057601 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ff2f43bf-9f73-439a-b6f8-573ab7d00453 tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 200 len: 1383 microversion: 2.1 time: 0.342196 Oct 12 09:13:14.089480 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2699/5829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:13 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 1383 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:13:15.089808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:15.091256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] [instance: 2bc893eb-327b-4365-ab8a-b5373a41799c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:15.149962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:15.154803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:15.158360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:15.162232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:15.163750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:15.169166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:15.220569 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] HTTP exception thrown: Instance 2bc893eb-327b-4365-ab8a-b5373a41799c could not be found. Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Request method failure captured: Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c HTTP/1.1 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoSJqhBzYjZg2iQMb-90XueDHP-3-t-PsnnfYzuAWPae82qq6L92VcObwpFSUq7MPEO4B2vsWVh4NVMrrMWSzvS7n0dWsv-hSL0rCRcCmF-49JP3aI3TiNKplKisjM6T7PU-8nnQ6TJgFuQFowEhTuKtf7jmYfvVPQfeyKF8B_Lg5Ro Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: dae3fa763c174899bd7caff7453f3de8 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-540091167 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dae3fa763c174899bd7caff7453f3de8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dae3fa763c174899bd7caff7453f3de8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dae3fa763c174899bd7caff7453f3de8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dae3fa763c174899bd7caff7453f3de8"}]}] Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestSecurityGroupsBasicOps-540091167 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: dae3fa763c174899bd7caff7453f3de8 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-540091167 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestSecurityGroupsBasicOps-540091167-project Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 4d4a1b8ae1f94acca3723e99355aba38 Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestSecurityGroupsBasicOps-540091167-project Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2bc893eb-327b-4365-ab8a-b5373a41799c could not be found. Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2bc893eb-327b-4365-ab8a-b5373a41799c'} Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc893eb-327b-4365-ab8a-b5373a41799c could not be found. Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc893eb-327b-4365-ab8a-b5373a41799c could not be found. Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:15.223463 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc893eb-327b-4365-ab8a-b5373a41799c could not be found. Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Returning 404 to user: Instance 2bc893eb-327b-4365-ab8a-b5373a41799c could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec818947-2428-41e0-973b-d646e61e782f tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c" status: 404 len: 111 microversion: 2.1 time: 0.142121 Oct 12 09:13:15.228280 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3131/5830] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:15 2022] GET /compute/v2.1/servers/2bc893eb-327b-4365-ab8a-b5373a41799c => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:13:19.698242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:19.699993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:19.723369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:19.723867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:19.724305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:19.725593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:19.726191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:19.726624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:19.775861 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] HTTP exception thrown: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Request method failure captured: Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 HTTP/1.1 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoOhpWX5N8Hcfw2TFn8mPz9PiEnUPir8X6AOJMuIgrkJL5GppRyqV1E6Lkk7L4v1Z7nqwRORYmfIXOLQb8pL_qjMVRRjUrIrARmjnFntI0hY9F8CoKNoHbaVT-QAhyOR1dDvlL9z0-L89cHSn10TRbs6UXb3kVr5gRyZXibd8af-_-U Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}] Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f8ec618a633f454791d5989610c839ed Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'c2f90057-6208-4a50-b0d3-e2060bf816d1'} Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:13:19.790036 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Returning 404 to user: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:13:19.794186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e34c3ccb-9fd5-4e4f-abfb-617b18b4f4e3 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 404 len: 111 microversion: 2.1 time: 0.099014 Oct 12 09:13:19.802676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:19.804050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: c2f90057-6208-4a50-b0d3-e2060bf816d1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:19.805275 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2700/5831] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:13:19 2022] DELETE /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:13:19.816707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:19.817205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:19.817691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:19.818400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:19.828097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:19.832414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:19.886840 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] HTTP exception thrown: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Request method failure captured: Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 HTTP/1.1 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoOhpWX5N8Hcfw2TFn8mPz9PiEnUPir8X6AOJMuIgrkJL5GppRyqV1E6Lkk7L4v1Z7nqwRORYmfIXOLQb8pL_qjMVRRjUrIrARmjnFntI0hY9F8CoKNoHbaVT-QAhyOR1dDvlL9z0-L89cHSn10TRbs6UXb3kVr5gRyZXibd8af-_-U Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}] Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f8ec618a633f454791d5989610c839ed Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'c2f90057-6208-4a50-b0d3-e2060bf816d1'} Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:19.896148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Returning 404 to user: Instance c2f90057-6208-4a50-b0d3-e2060bf816d1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d73e46f-bb6f-4156-b4a1-fc07c7a7e3c2 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1" status: 404 len: 111 microversion: 2.1 time: 0.099259 Oct 12 09:13:19.905098 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3132/5832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:19 2022] GET /compute/v2.1/servers/c2f90057-6208-4a50-b0d3-e2060bf816d1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:13:24.729658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1b44c681-52b5-43fa-8227-728b3c9132cb tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] Calling method '.version_select at 0x7f9843ddcaf0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:24.790775 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1b44c681-52b5-43fa-8227-728b3c9132cb tempest-TestSecurityGroupsBasicOps-540091167 tempest-TestSecurityGroupsBasicOps-540091167-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2097222838" status: 202 len: 0 microversion: 2.1 time: 0.065293 Oct 12 09:13:24.791636 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2701/5833] 10.222.0.40 () {58 vars in 1278 bytes} [Wed Oct 12 09:13:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2097222838 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:13:26.896419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:26.896964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:26.915579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:26.917234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:26.918169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:26.920206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:26.921145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:26.921859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:26.945593 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] HTTP exception thrown: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Request method failure captured: Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 HTTP/1.1 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoOhpWX5N8Hcfw2TFn8mPz9PiEnUPir8X6AOJMuIgrkJL5GppRyqV1E6Lkk7L4v1Z7nqwRORYmfIXOLQb8pL_qjMVRRjUrIrARmjnFntI0hY9F8CoKNoHbaVT-QAhyOR1dDvlL9z0-L89cHSn10TRbs6UXb3kVr5gRyZXibd8af-_-U Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}] Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f8ec618a633f454791d5989610c839ed Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '04bb6b8a-b0bf-43f5-a523-c7f92aca6c89'} Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:13:26.948209 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:26.952896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:13:26.955098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Returning 404 to user: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:13:26.957655 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-929c37ca-04e6-4528-bb06-3954aad6068e tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 404 len: 111 microversion: 2.1 time: 0.066981 Oct 12 09:13:26.958835 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3133/5834] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:13:26 2022] DELETE /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:13:26.968218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:26.969631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] [instance: 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:13:26.986133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:26.986633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:26.987080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:26.988263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:13:26.992283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:13:26.993086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:13:27.003969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:13:27.036993 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] HTTP exception thrown: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Request method failure captured: Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 HTTP/1.1 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoOhpWX5N8Hcfw2TFn8mPz9PiEnUPir8X6AOJMuIgrkJL5GppRyqV1E6Lkk7L4v1Z7nqwRORYmfIXOLQb8pL_qjMVRRjUrIrARmjnFntI0hY9F8CoKNoHbaVT-QAhyOR1dDvlL9z0-L89cHSn10TRbs6UXb3kVr5gRyZXibd8af-_-U Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dba422df2993458fbdf1c11f80e605c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dba422df2993458fbdf1c11f80e605c5"}]}] Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: dba422df2993458fbdf1c11f80e605c5 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1318455885 Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f8ec618a633f454791d5989610c839ed Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-AttachVolumeTestJSON-1318455885-project Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '04bb6b8a-b0bf-43f5-a523-c7f92aca6c89'} Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:13:27.045351 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:27.049942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:13:27.049942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:13:27.049942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:13:27.049942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:13:27.049942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:13:27.049942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. Oct 12 09:13:27.049942 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:13:27.051378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] Returning 404 to user: Instance 04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:13:27.052996 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8142091-3505-40b4-9d6c-3473b2b25252 tempest-AttachVolumeTestJSON-1318455885 tempest-AttachVolumeTestJSON-1318455885-project] 10.222.0.40 "GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89" status: 404 len: 111 microversion: 2.1 time: 0.090156 Oct 12 09:13:27.056049 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2702/5835] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:13:26 2022] GET /compute/v2.1/servers/04bb6b8a-b0bf-43f5-a523-c7f92aca6c89 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:13:45.373090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-641eae5f-cf88-47ad-810a-9b86de334e4c tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f9843dbe9d0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:45.382613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:13:45.383913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=23 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:13:45.431895 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-641eae5f-cf88-47ad-810a-9b86de334e4c tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ab3c7d1f-eb74-42a5-a570-15c02fab80d7" status: 200 len: 350 microversion: 2.1 time: 0.062793 Oct 12 09:13:45.440680 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3134/5836] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:13:45 2022] GET /compute/v2.1/os-volumes/ab3c7d1f-eb74-42a5-a570-15c02fab80d7 => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:48.108967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c968a810-03b1-4f3e-a4f9-20ff3faa73b9 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f984cce9ca0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:48.124688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:13:48.203467 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c968a810-03b1-4f3e-a4f9-20ff3faa73b9 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/61399ed3-9c2d-45af-b16b-2c74f67f709e" status: 200 len: 350 microversion: 2.1 time: 0.099977 Oct 12 09:13:48.212108 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2703/5837] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:13:48 2022] GET /compute/v2.1/os-volumes/61399ed3-9c2d-45af-b16b-2c74f67f709e => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:51.035281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f67b987-428c-42e6-b27b-ca617dbe94b9 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f984359d820>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:51.155933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f67b987-428c-42e6-b27b-ca617dbe94b9 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/7947041d-7c7c-40d6-9c04-4f06d33a827b" status: 200 len: 350 microversion: 2.1 time: 0.125107 Oct 12 09:13:51.159390 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3135/5838] 10.222.0.40 () {58 vars in 1245 bytes} [Wed Oct 12 09:13:51 2022] GET /compute/v2.1/os-volumes/7947041d-7c7c-40d6-9c04-4f06d33a827b => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:51.178609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d422d3f-ca01-4a84-a6da-24fc6c188dbe tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f9843ddcaf0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:51.380951 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d422d3f-ca01-4a84-a6da-24fc6c188dbe tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.211126 Oct 12 09:13:51.383011 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2704/5839] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Oct 12 09:13:51 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:13:51.398599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac4971b8-3a5d-454f-a040-22a93d9c3ebb tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f9843de6a60>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:51.622436 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac4971b8-3a5d-454f-a040-22a93d9c3ebb tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.227030 Oct 12 09:13:51.624675 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3136/5840] 10.222.0.40 () {58 vars in 1149 bytes} [Wed Oct 12 09:13:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:51.640440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc8eb147-81c5-490e-8a3d-dff0059619ac tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f984cce9ee0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:51.830316 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc8eb147-81c5-490e-8a3d-dff0059619ac tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.194136 Oct 12 09:13:51.848090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2705/5841] 10.222.0.40 () {58 vars in 1134 bytes} [Wed Oct 12 09:13:51 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:13:51.853818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7814207b-85df-42b9-8bc7-e6fdc2449249 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f98435b0700>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:52.020612 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7814207b-85df-42b9-8bc7-e6fdc2449249 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.170813 Oct 12 09:13:52.023553 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3137/5842] 10.222.0.40 () {58 vars in 1167 bytes} [Wed Oct 12 09:13:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:52.040915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b6d71316-5f50-4b87-bb42-c21ec9e41107 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f98437a6c10>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:52.204060 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b6d71316-5f50-4b87-bb42-c21ec9e41107 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.167769 Oct 12 09:13:52.205510 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2706/5843] 10.222.0.40 () {58 vars in 1170 bytes} [Wed Oct 12 09:13:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:52.223071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3860d0c-d8ba-48f2-a6bf-9b5d6a60600a tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f98435404c0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:52.419049 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3860d0c-d8ba-48f2-a6bf-9b5d6a60600a tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.199408 Oct 12 09:13:52.420594 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3138/5844] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 09:13:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:13:52.435579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-44f95a9b-51dd-4f5c-9480-c9e697941ce6 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f984cbd89d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:52.623689 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-44f95a9b-51dd-4f5c-9480-c9e697941ce6 tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.192529 Oct 12 09:13:52.624711 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2707/5845] 10.222.0.40 () {58 vars in 1188 bytes} [Wed Oct 12 09:13:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:13:52.639213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc0d901f-6f9e-49a1-8c54-a4e33ff245df tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] Calling method '.version_select at 0x7f98435b0310>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:13:52.826357 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc0d901f-6f9e-49a1-8c54-a4e33ff245df tempest-VolumesTestJSON-1621484795 tempest-VolumesTestJSON-1621484795-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.191708 Oct 12 09:13:52.826949 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3139/5846] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 09:13:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:14:44.248916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:14:44.671527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Calling method '.version_select at 0x7f9843c59940>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:14:44.671527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:14:44.671527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:14:44.671527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:14:44.691605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:14:44.692694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:14:44.693515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:14:44.710105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:14:44.710976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:14:44.711634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:14:44.718101 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10e8203b-db95-4366-8f5a-4ec6df43c521 tempest-PortsAdminExtendedAttrsTestJSON-280488076 tempest-PortsAdminExtendedAttrsTestJSON-280488076-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.475165 Oct 12 09:14:44.725885 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2708/5847] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:14:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:16:02.884287 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 09:16:02.886978 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 09:16:02.887132 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 12 09:16:02.889239 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:16:02.889557 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 12 09:16:02.890899 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 09:16:02.891165 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 12 09:16:02.906655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1322679633", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:16:03.372142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:16:03.902160 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 55756. Oct 12 09:16:04.474341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:16:04.474946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:16:04.475498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:16:04.476021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:16:04.476972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:16:04.495614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:04.498566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:04.499078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:04.499902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:04.500427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:04.505580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:04.535347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Getting quotas for project 26d559601808465280a5b8d8efc0a398. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:16:04.541195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Getting quotas for user 98d427c502604941acb750a64876383c and project 26d559601808465280a5b8d8efc0a398. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:16:04.555547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:16:04.558376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:16:04.650784 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa5416bf-279e-4467-bde8-1d067b651f8f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.768423 Oct 12 09:16:04.654970 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3140/5848] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:16:04.664153 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 09:16:04.665541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:16:04.666643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:16:04.669339 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:16:04.669785 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:16:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e (ip 10.222.0.40) !!! Oct 12 09:16:04.681645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e3e23af-c555-4bc6-b5c0-4cee0f015577 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:04.683744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e3e23af-c555-4bc6-b5c0-4cee0f015577 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:05.240881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e3e23af-c555-4bc6-b5c0-4cee0f015577 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:05.250697 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e3e23af-c555-4bc6-b5c0-4cee0f015577 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1215 microversion: 2.1 time: 0.589009 Oct 12 09:16:05.254534 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2709/5849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:04 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1215 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:06.275539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:06.276392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:06.301914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:06.303553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:06.304232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:06.305211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:06.306599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:06.307256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:06.506703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:06.520410 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-862535f3-33cb-48c5-86ed-b46bbbcdc1e6 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1267 microversion: 2.1 time: 0.249548 Oct 12 09:16:06.524692 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3141/5850] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:06 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:07.554636 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 55854. Oct 12 09:16:07.560592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:07.561604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:07.571126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:07.571898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:07.572584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:07.573603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:07.574283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:07.574929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:07.865226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:07.878752 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-febad8f7-9306-4fc7-9f4f-56b25a682920 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1273 microversion: 2.1 time: 0.334716 Oct 12 09:16:07.883020 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2710/5851] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:07 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:08.906313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:08.907483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:08.929655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:08.930599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:08.931252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:08.932176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:08.932798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:08.933392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:09.035318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:09.046137 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2820a05e-91a4-4459-9984-f373b4359c3f tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1273 microversion: 2.1 time: 0.143998 Oct 12 09:16:09.047294 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3142/5852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:08 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:10.072370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:10.074099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:10.084328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:10.094399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:10.095074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:10.095987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:10.096601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:10.099628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:10.372510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:10.385856 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ea863f7-e65b-4e1f-a543-4debbc8bd9e3 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.318385 Oct 12 09:16:10.390534 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2711/5853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:10 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:11.424264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:11.426908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:11.442966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:11.444533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:11.445354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:11.446306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:11.446985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:11.448328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:12.087762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:12.102774 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0241d342-df64-4d67-9872-68062db95682 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.686098 Oct 12 09:16:12.103685 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3143/5854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:11 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:13.131779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:13.132401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:13.148985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:13.150729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:13.151927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:13.154118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:13.156161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:13.156743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:13.539230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:13.549407 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c78692c-ed60-4a6e-ad1b-189cb62d6259 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.423006 Oct 12 09:16:13.550972 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2712/5855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:13 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:13.772548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3dcc56a1-24d5-4dcd-a1b1-994a222c12a5 req-8162ce76-fe1f-417b-95c5-a7efaa64d1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e", "tag": "84e2f8ca-f66d-49b3-a21c-4254ffcf9ed9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:16:13.797640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3dcc56a1-24d5-4dcd-a1b1-994a222c12a5 req-8162ce76-fe1f-417b-95c5-a7efaa64d1c4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:13.798043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3dcc56a1-24d5-4dcd-a1b1-994a222c12a5 req-8162ce76-fe1f-417b-95c5-a7efaa64d1c4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:13.798475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3dcc56a1-24d5-4dcd-a1b1-994a222c12a5 req-8162ce76-fe1f-417b-95c5-a7efaa64d1c4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:13.829472 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3dcc56a1-24d5-4dcd-a1b1-994a222c12a5 req-8162ce76-fe1f-417b-95c5-a7efaa64d1c4 service nova] Creating event network-changed:84e2f8ca-f66d-49b3-a21c-4254ffcf9ed9 for instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e on n-h2-858383-10 Oct 12 09:16:13.849197 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3dcc56a1-24d5-4dcd-a1b1-994a222c12a5 req-8162ce76-fe1f-417b-95c5-a7efaa64d1c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074440 Oct 12 09:16:13.853932 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3144/5856] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:16:14.572590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:14.573214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:14.587886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:14.589230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:14.597073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:14.598063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:14.598702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:14.599581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:14.813515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:14.823208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c8e2eec3-a576-4f8b-805f-8bd302d3cf74 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.254688 Oct 12 09:16:14.846557 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2713/5857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:14 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:15.844767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:16:15.845764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:16:15.853318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:15.855008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:15.871264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:15.877912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:15.878770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:15.880135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:15.880831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:15.881524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:16.443125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:16.454983 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad6c360d-923d-46bf-b3b5-f9c81733a40e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.611051 Oct 12 09:16:16.469470 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3145/5858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:15 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:17.480426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:17.481016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:17.484112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:16:17.499386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:17.500311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:17.500949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:17.501907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:17.502526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:17.503257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:17.790870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:17.819160 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-314349b0-2ed8-4f72-8d6b-c9294b2b0a1d tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.339188 Oct 12 09:16:17.820142 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2714/5859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:17 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:18.847176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:18.847792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:18.866664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:18.869704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:18.870216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:18.871146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:18.871424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:18.871890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:19.329033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:19.355162 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6048028c-a9ef-49eb-b905-a2817ba2cc8e tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.512558 Oct 12 09:16:19.375537 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3146/5860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:18 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:20.381298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:20.382083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:20.396582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:20.401943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:20.403052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:20.405990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:20.407743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:20.408575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:20.831776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:20.851672 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-41eac312-7c7a-4a2a-b285-6a15d2d1f368 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.475135 Oct 12 09:16:20.854826 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2715/5861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:20 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:21.529615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cf423f6f-9304-4a54-a4b9-7136b20b29c9 req-9a012f54-7cfd-4960-bbb8-53ea36a1326e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e", "name": "network-vif-plugged", "status": "completed", "tag": "84e2f8ca-f66d-49b3-a21c-4254ffcf9ed9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:16:21.546322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cf423f6f-9304-4a54-a4b9-7136b20b29c9 req-9a012f54-7cfd-4960-bbb8-53ea36a1326e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:21.550252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cf423f6f-9304-4a54-a4b9-7136b20b29c9 req-9a012f54-7cfd-4960-bbb8-53ea36a1326e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:21.551327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cf423f6f-9304-4a54-a4b9-7136b20b29c9 req-9a012f54-7cfd-4960-bbb8-53ea36a1326e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:21.576841 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cf423f6f-9304-4a54-a4b9-7136b20b29c9 req-9a012f54-7cfd-4960-bbb8-53ea36a1326e service nova] Creating event network-vif-plugged:84e2f8ca-f66d-49b3-a21c-4254ffcf9ed9 for instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e on n-h2-858383-10 Oct 12 09:16:21.588524 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cf423f6f-9304-4a54-a4b9-7136b20b29c9 req-9a012f54-7cfd-4960-bbb8-53ea36a1326e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.440799 Oct 12 09:16:21.605576 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3147/5862] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:16:21.890696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:21.891943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:21.899991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:21.900483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:21.900920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:21.901659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:21.902116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:21.902554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:22.348543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:22.358342 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7c02a052-0997-4fd3-a529-510116ab34d7 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1315 microversion: 2.1 time: 0.482823 Oct 12 09:16:22.358975 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2716/5863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:21 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:23.387050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:23.387762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:23.403368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:23.404040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:23.406656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:23.407776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:23.408424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:23.409676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:23.641038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:23.650211 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-640e2876-8a0b-48b8-8294-b90073ed1225 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1465 microversion: 2.1 time: 0.270708 Oct 12 09:16:23.652352 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3148/5864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:23 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1465 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:16:23.719451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:23.720019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:23.733159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:23.734012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:23.735334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:23.736223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:23.740270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:23.740724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:23.781792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:16:23.929630 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-855a0c5b-1146-4ecb-9172-e9a845ab95f4 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 204 len: 0 microversion: 2.1 time: 0.214474 Oct 12 09:16:23.934518 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2717/5865] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:16:23 2022] DELETE /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:16:23.939329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:23.940261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:23.965367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:23.970049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:23.970735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:23.971631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:23.972104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:23.972537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:24.174590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:24.186433 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a227401f-3b0f-442c-ba06-a4b38ebc8fec tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1471 microversion: 2.1 time: 0.251407 Oct 12 09:16:24.187739 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3149/5866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:23 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:25.219251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:25.220522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:25.238012 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:16:25.245196 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e (ip 10.222.0.40) !!! Oct 12 09:16:25.262941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:25.263529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:25.263986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:25.264734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:25.265190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:25.265652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:25.813247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:25.827083 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed77a452-8e0e-48bf-a85e-22163f5a4196 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1471 microversion: 2.1 time: 0.614642 Oct 12 09:16:25.830712 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2718/5867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:25 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1471 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:26.482999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-da6b41a8-040b-4801-95c5-8786d7994123 req-6ed7e0f9-8fa2-455d-b04b-342aef47cc32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e", "name": "network-vif-deleted", "tag": "84e2f8ca-f66d-49b3-a21c-4254ffcf9ed9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:16:26.525764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-da6b41a8-040b-4801-95c5-8786d7994123 req-6ed7e0f9-8fa2-455d-b04b-342aef47cc32 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:26.526262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-da6b41a8-040b-4801-95c5-8786d7994123 req-6ed7e0f9-8fa2-455d-b04b-342aef47cc32 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:26.526684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-da6b41a8-040b-4801-95c5-8786d7994123 req-6ed7e0f9-8fa2-455d-b04b-342aef47cc32 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:26.580044 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-da6b41a8-040b-4801-95c5-8786d7994123 req-6ed7e0f9-8fa2-455d-b04b-342aef47cc32 service nova] Creating event network-vif-deleted:84e2f8ca-f66d-49b3-a21c-4254ffcf9ed9 for instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e on n-h2-858383-10 Oct 12 09:16:26.596471 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-da6b41a8-040b-4801-95c5-8786d7994123 req-6ed7e0f9-8fa2-455d-b04b-342aef47cc32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114135 Oct 12 09:16:26.600418 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3150/5868] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:16:26.852974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:26.853703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:26.876582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:26.877296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:26.877910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:26.878744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:26.879299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:26.879832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:26.963488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:26.965595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:26.966241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:26.967024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lazy-loading 'fault' on Instance uuid dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:16:27.048687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d427c502604941acb750a64876383c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d559601808465280a5b8d8efc0a398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:16:27.082678 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-201bad3e-f3ea-4445-8a8d-b4d06d22f6c1 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 200 len: 1305 microversion: 2.1 time: 0.232745 Oct 12 09:16:27.089517 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2719/5869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:26 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 1305 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:16:28.123514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:16:28.124279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] [instance: dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:16:28.144741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:28.148718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:28.151685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:28.152512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:16:28.153001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:16:28.163787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:16:28.266860 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] HTTP exception thrown: Instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e could not be found. Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Request method failure captured: Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e HTTP/1.1 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoXPZg7EiV6w6BHkMJwzRuvnXV9hAjwGXzPDeE0oNwMDRl1NKihT9k8DVp66PimMacxYaWRNY8JM8RjXz8ZC7YKZDhhtPq-DpNaDPzekWMdRqk3xcqyJe8sE2y-5uJqXItUo-CIuDYGO955Oul4eOce5y9Pp8F6WtqXwMK5YqlWn9pg Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 26d559601808465280a5b8d8efc0a398 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesNegativeTest-1839226029 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26d559601808465280a5b8d8efc0a398"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26d559601808465280a5b8d8efc0a398"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26d559601808465280a5b8d8efc0a398"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26d559601808465280a5b8d8efc0a398"}]}] Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesNegativeTest-1839226029 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 26d559601808465280a5b8d8efc0a398 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesNegativeTest-1839226029 Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesNegativeTest-1839226029-project Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 98d427c502604941acb750a64876383c Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesNegativeTest-1839226029-project Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e could not be found. Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e'} Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e could not be found. Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e could not be found. Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:16:28.275166 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:16:28.279962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:16:28.279962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:16:28.279962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:16:28.279962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:16:28.279962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:16:28.279962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e could not be found. Oct 12 09:16:28.279962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:16:28.289568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] Returning 404 to user: Instance dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:16:28.291045 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05375e45-6b00-4366-9f00-eba658d54f39 tempest-VolumesNegativeTest-1839226029 tempest-VolumesNegativeTest-1839226029-project] 10.222.0.40 "GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e" status: 404 len: 111 microversion: 2.1 time: 0.179010 Oct 12 09:16:28.293579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3151/5870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:16:28 2022] GET /compute/v2.1/servers/dd3ea09f-f57e-49d7-abc2-fba8a70e1a7e => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:18:00.615459 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [69519c9e-db2a-456c-87f5-913be80c5911] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 09:18:00.616217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:00.617335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:01.164936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-792f8391-5ab7-44c7-9858-05d3d8ec3096 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'create', calling method: .version_select at 0x7f9843ddc280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-896903764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJBea79jAJ2+XAZHm7YzrcOqUb4C54VrP3M9ezqrWqnL9lEJRoyAhfTn9+5PwKCkTrQWWrb3lT16IlyEd5+pzYH0WTNpOMb+e6NuH3Py1278yGFrhp7POduZZnIdY3UeQ=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:18:01.197363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-792f8391-5ab7-44c7-9858-05d3d8ec3096 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:18:01.211662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-792f8391-5ab7-44c7-9858-05d3d8ec3096 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for user 98e7287fdde34fe198d4f43acd3da903 and project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:18:01.267305 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-792f8391-5ab7-44c7-9858-05d3d8ec3096 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.653807 Oct 12 09:18:01.274220 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2720/5871] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:18:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:18:23.204957 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 09:18:23.205763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:23.206680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=52 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:23.217986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-612232560", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "92da65d4-2963-4c03-83fa-f479fa11ff89"}], "key_name": "tempest-TestNetworkAdvancedServerOps-896903764", "security_groups": [{"name": "tempest-secgroup-smoke-970686758"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:18:23.882168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] validate_networks() for [('92da65d4-2963-4c03-83fa-f479fa11ff89', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:18:24.214785 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 59642. Oct 12 09:18:25.677262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:18:25.677884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:18:25.678188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:18:25.678613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:18:25.679012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:18:25.701194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:25.702035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:25.702556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:25.703906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:25.704760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:25.705502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:25.752550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:18:25.759348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for user 98e7287fdde34fe198d4f43acd3da903 and project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:18:25.778077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:18:25.781036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:18:25.934493 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a65d95d-9be2-4b45-b2dc-ba8e79c64992 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.731723 Oct 12 09:18:25.944659 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3152/5872] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:18:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 2740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:18:25.946477 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:18:25.946918 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:18:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 (ip 10.222.0.40) !!! Oct 12 09:18:25.947771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:25.948828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:25.956946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6cab1521-f2fb-48d0-b427-f44272936982 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:25.957809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6cab1521-f2fb-48d0-b427-f44272936982 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:26.032502 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [69519c9e-db2a-456c-87f5-913be80c5911] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 59674. Oct 12 09:18:26.217026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6cab1521-f2fb-48d0-b427-f44272936982 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:26.226544 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6cab1521-f2fb-48d0-b427-f44272936982 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1265 microversion: 2.1 time: 0.283321 Oct 12 09:18:26.247090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2721/5873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:25 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:27.259028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:27.265297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:27.303760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:27.309253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:27.310268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:27.311604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:27.316476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:27.318071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:27.530259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:27.553271 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47edff5b-82da-49d7-b7cd-fcaacd9b1a1e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1261 microversion: 2.1 time: 0.297025 Oct 12 09:18:27.556443 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3153/5874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:27 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1261 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:28.581269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:28.582560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:28.592765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:28.593569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:28.594570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:28.595666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:28.596274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:28.597194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:28.779266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:28.791122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65691822-7395-4ad8-a91e-0362afe4ff38 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1323 microversion: 2.1 time: 0.213642 Oct 12 09:18:28.791479 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2722/5875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:28 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:18:29.817978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:29.818605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:29.830108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:29.830614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:29.831059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:29.831786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:29.832251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:29.832683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:30.000829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:30.009701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51ae3605-4f3b-434b-9d7e-3330ea863abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1323 microversion: 2.1 time: 0.195890 Oct 12 09:18:30.010292 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3154/5876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:29 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:31.037696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:31.041906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:31.063159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:31.068152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:31.068820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:31.069766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:31.070364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:31.072537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:31.549787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:31.558857 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3b9a723-bae1-4475-93f9-858b2b258b20 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1390 microversion: 2.1 time: 0.527837 Oct 12 09:18:31.569890 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2723/5877] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:31 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1390 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:32.594256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:32.596545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:32.638671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:32.639336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:32.641842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:32.646200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:32.646947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:32.647780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:33.820650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:33.837621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7bb9aeea-e31e-4f8b-a2c7-b5d94b273b69 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1390 microversion: 2.1 time: 1.254981 Oct 12 09:18:33.855058 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3155/5878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:32 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1390 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:34.563693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-53db83d4-2905-4b2b-9e33-5de78264a063 req-28248e5c-243d-48c9-93ab-3dc135afe80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93674478-e3a2-4972-9f8c-bece3ff3ca88", "tag": "ea02c38f-688b-48b3-9b49-663a71de9b57"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:18:34.588197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53db83d4-2905-4b2b-9e33-5de78264a063 req-28248e5c-243d-48c9-93ab-3dc135afe80d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:34.604599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53db83d4-2905-4b2b-9e33-5de78264a063 req-28248e5c-243d-48c9-93ab-3dc135afe80d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:34.605239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-53db83d4-2905-4b2b-9e33-5de78264a063 req-28248e5c-243d-48c9-93ab-3dc135afe80d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:34.632492 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-53db83d4-2905-4b2b-9e33-5de78264a063 req-28248e5c-243d-48c9-93ab-3dc135afe80d service nova] Creating event network-changed:ea02c38f-688b-48b3-9b49-663a71de9b57 for instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 on n-h2-858383-10 Oct 12 09:18:34.647356 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-53db83d4-2905-4b2b-9e33-5de78264a063 req-28248e5c-243d-48c9-93ab-3dc135afe80d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.380352 Oct 12 09:18:34.651126 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2724/5879] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:18:34.864790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:34.865870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:34.885265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:34.888202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:34.888800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:34.894829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:34.896413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:34.898536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:35.741819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:35.771011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:35.832539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:35.870400 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-84ebb426-ab36-4a6a-bd28-a4738c4eec8c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1390 microversion: 2.1 time: 0.993798 Oct 12 09:18:35.871797 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3156/5880] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:34 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1390 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:36.905116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:36.905855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:36.909904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:18:36.923798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:36.929511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:36.932795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:36.933992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:36.934465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:36.947665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:37.326601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:37.336331 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45767e80-6ab7-4440-97b2-ab4ef9e10ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1390 microversion: 2.1 time: 0.439200 Oct 12 09:18:37.353372 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2725/5881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:36 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1390 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:38.360563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:38.361793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:38.378518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:38.379356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:38.380224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:38.382619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:38.383100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:38.384982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:38.665159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:38.683626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4966cacd-d41e-4adb-a06f-ca67481442bf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1390 microversion: 2.1 time: 0.327499 Oct 12 09:18:38.687092 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3157/5882] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:38 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1390 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:39.712989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:39.714275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:39.744493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:39.744945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:39.755470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:39.756708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:39.759320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:39.760122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:40.129740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:40.144462 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b6a6713-5318-4242-8c47-398500ebb02f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1390 microversion: 2.1 time: 0.434209 Oct 12 09:18:40.145493 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2726/5883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:39 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1390 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:41.116763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a5717017-dafb-4442-a914-eb9e3faba93d req-5a9f1e07-2a90-44f4-8959-4055ca0e5590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93674478-e3a2-4972-9f8c-bece3ff3ca88", "name": "network-vif-plugged", "status": "completed", "tag": "ea02c38f-688b-48b3-9b49-663a71de9b57"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:18:41.129124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a5717017-dafb-4442-a914-eb9e3faba93d req-5a9f1e07-2a90-44f4-8959-4055ca0e5590 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:41.130299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a5717017-dafb-4442-a914-eb9e3faba93d req-5a9f1e07-2a90-44f4-8959-4055ca0e5590 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:41.130931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a5717017-dafb-4442-a914-eb9e3faba93d req-5a9f1e07-2a90-44f4-8959-4055ca0e5590 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:41.149228 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a5717017-dafb-4442-a914-eb9e3faba93d req-5a9f1e07-2a90-44f4-8959-4055ca0e5590 service nova] Creating event network-vif-plugged:ea02c38f-688b-48b3-9b49-663a71de9b57 for instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 on n-h2-858383-10 Oct 12 09:18:41.154899 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a5717017-dafb-4442-a914-eb9e3faba93d req-5a9f1e07-2a90-44f4-8959-4055ca0e5590 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053574 Oct 12 09:18:41.156140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3158/5884] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:18:41.173194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:41.173986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:41.182189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:41.183235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:41.184169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:41.185109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:41.185991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:41.186588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:41.578098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:41.595920 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b727ab0-dfdf-4443-953f-5190f488ca34 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1390 microversion: 2.1 time: 0.427338 Oct 12 09:18:41.611527 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2727/5885] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:41 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1390 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:42.627059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:42.628400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:42.647663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:42.649694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:42.655995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:42.657018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:42.657657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:42.658294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:42.999030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:43.010317 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b8fec725-dbd0-4e89-9f6a-b9e76c7d3d12 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1562 microversion: 2.1 time: 0.388496 Oct 12 09:18:43.025700 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3159/5886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:42 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1562 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:43.044941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:43.046148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:43.060187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:43.063272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:43.064849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:43.066743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:43.067351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:43.068960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:43.721281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:43.730463 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c48ae813-0dac-4315-8016-068b5da9a304 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1562 microversion: 2.1 time: 0.695948 Oct 12 09:18:43.733842 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2728/5887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:43 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1562 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:18:49.520691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:18:49.522014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:18:49.525207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0557dc0e-dae3-4857-a2d6-576f5566e7d1 req-5647ae29-88db-4551-b76a-05d19d29ae39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93674478-e3a2-4972-9f8c-bece3ff3ca88", "tag": "ea02c38f-688b-48b3-9b49-663a71de9b57"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:18:49.532406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:49.532900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:49.533332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:49.547302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0557dc0e-dae3-4857-a2d6-576f5566e7d1 req-5647ae29-88db-4551-b76a-05d19d29ae39 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:49.547508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:18:49.552550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:49.553509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:49.554655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0557dc0e-dae3-4857-a2d6-576f5566e7d1 req-5647ae29-88db-4551-b76a-05d19d29ae39 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:18:49.556552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0557dc0e-dae3-4857-a2d6-576f5566e7d1 req-5647ae29-88db-4551-b76a-05d19d29ae39 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:18:49.605322 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0557dc0e-dae3-4857-a2d6-576f5566e7d1 req-5647ae29-88db-4551-b76a-05d19d29ae39 service nova] Creating event network-changed:ea02c38f-688b-48b3-9b49-663a71de9b57 for instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 on n-h2-858383-10 Oct 12 09:18:49.627305 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0557dc0e-dae3-4857-a2d6-576f5566e7d1 req-5647ae29-88db-4551-b76a-05d19d29ae39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105664 Oct 12 09:18:49.630780 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2729/5888] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:18:50.366628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:18:50.377306 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc98bd13-6a68-461b-95f6-d0091c0fa547 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1562 microversion: 2.1 time: 0.859931 Oct 12 09:18:50.393469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3160/5889] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:18:49 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1562 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:03.296103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=20 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:03.298150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=40 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:03.658793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94ba116d-874a-4432-a82a-d805c25810e5 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Action: 'create', calling method: .version_select at 0x7f9843c59940>, body: {"keypair": {"name": "tempest-TestServerBasicOps-959854354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD4xDnEIKnOb8ix1Ozi0co+PLK4Zi8ThNTbuaVITxkGDSHMlf7VPkIBirOmBY0NopKnqzMGNHTdmmKdP1bdf2wg9GcwJPMKfseZYY8xt47E83xXl3c+bA8iWiavjjpTmg=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:03.691080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-94ba116d-874a-4432-a82a-d805c25810e5 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Getting quotas for project c54a01f8e9cf42d596c1bfd4ffb60635. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:19:03.705304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-94ba116d-874a-4432-a82a-d805c25810e5 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Getting quotas for user f2548c7b1ac54751848fb24103fb6ff3 and project c54a01f8e9cf42d596c1bfd4ffb60635. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:19:03.752546 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94ba116d-874a-4432-a82a-d805c25810e5 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.462472 Oct 12 09:19:03.758939 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2730/5890] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:19:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:05.358524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1975659764", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-959854354", "security_groups": [{"name": "tempest-secgroup-smoke-1143338611"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "0b072dcb-0187-41b0-99bc-c015cc998e9e"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:05.374370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:05.375447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=46 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:05.660487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] validate_networks() for [('0b072dcb-0187-41b0-99bc-c015cc998e9e', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:19:06.479291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Getting quotas for project c54a01f8e9cf42d596c1bfd4ffb60635. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:19:06.506636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Getting quotas for user f2548c7b1ac54751848fb24103fb6ff3 and project c54a01f8e9cf42d596c1bfd4ffb60635. Resources: dict_keys(['metadata_items']) {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:19:06.551415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:19:06.552267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:19:06.552848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:19:06.554407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:19:06.554831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:19:06.576861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:06.577345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:06.577802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:06.578526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:06.578980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:06.579412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:06.642872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Getting quotas for project c54a01f8e9cf42d596c1bfd4ffb60635. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:19:06.659486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Getting quotas for user f2548c7b1ac54751848fb24103fb6ff3 and project c54a01f8e9cf42d596c1bfd4ffb60635. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:19:06.692521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:19:06.698960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:19:06.840452 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c59e53a8-3b8d-45af-bdf5-9e1b75c7f30f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.488285 Oct 12 09:19:06.847851 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3161/5891] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:19:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:19:06.880598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1393f002-862a-49a1-9943-eb3a7166617a tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:06.881579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1393f002-862a-49a1-9943-eb3a7166617a tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:07.009647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1393f002-862a-49a1-9943-eb3a7166617a tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:07.023554 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1393f002-862a-49a1-9943-eb3a7166617a tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1302 microversion: 2.1 time: 0.161654 Oct 12 09:19:07.026246 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2731/5892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:06 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1302 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:08.050250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:08.051458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:08.063773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:08.064334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:08.064860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:08.065694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:08.066185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:08.066643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:08.329359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:08.347110 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b92584b7-25eb-49cf-8c3a-d3c782837542 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1306 microversion: 2.1 time: 0.302076 Oct 12 09:19:08.349733 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3162/5893] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:08 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1306 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:09.118230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:09.121172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:09.151957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:09.159006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:09.161036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:09.164293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:09.169709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:09.174333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:09.299766 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-08176166-6a55-428f-9257-36b5c5e95cd2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action" status: 200 len: 24559 microversion: 2.1 time: 0.185672 Oct 12 09:19:09.309882 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2732/5894] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:19:09 2022] POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action => generated 24559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:19:09.378094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:09.380407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:09.394228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:09.395064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:09.396538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:09.397577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:09.398347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:09.398974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:09.709811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:09.746060 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3103bff8-7cf4-48b6-ad30-9d6633ecc5a6 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1360 microversion: 2.1 time: 0.373940 Oct 12 09:19:09.747170 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3163/5895] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:09 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1360 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:10.772750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:10.774424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:10.795471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:10.799125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:10.802605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:10.805994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:10.807411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:10.809284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:11.242747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:11.252941 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-804397af-fd24-465d-8d1d-7fe0137b2873 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1428 microversion: 2.1 time: 0.484881 Oct 12 09:19:11.270064 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2733/5896] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:10 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1428 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:12.283586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:12.284311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:12.296143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:12.297400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:12.298867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:12.300459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:12.303865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:12.306638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:12.583684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:12.602249 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-672be74d-6257-47a7-bba0-311bba0fec3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1428 microversion: 2.1 time: 0.323289 Oct 12 09:19:12.603262 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3164/5897] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:12 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1428 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:13.631145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:13.631855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:13.642793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:13.643374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:13.643729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:13.644446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:13.644903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:13.645329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:13.654539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-417ebe96-35bb-4167-86ea-246f5db0cf4e req-760f87bb-8d08-4421-b913-73e4e0b0fe2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c35cc4-36a6-4abc-8b26-4bd11fcbea79", "tag": "1b02627b-3da4-4fde-b9aa-6f900c16c1c7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:13.673014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-417ebe96-35bb-4167-86ea-246f5db0cf4e req-760f87bb-8d08-4421-b913-73e4e0b0fe2f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:13.673535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-417ebe96-35bb-4167-86ea-246f5db0cf4e req-760f87bb-8d08-4421-b913-73e4e0b0fe2f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:13.673977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-417ebe96-35bb-4167-86ea-246f5db0cf4e req-760f87bb-8d08-4421-b913-73e4e0b0fe2f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:13.696912 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-417ebe96-35bb-4167-86ea-246f5db0cf4e req-760f87bb-8d08-4421-b913-73e4e0b0fe2f service nova] Creating event network-changed:1b02627b-3da4-4fde-b9aa-6f900c16c1c7 for instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 on n-h1-858383-10 Oct 12 09:19:13.702288 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-417ebe96-35bb-4167-86ea-246f5db0cf4e req-760f87bb-8d08-4421-b913-73e4e0b0fe2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272926 Oct 12 09:19:13.703528 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2734/5898] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:13.900694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:13.908825 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-46dc5a7e-8557-43e8-b4e3-54b6dabdab88 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1428 microversion: 2.1 time: 0.282450 Oct 12 09:19:13.914662 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3165/5899] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:13 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1428 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:14.942071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:14.942778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:14.954074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:14.954887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:14.955556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:14.956735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:14.957430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:14.957962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:15.179784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:15.188419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3d92c6a-71d5-4fe8-8e62-34ea16eceae0 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1428 microversion: 2.1 time: 0.251442 Oct 12 09:19:15.219198 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2735/5900] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:14 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1428 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:16.226831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:16.227486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:16.243659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:16.244946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:16.245406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:16.248523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:16.255342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:16.256253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:16.561106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:16.577896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-81e33e96-fc62-45e7-94c1-015ac1aec61b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1428 microversion: 2.1 time: 0.364185 Oct 12 09:19:16.580249 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3166/5901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:16 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1428 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:17.603500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:17.604215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:17.608075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:17.616909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:17.617399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:17.618015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:17.619377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:17.619973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:17.620698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:17.783631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:17.792871 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58056fd7-a6ec-49b2-a72b-a23b7cba8922 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1428 microversion: 2.1 time: 0.193509 Oct 12 09:19:17.793482 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2736/5902] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:17 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1428 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:18.816684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:18.818161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:18.820614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:18.821480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=10 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:18.835467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:18.841015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:18.841984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:18.843882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:18.844494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:18.845068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:19.114618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:19.126800 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c28b5faf-0b0b-44aa-943d-c42c4d258d25 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1428 microversion: 2.1 time: 0.314007 Oct 12 09:19:19.127412 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3167/5903] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:18 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1428 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:19.276841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9083f02e-9880-40e9-9c82-1d52e4c1df17 req-63350455-7316-41e0-b697-6e6225bcb42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c35cc4-36a6-4abc-8b26-4bd11fcbea79", "name": "network-vif-plugged", "status": "completed", "tag": "1b02627b-3da4-4fde-b9aa-6f900c16c1c7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:19.304005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9083f02e-9880-40e9-9c82-1d52e4c1df17 req-63350455-7316-41e0-b697-6e6225bcb42b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:19.304646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9083f02e-9880-40e9-9c82-1d52e4c1df17 req-63350455-7316-41e0-b697-6e6225bcb42b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:19.305793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9083f02e-9880-40e9-9c82-1d52e4c1df17 req-63350455-7316-41e0-b697-6e6225bcb42b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:19.325600 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9083f02e-9880-40e9-9c82-1d52e4c1df17 req-63350455-7316-41e0-b697-6e6225bcb42b service nova] Creating event network-vif-plugged:1b02627b-3da4-4fde-b9aa-6f900c16c1c7 for instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 on n-h1-858383-10 Oct 12 09:19:19.334070 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9083f02e-9880-40e9-9c82-1d52e4c1df17 req-63350455-7316-41e0-b697-6e6225bcb42b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061223 Oct 12 09:19:19.334896 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2737/5904] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:20.154298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:20.154928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:20.169539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:20.170941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:20.171463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:20.173122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:20.174750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:20.177264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:20.283931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:20.285186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:20.306398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:20.306983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:20.309680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:20.310506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:20.311031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:20.311483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:20.432043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:20.448380 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5db83129-7b17-4553-b16f-ed3f94a26380 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1428 microversion: 2.1 time: 0.299295 Oct 12 09:19:20.450052 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3168/5905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:20 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1428 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:20.912472 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2e4c28f5-41f5-4eae-985f-b0e66292bbca tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1833 microversion: 2.1 time: 0.634089 Oct 12 09:19:20.913132 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2738/5906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:20 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1833 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:20.938033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:20.938859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:20.947888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:20.948711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:20.949227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:20.950572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:20.951138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:20.951777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:21.214924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:21.229770 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ee5dba27-799c-4496-b0f7-5fc22b2f6709 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1680 microversion: 2.1 time: 0.289221 Oct 12 09:19:21.261734 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3169/5907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:20 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1680 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:21.404264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:21.406652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:21.415730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:21.416278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:21.417893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:21.419750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:21.420495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:21.421200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:21.472903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:21.475319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:21.483759 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82dcd554-078f-45f7-9af7-e52dfd86de43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action" status: 200 len: 32634 microversion: 2.1 time: 0.083587 Oct 12 09:19:21.486138 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2739/5908] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:19:21 2022] POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action => generated 32634 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:19:21.489291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:21.490039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:21.492781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:21.493945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:21.495591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:21.496225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:21.642691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:21.643870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:21.652576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:21.653117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:21.653608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:21.654327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:21.654785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:21.655214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:21.860468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '47f635822a4f43b2a447a8e94f11217e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f447fb7b310840219abf3b3d4ba6729a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:21.860468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] flavor_id is None. Assuming migration. {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 12 09:19:21.860468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:19:21.866558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:21.879700 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d38bbe40-6c61-4172-a908-dc4979759472 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1609 microversion: 2.1 time: 0.412223 Oct 12 09:19:21.883961 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3170/5909] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:21 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1609 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:21.906707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:21.907326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:21.924220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:21.926973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:21.927699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:21.929147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:21.930021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:21.930555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:22.267943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:22.273382 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e6187a8b-dda9-453d-ab52-ec47c45fefa7 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action" status: 202 len: 0 microversion: 2.1 time: 0.635079 Oct 12 09:19:22.277492 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2740/5910] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:19:21 2022] POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:19:22.283387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:22.284037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:22.291481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:22.292314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:22.293121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:22.293954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:22.294419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:22.294857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:22.303014 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a909d693-6852-47a1-b2aa-35f85997de27 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1609 microversion: 2.1 time: 0.394803 Oct 12 09:19:22.304451 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3171/5911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:21 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1609 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:22.338899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:22.340720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:22.348832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:22.349748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:22.350545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:22.351558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:22.352264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:22.352912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:22.607655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:22.619930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b3605e53-7268-4cc4-8df7-88bdc2a32d3b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1609 microversion: 2.1 time: 0.296027 Oct 12 09:19:22.621631 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3172/5912] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:22 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1609 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:22.944348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:22.961175 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-527741bc-d646-46ba-9a47-1231baec42e1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1689 microversion: 2.1 time: 0.680052 Oct 12 09:19:22.981755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2741/5913] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:22 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1689 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:23.992687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:23.994200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:24.033246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:24.036023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:24.037812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:24.045122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:24.047158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:24.048120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:24.709176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:24.725744 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd945165-e862-417e-9c77-15a8fb9aec7c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1689 microversion: 2.1 time: 0.741178 Oct 12 09:19:24.731244 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3173/5914] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:23 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1689 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:25.760305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:25.761606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:25.774011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:25.776626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:25.779034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:25.779933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:25.780526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:25.787746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:26.423146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e1bba6bb-1408-4e04-a96a-08df21693819 req-6941475d-d5bc-4610-a469-eb1a074b66fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c35cc4-36a6-4abc-8b26-4bd11fcbea79", "tag": "1b02627b-3da4-4fde-b9aa-6f900c16c1c7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:26.436246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e1bba6bb-1408-4e04-a96a-08df21693819 req-6941475d-d5bc-4610-a469-eb1a074b66fe service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:26.440769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e1bba6bb-1408-4e04-a96a-08df21693819 req-6941475d-d5bc-4610-a469-eb1a074b66fe service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:26.441651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e1bba6bb-1408-4e04-a96a-08df21693819 req-6941475d-d5bc-4610-a469-eb1a074b66fe service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:26.473568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e1bba6bb-1408-4e04-a96a-08df21693819 req-6941475d-d5bc-4610-a469-eb1a074b66fe service nova] Creating event network-changed:1b02627b-3da4-4fde-b9aa-6f900c16c1c7 for instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 on n-h1-858383-10 Oct 12 09:19:26.488497 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e1bba6bb-1408-4e04-a96a-08df21693819 req-6941475d-d5bc-4610-a469-eb1a074b66fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071323 Oct 12 09:19:26.493828 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3174/5915] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:19:26.754913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:26.764253 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5a063c9d-c00f-41e4-a468-40b340c4c326 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1689 microversion: 2.1 time: 1.007760 Oct 12 09:19:26.792324 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2742/5916] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:25 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1689 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:27.793976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:27.794786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:27.806169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:27.806675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:27.808644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:27.810546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:27.811855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:27.813315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:28.116087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:28.128050 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f642158a-1680-4b96-a3ab-e63b8af56938 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.339486 Oct 12 09:19:28.133798 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3175/5917] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:27 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:29.158289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:29.159026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:29.170144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:29.170725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:29.171263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:29.172276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:29.172941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:29.173668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:29.508877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:29.517786 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-56a9918e-28e3-4bb5-af97-3a2db142c47b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.364156 Oct 12 09:19:29.535472 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2743/5918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:29 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:30.544871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:30.545664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:30.553431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:30.553940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:30.554377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:30.555076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:30.555534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:30.555943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:30.714777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:30.724436 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1375eb0-10b9-44b6-9299-3e1205c1ae48 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.183913 Oct 12 09:19:30.725749 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3176/5919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:30 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:31.458056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1494984842", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "dd6ebd79-31a8-4aa4-87f6-1603c9906d75"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:31.550704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] validate_networks() for [('dd6ebd79-31a8-4aa4-87f6-1603c9906d75', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:19:31.757258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:31.758760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:31.778787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:31.779429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:31.779884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:31.780610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:31.785151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:31.785815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:32.166475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:32.177672 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e1e9f60-101e-4854-8725-9bd1feed16b7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.433127 Oct 12 09:19:32.178448 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3177/5920] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:31 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:32.394264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:19:32.394696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:19:32.395158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:19:32.395632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:19:32.396047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:19:32.405428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:32.405970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:32.406406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:32.407146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:32.407591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:32.408007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:32.429201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Getting quotas for project 19fba7f86a064d7d9f421258ea170c02. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:19:32.434858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Getting quotas for user 121060278a2a4d6aa76e8c2e951ee793 and project 19fba7f86a064d7d9f421258ea170c02. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:19:32.448805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:19:32.451535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:19:32.502879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-517ab570-bd20-4508-a42e-8874c92f1bf6 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048894 Oct 12 09:19:32.505589 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2744/5921] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:19:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:19:32.515645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3783a766-a0e7-473d-932e-38e778c193dd tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:32.516505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3783a766-a0e7-473d-932e-38e778c193dd tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:32.612082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3783a766-a0e7-473d-932e-38e778c193dd tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:32.623253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3783a766-a0e7-473d-932e-38e778c193dd tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1214 microversion: 2.1 time: 0.111663 Oct 12 09:19:32.624928 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3178/5922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:32 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:33.201787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:33.209246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:33.250295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:33.251422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:33.252230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:33.254489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:33.255133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:33.256770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:33.306534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:33.590065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:33.602666 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aef18956-fa26-4bb5-99f0-200ee80bcbb4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.404981 Oct 12 09:19:33.603312 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2745/5923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:33 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:33.647832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:33.649464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:33.660036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:33.660783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:33.661392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:33.662259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:33.662950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:33.663385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:33.755837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:33.761415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:33.777606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d560a748-11f1-4b4e-b88c-c3ab6eb243ac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1266 microversion: 2.1 time: 0.133860 Oct 12 09:19:33.778491 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3179/5924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:33 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:34.629050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:34.629752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:34.631617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:34.638093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:34.638863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:34.639522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:34.640450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:34.640947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:34.641408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:34.798732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:34.811036 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f34123e6-789d-417b-8a61-b9daa09222c0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.186470 Oct 12 09:19:34.812331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2746/5925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:34 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:34.826890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:34.827637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:34.837547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:34.838050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:34.838508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:34.839220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:34.839675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:34.840172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:35.091923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:35.101973 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-336c46e0-ab62-4665-8fa0-c51ce3cae634 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1314 microversion: 2.1 time: 0.294665 Oct 12 09:19:35.102572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3180/5926] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:34 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:35.836798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:35.838012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:35.851958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:35.852560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:35.852872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:35.855956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:35.856428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:35.856864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:35.956581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0fa2ebe6-c90b-4718-bcf3-72b6430c83fd req-4ddfa6fa-2363-4726-9e98-b13500758911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e798eea-16fe-4d6a-bc09-2a7a5b08306a", "tag": "1ae2d39a-cd8e-44aa-a433-4463ed9021a6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:35.970047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:35.983071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0fa2ebe6-c90b-4718-bcf3-72b6430c83fd req-4ddfa6fa-2363-4726-9e98-b13500758911 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:35.983855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0fa2ebe6-c90b-4718-bcf3-72b6430c83fd req-4ddfa6fa-2363-4726-9e98-b13500758911 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:35.985466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0fa2ebe6-c90b-4718-bcf3-72b6430c83fd req-4ddfa6fa-2363-4726-9e98-b13500758911 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:36.002317 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0fa2ebe6-c90b-4718-bcf3-72b6430c83fd req-4ddfa6fa-2363-4726-9e98-b13500758911 service nova] Creating event network-changed:1ae2d39a-cd8e-44aa-a433-4463ed9021a6 for instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a on n-h2-858383-10 Oct 12 09:19:36.009208 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0fa2ebe6-c90b-4718-bcf3-72b6430c83fd req-4ddfa6fa-2363-4726-9e98-b13500758911 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062960 Oct 12 09:19:36.010728 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3181/5927] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:36.132520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:36.134069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:36.143135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:36.143681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:36.144348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:36.145808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:36.146743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:36.147499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:36.168498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:36.177208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0732791a-1a40-4bd5-b3ac-3bd6ca4c654f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.344832 Oct 12 09:19:36.181995 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2747/5928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:35 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:36.470525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:36.487162 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2007aced-1700-4156-b7f9-2800ca414668 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1314 microversion: 2.1 time: 0.366436 Oct 12 09:19:36.488103 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3182/5929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:36 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:37.202356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:37.203881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:37.213865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:37.215415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:37.216021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:37.218623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:37.219247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:37.220111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:37.447226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:37.457843 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54b42cb3-f88a-40a0-872b-cff0d69437a0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.261223 Oct 12 09:19:37.459292 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2748/5930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:37 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:37.512746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:37.514021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:37.526070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:37.526811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:37.527304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:37.528022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:37.534859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:37.535695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:38.235092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:38.243992 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-62872d5d-7893-4945-a024-5d8c5c55034c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1314 microversion: 2.1 time: 0.735519 Oct 12 09:19:38.244784 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3183/5931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:37 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:38.482855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:38.483480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:38.491011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:38.491604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:38.492106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:38.492921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:38.493616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:38.494588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:38.637604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:38.647103 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-379d0314-2b25-4f78-9276-97a4d15b4305 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.168361 Oct 12 09:19:38.648314 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2749/5932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:38 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:39.268033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:39.269923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:39.278161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:39.279047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:39.279789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:39.280694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:39.281321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:39.282095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:39.672863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:39.673518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:39.687567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:39.696347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:39.699070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:39.699921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:39.704010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:39.704984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:39.817297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:39.830929 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5610fb40-91d4-4a30-b999-c454caaebdf9 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1314 microversion: 2.1 time: 0.562875 Oct 12 09:19:39.832841 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3184/5933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:39 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:40.579368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:40.587535 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10ad8adf-75d9-4813-8c64-08761cf80032 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1694 microversion: 2.1 time: 0.919547 Oct 12 09:19:40.588150 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2750/5934] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:39 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1694 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:40.856030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:40.856756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:40.871321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:40.872127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:40.872744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:40.873675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:40.874275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:40.874835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:41.172122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:41.172276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a1087ac2-20c0-45e4-94d4-69ccd0cf5f65 req-a16472aa-d691-4382-92d1-5d64d5258f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93674478-e3a2-4972-9f8c-bece3ff3ca88", "name": "network-vif-unplugged", "status": "completed", "tag": "ea02c38f-688b-48b3-9b49-663a71de9b57"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:41.190230 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-354ccdba-2283-40e2-83b2-0f22664a40cf tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1314 microversion: 2.1 time: 0.337840 Oct 12 09:19:41.190598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a1087ac2-20c0-45e4-94d4-69ccd0cf5f65 req-a16472aa-d691-4382-92d1-5d64d5258f78 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:41.191081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a1087ac2-20c0-45e4-94d4-69ccd0cf5f65 req-a16472aa-d691-4382-92d1-5d64d5258f78 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:41.191504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a1087ac2-20c0-45e4-94d4-69ccd0cf5f65 req-a16472aa-d691-4382-92d1-5d64d5258f78 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:41.193679 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3185/5935] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:40 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:41.220756 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a1087ac2-20c0-45e4-94d4-69ccd0cf5f65 req-a16472aa-d691-4382-92d1-5d64d5258f78 service nova] Creating event network-vif-unplugged:ea02c38f-688b-48b3-9b49-663a71de9b57 for instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 on n-h1-858383-10 Oct 12 09:19:41.227268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-a1087ac2-20c0-45e4-94d4-69ccd0cf5f65 req-a16472aa-d691-4382-92d1-5d64d5258f78 service nova] Instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:19:41.239813 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a1087ac2-20c0-45e4-94d4-69ccd0cf5f65 req-a16472aa-d691-4382-92d1-5d64d5258f78 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071199 Oct 12 09:19:41.240969 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2751/5936] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:41.525620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1afc3543-da1d-4195-97d4-aba2075765f9 req-8635f3d2-b37e-4e0e-87b3-e8acdc5f7e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e798eea-16fe-4d6a-bc09-2a7a5b08306a", "name": "network-vif-plugged", "status": "completed", "tag": "1ae2d39a-cd8e-44aa-a433-4463ed9021a6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:41.608726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1afc3543-da1d-4195-97d4-aba2075765f9 req-8635f3d2-b37e-4e0e-87b3-e8acdc5f7e52 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:41.609343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1afc3543-da1d-4195-97d4-aba2075765f9 req-8635f3d2-b37e-4e0e-87b3-e8acdc5f7e52 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.046s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:41.610162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1afc3543-da1d-4195-97d4-aba2075765f9 req-8635f3d2-b37e-4e0e-87b3-e8acdc5f7e52 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:41.611735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:41.612837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:41.620113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:41.620890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:41.621583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:41.622859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:41.623458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:41.624030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:41.644357 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1afc3543-da1d-4195-97d4-aba2075765f9 req-8635f3d2-b37e-4e0e-87b3-e8acdc5f7e52 service nova] Creating event network-vif-plugged:1ae2d39a-cd8e-44aa-a433-4463ed9021a6 for instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a on n-h2-858383-10 Oct 12 09:19:41.659467 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1afc3543-da1d-4195-97d4-aba2075765f9 req-8635f3d2-b37e-4e0e-87b3-e8acdc5f7e52 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138197 Oct 12 09:19:41.661780 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3186/5937] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:41.881021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:41.892308 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d0a4e309-f875-4a64-a289-8e92c2a9ac85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1693 microversion: 2.1 time: 0.284595 Oct 12 09:19:41.907009 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2752/5938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:41 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1693 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:42.223046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:42.224440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:42.232807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:42.233811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:42.234532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:42.235539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:42.236178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:42.236814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:42.466318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:42.476644 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0d1fc53-9082-44fb-9be2-02f2808b1b4e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1314 microversion: 2.1 time: 0.260166 Oct 12 09:19:42.477579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3187/5939] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:42 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:42.919474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:42.920803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:42.927622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:42.928318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:42.935282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:42.937129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:42.937968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:42.938960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:42.939613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:42.940231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:43.208837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:43.219383 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-59b081b4-d9eb-46c6-8831-987624abffce tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1691 microversion: 2.1 time: 0.304784 Oct 12 09:19:43.219979 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2753/5940] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:42 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:43.278811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-dc5c292e-e86f-4c85-9d18-fa046836a49e req-5ff70d9a-92a0-4fa7-94e2-713077773b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93674478-e3a2-4972-9f8c-bece3ff3ca88", "tag": "ea02c38f-688b-48b3-9b49-663a71de9b57"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:43.283773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:43.290779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dc5c292e-e86f-4c85-9d18-fa046836a49e req-5ff70d9a-92a0-4fa7-94e2-713077773b0a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:43.291268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dc5c292e-e86f-4c85-9d18-fa046836a49e req-5ff70d9a-92a0-4fa7-94e2-713077773b0a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:43.292022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dc5c292e-e86f-4c85-9d18-fa046836a49e req-5ff70d9a-92a0-4fa7-94e2-713077773b0a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:43.304423 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-dc5c292e-e86f-4c85-9d18-fa046836a49e req-5ff70d9a-92a0-4fa7-94e2-713077773b0a service nova] Creating event network-changed:ea02c38f-688b-48b3-9b49-663a71de9b57 for instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 on n-h1-858383-10 Oct 12 09:19:43.310510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-dc5c292e-e86f-4c85-9d18-fa046836a49e req-5ff70d9a-92a0-4fa7-94e2-713077773b0a service nova] Instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:19:43.321748 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-dc5c292e-e86f-4c85-9d18-fa046836a49e req-5ff70d9a-92a0-4fa7-94e2-713077773b0a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046609 Oct 12 09:19:43.322634 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3188/5941] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:43.499901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:43.500937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:43.508761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:43.509396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:43.509958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:43.510796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:43.511351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:43.512005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:43.751848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:43.760305 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4dc9f0a3-6248-437a-a8e8-f96f4ded1fb3 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1497 microversion: 2.1 time: 0.264346 Oct 12 09:19:43.760901 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2754/5942] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:43 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1497 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:44.248570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:44.249651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:44.266384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:44.267323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:44.270114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:44.270965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:44.271535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:44.273271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:44.301705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:44.302820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:44.310325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:44.311025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:44.311601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:44.312452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:44.313040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:44.313667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:44.343708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:19:44.447629 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b31261e-9918-4716-9527-e32751a34b0e tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 204 len: 0 microversion: 2.1 time: 0.149722 Oct 12 09:19:44.451443 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2755/5943] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:19:44 2022] DELETE /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:19:44.457259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:44.458183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:44.464467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:44.465287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:44.466154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:44.467195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:44.467765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:44.468291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:44.616398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:44.627454 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53786fde-4ba9-4c2f-8690-2b956d6845d5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1691 microversion: 2.1 time: 0.383915 Oct 12 09:19:44.628336 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3189/5944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:44 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1691 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:45.024069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:45.032531 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b5574f0-0793-4c9c-a770-6407c5417269 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1503 microversion: 2.1 time: 0.579491 Oct 12 09:19:45.055507 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2756/5945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:44 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1503 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:45.654131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:45.662822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:45.683236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:45.685163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:45.686057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:45.687483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:45.689015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:45.689859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:45.956413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:45.964627 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c9e725a-95c2-45ce-8a0e-938f719d647a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1688 microversion: 2.1 time: 0.316425 Oct 12 09:19:45.965215 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3190/5946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:45 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1688 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:45.988453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:45.988982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:45.995937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:45.996414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:45.996929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:45.997652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:45.998103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:45.998525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:46.056640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:46.058177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:46.059517 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba0808e3-f8ba-43b6-bd5f-06d26ef77da3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action" status: 204 len: 0 microversion: 2.1 time: 0.074700 Oct 12 09:19:46.060432 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2757/5947] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:19:45 2022] POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:19:46.067493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:46.068874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:46.069633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:46.074861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:46.077230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:46.081566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:46.081745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:46.082066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:46.082514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:46.082988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:46.083225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:46.083847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:46.083967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:46.084524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:46.344286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:46.359092 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6d239fc6-3481-4f7b-9698-60793212140a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1688 microversion: 2.1 time: 0.293541 Oct 12 09:19:46.360051 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2758/5948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:46 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1688 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:46.376123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:46.391086 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-27f05769-956a-4ed5-870e-78ada2ce3663 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1503 microversion: 2.1 time: 0.337948 Oct 12 09:19:46.392965 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3191/5949] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:46 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:46.765267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-47c8b98b-ccc6-429f-9ba3-4fd23223433f req-9f3b21ab-02c6-416f-baa0-981d5d4169ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e798eea-16fe-4d6a-bc09-2a7a5b08306a", "name": "network-vif-deleted", "tag": "1ae2d39a-cd8e-44aa-a433-4463ed9021a6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:46.779448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-47c8b98b-ccc6-429f-9ba3-4fd23223433f req-9f3b21ab-02c6-416f-baa0-981d5d4169ab service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:46.779934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-47c8b98b-ccc6-429f-9ba3-4fd23223433f req-9f3b21ab-02c6-416f-baa0-981d5d4169ab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:46.780346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-47c8b98b-ccc6-429f-9ba3-4fd23223433f req-9f3b21ab-02c6-416f-baa0-981d5d4169ab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:46.784573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:46.804705 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-47c8b98b-ccc6-429f-9ba3-4fd23223433f req-9f3b21ab-02c6-416f-baa0-981d5d4169ab service nova] Creating event network-vif-deleted:1ae2d39a-cd8e-44aa-a433-4463ed9021a6 for instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a on n-h2-858383-10 Oct 12 09:19:46.810222 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-47c8b98b-ccc6-429f-9ba3-4fd23223433f req-9f3b21ab-02c6-416f-baa0-981d5d4169ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048511 Oct 12 09:19:46.811689 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2759/5950] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:47.390037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:47.390632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:47.402022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:47.402574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:47.405397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:47.406220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:47.406699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:47.407143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:47.419984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:47.420994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:47.430537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:47.431206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:47.431657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:47.432382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:47.432845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:47.433271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:47.509623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:47.510268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:47.510728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:47.511515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lazy-loading 'fault' on Instance uuid 2e798eea-16fe-4d6a-bc09-2a7a5b08306a {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:19:47.699259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:47.717387 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06da7d2b-2680-4d1b-9c09-54905e8f3c6d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1688 microversion: 2.1 time: 0.331206 Oct 12 09:19:47.738476 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3192/5951] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:47 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1688 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:47.761605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:47.772989 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5e695d33-c121-4ab6-8def-4515f1f86a8c tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 200 len: 1304 microversion: 2.1 time: 0.360096 Oct 12 09:19:47.787912 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2760/5952] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:47 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 1304 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:19:48.746856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:48.747436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:48.761240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:48.761829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:48.762341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:48.765064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:48.765570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:48.767822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:48.799679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:48.801355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: 2e798eea-16fe-4d6a-bc09-2a7a5b08306a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:48.815350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:48.815860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:48.816291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:48.817051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:48.824135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:48.826258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:48.889775 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] HTTP exception thrown: Instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a could not be found. Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Request method failure captured: Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a HTTP/1.1 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoahn9f15ki-03EEC_xVQNOpMwx0S5v3WegOGJyKfXUTYXqRehrxUq_VV4ReQprXw0VrnXbcff5KCwqOr4W_IVXGuGI7DAK7VoqC6umr-5SkFyXKy_jr7RuifHLZpi3mkaCQmThgQD0mxK4gflgTANHkq4-K77LFcFCOCfAY7ESMpW0 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 19fba7f86a064d7d9f421258ea170c02 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesActionsTest-1502302250 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19fba7f86a064d7d9f421258ea170c02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19fba7f86a064d7d9f421258ea170c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19fba7f86a064d7d9f421258ea170c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19fba7f86a064d7d9f421258ea170c02"}]}] Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesActionsTest-1502302250 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 19fba7f86a064d7d9f421258ea170c02 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesActionsTest-1502302250 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesActionsTest-1502302250-project Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 121060278a2a4d6aa76e8c2e951ee793 Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesActionsTest-1502302250-project Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a could not be found. Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '2e798eea-16fe-4d6a-bc09-2a7a5b08306a'} Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a could not be found. Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a could not be found. Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:19:48.891683 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:19:48.895307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:19:48.895307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:19:48.895307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:19:48.895307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:19:48.895307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:19:48.895307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a could not be found. Oct 12 09:19:48.895307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:19:48.896797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Returning 404 to user: Instance 2e798eea-16fe-4d6a-bc09-2a7a5b08306a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:19:48.898129 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-08832734-f66a-48e7-bc25-cfa08b479696 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a" status: 404 len: 111 microversion: 2.1 time: 0.102822 Oct 12 09:19:48.899592 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2761/5953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:48 2022] GET /compute/v2.1/servers/2e798eea-16fe-4d6a-bc09-2a7a5b08306a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:19:49.126821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:49.146981 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-688de853-8a1e-4aaf-b003-a1f51f66c8e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1680 microversion: 2.1 time: 0.404991 Oct 12 09:19:49.157159 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3193/5954] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:48 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1680 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:49.182296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1939329424", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "dd6ebd79-31a8-4aa4-87f6-1603c9906d75"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:49.284118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] validate_networks() for [('dd6ebd79-31a8-4aa4-87f6-1603c9906d75', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:19:49.457309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-960cbfc4-c56a-4888-82ff-4a3f392a07fe req-ff8a7b96-4c04-45b6-a64b-41bec8a1e54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93674478-e3a2-4972-9f8c-bece3ff3ca88", "name": "network-vif-plugged", "status": "completed", "tag": "ea02c38f-688b-48b3-9b49-663a71de9b57"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:49.471579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-960cbfc4-c56a-4888-82ff-4a3f392a07fe req-ff8a7b96-4c04-45b6-a64b-41bec8a1e54e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:49.472071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-960cbfc4-c56a-4888-82ff-4a3f392a07fe req-ff8a7b96-4c04-45b6-a64b-41bec8a1e54e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:49.472520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-960cbfc4-c56a-4888-82ff-4a3f392a07fe req-ff8a7b96-4c04-45b6-a64b-41bec8a1e54e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:49.502417 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-960cbfc4-c56a-4888-82ff-4a3f392a07fe req-ff8a7b96-4c04-45b6-a64b-41bec8a1e54e service nova] Creating event network-vif-plugged:ea02c38f-688b-48b3-9b49-663a71de9b57 for instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 on n-h1-858383-10 Oct 12 09:19:49.521168 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-960cbfc4-c56a-4888-82ff-4a3f392a07fe req-ff8a7b96-4c04-45b6-a64b-41bec8a1e54e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067983 Oct 12 09:19:49.525205 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3194/5955] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:50.057264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:19:50.058582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:19:50.059438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:19:50.060083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:19:50.060760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:19:50.071951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:50.072684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:50.073819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:50.074923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:50.075442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:50.076330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:50.099975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Getting quotas for project 19fba7f86a064d7d9f421258ea170c02. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:19:50.106899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Getting quotas for user 121060278a2a4d6aa76e8c2e951ee793 and project 19fba7f86a064d7d9f421258ea170c02. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:19:50.123531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:19:50.127101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:19:50.190020 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-928d3b86-f06b-461a-9355-d20a0a359555 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035814 Oct 12 09:19:50.196611 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2762/5956] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:19:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:19:50.205346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95478f8d-dfa3-4977-881c-aac59f09a3aa tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:50.206155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95478f8d-dfa3-4977-881c-aac59f09a3aa tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:50.296957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95478f8d-dfa3-4977-881c-aac59f09a3aa tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:50.307999 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95478f8d-dfa3-4977-881c-aac59f09a3aa tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1214 microversion: 2.1 time: 0.106071 Oct 12 09:19:50.308668 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3195/5957] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:50 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:51.332556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:51.333181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:51.358643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:51.359666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:51.360428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:51.361322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:51.361861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:51.362303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:51.633075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:51.646475 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dae4521a-212e-4d01-a4ee-4cbe48b98792 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1266 microversion: 2.1 time: 0.319880 Oct 12 09:19:51.668486 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2763/5958] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:51 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:52.676461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:52.679481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:52.691606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:52.692616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:52.693269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:52.694292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:52.695126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:52.695753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:52.919031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:52.930204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-81243c9c-7ecf-449d-8882-8afc7a33877b tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1314 microversion: 2.1 time: 0.258534 Oct 12 09:19:52.947475 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3196/5959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:52 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:53.473592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1dbac6d5-9a48-44e8-ba97-69803112bfc3 req-a87094b8-676e-48de-bce1-5f1d0047292b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a165c5ec-d57f-4a35-b5af-407fd851f838", "tag": "2c61a8cf-9202-462d-b6ab-3449d6ce5af9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:53.496530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1dbac6d5-9a48-44e8-ba97-69803112bfc3 req-a87094b8-676e-48de-bce1-5f1d0047292b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:53.497017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1dbac6d5-9a48-44e8-ba97-69803112bfc3 req-a87094b8-676e-48de-bce1-5f1d0047292b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:53.498826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1dbac6d5-9a48-44e8-ba97-69803112bfc3 req-a87094b8-676e-48de-bce1-5f1d0047292b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:53.520991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1dbac6d5-9a48-44e8-ba97-69803112bfc3 req-a87094b8-676e-48de-bce1-5f1d0047292b service nova] Creating event network-changed:2c61a8cf-9202-462d-b6ab-3449d6ce5af9 for instance a165c5ec-d57f-4a35-b5af-407fd851f838 on n-h2-858383-10 Oct 12 09:19:53.526218 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1dbac6d5-9a48-44e8-ba97-69803112bfc3 req-a87094b8-676e-48de-bce1-5f1d0047292b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057166 Oct 12 09:19:53.527039 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2764/5960] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:19:53.956427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:53.957037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:53.969572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:53.970273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:53.970721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:53.971444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:53.971915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:53.972323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:54.178033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:54.187475 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-491d3db9-e635-47c6-9155-826b493dfab8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1314 microversion: 2.1 time: 0.234503 Oct 12 09:19:54.188155 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3197/5961] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:53 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:55.214703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:55.216135 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:55.229824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:55.230327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:55.230868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:55.231585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:55.232074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:55.232462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:55.629686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:55.643434 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f53e2217-25f0-4f36-9744-8e982af43ef5 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1314 microversion: 2.1 time: 0.435696 Oct 12 09:19:55.649016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2765/5962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:55 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:56.671743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:56.672547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:56.681916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:56.682764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:56.684374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:56.685473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:56.686139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:56.686770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:56.841016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:56.852346 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e9af0a92-a07c-4a1e-9425-7d971d2044d8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1314 microversion: 2.1 time: 0.187127 Oct 12 09:19:56.853753 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3198/5963] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:56 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:57.412616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-286ddb01-89b9-4aa1-ae22-23f66deffb4f req-971fffa9-b970-4986-a82d-75e61451689d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a165c5ec-d57f-4a35-b5af-407fd851f838", "name": "network-vif-plugged", "status": "completed", "tag": "2c61a8cf-9202-462d-b6ab-3449d6ce5af9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:19:57.456141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-286ddb01-89b9-4aa1-ae22-23f66deffb4f req-971fffa9-b970-4986-a82d-75e61451689d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:57.456551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-286ddb01-89b9-4aa1-ae22-23f66deffb4f req-971fffa9-b970-4986-a82d-75e61451689d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:57.456985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-286ddb01-89b9-4aa1-ae22-23f66deffb4f req-971fffa9-b970-4986-a82d-75e61451689d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:57.487622 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-286ddb01-89b9-4aa1-ae22-23f66deffb4f req-971fffa9-b970-4986-a82d-75e61451689d service nova] Creating event network-vif-plugged:2c61a8cf-9202-462d-b6ab-3449d6ce5af9 for instance a165c5ec-d57f-4a35-b5af-407fd851f838 on n-h2-858383-10 Oct 12 09:19:57.494488 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-286ddb01-89b9-4aa1-ae22-23f66deffb4f req-971fffa9-b970-4986-a82d-75e61451689d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085727 Oct 12 09:19:57.495809 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2766/5964] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:19:57.876510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:57.877112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:57.891938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:57.892625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:57.893247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:57.894005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:57.894613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:57.895195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:58.081047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:58.085327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:19:58.093650 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a5bd5076-9d4f-435a-ad85-d20bf80514e8 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1314 microversion: 2.1 time: 0.220542 Oct 12 09:19:58.107890 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3199/5965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:57 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:19:59.118444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:19:59.119180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:19:59.129545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:59.129907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:59.130341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:59.131115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:19:59.131574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:19:59.132087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:19:59.397828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:19:59.416653 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-22ded4eb-d675-4dff-8baa-86dc993f4037 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1314 microversion: 2.1 time: 0.302326 Oct 12 09:19:59.418036 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2767/5966] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:19:59 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:00.450269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:00.451583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:00.454588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:00.460749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:00.461377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:00.462076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:00.462860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:00.463531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:00.464162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:00.613485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:00.622492 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-631a81cf-1934-4d80-bded-4a52933e0dae tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1498 microversion: 2.1 time: 0.176614 Oct 12 09:20:00.623289 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3200/5967] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:00 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:01.204934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:01.206312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:01.208596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:01.209906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:01.218358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:01.219210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:01.219858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:01.220738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:01.221419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:01.222218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:01.257674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:20:01.398066 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7bdd7c0e-7fab-450a-b0d2-b7934b101c01 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 204 len: 0 microversion: 2.1 time: 0.196718 Oct 12 09:20:01.399558 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2768/5968] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:20:01 2022] DELETE /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:20:01.410493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:01.411440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:01.420626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:01.421336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:01.422074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:01.422989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:01.423621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:01.424227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:01.634463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:01.656530 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6b9f1910-d064-47ea-a1da-8db8cedcbaac tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1504 microversion: 2.1 time: 0.245663 Oct 12 09:20:01.660021 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3201/5969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:01 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:02.684241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:02.684953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:02.697489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:02.697979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:02.698419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:02.699173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:02.699631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:02.700060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:03.499627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:03.510832 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3841d9b6-627d-4d71-9b6f-a01091c61418 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1504 microversion: 2.1 time: 0.831358 Oct 12 09:20:03.511436 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2769/5970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:02 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1504 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:03.908144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-011a76cf-1593-479c-a7ea-d980ec80091c req-7682e3ba-b687-4b63-b1db-6b2054d79511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a165c5ec-d57f-4a35-b5af-407fd851f838", "name": "network-vif-deleted", "tag": "2c61a8cf-9202-462d-b6ab-3449d6ce5af9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:20:03.957377 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:20:03.959454 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:20:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 12 09:20:03.987872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-011a76cf-1593-479c-a7ea-d980ec80091c req-7682e3ba-b687-4b63-b1db-6b2054d79511 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:03.992399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-011a76cf-1593-479c-a7ea-d980ec80091c req-7682e3ba-b687-4b63-b1db-6b2054d79511 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:03.992981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-011a76cf-1593-479c-a7ea-d980ec80091c req-7682e3ba-b687-4b63-b1db-6b2054d79511 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:04.044003 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-011a76cf-1593-479c-a7ea-d980ec80091c req-7682e3ba-b687-4b63-b1db-6b2054d79511 service nova] Creating event network-vif-deleted:2c61a8cf-9202-462d-b6ab-3449d6ce5af9 for instance a165c5ec-d57f-4a35-b5af-407fd851f838 on n-h2-858383-10 Oct 12 09:20:04.060910 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-011a76cf-1593-479c-a7ea-d980ec80091c req-7682e3ba-b687-4b63-b1db-6b2054d79511 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159851 Oct 12 09:20:04.062047 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3202/5971] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:20:04.494098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:04.495279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:04.505486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:04.505966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:04.506767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:04.507469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:04.508086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:04.508648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:04.541735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:04.542627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:04.551618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:04.552718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:04.553462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:04.554499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:04.555359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:04.556515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:04.565709 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-48bdbe83-7d0d-469f-af00-2312bc36a300 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.074858 Oct 12 09:20:04.567367 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2770/5972] 10.222.0.40 () {58 vars in 1293 bytes} [Wed Oct 12 09:20:04 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79/os-server-password => generated 116 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:20:04.607987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:04.608685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:04.609269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:04.609895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lazy-loading 'fault' on Instance uuid a165c5ec-d57f-4a35-b5af-407fd851f838 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:20:04.669612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121060278a2a4d6aa76e8c2e951ee793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fba7f86a064d7d9f421258ea170c02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:04.683713 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f1c0eb60-96c3-4415-bbc1-2dd1bc3e2a13 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 200 len: 1304 microversion: 2.1 time: 0.147985 Oct 12 09:20:04.685136 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3203/5973] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:04 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:20:05.711915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:05.712546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] [instance: a165c5ec-d57f-4a35-b5af-407fd851f838] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:05.726443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:05.733603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:05.734218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:05.736718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:05.744790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:05.745999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:05.752058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:05.808124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] HTTP exception thrown: Instance a165c5ec-d57f-4a35-b5af-407fd851f838 could not be found. Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Request method failure captured: Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 HTTP/1.1 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoahn9f15ki-03EEC_xVQNOpMwx0S5v3WegOGJyKfXUTYXqRehrxUq_VV4ReQprXw0VrnXbcff5KCwqOr4W_IVXGuGI7DAK7VoqC6umr-5SkFyXKy_jr7RuifHLZpi3mkaCQmThgQD0mxK4gflgTANHkq4-K77LFcFCOCfAY7ESMpW0 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 19fba7f86a064d7d9f421258ea170c02 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-VolumesActionsTest-1502302250 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19fba7f86a064d7d9f421258ea170c02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19fba7f86a064d7d9f421258ea170c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19fba7f86a064d7d9f421258ea170c02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19fba7f86a064d7d9f421258ea170c02"}]}] Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-VolumesActionsTest-1502302250 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 19fba7f86a064d7d9f421258ea170c02 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-VolumesActionsTest-1502302250 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-VolumesActionsTest-1502302250-project Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 121060278a2a4d6aa76e8c2e951ee793 Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-VolumesActionsTest-1502302250-project Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance a165c5ec-d57f-4a35-b5af-407fd851f838 could not be found. Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a165c5ec-d57f-4a35-b5af-407fd851f838'} Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a165c5ec-d57f-4a35-b5af-407fd851f838 could not be found. Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a165c5ec-d57f-4a35-b5af-407fd851f838 could not be found. Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:20:05.815660 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a165c5ec-d57f-4a35-b5af-407fd851f838 could not be found. Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] Returning 404 to user: Instance a165c5ec-d57f-4a35-b5af-407fd851f838 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:20:05.819357 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-49f7062a-4231-4143-ac05-9985fd21f860 tempest-VolumesActionsTest-1502302250 tempest-VolumesActionsTest-1502302250-project] 10.222.0.40 "GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838" status: 404 len: 111 microversion: 2.1 time: 0.111650 Oct 12 09:20:05.825888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2771/5974] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:05 2022] GET /compute/v2.1/servers/a165c5ec-d57f-4a35-b5af-407fd851f838 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:20:11.469505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:20:11.473007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:11.478769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=50 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:11.486842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:11.488967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:11.489857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:11.492047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:11.492755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:11.494487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:11.568473 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-56695385-fecf-4f65-9ec1-03719ed00119 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action" status: 200 len: 24576 microversion: 2.1 time: 0.102802 Oct 12 09:20:11.577602 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3204/5975] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:20:11 2022] POST /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88/action => generated 24576 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:20:17.748523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:17.750099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:17.766529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:17.775557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:17.778292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:17.780137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:17.781140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:17.786423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:17.788864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:18.116661 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-952d5e9c-6b92-442e-9dff-57e2b1f97af8 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1833 microversion: 2.1 time: 0.371829 Oct 12 09:20:18.137082 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2772/5976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:17 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1833 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:20.196887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:20.198132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:20.205037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9bb6a5d3-d372-4484-ac2a-31902de9bf28 req-18694b4c-c290-4234-961c-8939707880bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93674478-e3a2-4972-9f8c-bece3ff3ca88", "tag": "ea02c38f-688b-48b3-9b49-663a71de9b57"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:20:20.219628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:20.220651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:20.221046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:20.221833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:20.222303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:20.222818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:20.246478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9bb6a5d3-d372-4484-ac2a-31902de9bf28 req-18694b4c-c290-4234-961c-8939707880bd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:20.246982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9bb6a5d3-d372-4484-ac2a-31902de9bf28 req-18694b4c-c290-4234-961c-8939707880bd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:20.247427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9bb6a5d3-d372-4484-ac2a-31902de9bf28 req-18694b4c-c290-4234-961c-8939707880bd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:20.295900 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9bb6a5d3-d372-4484-ac2a-31902de9bf28 req-18694b4c-c290-4234-961c-8939707880bd service nova] Creating event network-changed:ea02c38f-688b-48b3-9b49-663a71de9b57 for instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 on n-h1-858383-10 Oct 12 09:20:20.303615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:20:20.312600 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9bb6a5d3-d372-4484-ac2a-31902de9bf28 req-18694b4c-c290-4234-961c-8939707880bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117932 Oct 12 09:20:20.318691 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2773/5977] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:20:20.522595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3cc3f52-d7c3-485f-894d-8397d0bb17e4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "DELETE /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 204 len: 0 microversion: 2.1 time: 0.330339 Oct 12 09:20:20.524295 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3205/5978] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:20:20 2022] DELETE /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:20:20.536657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:20.537682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:20.559370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:20.560195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:20.562768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:20.564192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:20.567907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:20.581619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:21.144639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:21.154131 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33d4a31a-fe96-4fb2-b99a-95f9ac9872eb tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1686 microversion: 2.1 time: 0.624106 Oct 12 09:20:21.158401 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2774/5979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:20 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1686 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:22.195390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:22.197170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:22.222995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:22.224132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:22.225245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:22.228260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:22.229394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:22.230634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:23.271804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:23.283174 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-30aa910d-0896-4a87-90f3-a2bc7638e76f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1686 microversion: 2.1 time: 1.103969 Oct 12 09:20:23.289697 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3206/5980] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:22 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1686 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:24.318367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:24.319750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:24.340874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:24.350060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:24.352593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:24.355348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:24.359700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:24.367416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:24.475568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-78c607c1-01a8-4a9e-939e-53db8eab555b req-4f27863c-4298-4d05-946b-b525749285a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93674478-e3a2-4972-9f8c-bece3ff3ca88", "name": "network-vif-deleted", "tag": "ea02c38f-688b-48b3-9b49-663a71de9b57"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:20:24.494619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-78c607c1-01a8-4a9e-939e-53db8eab555b req-4f27863c-4298-4d05-946b-b525749285a5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:24.495431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-78c607c1-01a8-4a9e-939e-53db8eab555b req-4f27863c-4298-4d05-946b-b525749285a5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:24.496277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-78c607c1-01a8-4a9e-939e-53db8eab555b req-4f27863c-4298-4d05-946b-b525749285a5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:24.523796 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-78c607c1-01a8-4a9e-939e-53db8eab555b req-4f27863c-4298-4d05-946b-b525749285a5 service nova] Creating event network-vif-deleted:ea02c38f-688b-48b3-9b49-663a71de9b57 for instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 on n-h1-858383-10 Oct 12 09:20:24.535779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:24.554110 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9cbdb745-27f1-4aae-a958-3279860413f1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 200 len: 1501 microversion: 2.1 time: 0.240250 Oct 12 09:20:24.557016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2775/5981] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:24 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 1501 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:24.559351 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-78c607c1-01a8-4a9e-939e-53db8eab555b req-4f27863c-4298-4d05-946b-b525749285a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090867 Oct 12 09:20:24.561129 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3207/5982] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:20:25.582469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:25.583086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: 93674478-e3a2-4972-9f8c-bece3ff3ca88] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:25.596828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:25.596937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:25.597301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:25.598057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:25.598516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:25.598948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:25.631100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] HTTP exception thrown: Instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 could not be found. Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Request method failure captured: Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 HTTP/1.1 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoZHs9OCmMfgFTAW5s5TKsdNvhEgMjtY2IwEwqgbpTOZaYH47TuzA4aLKKIZjP7v1vTyD0z-vVJEQsWgm9Dai8u6XRn9LQsC_awu6eyynstyGA6XoG_eGwhigzCdK3govzbDJ2aaZBWwd1KZ8BMC0BzDT7FAVnW5PaHuxvLUJmgAZ4I Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 1c149b7c2f3345fb90935d70bbbb66c3 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c149b7c2f3345fb90935d70bbbb66c3"}]}] Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 1c149b7c2f3345fb90935d70bbbb66c3 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestNetworkAdvancedServerOps-1590050818-project Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 98e7287fdde34fe198d4f43acd3da903 Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1590050818-project Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 could not be found. Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '93674478-e3a2-4972-9f8c-bece3ff3ca88'} Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 could not be found. Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 could not be found. Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:25.632819 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 could not be found. Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Returning 404 to user: Instance 93674478-e3a2-4972-9f8c-bece3ff3ca88 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:20:25.636521 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-492651f8-e941-4d1f-a234-9e99ae9bad57 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88" status: 404 len: 111 microversion: 2.1 time: 0.056244 Oct 12 09:20:25.642523 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2776/5983] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:25 2022] GET /compute/v2.1/servers/93674478-e3a2-4972-9f8c-bece3ff3ca88 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:20:32.538201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f7677ad-1ca1-4272-b7c0-8f420c512a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '.version_select at 0x7f9843512160>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:32.596733 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f7677ad-1ca1-4272-b7c0-8f420c512a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-896903764" status: 202 len: 0 microversion: 2.1 time: 0.063854 Oct 12 09:20:32.598217 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3208/5984] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 12 09:20:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-896903764 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:20:32.637948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73d37b12-29f4-4829-be02-88128c8a973e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'create', calling method: .version_select at 0x7f98437160d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-508313617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUXVgkXl0gcg/5VnAeJeZd86UU2oyjnB973U4wV0Ibiy+D2jTIQnmadVWysOREW+hiB7Fs0BscVMA2nzeDRNFkIhZeBd03DSgFLQIoroGLAUxNQtYBWftocPgQ5A19xCg=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:20:32.672946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-73d37b12-29f4-4829-be02-88128c8a973e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:20:32.690079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-73d37b12-29f4-4829-be02-88128c8a973e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for user 98e7287fdde34fe198d4f43acd3da903 and project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:20:32.789792 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-73d37b12-29f4-4829-be02-88128c8a973e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.156111 Oct 12 09:20:32.797672 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2777/5985] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:20:32 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:20:46.663067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:46.664037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:46.669012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-42348441", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "f5668823-ca31-4b1e-a4b1-e76543e96e4f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-508313617", "security_groups": [{"name": "tempest-secgroup-smoke-183212137"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:20:46.844992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] validate_networks() for [('f5668823-ca31-4b1e-a4b1-e76543e96e4f', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:20:47.441816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:20:47.442329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:20:47.442732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:20:47.443140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:20:47.443561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:20:47.460704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:47.461514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:47.462152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:47.463150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:47.463802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:47.465861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:47.490103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:20:47.497624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for user 98e7287fdde34fe198d4f43acd3da903 and project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:20:47.525999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:20:47.530898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:20:47.617615 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a44b8cc5-d222-4ec6-ad1c-c94d0b940d89 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.956036 Oct 12 09:20:47.618628 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3209/5986] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:20:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:20:47.630751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1e20269c-7a55-4f7c-bbd4-278205cb5e39 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:47.632525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1e20269c-7a55-4f7c-bbd4-278205cb5e39 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:47.635925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=22 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:47.637526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:47.658650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:47.766535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1e20269c-7a55-4f7c-bbd4-278205cb5e39 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:47.784148 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1e20269c-7a55-4f7c-bbd4-278205cb5e39 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1264 microversion: 2.1 time: 0.157791 Oct 12 09:20:47.787557 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2778/5987] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:47 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:48.816180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:48.816797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:48.832715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:48.835488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:48.836225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:48.838638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:48.839634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:48.840288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:48.998440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:49.017078 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec2088c1-7ae6-46ff-b21c-beab98276db6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1268 microversion: 2.1 time: 0.206389 Oct 12 09:20:49.019149 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3210/5988] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:48 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1268 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:50.042470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:50.045184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:50.068557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:50.069707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:50.070581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:50.071562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:50.072305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:50.073325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:50.217798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:50.225931 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-59df98df-4c61-46a0-868d-1cce337a9bd8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1322 microversion: 2.1 time: 0.188254 Oct 12 09:20:50.231734 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2779/5989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:50 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:51.254977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:51.256898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:51.269318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:51.271592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:51.274053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:51.276985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:51.277988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:51.278703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:51.505978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:51.519286 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39a89c2c-51c9-4680-8586-56bc52bf4110 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1389 microversion: 2.1 time: 0.268499 Oct 12 09:20:51.521384 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3211/5990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:51 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1389 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:20:52.555152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:52.557358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:52.557673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-85eb21bb-a65f-4640-b91b-cea7708e12bc req-834c999c-d0ce-40e4-a873-a87721054e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:20:52.578496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-85eb21bb-a65f-4640-b91b-cea7708e12bc req-834c999c-d0ce-40e4-a873-a87721054e86 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:52.578990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-85eb21bb-a65f-4640-b91b-cea7708e12bc req-834c999c-d0ce-40e4-a873-a87721054e86 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:52.579722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-85eb21bb-a65f-4640-b91b-cea7708e12bc req-834c999c-d0ce-40e4-a873-a87721054e86 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:52.582643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:52.583355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:52.583981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:52.587301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:52.587994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:52.589885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:52.600453 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-85eb21bb-a65f-4640-b91b-cea7708e12bc req-834c999c-d0ce-40e4-a873-a87721054e86 service nova] Creating event network-changed:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h2-858383-10 Oct 12 09:20:52.617261 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-85eb21bb-a65f-4640-b91b-cea7708e12bc req-834c999c-d0ce-40e4-a873-a87721054e86 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063177 Oct 12 09:20:52.618742 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3212/5991] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:20:53.401100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:53.412686 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-214c66f1-3844-4f44-8a19-7528c8c5e8b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1389 microversion: 2.1 time: 0.870076 Oct 12 09:20:53.413554 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2780/5992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:52 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1389 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:54.439232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:54.439921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:54.446959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:54.447652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:54.448269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:54.449115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:54.449739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:54.450575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:54.639560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:54.651893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ed3afb50-4343-4b2e-ad4e-bfcdfbc12c9b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1389 microversion: 2.1 time: 0.216749 Oct 12 09:20:54.654579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3213/5993] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:54 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1389 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:55.676521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:55.677770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:55.690014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:55.690509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:55.692107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:55.693239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:55.694076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:55.694510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:55.908853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:55.921137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0fc13cba-b0d3-4d2e-b5ce-dc0266622ac8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1389 microversion: 2.1 time: 0.248914 Oct 12 09:20:55.923880 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2781/5994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:55 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1389 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:56.946655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:56.948248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:56.955835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:56.956331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:56.956825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:56.957482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:56.957941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:56.958619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:57.117488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:57.128241 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a49e525c-71d6-46c3-b993-1af0853e818d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1389 microversion: 2.1 time: 0.185759 Oct 12 09:20:57.128839 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3214/5995] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:56 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1389 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:58.152317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:58.153632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:58.157221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:58.171793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:58.172291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:58.172731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:58.173469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:58.173927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:58.174350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:58.395591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:58.404481 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a39d0178-e866-4548-a192-7e16e3343ef3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1389 microversion: 2.1 time: 0.256031 Oct 12 09:20:58.405800 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2782/5996] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:58 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1389 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:20:59.432412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:20:59.433374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:20:59.436344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:59.442107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:20:59.463922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:59.464421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:59.464882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:59.466770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:59.467270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:59.468335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:59.571326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-49210bd0-c6ac-4457-8428-2b6ee6032328 req-8c305d83-0f0a-4286-95da-e1a10b8c35da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "name": "network-vif-plugged", "status": "completed", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:20:59.589171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-49210bd0-c6ac-4457-8428-2b6ee6032328 req-8c305d83-0f0a-4286-95da-e1a10b8c35da service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:20:59.591581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-49210bd0-c6ac-4457-8428-2b6ee6032328 req-8c305d83-0f0a-4286-95da-e1a10b8c35da service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:20:59.592011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-49210bd0-c6ac-4457-8428-2b6ee6032328 req-8c305d83-0f0a-4286-95da-e1a10b8c35da service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:20:59.629003 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-49210bd0-c6ac-4457-8428-2b6ee6032328 req-8c305d83-0f0a-4286-95da-e1a10b8c35da service nova] Creating event network-vif-plugged:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h2-858383-10 Oct 12 09:20:59.636054 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-49210bd0-c6ac-4457-8428-2b6ee6032328 req-8c305d83-0f0a-4286-95da-e1a10b8c35da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068904 Oct 12 09:20:59.641294 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2783/5997] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:20:59.744050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:20:59.752988 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-203e8307-bea5-4ec9-b57c-41b487f7df30 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1389 microversion: 2.1 time: 0.326477 Oct 12 09:20:59.757387 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3215/5998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:20:59 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1389 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:00.779047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:00.779820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:00.794353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:00.795320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:00.795997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:00.796908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:00.797600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:00.798331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:00.972673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:00.983662 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2fb433e1-1787-40c0-a23c-fe68e2aa88b3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1389 microversion: 2.1 time: 0.208935 Oct 12 09:21:00.984507 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2784/5999] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:00 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1389 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:02.007771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:02.008487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:02.019656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:02.021025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:02.021829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:02.022832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:02.023761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:02.024724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:02.211519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:02.223406 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2ed2d170-46f5-4a1f-aea0-cc328cca2c3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1559 microversion: 2.1 time: 0.219842 Oct 12 09:21:02.224003 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3216/6000] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:02 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:02.247640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:02.248569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:02.266787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:02.266787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:02.266787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:02.266787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:02.266787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:02.266787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:02.462462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:02.476331 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2564b6cd-2edb-456a-a6ef-061b6406dad0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1559 microversion: 2.1 time: 0.233747 Oct 12 09:21:02.490504 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2785/6001] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:02 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1559 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:04.498242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:04.498875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:04.502384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ef1a7e5a-0ecc-46f6-b59e-3f5a07f5b68d req-9e5e5acd-2b71-4594-87ad-9c7beb0abcf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:21:04.511837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:04.512230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:04.513357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:04.514408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:04.515037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:04.515770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:04.523048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef1a7e5a-0ecc-46f6-b59e-3f5a07f5b68d req-9e5e5acd-2b71-4594-87ad-9c7beb0abcf3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:04.523850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef1a7e5a-0ecc-46f6-b59e-3f5a07f5b68d req-9e5e5acd-2b71-4594-87ad-9c7beb0abcf3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:04.526091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ef1a7e5a-0ecc-46f6-b59e-3f5a07f5b68d req-9e5e5acd-2b71-4594-87ad-9c7beb0abcf3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:04.579371 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ef1a7e5a-0ecc-46f6-b59e-3f5a07f5b68d req-9e5e5acd-2b71-4594-87ad-9c7beb0abcf3 service nova] Creating event network-changed:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h2-858383-10 Oct 12 09:21:04.595486 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ef1a7e5a-0ecc-46f6-b59e-3f5a07f5b68d req-9e5e5acd-2b71-4594-87ad-9c7beb0abcf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097219 Oct 12 09:21:04.599185 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2786/6002] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:21:05.130444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:05.142764 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-84966675-31e9-4592-99a5-208b6e35db97 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1559 microversion: 2.1 time: 0.652180 Oct 12 09:21:05.144351 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3217/6003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:04 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1559 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:09.724002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-214723555", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:21:10.049903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] validate_networks() for None {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:21:10.638522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:21:10.640154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:21:10.640780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:21:10.641402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:21:10.642516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:21:10.653741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:10.654647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:10.656168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:10.657715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:10.658171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:10.658597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:10.679154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Getting quotas for project 9513e199238745eba1180da30d732db1. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:21:10.689703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Getting quotas for user ccc39bfe83bf43c4a5170f714b495f5f and project 9513e199238745eba1180da30d732db1. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:21:10.707565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:21:10.710515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:21:10.762065 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24f83bdf-77f6-4b0e-971e-4f39ef379294 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042439 Oct 12 09:21:10.770768 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2787/6004] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:21:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:21:10.776120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cec30cb3-186d-4388-827c-ef1001c869b6 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:10.776854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cec30cb3-186d-4388-827c-ef1001c869b6 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:10.850432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cec30cb3-186d-4388-827c-ef1001c869b6 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:10.869335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cec30cb3-186d-4388-827c-ef1001c869b6 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1213 microversion: 2.1 time: 0.097992 Oct 12 09:21:10.870270 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3218/6005] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:10 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:21:11.892690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:11.893304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:11.902866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:11.903470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:11.903989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:11.904767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:11.905295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:11.905890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:11.979404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:11.991133 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-99ed7f2b-72c9-4f10-b293-ce08bf6cb1f9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1265 microversion: 2.1 time: 0.102457 Oct 12 09:21:11.992010 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2788/6006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:11 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:13.018185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:13.020078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:13.035639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:13.037148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:13.038102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:13.039642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:13.040670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:13.041395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:13.269320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:13.290523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3b14787-7128-4e8d-b0d7-b8ecd553cd9c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1313 microversion: 2.1 time: 0.277395 Oct 12 09:21:13.313955 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3219/6007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:13 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:14.133886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-75f7f0f0-3683-4961-8858-a94982d2d1cc req-52fcab7d-bb90-49d7-bdf6-2443acb02dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd87c908-ee6b-4b8e-9b87-bde3b990398a", "tag": "a3d6a4b3-530c-45b7-91d1-ba32adbdbad7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:21:14.169482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75f7f0f0-3683-4961-8858-a94982d2d1cc req-52fcab7d-bb90-49d7-bdf6-2443acb02dfa service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:14.170359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75f7f0f0-3683-4961-8858-a94982d2d1cc req-52fcab7d-bb90-49d7-bdf6-2443acb02dfa service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:14.171839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-75f7f0f0-3683-4961-8858-a94982d2d1cc req-52fcab7d-bb90-49d7-bdf6-2443acb02dfa service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:14.201201 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-75f7f0f0-3683-4961-8858-a94982d2d1cc req-52fcab7d-bb90-49d7-bdf6-2443acb02dfa service nova] Creating event network-changed:a3d6a4b3-530c-45b7-91d1-ba32adbdbad7 for instance cd87c908-ee6b-4b8e-9b87-bde3b990398a on n-h1-858383-10 Oct 12 09:21:14.225016 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-75f7f0f0-3683-4961-8858-a94982d2d1cc req-52fcab7d-bb90-49d7-bdf6-2443acb02dfa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096737 Oct 12 09:21:14.227180 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2789/6008] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:21:14.325161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:14.325990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:14.340664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:14.341358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:14.342670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:14.342670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:14.343155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:14.343576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:14.517548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:14.529972 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-10bcd794-4a79-4850-a676-9315103dc42a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1313 microversion: 2.1 time: 0.209121 Oct 12 09:21:14.546525 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3220/6009] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:14 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:21:15.560131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:15.561689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:15.573169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:15.573671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:15.574108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:15.575333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:15.576085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:15.577340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:15.801559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:15.820543 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8ff963cf-0e95-4ca3-8679-4289b6f7ea14 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1313 microversion: 2.1 time: 0.265266 Oct 12 09:21:15.873614 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2790/6010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:15 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:21:16.861514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:16.862057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:16.871905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:16.873868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:16.874410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:16.874923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:16.876267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:16.877010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:16.878020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:16.881587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=59 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:17.032080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:17.041868 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-94d1deaf-6af7-4416-9525-35fbb32384b9 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1313 microversion: 2.1 time: 0.184759 Oct 12 09:21:17.042540 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3221/6011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:16 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:18.067769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:18.068996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:18.075740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:18.084910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:18.094337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:18.095122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:18.096019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:18.096564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:18.097130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:18.101003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=57 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:18.259695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:18.275623 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2ed26773-bc8e-4ec8-9ecc-7cc2b82fe20d tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1313 microversion: 2.1 time: 0.212201 Oct 12 09:21:18.277009 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2791/6012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:18 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:19.306594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:19.307449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:19.315766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:19.316502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:19.316915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:19.317865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:19.318559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:19.319054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:19.459273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:19.468916 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c4e9fbc8-ffad-48d8-883e-c8d09522f404 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1313 microversion: 2.1 time: 0.166494 Oct 12 09:21:19.487054 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3222/6013] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:19 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:19.588553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f3b72f0d-4390-486d-b196-20e4e4685066 req-902cafcc-5f54-4c0a-b1f9-453a2393a6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd87c908-ee6b-4b8e-9b87-bde3b990398a", "name": "network-vif-plugged", "status": "completed", "tag": "a3d6a4b3-530c-45b7-91d1-ba32adbdbad7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:21:19.606322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f3b72f0d-4390-486d-b196-20e4e4685066 req-902cafcc-5f54-4c0a-b1f9-453a2393a6b6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:19.606809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f3b72f0d-4390-486d-b196-20e4e4685066 req-902cafcc-5f54-4c0a-b1f9-453a2393a6b6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:19.607628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f3b72f0d-4390-486d-b196-20e4e4685066 req-902cafcc-5f54-4c0a-b1f9-453a2393a6b6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:19.623681 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f3b72f0d-4390-486d-b196-20e4e4685066 req-902cafcc-5f54-4c0a-b1f9-453a2393a6b6 service nova] Creating event network-vif-plugged:a3d6a4b3-530c-45b7-91d1-ba32adbdbad7 for instance cd87c908-ee6b-4b8e-9b87-bde3b990398a on n-h1-858383-10 Oct 12 09:21:19.629931 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f3b72f0d-4390-486d-b196-20e4e4685066 req-902cafcc-5f54-4c0a-b1f9-453a2393a6b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045359 Oct 12 09:21:19.631265 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2792/6014] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:21:20.494268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:20.494931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:20.502466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:20.502844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:20.503279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:20.503990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:20.504442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:20.504864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:20.639788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:20.648994 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-afc7fa02-0f34-442f-b553-344c4a73f273 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1313 microversion: 2.1 time: 0.159121 Oct 12 09:21:20.650151 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3223/6015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:20 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:21.673133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:21.676181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:21.694363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:21.695201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:21.701877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:21.702361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:21.702796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:21.703493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:21.703941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:21.704365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:21.853586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:21.866499 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-90f717ac-d573-4a4f-a8dc-5ba21f28e95a tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1461 microversion: 2.1 time: 0.195059 Oct 12 09:21:21.866499 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2793/6016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:21 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1461 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:21.886795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a4a779-56de-48a4-8630-4e8a8aa3af7e", "device": "/dev/sdb"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:21:21.890061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:21.892144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:21.898902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:21.899555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:21.909559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:21.910400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:21.910879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:21.911327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:22.178571 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-797808b8-d7af-4b16-ba57-db6dd71deeb4 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "POST /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295528 Oct 12 09:21:22.185494 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3224/6017] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:21:21 2022] POST /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:21:27.596074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:21:27.598724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:27.605363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:27.606108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:27.606725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:27.607434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:27.607886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:27.608327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:27.661840 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c81cffb-f23e-4962-b05b-3a7fdb142baa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action" status: 200 len: 24570 microversion: 2.1 time: 0.069540 Oct 12 09:21:27.663652 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2794/6018] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:21:27 2022] POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action => generated 24570 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:21:38.735625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:38.737154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:38.741097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:38.742855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:38.752018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:38.752809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:38.754175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:38.755133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:38.755759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:38.756357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:38.931997 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1696e443-6bd2-4393-883b-a5466527b6ea tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1831 microversion: 2.1 time: 0.201021 Oct 12 09:21:38.937870 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3225/6019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:38 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1831 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:38.962045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:38.963337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:38.966897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=7 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:38.968176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=17 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:21:38.978193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:38.978993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:38.979663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:38.980798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:38.981686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:38.982322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:39.235487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:39.254100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac8aec6f-7bcb-47d2-9846-a905a5b30db4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1678 microversion: 2.1 time: 0.296952 Oct 12 09:21:39.255893 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2795/6020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:38 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1678 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:39.505716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:21:39.508633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:39.529071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:39.529071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:39.529071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:39.529071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:39.529461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:39.530226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:39.593643 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9da1b0e1-47c8-4d89-a428-deb3dd035b29 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action" status: 200 len: 32635 microversion: 2.1 time: 0.093079 Oct 12 09:21:39.599163 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3226/6021] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:21:39 2022] POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action => generated 32635 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:21:39.768493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:21:39.769105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:39.781232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:39.784471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:39.785022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:39.785897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:39.791332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:39.791854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:39.871103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '47f635822a4f43b2a447a8e94f11217e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f447fb7b310840219abf3b3d4ba6729a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:39.871830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] flavor_id is None. Assuming migration. {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 12 09:21:39.872370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:21:40.095253 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-21d63600-5984-4990-8864-2db14382ffc5 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action" status: 202 len: 0 microversion: 2.1 time: 0.324589 Oct 12 09:21:40.111989 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2796/6022] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:21:39 2022] POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:21:40.118508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:40.119260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:40.128488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:40.136901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:40.137598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:40.142000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:40.142538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:40.143400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:40.681287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:40.699935 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-633260fc-9761-4dfd-b7ab-68456f693e72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1687 microversion: 2.1 time: 0.586235 Oct 12 09:21:40.701031 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3227/6023] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:40 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1687 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:41.759976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:41.760622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:41.788163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:41.791381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:41.796240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:41.797193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:41.798929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:41.799533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:42.031010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:42.040506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83de74cf-352a-4e51-a185-5848eb196c31 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1687 microversion: 2.1 time: 0.315359 Oct 12 09:21:42.041975 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2797/6024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:41 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1687 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:43.068351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:43.068965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:43.084737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:43.086592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:43.087847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:43.096129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:43.098342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:43.100580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:43.450560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:43.462805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-40cd714f-6d8f-4bff-8864-8876b3258a04 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1687 microversion: 2.1 time: 0.397078 Oct 12 09:21:43.479215 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3228/6025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:43 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1687 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:44.497791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:44.501734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:44.512454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:44.514998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:44.515773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:44.516742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:44.517427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:44.518100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:44.984122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:44.994538 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dff4de38-2d32-41cb-a6b2-7661799c9ee7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1687 microversion: 2.1 time: 0.500915 Oct 12 09:21:44.995134 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2798/6026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:44 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1687 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:46.020146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:46.020760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:46.030504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:46.031206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:46.031643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:46.032474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:46.033023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:46.033502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:46.212324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:46.226237 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf8305e5-e17b-48a7-ab74-459ce2cafb96 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.209736 Oct 12 09:21:46.227842 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3229/6027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:46 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:47.252087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:47.252907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:47.259493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:47.259981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:47.260650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:47.261772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:47.262579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:47.263211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:47.462382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:47.471281 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7089cfc6-d82e-4df3-9c71-a0ab472981a5 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.223098 Oct 12 09:21:47.471981 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2799/6028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:47 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:48.496591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:48.497755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:48.510150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:48.510666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:48.511115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:48.511850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:48.512319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:48.512760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:48.803619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:48.815511 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ad5391b-90b6-4f0a-a9eb-67de856a280f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.322884 Oct 12 09:21:48.826313 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3230/6029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:48 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:49.840612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:49.842075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:49.849847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:49.850332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:49.850768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:49.851649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:49.852107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:49.852529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:49.996184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:50.004538 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-66d442c0-987b-4c9a-9aec-f8c22941b05d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.167936 Oct 12 09:21:50.005469 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2800/6030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:49 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:51.029865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:51.031210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:51.040783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:51.041621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:51.042283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:51.043256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:51.043932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:51.044686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:51.213177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:51.224043 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e5ca10fd-e3e3-438f-afec-99e5d97e546b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.199405 Oct 12 09:21:51.239125 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3231/6031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:51 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:52.250288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:52.251501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:52.259393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:52.260164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:52.260791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:52.261687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:52.262291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:52.262859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:52.419277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:52.427554 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc32d370-b49f-4cb9-a410-20d3e74bb01f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.181132 Oct 12 09:21:52.428130 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2801/6032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:52 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:53.450889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:53.451401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:53.458594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:53.459070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:53.459504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:53.460193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:53.460689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:53.461113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:53.605373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:53.615281 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f766489-26d7-4215-a6b9-9d87b310a85b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.168391 Oct 12 09:21:53.617487 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3232/6033] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:53 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:54.639653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:54.640514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:54.648428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:54.648923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:54.649367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:54.650117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:54.650774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:54.651211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:54.807318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:54.819767 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6cf4d5db-cee6-4989-a5a9-6ec4ba6ad4aa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.183150 Oct 12 09:21:54.820811 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2802/6034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:54 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:55.844188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:55.845099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:55.856055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:55.857243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:55.862655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:55.863588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:55.864217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:55.865462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:56.053656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:56.068443 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-17b08276-bb98-4ce7-85fc-44478429cb64 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.228577 Oct 12 09:21:56.069488 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3233/6035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:55 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:57.092272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:57.093959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:57.102202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:57.106086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:57.106688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:57.107562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:57.108049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:57.108444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:57.368552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:57.379682 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-152be3dd-26aa-41e9-a6a7-4f0be2da3ac1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.290985 Oct 12 09:21:57.380804 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2803/6036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:57 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:58.412566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:58.418003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:58.434888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:58.435380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:58.435823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:58.436516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:58.437325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:58.437801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:58.650557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:58.659739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d1a3d00e-7ba7-4193-a5de-6d5eeeecfb50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.258009 Oct 12 09:21:58.663893 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3234/6037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:58 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:21:59.696639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:21:59.698115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:21:59.713572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:59.715223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:59.718130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:59.719307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:21:59.719927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:21:59.723298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:21:59.892183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:21:59.902167 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-84c1cc46-b356-4593-b81c-45fafb99c809 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.210086 Oct 12 09:21:59.911839 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2804/6038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:21:59 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:00.927289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:00.928860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:00.937226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:00.937760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:00.938344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:00.939307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:00.940061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:00.940701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:01.116622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:01.126614 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6b06f12a-1591-4672-b170-62f06989be85 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.204087 Oct 12 09:22:01.127523 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3235/6039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:00 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:02.151346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:02.152666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:02.160824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:02.161642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:02.162277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:02.163245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:02.164311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:02.164897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:02.324667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:02.333072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32220d0b-f61f-414f-b103-d96e4516d21c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1692 microversion: 2.1 time: 0.185712 Oct 12 09:22:02.334318 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2805/6040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:02 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:03.356322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:03.356934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:03.364562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:03.365058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:03.365525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:03.366271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:03.366920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:03.367494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:03.443669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ea220c4d-883f-46cf-ba87-80e11159018d req-a002940f-3fe2-4089-9600-4ecdfcc139c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "name": "network-vif-unplugged", "status": "completed", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:03.462181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ea220c4d-883f-46cf-ba87-80e11159018d req-a002940f-3fe2-4089-9600-4ecdfcc139c4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:03.470685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ea220c4d-883f-46cf-ba87-80e11159018d req-a002940f-3fe2-4089-9600-4ecdfcc139c4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:03.471204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ea220c4d-883f-46cf-ba87-80e11159018d req-a002940f-3fe2-4089-9600-4ecdfcc139c4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:03.500392 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ea220c4d-883f-46cf-ba87-80e11159018d req-a002940f-3fe2-4089-9600-4ecdfcc139c4 service nova] Creating event network-vif-unplugged:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h1-858383-10 Oct 12 09:22:03.526679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-ea220c4d-883f-46cf-ba87-80e11159018d req-a002940f-3fe2-4089-9600-4ecdfcc139c4 service nova] Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:22:03.554393 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ea220c4d-883f-46cf-ba87-80e11159018d req-a002940f-3fe2-4089-9600-4ecdfcc139c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116266 Oct 12 09:22:03.555007 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2806/6041] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:22:03.574586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:03.583854 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c78e403b-b634-4e9b-b407-cbc57312e5d4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1691 microversion: 2.1 time: 0.231453 Oct 12 09:22:03.599551 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3236/6042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:03 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1691 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:04.611714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:04.614852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:04.626310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:04.641258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:04.642737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:04.643584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:04.644152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:04.644654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:04.926690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:04.936283 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-545c011d-7eea-4d3e-aaf2-040ec9fff378 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1691 microversion: 2.1 time: 0.331744 Oct 12 09:22:04.949996 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2807/6043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:04 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1691 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:05.628729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d2620de0-d7a7-4cb1-911e-9d4f4ef773df req-3035b719-75bc-416e-b0bb-f1321eb430a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:05.643978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2620de0-d7a7-4cb1-911e-9d4f4ef773df req-3035b719-75bc-416e-b0bb-f1321eb430a4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:05.644444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2620de0-d7a7-4cb1-911e-9d4f4ef773df req-3035b719-75bc-416e-b0bb-f1321eb430a4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:05.644857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d2620de0-d7a7-4cb1-911e-9d4f4ef773df req-3035b719-75bc-416e-b0bb-f1321eb430a4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:05.658452 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d2620de0-d7a7-4cb1-911e-9d4f4ef773df req-3035b719-75bc-416e-b0bb-f1321eb430a4 service nova] Creating event network-changed:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h1-858383-10 Oct 12 09:22:05.664996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-d2620de0-d7a7-4cb1-911e-9d4f4ef773df req-3035b719-75bc-416e-b0bb-f1321eb430a4 service nova] Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:22:05.678841 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d2620de0-d7a7-4cb1-911e-9d4f4ef773df req-3035b719-75bc-416e-b0bb-f1321eb430a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053899 Oct 12 09:22:05.679799 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3237/6044] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:05.960710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:05.961343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:05.978593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:05.979331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:05.981824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:05.983001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:05.983702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:05.984147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:06.307359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:06.332501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b49871af-4f8f-4cba-a722-7e73ce2cdc93 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1689 microversion: 2.1 time: 0.375470 Oct 12 09:22:06.339531 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2808/6045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:05 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1689 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:07.364853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:07.366160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:07.374040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:07.374531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:07.374967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:07.375683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:07.376140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:07.377022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:07.577831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:07.590115 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-542bfd2a-a89d-43e0-9d62-2eb58c87de09 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1686 microversion: 2.1 time: 0.229457 Oct 12 09:22:07.593388 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3238/6046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:07 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1686 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:07.616131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:07.617755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:07.628068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:07.633722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:07.634401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:07.639196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:07.639943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:07.640618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:07.759512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:08.162653 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb86d3fe-a6bc-41ef-aaec-88638e975bc8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action" status: 202 len: 0 microversion: 2.1 time: 0.550074 Oct 12 09:22:08.167515 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2809/6047] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:22:07 2022] POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:22:08.176101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:08.176739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:08.194054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:08.195245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:08.195771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:08.196722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:08.197494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:08.198210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:08.439570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:08.447987 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e176256-cb51-40e9-9963-d8bfb5495686 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1685 microversion: 2.1 time: 0.278495 Oct 12 09:22:08.451541 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3239/6048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:08 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1685 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:09.472290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:09.473046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:09.476123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=37 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:09.492697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:09.493198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:09.493674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:09.494384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:09.494837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:09.495261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:09.728673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:09.742072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-46f157db-6ae8-4760-8ca5-e13424f49cee tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1685 microversion: 2.1 time: 0.274056 Oct 12 09:22:09.743617 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2810/6049] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:09 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1685 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:10.039875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ab913bb5-aa4a-4f27-bb87-8ad769141ce3 req-ce744c96-1f7b-460a-823f-028f9011c129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "name": "network-vif-plugged", "status": "completed", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:10.049866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=31 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:10.052300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ab913bb5-aa4a-4f27-bb87-8ad769141ce3 req-ce744c96-1f7b-460a-823f-028f9011c129 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:10.052963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ab913bb5-aa4a-4f27-bb87-8ad769141ce3 req-ce744c96-1f7b-460a-823f-028f9011c129 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:10.053644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ab913bb5-aa4a-4f27-bb87-8ad769141ce3 req-ce744c96-1f7b-460a-823f-028f9011c129 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:10.061240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=87 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:10.071738 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ab913bb5-aa4a-4f27-bb87-8ad769141ce3 req-ce744c96-1f7b-460a-823f-028f9011c129 service nova] Creating event network-vif-plugged:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h1-858383-10 Oct 12 09:22:10.078592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-ab913bb5-aa4a-4f27-bb87-8ad769141ce3 req-ce744c96-1f7b-460a-823f-028f9011c129 service nova] Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:22:10.091623 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ab913bb5-aa4a-4f27-bb87-8ad769141ce3 req-ce744c96-1f7b-460a-823f-028f9011c129 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233947 Oct 12 09:22:10.096756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3240/6050] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:10.771032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:10.771884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:10.779760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:10.791693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:10.792397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:10.793186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:10.793681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:10.794119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:11.013490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:11.025113 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5d1d1140-ff5b-4a31-8949-b59f46930093 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1685 microversion: 2.1 time: 0.258264 Oct 12 09:22:11.026031 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2811/6051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:10 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1685 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:12.052609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:12.053911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:12.060968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:12.061486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:12.067722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:12.068669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:12.070153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:12.070761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:12.261767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:12.274550 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9fe37b91-9e34-498c-b712-39f255371109 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1685 microversion: 2.1 time: 0.227171 Oct 12 09:22:12.275175 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3241/6052] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:12 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1685 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:12.545428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d61049e4-eac5-4043-92b4-9a990bc98074 req-8ab508a2-9874-4359-9ec7-e72651b24d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "name": "network-vif-unplugged", "status": "completed", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:12.563741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d61049e4-eac5-4043-92b4-9a990bc98074 req-8ab508a2-9874-4359-9ec7-e72651b24d29 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:12.566492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d61049e4-eac5-4043-92b4-9a990bc98074 req-8ab508a2-9874-4359-9ec7-e72651b24d29 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:12.567886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d61049e4-eac5-4043-92b4-9a990bc98074 req-8ab508a2-9874-4359-9ec7-e72651b24d29 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:12.593716 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d61049e4-eac5-4043-92b4-9a990bc98074 req-8ab508a2-9874-4359-9ec7-e72651b24d29 service nova] Creating event network-vif-unplugged:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h2-858383-10 Oct 12 09:22:12.611983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-d61049e4-eac5-4043-92b4-9a990bc98074 req-8ab508a2-9874-4359-9ec7-e72651b24d29 service nova] Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:22:12.631378 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d61049e4-eac5-4043-92b4-9a990bc98074 req-8ab508a2-9874-4359-9ec7-e72651b24d29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089507 Oct 12 09:22:12.632427 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2812/6053] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:13.306786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:13.306786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:13.313831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:13.314341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:13.314903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:13.315820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:13.316155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:13.316587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:13.494281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:13.503185 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7fbefb8a-9826-4792-947d-13148542fcc0 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1685 microversion: 2.1 time: 0.204888 Oct 12 09:22:13.504418 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3242/6054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:13 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1685 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:14.529198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:14.530455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:14.537187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:14.537986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:14.538465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:14.539441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:14.540213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:14.540646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:14.659074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-49eca0a7-84ff-4228-8eb9-82a56b2b9e4b req-f3663b91-b9bf-4914-8a55-4a6e9068e6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:14.674927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-49eca0a7-84ff-4228-8eb9-82a56b2b9e4b req-f3663b91-b9bf-4914-8a55-4a6e9068e6f2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:14.681467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-49eca0a7-84ff-4228-8eb9-82a56b2b9e4b req-f3663b91-b9bf-4914-8a55-4a6e9068e6f2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:14.682076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-49eca0a7-84ff-4228-8eb9-82a56b2b9e4b req-f3663b91-b9bf-4914-8a55-4a6e9068e6f2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:14.706619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-49eca0a7-84ff-4228-8eb9-82a56b2b9e4b req-f3663b91-b9bf-4914-8a55-4a6e9068e6f2 service nova] Creating event network-changed:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h2-858383-10 Oct 12 09:22:14.719795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-49eca0a7-84ff-4228-8eb9-82a56b2b9e4b req-f3663b91-b9bf-4914-8a55-4a6e9068e6f2 service nova] Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:22:14.742754 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-49eca0a7-84ff-4228-8eb9-82a56b2b9e4b req-f3663b91-b9bf-4914-8a55-4a6e9068e6f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088053 Oct 12 09:22:14.747893 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3243/6055] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:22:14.919493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:14.937241 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-00f6ff91-abbf-4616-a8af-f7f81cc2aa33 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1685 microversion: 2.1 time: 0.408598 Oct 12 09:22:14.974005 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2813/6056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:14 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1685 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:15.984355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:15.985234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:15.996914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:15.999668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:16.000306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:16.002410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:16.003987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:16.004596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:16.260141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:16.271348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-518f58bd-50a9-430a-8b07-1b0b4f48723f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1678 microversion: 2.1 time: 0.292429 Oct 12 09:22:16.274577 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3244/6057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:15 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1678 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:20.061967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-134c68fb-15b0-42e3-9046-05e1ee5f7f52 req-10432f7b-ffca-4bae-9a75-5b1acb009f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "name": "network-vif-plugged", "status": "completed", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:20.089905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-134c68fb-15b0-42e3-9046-05e1ee5f7f52 req-10432f7b-ffca-4bae-9a75-5b1acb009f4c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:20.090400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-134c68fb-15b0-42e3-9046-05e1ee5f7f52 req-10432f7b-ffca-4bae-9a75-5b1acb009f4c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:20.090830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-134c68fb-15b0-42e3-9046-05e1ee5f7f52 req-10432f7b-ffca-4bae-9a75-5b1acb009f4c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:20.133174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-134c68fb-15b0-42e3-9046-05e1ee5f7f52 req-10432f7b-ffca-4bae-9a75-5b1acb009f4c service nova] Creating event network-vif-plugged:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h2-858383-10 Oct 12 09:22:20.138483 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-134c68fb-15b0-42e3-9046-05e1ee5f7f52 req-10432f7b-ffca-4bae-9a75-5b1acb009f4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080679 Oct 12 09:22:20.139092 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2814/6058] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:31.140539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=9 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:31.141745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=25 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:31.343927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-70466461-d0e2-4ab3-9ae2-77ba22e55670 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1388835636", "availability_zone": "foo_zone"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:31.348559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.aggregate [None req-70466461-d0e2-4ab3-9ae2-77ba22e55670 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Generated uuid e50f9352-db3a-437d-bc15-35610ea2a32d for aggregate {{(pid=127006) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 12 09:22:31.395997 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-70466461-d0e2-4ab3-9ae2-77ba22e55670 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.260815 Oct 12 09:22:31.396693 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3245/6059] 10.222.0.40 () {60 vars in 1164 bytes} [Wed Oct 12 09:22:31 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:31.406927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=9 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:31.407689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:31.412445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c893ef4b-a6c3-4330-afb3-bd5cdff8f648 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:31.449495 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c893ef4b-a6c3-4330-afb3-bd5cdff8f648 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.044714 Oct 12 09:22:31.450345 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2815/6060] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 09:22:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:31.462966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d243de6-2a4d-47f3-a406-71083c7e9e85 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:31.467213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d243de6-2a4d-47f3-a406-71083c7e9e85 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:31.467933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d243de6-2a4d-47f3-a406-71083c7e9e85 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:31.468577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d243de6-2a4d-47f3-a406-71083c7e9e85 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:31.469566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d243de6-2a4d-47f3-a406-71083c7e9e85 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:31.470214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d243de6-2a4d-47f3-a406-71083c7e9e85 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:31.470847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d243de6-2a4d-47f3-a406-71083c7e9e85 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:31.504327 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d243de6-2a4d-47f3-a406-71083c7e9e85 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.045437 Oct 12 09:22:31.509958 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3246/6061] 10.222.0.40 () {58 vars in 1176 bytes} [Wed Oct 12 09:22:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:31.517473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5134ae4-7ea2-46eb-8ffb-9d49faa1b9db tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:31.527199 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5134ae4-7ea2-46eb-8ffb-9d49faa1b9db tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014149 Oct 12 09:22:31.530002 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2816/6062] 10.222.0.40 () {58 vars in 1143 bytes} [Wed Oct 12 09:22:31 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:31.540865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-555e0bba-faf2-4be4-8bc3-752167f5b5d4 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858383-10"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:31.558999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-555e0bba-faf2-4be4-8bc3-752167f5b5d4 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:31.559504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-555e0bba-faf2-4be4-8bc3-752167f5b5d4 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:31.559944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-555e0bba-faf2-4be4-8bc3-752167f5b5d4 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:31.916618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-555e0bba-faf2-4be4-8bc3-752167f5b5d4 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.380651 Oct 12 09:22:31.924589 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3247/6063] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 09:22:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:31.930122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49847bf8-c741-4738-ad36-f1144cb79fa2 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:31.938535 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-49847bf8-c741-4738-ad36-f1144cb79fa2 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.012783 Oct 12 09:22:31.939468 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2817/6064] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:22:31 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:31.952395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4623bce6-39c3-467d-b85c-742233cead33 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1109424415", "availability_zone": "foo_zone"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:32.024638 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4623bce6-39c3-467d-b85c-742233cead33 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.076033 Oct 12 09:22:32.025228 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3248/6065] 10.222.0.40 () {60 vars in 1173 bytes} [Wed Oct 12 09:22:31 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:22:32.037145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef8abf4f-b67e-4695-a3be-21e1c567e1a5 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:32.067717 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef8abf4f-b67e-4695-a3be-21e1c567e1a5 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.034371 Oct 12 09:22:32.068753 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2818/6066] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 09:22:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:22:32.079902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd573f37-92d0-433c-a412-2eb28fd9aa8a tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:32.095707 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd573f37-92d0-433c-a412-2eb28fd9aa8a tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.019727 Oct 12 09:22:32.096438 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3249/6067] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:22:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:22:32.108836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-21ffd15c-bd96-48eb-b185-84e824cf9511 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858383-10"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:32.123796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21ffd15c-bd96-48eb-b185-84e824cf9511 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:32.124351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21ffd15c-bd96-48eb-b185-84e824cf9511 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:32.124788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21ffd15c-bd96-48eb-b185-84e824cf9511 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:32.298459 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-21ffd15c-bd96-48eb-b185-84e824cf9511 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.193411 Oct 12 09:22:32.299466 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2819/6068] 10.222.0.40 () {60 vars in 1194 bytes} [Wed Oct 12 09:22:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:22:32.312017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad03a8cf-0410-4178-ad69-5b56ffd3d910 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:32.345093 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad03a8cf-0410-4178-ad69-5b56ffd3d910 tempest-TestAggregatesBasicOps-1951107788 tempest-TestAggregatesBasicOps-1951107788-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.037438 Oct 12 09:22:32.345966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3250/6069] 10.222.0.40 () {58 vars in 1155 bytes} [Wed Oct 12 09:22:32 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 12 09:22:42.581981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:42.583138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:42.587920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:42.590657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:42.606077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:42.606621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:42.607012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:42.607993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:42.608678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:42.609087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:42.673830 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e35fcab0-fe5d-4080-9510-b61dd5bb3ed2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action" status: 200 len: 63190 microversion: 2.1 time: 0.093286 Oct 12 09:22:42.674815 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2820/6070] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:22:42 2022] POST /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55/action => generated 63190 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:22:44.653938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:44.655475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:44.656443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:22:44.666417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:44.667121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:44.674370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:44.675273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:44.675722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:44.676599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:44.677283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:44.677750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:44.795568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lazy-loading 'services' on Instance uuid cd87c908-ee6b-4b8e-9b87-bde3b990398a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:22:44.900065 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b812f9d-b1a7-4fa6-8819-2488b67195f0 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a/os-volume_attachments/37a4a779-56de-48a4-8630-4e8a8aa3af7e" status: 202 len: 0 microversion: 2.1 time: 0.247708 Oct 12 09:22:44.904965 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3251/6071] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:22:44 2022] DELETE /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a/os-volume_attachments/37a4a779-56de-48a4-8630-4e8a8aa3af7e => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:22:49.110555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:49.111280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:49.128419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:49.130486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:49.130953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:49.131688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:49.132148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:49.132578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:49.412492 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15c02fd6-eb87-440d-a4a8-384d4833c68d tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1831 microversion: 2.1 time: 0.307138 Oct 12 09:22:49.434353 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2821/6072] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:49 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1831 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:50.753412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:50.754047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:50.772146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c23a6048-6a7b-4184-bd5a-c6b8ee50c78c req-49bee22a-6d37-4e19-9139-48cf3fa020a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:50.800715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:50.802046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c23a6048-6a7b-4184-bd5a-c6b8ee50c78c req-49bee22a-6d37-4e19-9139-48cf3fa020a3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:50.802185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:50.802827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c23a6048-6a7b-4184-bd5a-c6b8ee50c78c req-49bee22a-6d37-4e19-9139-48cf3fa020a3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:50.803379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:50.804431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c23a6048-6a7b-4184-bd5a-c6b8ee50c78c req-49bee22a-6d37-4e19-9139-48cf3fa020a3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:50.806077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:50.807339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:50.809545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:50.838010 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c23a6048-6a7b-4184-bd5a-c6b8ee50c78c req-49bee22a-6d37-4e19-9139-48cf3fa020a3 service nova] Creating event network-changed:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h2-858383-10 Oct 12 09:22:50.844137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c23a6048-6a7b-4184-bd5a-c6b8ee50c78c req-49bee22a-6d37-4e19-9139-48cf3fa020a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085080 Oct 12 09:22:50.851679 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2822/6073] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:22:50.915254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:22:51.145340 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86f42b88-951a-4294-8983-0cff6e7fc784 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 204 len: 0 microversion: 2.1 time: 0.397785 Oct 12 09:22:51.146844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3252/6074] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:22:50 2022] DELETE /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:22:51.155440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:51.156620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:51.169554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:51.170508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:51.171191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:51.177355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:51.178345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:51.179043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:51.462594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:51.477707 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a96740a-f906-47df-b489-3fd00ae4cbb1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1684 microversion: 2.1 time: 0.326463 Oct 12 09:22:51.495196 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2823/6075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:51 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1684 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:52.502432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:52.503844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:52.518120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:52.521026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:52.521684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:52.523532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:52.526758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:52.527397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:52.783824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:52.783824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:52.804757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:52.805261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:52.805731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:52.806454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:52.811811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:52.812247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:52.883785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:22:53.003843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:53.013589 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa89c01d-ef52-4439-9b80-6c919fba4758 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1684 microversion: 2.1 time: 0.515573 Oct 12 09:22:53.014241 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3253/6076] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:52 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1684 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:53.102635 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dc651aed-a94c-41f7-8a26-a95885b1195c tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 204 len: 0 microversion: 2.1 time: 0.326011 Oct 12 09:22:53.103373 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2824/6077] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:22:52 2022] DELETE /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:22:53.112407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:53.114101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:53.131501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:53.139226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:53.139705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:53.140468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:53.140942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:53.141365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:53.545121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:53.559447 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb2d5d97-cdcc-40fd-8b94-67d5379c54cc tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1467 microversion: 2.1 time: 0.446547 Oct 12 09:22:53.560847 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3254/6078] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:53 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1467 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:53.968860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-97ed89ef-93cc-4495-b876-e2c7003801d3 req-62fbf4ba-23d0-4f4a-bbf9-91c048d206cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e408f5-e16b-4657-96cf-7d471a1a6f55", "name": "network-vif-deleted", "tag": "1431a2cd-2854-4340-b569-00bbc49f5106"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:53.994110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97ed89ef-93cc-4495-b876-e2c7003801d3 req-62fbf4ba-23d0-4f4a-bbf9-91c048d206cd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:53.995351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97ed89ef-93cc-4495-b876-e2c7003801d3 req-62fbf4ba-23d0-4f4a-bbf9-91c048d206cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:53.996030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97ed89ef-93cc-4495-b876-e2c7003801d3 req-62fbf4ba-23d0-4f4a-bbf9-91c048d206cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:54.040463 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-97ed89ef-93cc-4495-b876-e2c7003801d3 req-62fbf4ba-23d0-4f4a-bbf9-91c048d206cd service nova] Creating event network-vif-deleted:1431a2cd-2854-4340-b569-00bbc49f5106 for instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 on n-h2-858383-10 Oct 12 09:22:54.043464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:54.044488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:54.051575 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-97ed89ef-93cc-4495-b876-e2c7003801d3 req-62fbf4ba-23d0-4f4a-bbf9-91c048d206cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086671 Oct 12 09:22:54.052307 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2825/6079] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:22:54.062383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:54.068531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:54.069182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:54.070029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:54.073431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:54.073918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:54.184156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:54.193771 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-417348a4-d746-4181-b994-916c7b45c9c2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 200 len: 1349 microversion: 2.1 time: 0.158834 Oct 12 09:22:54.195154 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3255/6080] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:54 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 1349 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:54.588090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:54.588794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:54.604120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:54.605062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:54.605853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:54.606885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:54.607644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:54.609058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:54.876741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:54.885863 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ce1a60d6-aa73-464a-9d0e-aab7053eda7f tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1467 microversion: 2.1 time: 0.302069 Oct 12 09:22:54.886464 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2826/6081] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:54 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1467 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:55.221981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:55.222597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b1e408f5-e16b-4657-96cf-7d471a1a6f55] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:55.235374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:55.236150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:55.237801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:55.242478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:55.243876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:55.244694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:55.287124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] HTTP exception thrown: Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 could not be found. Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Request method failure captured: Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 HTTP/1.1 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRoZHs9OCmMfgFTAW5s5TKsdNvhEgMjtY2IwEwqgbpTOZaYH47TuzA4aLKKIZjP7v1vTyD0z-vVJEQsWgm9Dai8u6XRn9LQsC_awu6eyynstyGA6XoG_eGwhigzCdK3govzbDJ2aaZBWwd1KZ8BMC0BzDT7FAVnW5PaHuxvLUJmgAZ4I Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 1c149b7c2f3345fb90935d70bbbb66c3 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c149b7c2f3345fb90935d70bbbb66c3"}]}] Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 1c149b7c2f3345fb90935d70bbbb66c3 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestNetworkAdvancedServerOps-1590050818-project Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 98e7287fdde34fe198d4f43acd3da903 Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1590050818-project Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 could not be found. Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'b1e408f5-e16b-4657-96cf-7d471a1a6f55'} Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 could not be found. Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 could not be found. Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:55.292965 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:22:55.297620 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:55.297620 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:22:55.297620 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:22:55.297620 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:22:55.297620 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:22:55.297620 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:22:55.297620 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 could not be found. Oct 12 09:22:55.297620 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:55.300679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Returning 404 to user: Instance b1e408f5-e16b-4657-96cf-7d471a1a6f55 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:22:55.307671 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe47dcac-67af-495a-b3ec-4c52fc9c4734 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55" status: 404 len: 111 microversion: 2.1 time: 0.088769 Oct 12 09:22:55.314698 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3256/6082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:55 2022] GET /compute/v2.1/servers/b1e408f5-e16b-4657-96cf-7d471a1a6f55 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:22:55.910714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:55.911267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:55.933969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:55.934698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:55.935167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:55.935935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:55.936385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:55.937419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:56.008117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a101d5e3-1077-4f83-9e0f-3d433751d4ad req-451a7ed3-0708-4c2f-a11c-2a08ecdc97b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd87c908-ee6b-4b8e-9b87-bde3b990398a", "name": "network-vif-deleted", "tag": "a3d6a4b3-530c-45b7-91d1-ba32adbdbad7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:22:56.025386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a101d5e3-1077-4f83-9e0f-3d433751d4ad req-451a7ed3-0708-4c2f-a11c-2a08ecdc97b2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:56.025910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a101d5e3-1077-4f83-9e0f-3d433751d4ad req-451a7ed3-0708-4c2f-a11c-2a08ecdc97b2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:56.026357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a101d5e3-1077-4f83-9e0f-3d433751d4ad req-451a7ed3-0708-4c2f-a11c-2a08ecdc97b2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:56.059436 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a101d5e3-1077-4f83-9e0f-3d433751d4ad req-451a7ed3-0708-4c2f-a11c-2a08ecdc97b2 service nova] Creating event network-vif-deleted:a3d6a4b3-530c-45b7-91d1-ba32adbdbad7 for instance cd87c908-ee6b-4b8e-9b87-bde3b990398a on n-h1-858383-10 Oct 12 09:22:56.060309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39bfe83bf43c4a5170f714b495f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9513e199238745eba1180da30d732db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:22:56.079898 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a101d5e3-1077-4f83-9e0f-3d433751d4ad req-451a7ed3-0708-4c2f-a11c-2a08ecdc97b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075428 Oct 12 09:22:56.083208 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3257/6083] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:22:56.100522 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-402a09de-a887-4067-827b-28637c342a11 tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 200 len: 1425 microversion: 2.1 time: 0.194631 Oct 12 09:22:56.105073 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2827/6084] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:55 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 1425 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:22:57.128954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:22:57.130557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] [instance: cd87c908-ee6b-4b8e-9b87-bde3b990398a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:22:57.137320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:57.138118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:57.138964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:57.139898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:22:57.140546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:22:57.141167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:22:57.157856 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] HTTP exception thrown: Instance cd87c908-ee6b-4b8e-9b87-bde3b990398a could not be found. Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Request method failure captured: Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a HTTP/1.1 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRocEvVrL3lWtER98FDqT6ADlzGpKPtXCHDyEmuNjIH-m311G5fMlJSahBaxVRwpUkGL2vNjz6kkXJLZjMi527i3teKgB8b0VarJrSZWTXQoKAIT8_gSB2Vr-t7oVoZH69iL4X50Al1Sr24PmgXzpSGxQK0pFd4DoRmvHqmSDGgCrU_0 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 9513e199238745eba1180da30d732db1 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesBackupsTest-579616291 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9513e199238745eba1180da30d732db1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9513e199238745eba1180da30d732db1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9513e199238745eba1180da30d732db1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9513e199238745eba1180da30d732db1"}]}] Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesBackupsTest-579616291 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 9513e199238745eba1180da30d732db1 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesBackupsTest-579616291 Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesBackupsTest-579616291-project Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: ccc39bfe83bf43c4a5170f714b495f5f Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesBackupsTest-579616291-project Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance cd87c908-ee6b-4b8e-9b87-bde3b990398a could not be found. Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'cd87c908-ee6b-4b8e-9b87-bde3b990398a'} Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd87c908-ee6b-4b8e-9b87-bde3b990398a could not be found. Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd87c908-ee6b-4b8e-9b87-bde3b990398a could not be found. Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:22:57.161596 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:57.167264 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:22:57.167264 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:22:57.167264 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:22:57.167264 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:22:57.167264 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:22:57.167264 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd87c908-ee6b-4b8e-9b87-bde3b990398a could not be found. Oct 12 09:22:57.167264 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:22:57.170304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] Returning 404 to user: Instance cd87c908-ee6b-4b8e-9b87-bde3b990398a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:22:57.171433 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7de34c36-bcc1-461c-a76b-21b705c2869b tempest-VolumesBackupsTest-579616291 tempest-VolumesBackupsTest-579616291-project] 10.222.0.40 "GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a" status: 404 len: 111 microversion: 2.1 time: 0.048927 Oct 12 09:22:57.175729 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3258/6085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:22:57 2022] GET /compute/v2.1/servers/cd87c908-ee6b-4b8e-9b87-bde3b990398a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:23:00.620942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4e3a0a9e-e909-4277-bd5d-e58d16bca90b tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:00.622953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e3a0a9e-e909-4277-bd5d-e58d16bca90b tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:00.625657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e3a0a9e-e909-4277-bd5d-e58d16bca90b tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:00.626859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e3a0a9e-e909-4277-bd5d-e58d16bca90b tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:00.630006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e3a0a9e-e909-4277-bd5d-e58d16bca90b tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:00.630952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e3a0a9e-e909-4277-bd5d-e58d16bca90b tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:00.635449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e3a0a9e-e909-4277-bd5d-e58d16bca90b tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:00.704906 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4e3a0a9e-e909-4277-bd5d-e58d16bca90b tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.373827 Oct 12 09:23:00.706655 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2828/6086] 10.222.0.40 () {58 vars in 1185 bytes} [Wed Oct 12 09:23:00 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:00.920695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1516095810", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "availability_zone": "nova:n-h1-858383-10", "networks": [{"uuid": "ad70f64f-971c-401f-81b5-e993d99dc041"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:01.075788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] validate_networks() for [('ad70f64f-971c-401f-81b5-e993d99dc041', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:23:02.960427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:23:02.961531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:23:02.962171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:23:02.962771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:23:02.963696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:23:03.011437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:03.012319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:03.012442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:03.018528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:03.019039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:03.019491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:03.074220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Getting quotas for project cfa4f3b96676444a85f520e1ee6f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:23:03.092651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Getting quotas for user ac8733ed059740a2808d7ff4fd5e6bc4 and project cfa4f3b96676444a85f520e1ee6f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:23:03.152666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:23:03.156818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:23:03.279931 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-189db73f-381d-4cee-9fcf-72ca2c2fae3f tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375493 Oct 12 09:23:03.287534 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3259/6087] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:23:03.291925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1dffadd-779d-48e8-b369-5510a4bad680 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:03.292550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1dffadd-779d-48e8-b369-5510a4bad680 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:03.413181 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1dffadd-779d-48e8-b369-5510a4bad680 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1329 microversion: 2.1 time: 0.124770 Oct 12 09:23:03.416238 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2829/6088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:03 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1329 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:03.572803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12427704-e1e7-4ea4-9d4a-d330992695da tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '.version_select at 0x7f9843508790>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:03.611029 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12427704-e1e7-4ea4-9d4a-d330992695da tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-508313617" status: 202 len: 0 microversion: 2.1 time: 0.042134 Oct 12 09:23:03.613970 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3260/6089] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 12 09:23:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-508313617 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:23:03.649667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1fe56921-3f86-44d8-96c8-fbe51928dd4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'create', calling method: .version_select at 0x7f9843615790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-526017776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmkZ8XpQNt1KeENzTYFd+jwA1JP3csxYOtDzZigEbdnTpboFTFeOljSJUt792qWQ/ZLQiquPb+ryNdpoJeX875qjgAagI9I+GFnZHfj8J46yxHgNeFHWutRcM+LNJ7ZPA=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:03.732143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1fe56921-3f86-44d8-96c8-fbe51928dd4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:23:03.741151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1fe56921-3f86-44d8-96c8-fbe51928dd4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for user 98e7287fdde34fe198d4f43acd3da903 and project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:23:03.805524 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1fe56921-3f86-44d8-96c8-fbe51928dd4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.160090 Oct 12 09:23:03.806064 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2830/6090] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:23:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:04.453902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:04.455299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:04.485041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:04.491713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:04.492386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:04.493347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:04.498268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:04.501582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:04.668404 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc660d45-2d52-448b-a814-666197ba5fa3 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1346 microversion: 2.1 time: 0.228694 Oct 12 09:23:04.671875 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3261/6091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:04 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:04.806630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1346383628", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "757ab4d8-4c55-4b2e-b526-e367fce1e868"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:04.998501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] validate_networks() for [('757ab4d8-4c55-4b2e-b526-e367fce1e868', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:23:05.692981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:05.693637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:05.709592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:05.710527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:05.711141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:05.712508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:05.713130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:05.716766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:05.954815 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-793f7519-63eb-47e0-9b27-1323fd91a9b1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1426 microversion: 2.1 time: 0.266195 Oct 12 09:23:05.974308 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3262/6092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:05 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1426 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:06.235444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:23:06.237123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:23:06.238237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:23:06.239409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:23:06.240234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:23:06.252328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:06.253225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:06.254849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:06.256414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:06.260131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:06.261401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:06.289198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Getting quotas for project acd07246242946faa59f545c56224da3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:23:06.296888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Getting quotas for user 506e0f8369d84d4abe82bc00f9928e0f and project acd07246242946faa59f545c56224da3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:23:06.321846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:23:06.326309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:23:06.399238 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe356538-8547-4a95-b464-798efef1e53c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596400 Oct 12 09:23:06.400819 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2831/6093] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:23:06.412063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-baa7ade3-92ff-415c-9bb4-161855f24fc6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:06.412678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-baa7ade3-92ff-415c-9bb4-161855f24fc6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:06.486307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-baa7ade3-92ff-415c-9bb4-161855f24fc6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:06.498282 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-baa7ade3-92ff-415c-9bb4-161855f24fc6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1219 microversion: 2.1 time: 0.089085 Oct 12 09:23:06.498865 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3263/6094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:06 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:06.985957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:06.986705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:07.006232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:07.008055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:07.011171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:07.011866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:07.012560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:07.013699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:07.122941 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bff05476-bfe6-404c-a6a1-dd3f3b94e526 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1424 microversion: 2.1 time: 0.141097 Oct 12 09:23:07.125094 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2832/6095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:06 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:07.521368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:07.522924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:07.535489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:07.536400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:07.548128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:07.549173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:07.549704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:07.553501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:07.690642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:07.702795 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-343353db-c474-466a-a8fe-4883fa8370a8 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1271 microversion: 2.1 time: 0.185505 Oct 12 09:23:07.715048 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3264/6096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:07 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:08.158285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:08.161620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:08.175749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:08.180674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:08.181275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:08.182544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:08.185499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:08.186309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:08.579945 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f1783e6-00ad-4614-95e1-88f436a9b151 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1466 microversion: 2.1 time: 0.435253 Oct 12 09:23:08.581456 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2833/6097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:08 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1466 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:08.727879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:08.730576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:08.740318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:08.740812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:08.741250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:08.741982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:08.742431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:08.742859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:08.828537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:08.847070 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc7ab4ca-83b6-4cf7-8abd-e8fbf791f080 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1277 microversion: 2.1 time: 0.123435 Oct 12 09:23:08.848596 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3265/6098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:08 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:08.977067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-be350278-4556-4382-ba40-1a16f58389a2 req-e0ece8ca-1c6d-4067-8ed6-bb077891dc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4fd8b5-543c-4b8f-bdaf-73a102201a4c", "tag": "40227495-53de-41f3-a298-40b94235fcb7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:08.990291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-be350278-4556-4382-ba40-1a16f58389a2 req-e0ece8ca-1c6d-4067-8ed6-bb077891dc0b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:08.991116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-be350278-4556-4382-ba40-1a16f58389a2 req-e0ece8ca-1c6d-4067-8ed6-bb077891dc0b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:08.991704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-be350278-4556-4382-ba40-1a16f58389a2 req-e0ece8ca-1c6d-4067-8ed6-bb077891dc0b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:09.010291 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-be350278-4556-4382-ba40-1a16f58389a2 req-e0ece8ca-1c6d-4067-8ed6-bb077891dc0b service nova] Creating event network-changed:40227495-53de-41f3-a298-40b94235fcb7 for instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c on n-h1-858383-10 Oct 12 09:23:09.020639 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-be350278-4556-4382-ba40-1a16f58389a2 req-e0ece8ca-1c6d-4067-8ed6-bb077891dc0b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050258 Oct 12 09:23:09.021837 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2834/6099] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:23:09.604437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:09.605482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:09.615961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:09.616723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:09.617340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:09.618401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:09.619024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:09.619615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:09.899481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:09.909403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:09.920251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-028c0c11-454a-45db-8e69-63f99fd0c760 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1466 microversion: 2.1 time: 0.320575 Oct 12 09:23:09.943170 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3266/6100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:09 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1466 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:09.945661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:09.946382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:09.947267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:09.948430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:09.949069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:09.949935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:10.174873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:10.185502 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7a70dbc-b99b-4d58-9f33-3fe15315b917 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1319 microversion: 2.1 time: 0.309762 Oct 12 09:23:10.186125 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2835/6101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:09 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:10.948664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:10.950196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:10.964698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:10.965711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:10.966360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:10.967323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:10.970590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:10.971593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:11.064332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-cac85b71-e11e-46fe-aa30-7fb3fec1a84f req-16769fb7-8468-46a9-af04-94f263bea1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d6469a-6180-41fd-9716-2e8c5819829e", "tag": "ebff6692-66c7-4ea1-872d-48ba519be6c2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:11.085130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cac85b71-e11e-46fe-aa30-7fb3fec1a84f req-16769fb7-8468-46a9-af04-94f263bea1f0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:11.085780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cac85b71-e11e-46fe-aa30-7fb3fec1a84f req-16769fb7-8468-46a9-af04-94f263bea1f0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:11.086217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cac85b71-e11e-46fe-aa30-7fb3fec1a84f req-16769fb7-8468-46a9-af04-94f263bea1f0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:11.110421 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-cac85b71-e11e-46fe-aa30-7fb3fec1a84f req-16769fb7-8468-46a9-af04-94f263bea1f0 service nova] Creating event network-changed:ebff6692-66c7-4ea1-872d-48ba519be6c2 for instance f1d6469a-6180-41fd-9716-2e8c5819829e on n-h2-858383-10 Oct 12 09:23:11.126303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-cac85b71-e11e-46fe-aa30-7fb3fec1a84f req-16769fb7-8468-46a9-af04-94f263bea1f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065464 Oct 12 09:23:11.127969 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2836/6102] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:11.209476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:11.210280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:11.227689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:11.229082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:11.234035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:11.235170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:11.238394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:11.242218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:11.390357 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d32343df-ec08-4bba-84aa-20cc47f3a5ea tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1466 microversion: 2.1 time: 0.441272 Oct 12 09:23:11.394359 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3267/6103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:10 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1466 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:11.672979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:11.681927 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ce1452f3-35fd-4a07-8123-d58c7affb200 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1319 microversion: 2.1 time: 0.476889 Oct 12 09:23:11.687293 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2837/6104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:11 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:12.420086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:12.421033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:12.450706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:12.451254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:12.451693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:12.452532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:12.452918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:12.453356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:12.726835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:12.728172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:12.740826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:12.748774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:12.749710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:12.752945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:12.754092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:12.755511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:12.756876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:12.770346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:12.819076 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-63dfff28-8c3c-4ee1-93e6-af63bbf77375 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1466 microversion: 2.1 time: 0.402438 Oct 12 09:23:12.824733 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3268/6105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:12 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1466 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:13.207701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:13.229759 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b56f21fd-78ce-4e7b-b860-7bfd9c2cb3d4 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1319 microversion: 2.1 time: 0.508325 Oct 12 09:23:13.230966 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2838/6106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:12 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:13.853023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:13.853641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:13.867963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:13.876207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:13.884727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:13.887171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:13.888618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:13.890710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:13.892088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:14.128643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:14.136914 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3675d60e-a9ba-45f5-b366-c58c239575d5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1466 microversion: 2.1 time: 0.287204 Oct 12 09:23:14.153899 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3269/6107] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:13 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1466 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:14.256311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:14.257137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:14.276741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:14.277412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:14.277891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:14.278629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:14.279097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:14.280045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:14.337330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1080092343", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "a48520c6-354c-4745-a75b-4f9a62b47541"}], "key_name": "tempest-TestNetworkAdvancedServerOps-526017776", "security_groups": [{"name": "tempest-secgroup-smoke-721838477"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:14.488395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] validate_networks() for [('a48520c6-354c-4745-a75b-4f9a62b47541', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:23:14.506063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:14.517312 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3dea5d68-bad7-4360-9e0b-70a663507ba9 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1319 microversion: 2.1 time: 0.265585 Oct 12 09:23:14.518958 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2839/6108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:14 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:14.769540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-25b7f9d6-376d-45d8-8f1c-bd27df6e32f7 req-5ff95982-26ac-4bbf-8c82-5f3904ae0547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4fd8b5-543c-4b8f-bdaf-73a102201a4c", "name": "network-vif-plugged", "status": "completed", "tag": "40227495-53de-41f3-a298-40b94235fcb7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:14.787018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-25b7f9d6-376d-45d8-8f1c-bd27df6e32f7 req-5ff95982-26ac-4bbf-8c82-5f3904ae0547 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:14.788940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-25b7f9d6-376d-45d8-8f1c-bd27df6e32f7 req-5ff95982-26ac-4bbf-8c82-5f3904ae0547 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:14.793063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-25b7f9d6-376d-45d8-8f1c-bd27df6e32f7 req-5ff95982-26ac-4bbf-8c82-5f3904ae0547 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:14.812910 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-25b7f9d6-376d-45d8-8f1c-bd27df6e32f7 req-5ff95982-26ac-4bbf-8c82-5f3904ae0547 service nova] Creating event network-vif-plugged:40227495-53de-41f3-a298-40b94235fcb7 for instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c on n-h1-858383-10 Oct 12 09:23:14.823036 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-25b7f9d6-376d-45d8-8f1c-bd27df6e32f7 req-5ff95982-26ac-4bbf-8c82-5f3904ae0547 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058555 Oct 12 09:23:14.824677 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2840/6109] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:23:14.936336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:23:14.936986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:23:14.938024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:23:14.938722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:23:14.939421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:23:14.942247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:14.952038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:14.952599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:14.953249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:14.954063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:14.954943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:14.955579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:14.980714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:23:14.987639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for user 98e7287fdde34fe198d4f43acd3da903 and project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:23:15.003292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:23:15.006255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:23:15.077941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0cf47076-9b67-401a-9c21-4451f68e9b56 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.744642 Oct 12 09:23:15.085276 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3270/6110] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:23:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:23:15.092068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ec3ac62f-2c80-431e-b7ff-31ed9f40a8ff tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:15.092860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ec3ac62f-2c80-431e-b7ff-31ed9f40a8ff tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:15.151676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ec3ac62f-2c80-431e-b7ff-31ed9f40a8ff tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:15.161264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:15.162265 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ec3ac62f-2c80-431e-b7ff-31ed9f40a8ff tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1266 microversion: 2.1 time: 0.074800 Oct 12 09:23:15.163050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:15.169601 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2841/6111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:15 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:15.171031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:15.171897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:15.172559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:15.173519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:15.174309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:15.174977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:15.545247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:15.545917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:15.564789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:15.565722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:15.566213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:15.567287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:15.567811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:15.568254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:15.702967 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-592c622a-370d-4979-aae7-e775216170b4 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1466 microversion: 2.1 time: 0.545454 Oct 12 09:23:15.705692 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3271/6112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:15 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1466 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:15.807754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:15.818049 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-084aaacb-7213-48dc-b665-859b24e8ef4f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1319 microversion: 2.1 time: 0.278817 Oct 12 09:23:15.819341 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2842/6113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:15 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:16.191468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:16.193256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:16.202715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:16.203224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:16.204026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:16.204818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:16.205484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:16.206078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:16.284902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:16.303562 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f53def24-d3c0-4af1-ae4e-6419434326ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1318 microversion: 2.1 time: 0.116803 Oct 12 09:23:16.304720 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3272/6114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:16 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1318 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:16.729091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:16.730580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:16.739485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:16.743403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:16.744501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:16.745185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:16.746804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:16.747530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:16.748066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:16.850301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:16.851069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:16.867831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:16.868648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:16.869175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:16.870017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:16.870562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:16.871445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:17.030692 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d626ad35-e688-43b9-90cb-5e66c23c245e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1650 microversion: 2.1 time: 0.304195 Oct 12 09:23:17.032341 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2843/6115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:16 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1650 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:17.039676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-469826d1-afaf-4f00-9637-e28be5720ecc req-269b8055-95b9-48d8-ade5-cd20bd6ed5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d6469a-6180-41fd-9716-2e8c5819829e", "name": "network-vif-plugged", "status": "completed", "tag": "ebff6692-66c7-4ea1-872d-48ba519be6c2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:17.090523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-469826d1-afaf-4f00-9637-e28be5720ecc req-269b8055-95b9-48d8-ade5-cd20bd6ed5e7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:17.092082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-469826d1-afaf-4f00-9637-e28be5720ecc req-269b8055-95b9-48d8-ade5-cd20bd6ed5e7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:17.092959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-469826d1-afaf-4f00-9637-e28be5720ecc req-269b8055-95b9-48d8-ade5-cd20bd6ed5e7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:17.094357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:17.106456 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-158dbeab-2aea-4a64-a0d2-e92651b231c5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1319 microversion: 2.1 time: 0.269778 Oct 12 09:23:17.107897 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3273/6116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:16 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:17.116209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:17.117280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:17.122848 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-469826d1-afaf-4f00-9637-e28be5720ecc req-269b8055-95b9-48d8-ade5-cd20bd6ed5e7 service nova] Creating event network-vif-plugged:ebff6692-66c7-4ea1-872d-48ba519be6c2 for instance f1d6469a-6180-41fd-9716-2e8c5819829e on n-h2-858383-10 Oct 12 09:23:17.124941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:17.125854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:17.128133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:17.128718 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-469826d1-afaf-4f00-9637-e28be5720ecc req-269b8055-95b9-48d8-ade5-cd20bd6ed5e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095058 Oct 12 09:23:17.129628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:17.130234 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2844/6117] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:17.133612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:17.136103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:17.331811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:17.334239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:17.344098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:17.344954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:17.345685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:17.346667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:17.347345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:17.348141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:17.352254 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8dcad941-be1a-4716-9f6b-d01d98ae0048 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1650 microversion: 2.1 time: 0.241389 Oct 12 09:23:17.352848 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3274/6118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:17 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1650 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:17.376938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:17.378069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:17.384659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:17.385735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:17.386342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:17.387221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:17.387834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:17.388712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:17.541921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:17.570841 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4136396-4fab-4782-9733-9ef7e529d55c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1324 microversion: 2.1 time: 0.230801 Oct 12 09:23:17.573102 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2845/6119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:17 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:17.622467 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8c0f6330-fa46-422c-8d96-93252b4063de tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1650 microversion: 2.1 time: 0.247568 Oct 12 09:23:17.623009 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3275/6120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:17 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1650 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:17.724615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1353462897", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "availability_zone": "nova:n-h2-858383-10", "networks": [{"uuid": "ad70f64f-971c-401f-81b5-e993d99dc041"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:17.835067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] validate_networks() for [('ad70f64f-971c-401f-81b5-e993d99dc041', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:23:18.131895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:18.132535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:18.139098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:18.139602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:18.140067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:18.146173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:18.146683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:18.147134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:18.331550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:18.344468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e842775d-66c0-426e-aec9-f84fc771db32 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1319 microversion: 2.1 time: 0.216702 Oct 12 09:23:18.345077 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3276/6121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:18 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:18.597579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:18.599076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:18.605932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:18.606706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:18.607682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:18.608723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:18.609347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:18.609969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:18.663599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:23:18.664300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:23:18.664960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:23:18.665553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:23:18.666131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:23:18.688440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:18.688931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:18.689361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:18.690295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:18.690925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:18.691656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:18.730490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Getting quotas for project cfa4f3b96676444a85f520e1ee6f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:23:18.736841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Getting quotas for user ac8733ed059740a2808d7ff4fd5e6bc4 and project cfa4f3b96676444a85f520e1ee6f5e5e. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:23:18.762728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:23:18.766942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:23:18.808504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:18.819226 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e2a4eca3-36f8-44aa-8388-1a50b8189a03 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1391 microversion: 2.1 time: 0.225275 Oct 12 09:23:18.820104 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3277/6122] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:18 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:18.845358 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e49e704-359b-4b7d-ad36-9a944098b8e9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125136 Oct 12 09:23:18.847233 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2846/6123] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:23:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:23:18.859041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38388e6c-71f9-4bb9-b81d-c52b7f7497ee tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:18.859660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-38388e6c-71f9-4bb9-b81d-c52b7f7497ee tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:18.963758 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38388e6c-71f9-4bb9-b81d-c52b7f7497ee tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1329 microversion: 2.1 time: 0.108939 Oct 12 09:23:18.975703 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3278/6124] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:18 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1329 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:19.300861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1a0edc01-5f42-4b3e-a907-3244c29f1ea9 req-6c7312db-91fd-4bbb-b9b8-076fce9a52a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c600912f-2506-4f19-b36d-69a508a27a3a", "tag": "faf40fa9-96f1-4381-bd1f-a37354df784a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:19.337073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a0edc01-5f42-4b3e-a907-3244c29f1ea9 req-6c7312db-91fd-4bbb-b9b8-076fce9a52a0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:19.337989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a0edc01-5f42-4b3e-a907-3244c29f1ea9 req-6c7312db-91fd-4bbb-b9b8-076fce9a52a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:19.338989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a0edc01-5f42-4b3e-a907-3244c29f1ea9 req-6c7312db-91fd-4bbb-b9b8-076fce9a52a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:19.354461 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1a0edc01-5f42-4b3e-a907-3244c29f1ea9 req-6c7312db-91fd-4bbb-b9b8-076fce9a52a0 service nova] Creating event network-changed:faf40fa9-96f1-4381-bd1f-a37354df784a for instance c600912f-2506-4f19-b36d-69a508a27a3a on n-h2-858383-10 Oct 12 09:23:19.360962 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1a0edc01-5f42-4b3e-a907-3244c29f1ea9 req-6c7312db-91fd-4bbb-b9b8-076fce9a52a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063259 Oct 12 09:23:19.368030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:19.369186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:19.374334 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2847/6125] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:19.387642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:19.388452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:19.389123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:19.390155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:19.390852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:19.391624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:19.583705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:19.595932 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d240aba2-ec71-4b67-bdf8-b35bc87f05b0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1508 microversion: 2.1 time: 0.232327 Oct 12 09:23:19.596788 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3279/6126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:19 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:19.855153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:19.856609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:19.865476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:19.865965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:19.866405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:19.867160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:19.867596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:19.868614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:19.987612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:19.989111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:19.997672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:19.998504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:19.999384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:20.000930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:20.001613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:20.002741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:20.024428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:20.034524 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cadfcbad-87d1-49b6-a6f8-1ce3f5a54f46 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1391 microversion: 2.1 time: 0.183992 Oct 12 09:23:20.050285 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2848/6127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:19 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1391 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:20.139399 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aeefd256-c646-420a-9128-396840ff9b50 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1418 microversion: 2.1 time: 0.155548 Oct 12 09:23:20.140035 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3280/6128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:19 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1418 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:21.060443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:21.061751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:21.075296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:21.075809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:21.076246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:21.076965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:21.081926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:21.082377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:21.165312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:21.166824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:21.174106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:21.175051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:21.176010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:21.177800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:21.178469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:21.179093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:21.328836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:21.336911 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-07dfefb5-22f0-4ecb-8932-b4e8fb590a55 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1391 microversion: 2.1 time: 0.281444 Oct 12 09:23:21.338164 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2849/6129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:21 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1391 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:21.368455 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f562ed3-fedf-4a8d-9d21-e8fcd48a9124 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1424 microversion: 2.1 time: 0.208766 Oct 12 09:23:21.383176 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3281/6130] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:21 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1424 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:22.360462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:22.361082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:22.373294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:22.374340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:22.375376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:22.376538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:22.377411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:22.380727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:22.396877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:22.398554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:22.408354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:22.409531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:22.410491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:22.411633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:22.412830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:22.413891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:22.602285 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f3ee7355-0c31-407e-9453-9ec44bb70daf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1466 microversion: 2.1 time: 0.209828 Oct 12 09:23:22.617716 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3282/6131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:22 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1466 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:22.774216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:22.788486 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac76f4a7-935a-41bd-8d58-d3d07bf9d27e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1391 microversion: 2.1 time: 0.432007 Oct 12 09:23:22.789093 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2850/6132] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:22 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1391 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:22.989010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5ac4fd60-43e8-4137-896a-102c2e08d6a1 req-5106f882-fcef-484f-8ca3-09975f3641fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab0e191-3c7c-4887-b8eb-893435ccb7a5", "tag": "9198db72-c200-4917-95ba-77eb743d8f11"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:23.005845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5ac4fd60-43e8-4137-896a-102c2e08d6a1 req-5106f882-fcef-484f-8ca3-09975f3641fb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:23.006723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5ac4fd60-43e8-4137-896a-102c2e08d6a1 req-5106f882-fcef-484f-8ca3-09975f3641fb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:23.007375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5ac4fd60-43e8-4137-896a-102c2e08d6a1 req-5106f882-fcef-484f-8ca3-09975f3641fb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:23.019569 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5ac4fd60-43e8-4137-896a-102c2e08d6a1 req-5106f882-fcef-484f-8ca3-09975f3641fb service nova] Creating event network-changed:9198db72-c200-4917-95ba-77eb743d8f11 for instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 on n-h2-858383-10 Oct 12 09:23:23.025431 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5ac4fd60-43e8-4137-896a-102c2e08d6a1 req-5106f882-fcef-484f-8ca3-09975f3641fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040107 Oct 12 09:23:23.027213 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3283/6133] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:23.625091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:23.625773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:23.633728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:23.634217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:23.634653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:23.635354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:23.635798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:23.636404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:23.774787 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c665637-9044-4382-a229-6703f1d1049e tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1466 microversion: 2.1 time: 0.153217 Oct 12 09:23:23.776262 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2851/6134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:23 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1466 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:23.813229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:23.814855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:23.821644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:23.822138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:23.822657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:23.823641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:23.824101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:23.824811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:23.989239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:23.999778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c0adc9fe-950f-4ab6-91c7-547333c6997a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1391 microversion: 2.1 time: 0.192271 Oct 12 09:23:24.000476 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3284/6135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:23 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:24.798395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:24.800002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:24.808494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:24.809298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:24.809941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:24.810842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:24.811456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:24.817167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:25.024101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:25.024729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:25.027526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:25.043855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:25.044567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:25.044993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:25.046008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:25.058251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:25.058972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:25.089032 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0fff8364-7349-45bc-9daa-ea0d6cf164a8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1466 microversion: 2.1 time: 0.294387 Oct 12 09:23:25.102534 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2852/6136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:24 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1466 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:25.260990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:25.272081 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0ac41143-1eae-4d8a-9de0-24d28b4e35c1 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1391 microversion: 2.1 time: 0.252218 Oct 12 09:23:25.274417 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3285/6137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:25 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:26.125594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:26.126519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:26.136989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:26.137548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:26.138208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:26.138977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:26.139662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:26.140267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:26.297105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:26.298087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:26.301134 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dda687c6-48be-4e14-89ce-00362d2d6d57 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1466 microversion: 2.1 time: 0.179357 Oct 12 09:23:26.301770 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2853/6138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:26 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1466 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:26.311888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:26.312629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:26.313079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:26.313832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:26.326341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:26.326813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:26.580013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:26.588652 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c3bdfbb3-4a33-44a4-8458-d3652e74a07a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1391 microversion: 2.1 time: 0.296156 Oct 12 09:23:26.589553 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3286/6139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:26 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1391 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:26.651476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e4fe2882-27b0-4e7d-8cac-4bd4ee44a6a1 req-5303d946-7e07-42d0-9ca4-3c4b9c396849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c600912f-2506-4f19-b36d-69a508a27a3a", "name": "network-vif-plugged", "status": "completed", "tag": "faf40fa9-96f1-4381-bd1f-a37354df784a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:26.668752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e4fe2882-27b0-4e7d-8cac-4bd4ee44a6a1 req-5303d946-7e07-42d0-9ca4-3c4b9c396849 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:26.669129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e4fe2882-27b0-4e7d-8cac-4bd4ee44a6a1 req-5303d946-7e07-42d0-9ca4-3c4b9c396849 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:26.669602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e4fe2882-27b0-4e7d-8cac-4bd4ee44a6a1 req-5303d946-7e07-42d0-9ca4-3c4b9c396849 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:26.699909 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e4fe2882-27b0-4e7d-8cac-4bd4ee44a6a1 req-5303d946-7e07-42d0-9ca4-3c4b9c396849 service nova] Creating event network-vif-plugged:faf40fa9-96f1-4381-bd1f-a37354df784a for instance c600912f-2506-4f19-b36d-69a508a27a3a on n-h2-858383-10 Oct 12 09:23:26.707553 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e4fe2882-27b0-4e7d-8cac-4bd4ee44a6a1 req-5303d946-7e07-42d0-9ca4-3c4b9c396849 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059282 Oct 12 09:23:26.708594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2854/6140] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:27.328357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:27.329003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:27.336481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:27.336988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:27.337415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:27.338149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:27.338601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:27.339035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:27.475417 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d29ab8dd-1dec-4f89-a28a-de9533a180c9 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1466 microversion: 2.1 time: 0.150869 Oct 12 09:23:27.476004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3287/6141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:27 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:27.613182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:27.613916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:27.621300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:27.621845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:27.622290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:27.623001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:27.623499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:27.623924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:27.764809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:27.772846 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c2f3979f-11c0-4ff9-9d39-64a9f3b76d2a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1391 microversion: 2.1 time: 0.164275 Oct 12 09:23:27.773604 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2855/6142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:27 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:28.497913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:28.498589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:28.505483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:28.506227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:28.506853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:28.507733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:28.508374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:28.508968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:28.641219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:28.648444 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4a94c0b6-ca60-43fd-a5f9-1332cedfd4cc tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1466 microversion: 2.1 time: 0.154175 Oct 12 09:23:28.662071 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3288/6143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:28 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1466 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:28.725630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-307b4a8c-39e6-4b8f-a99d-14e56e934881 req-937d8792-f8a6-4afa-9c17-d51c2c1e645b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab0e191-3c7c-4887-b8eb-893435ccb7a5", "name": "network-vif-plugged", "status": "completed", "tag": "9198db72-c200-4917-95ba-77eb743d8f11"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:28.733025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:28.738215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-307b4a8c-39e6-4b8f-a99d-14e56e934881 req-937d8792-f8a6-4afa-9c17-d51c2c1e645b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:28.738712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-307b4a8c-39e6-4b8f-a99d-14e56e934881 req-937d8792-f8a6-4afa-9c17-d51c2c1e645b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:28.739149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-307b4a8c-39e6-4b8f-a99d-14e56e934881 req-937d8792-f8a6-4afa-9c17-d51c2c1e645b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:28.750795 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-307b4a8c-39e6-4b8f-a99d-14e56e934881 req-937d8792-f8a6-4afa-9c17-d51c2c1e645b service nova] Creating event network-vif-plugged:9198db72-c200-4917-95ba-77eb743d8f11 for instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 on n-h2-858383-10 Oct 12 09:23:28.754343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=20 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:28.756400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-307b4a8c-39e6-4b8f-a99d-14e56e934881 req-937d8792-f8a6-4afa-9c17-d51c2c1e645b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036926 Oct 12 09:23:28.757013 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2856/6144] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:28.797463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:28.798570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:28.807518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:28.808289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:28.809191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:28.810187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:28.810665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:28.811669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:28.963413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=16 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:28.982413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:28.992982 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6a84cb2-9780-417e-8865-fe218d637842 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1563 microversion: 2.1 time: 0.200027 Oct 12 09:23:28.994138 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3289/6145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:28 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1563 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:29.016128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:29.016837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:29.024013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:29.024517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:29.024947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:29.025958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:29.026580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:29.027016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:29.174953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:29.184020 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0409df19-0a74-487b-b4f8-2617e1eb290c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1563 microversion: 2.1 time: 0.172046 Oct 12 09:23:29.190045 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2857/6146] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:29 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:29.674414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:29.675888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:29.684620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:29.685494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:29.686121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:29.687218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:29.688026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:29.688635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:29.881960 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d9cd9bda-157a-4755-8d35-a232176d2651 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1466 microversion: 2.1 time: 0.212720 Oct 12 09:23:29.883271 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3290/6147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:29 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1466 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:30.905352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:30.906689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:30.916591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:30.917526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:30.918297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:30.919189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:30.919805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:30.920730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.150264 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-51ee2d79-c2aa-42a1-9d27-b0c203c69d44 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1651 microversion: 2.1 time: 0.248625 Oct 12 09:23:31.151591 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2858/6148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:30 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1651 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:31.175448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:31.176077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:31.185264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.193940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.194428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.195181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.195652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.196078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.297239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:31.298778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:31.309504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.310002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.310441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.311176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.311600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.312028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.401713 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-242c5f40-50d5-481e-a594-d5dc40484ad5 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1651 microversion: 2.1 time: 0.231458 Oct 12 09:23:31.403028 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3291/6149] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:31 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1651 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:31.411530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ad18cb2d-b1b5-4bc1-8a26-4d482c3c364c req-65ba292f-fbed-4758-a161-f6235044197b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c600912f-2506-4f19-b36d-69a508a27a3a", "tag": "faf40fa9-96f1-4381-bd1f-a37354df784a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:31.424372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad18cb2d-b1b5-4bc1-8a26-4d482c3c364c req-65ba292f-fbed-4758-a161-f6235044197b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.425312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad18cb2d-b1b5-4bc1-8a26-4d482c3c364c req-65ba292f-fbed-4758-a161-f6235044197b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.426045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad18cb2d-b1b5-4bc1-8a26-4d482c3c364c req-65ba292f-fbed-4758-a161-f6235044197b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.454909 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ad18cb2d-b1b5-4bc1-8a26-4d482c3c364c req-65ba292f-fbed-4758-a161-f6235044197b service nova] Creating event network-changed:faf40fa9-96f1-4381-bd1f-a37354df784a for instance c600912f-2506-4f19-b36d-69a508a27a3a on n-h2-858383-10 Oct 12 09:23:31.466184 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ad18cb2d-b1b5-4bc1-8a26-4d482c3c364c req-65ba292f-fbed-4758-a161-f6235044197b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059643 Oct 12 09:23:31.469081 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3292/6150] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:31.488700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:31.491112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:31.499853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.500366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.501212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.502277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.502968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.506364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.566240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:23:31.569908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:31.576504 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e4b7bcb-4795-4172-8f96-0e1743cf4daa tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1563 microversion: 2.1 time: 0.283851 Oct 12 09:23:31.579166 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2859/6151] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:31 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1563 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:31.696742 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-086090d7-e936-498b-acb1-ec7aae1e0683 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1651 microversion: 2.1 time: 0.225991 Oct 12 09:23:31.698605 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3293/6152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:31 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1651 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:31.727302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:31.730373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:31.741376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.742824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.745667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.747990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.750177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.751479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.783301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:23:31.921693 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e6e2b122-f966-4704-93ad-ad23ef33f430 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 204 len: 0 microversion: 2.1 time: 0.204410 Oct 12 09:23:31.927887 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2860/6153] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:23:31 2022] DELETE /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:23:31.933402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:31.935432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:31.948401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.950358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.950914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:31.952668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:31.954624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:31.956921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:32.136534 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1f6a16ea-9bdb-40c1-ab3e-a4ca8f9872c1 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1657 microversion: 2.1 time: 0.207085 Oct 12 09:23:32.137129 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3294/6154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:31 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1657 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:33.163539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:33.164589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:33.173243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:33.174145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:33.174687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:33.175578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:33.176153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:33.176811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:33.344370 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-266f2ac9-4f1b-41b2-a4f9-bcb89dc15431 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1657 microversion: 2.1 time: 0.187595 Oct 12 09:23:33.345490 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2861/6155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:33 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1657 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:33.922283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1b83d21e-4324-4d7f-8b4e-97c11527c75a req-04367895-c4c0-44b2-a81b-abbe37c128c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab0e191-3c7c-4887-b8eb-893435ccb7a5", "name": "network-vif-deleted", "tag": "9198db72-c200-4917-95ba-77eb743d8f11"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:33.937259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1b83d21e-4324-4d7f-8b4e-97c11527c75a req-04367895-c4c0-44b2-a81b-abbe37c128c5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:33.940601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1b83d21e-4324-4d7f-8b4e-97c11527c75a req-04367895-c4c0-44b2-a81b-abbe37c128c5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:33.941252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1b83d21e-4324-4d7f-8b4e-97c11527c75a req-04367895-c4c0-44b2-a81b-abbe37c128c5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:33.967396 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1b83d21e-4324-4d7f-8b4e-97c11527c75a req-04367895-c4c0-44b2-a81b-abbe37c128c5 service nova] Creating event network-vif-deleted:9198db72-c200-4917-95ba-77eb743d8f11 for instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 on n-h2-858383-10 Oct 12 09:23:33.975283 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1b83d21e-4324-4d7f-8b4e-97c11527c75a req-04367895-c4c0-44b2-a81b-abbe37c128c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057436 Oct 12 09:23:33.980261 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3295/6156] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:34.371520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:34.372122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:34.379667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:34.380160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:34.380598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:34.381298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:34.381791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:34.382223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:34.415049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:34.415515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:34.415981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:34.416433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lazy-loading 'fault' on Instance uuid aab0e191-3c7c-4887-b8eb-893435ccb7a5 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:23:34.468790 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e494e271-92e1-46d6-87e2-cd6961aafbbf tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 200 len: 1456 microversion: 2.1 time: 0.101008 Oct 12 09:23:34.469355 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2862/6157] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:34 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 1456 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:35.494451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:35.495232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: aab0e191-3c7c-4887-b8eb-893435ccb7a5] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:35.502766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:35.503198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:35.503633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:35.504368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:35.504879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:35.505263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:35.520589 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] HTTP exception thrown: Instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 could not be found. Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Request method failure captured: Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 HTTP/1.1 Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRod0NcFwCaX8JBdVvIfVAGbfS3QzyCshcFrmeuofQhTuiA0riqp8IrpZ42QPiDr1ywffRS9Bu8u21jAnoDQUhM1ENSXvdTAXPjjqFFpCTV7vrjSV83gDlUpZ2ocLfC2L3pzM2Iuj6UupN0rZQygZlBuCxzYzfihcal51sB56I7yaH8Q Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: cfa4f3b96676444a85f520e1ee6f5e5e Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestServerMultinode-1388849237 Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cfa4f3b96676444a85f520e1ee6f5e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cfa4f3b96676444a85f520e1ee6f5e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cfa4f3b96676444a85f520e1ee6f5e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cfa4f3b96676444a85f520e1ee6f5e5e"}]}] Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestServerMultinode-1388849237 Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: cfa4f3b96676444a85f520e1ee6f5e5e Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestServerMultinode-1388849237 Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestServerMultinode-1388849237-project-admin Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: ac8733ed059740a2808d7ff4fd5e6bc4 Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestServerMultinode-1388849237-project-admin Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 could not be found. Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'aab0e191-3c7c-4887-b8eb-893435ccb7a5'} Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 could not be found. Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 could not be found. Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:23:35.522749 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 could not be found. Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Returning 404 to user: Instance aab0e191-3c7c-4887-b8eb-893435ccb7a5 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-649cb3a0-5048-42a6-85b3-f1ff81d96b27 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5" status: 404 len: 111 microversion: 2.1 time: 0.036741 Oct 12 09:23:35.531722 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3296/6158] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:35 2022] GET /compute/v2.1/servers/aab0e191-3c7c-4887-b8eb-893435ccb7a5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:23:35.535745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:35.536326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:35.544810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:35.545621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:35.546061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:35.547370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:35.548017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:35.548660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:35.577235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:23:35.662951 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-18513b00-ca4a-4380-b024-9c3e5de2190d tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 204 len: 0 microversion: 2.1 time: 0.130786 Oct 12 09:23:35.664153 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2863/6159] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:23:35 2022] DELETE /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:23:35.672273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:35.673526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:35.679982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:35.680517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:35.681189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:35.681989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:35.682518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:35.683058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:35.831449 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5983e456-97e7-4514-81dc-9b976f67df36 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1656 microversion: 2.1 time: 0.162162 Oct 12 09:23:35.832279 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3297/6160] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:35 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:23:36.854589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:36.855982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:36.863192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:36.863645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:36.864117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:36.864810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:36.865256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:36.865753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:37.014716 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-603cd78e-cde5-4061-9796-9f9cfaa7c3cb tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1656 microversion: 2.1 time: 0.164073 Oct 12 09:23:37.016443 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2864/6161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:36 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1656 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:37.725647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-95721556-6723-405b-a698-1039f80ff56a req-fb5e4f22-191a-4024-ac0b-03dd0c845eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4fd8b5-543c-4b8f-bdaf-73a102201a4c", "name": "network-vif-deleted", "tag": "40227495-53de-41f3-a298-40b94235fcb7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:37.738851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-95721556-6723-405b-a698-1039f80ff56a req-fb5e4f22-191a-4024-ac0b-03dd0c845eda service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:37.739793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-95721556-6723-405b-a698-1039f80ff56a req-fb5e4f22-191a-4024-ac0b-03dd0c845eda service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:37.740450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-95721556-6723-405b-a698-1039f80ff56a req-fb5e4f22-191a-4024-ac0b-03dd0c845eda service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:37.759892 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-95721556-6723-405b-a698-1039f80ff56a req-fb5e4f22-191a-4024-ac0b-03dd0c845eda service nova] Creating event network-vif-deleted:40227495-53de-41f3-a298-40b94235fcb7 for instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c on n-h1-858383-10 Oct 12 09:23:37.765378 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-95721556-6723-405b-a698-1039f80ff56a req-fb5e4f22-191a-4024-ac0b-03dd0c845eda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044387 Oct 12 09:23:37.766491 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3298/6162] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:38.044208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:38.045602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:38.053580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:38.054356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:38.054959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:38.055829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:38.058027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:38.058666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:38.098556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:38.099039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:38.099474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:38.099920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lazy-loading 'fault' on Instance uuid ad4fd8b5-543c-4b8f-bdaf-73a102201a4c {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:23:38.149109 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b781fd3b-0fe0-43fe-9d72-7688a45cec20 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 200 len: 1456 microversion: 2.1 time: 0.112932 Oct 12 09:23:38.149701 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2865/6163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:38 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 1456 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:23:39.173877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:23:39.174580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] [instance: ad4fd8b5-543c-4b8f-bdaf-73a102201a4c] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:39.181647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:39.182177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:39.182682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:39.183493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:39.184100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:39.184542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:39.198466 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] HTTP exception thrown: Instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c could not be found. Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Request method failure captured: Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c HTTP/1.1 Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRod0NcFwCaX8JBdVvIfVAGbfS3QzyCshcFrmeuofQhTuiA0riqp8IrpZ42QPiDr1ywffRS9Bu8u21jAnoDQUhM1ENSXvdTAXPjjqFFpCTV7vrjSV83gDlUpZ2ocLfC2L3pzM2Iuj6UupN0rZQygZlBuCxzYzfihcal51sB56I7yaH8Q Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: cfa4f3b96676444a85f520e1ee6f5e5e Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestServerMultinode-1388849237 Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cfa4f3b96676444a85f520e1ee6f5e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cfa4f3b96676444a85f520e1ee6f5e5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cfa4f3b96676444a85f520e1ee6f5e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cfa4f3b96676444a85f520e1ee6f5e5e"}]}] Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestServerMultinode-1388849237 Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: cfa4f3b96676444a85f520e1ee6f5e5e Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestServerMultinode-1388849237 Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestServerMultinode-1388849237-project-admin Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: ac8733ed059740a2808d7ff4fd5e6bc4 Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestServerMultinode-1388849237-project-admin Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c could not be found. Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'ad4fd8b5-543c-4b8f-bdaf-73a102201a4c'} Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c could not be found. Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c could not be found. Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:23:39.200142 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c could not be found. Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] Returning 404 to user: Instance ad4fd8b5-543c-4b8f-bdaf-73a102201a4c could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:23:39.204896 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5503bdeb-96ae-4650-828a-c25c3a6d5ff8 tempest-TestServerMultinode-1388849237 tempest-TestServerMultinode-1388849237-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c" status: 404 len: 111 microversion: 2.1 time: 0.032997 Oct 12 09:23:39.205547 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3299/6164] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:23:39 2022] GET /compute/v2.1/servers/ad4fd8b5-543c-4b8f-bdaf-73a102201a4c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:23:39.400334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd01b9f9-8310-4015-8a91-515e598980b9", "device": "/dev/sdb"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:39.402926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:39.410285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:39.410778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:39.411217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:39.411929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:39.412684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:39.413113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:39.725195 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b87f615c-aa54-443e-938a-475cd517c8f0 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "POST /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328668 Oct 12 09:23:39.726137 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2866/6165] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:23:39 2022] POST /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:23:56.901343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:23:56.904782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:23:56.913106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:56.914121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=46 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:23:56.916243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:56.917248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:56.918058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:56.918960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:23:56.919585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:23:56.920184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:23:56.978772 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5cbd0b0b-7e67-4151-86f3-a80be1827eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a/action" status: 200 len: 24574 microversion: 2.1 time: 0.083390 Oct 12 09:23:56.983735 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3300/6166] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:23:56 2022] POST /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a/action => generated 24574 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:24:05.079207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:05.079992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:05.084188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:05.084766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:05.092329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:05.092848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:05.093288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:05.093993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:05.094441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:05.094862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:05.181149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lazy-loading 'services' on Instance uuid f1d6469a-6180-41fd-9716-2e8c5819829e {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:24:05.262021 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc423b2f-8e21-4b47-971e-1ea34ae95369 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e/os-volume_attachments/dd01b9f9-8310-4015-8a91-515e598980b9" status: 202 len: 0 microversion: 2.1 time: 0.184748 Oct 12 09:24:05.263102 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2867/6167] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:24:05 2022] DELETE /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e/os-volume_attachments/dd01b9f9-8310-4015-8a91-515e598980b9 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:24:08.058217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:08.059150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:08.061976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:08.062705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:08.069697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.070209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.070663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.071395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.071860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.072297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.252076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:08.261683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a0e31377-aaf0-45cf-bc89-4ec0af960d43 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1682 microversion: 2.1 time: 0.208128 Oct 12 09:24:08.262481 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3301/6168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:08 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:08.364276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:08.366509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:08.373197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.373725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.374167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.374943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.375341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.375772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.407986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:08.409308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:08.416302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.416813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.417259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.418000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.418456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.418887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.446699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:24:08.452883 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-31bbfdf3-05b7-46c8-91d3-597720dea454 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a/action" status: 200 len: 32645 microversion: 2.1 time: 0.092628 Oct 12 09:24:08.454316 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3302/6169] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:24:08 2022] POST /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a/action => generated 32645 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 09:24:08.548302 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-851bd394-8bc1-401f-ac4f-d9287758f031 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 204 len: 0 microversion: 2.1 time: 0.425506 Oct 12 09:24:08.550035 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2868/6170] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:24:08 2022] DELETE /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:24:08.560314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:08.560838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:08.577332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.578114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.578557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.579336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.579774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.580209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.612329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:08.613210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:08.620375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.622375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.622375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.623308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.624011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.625024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.728619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:08.738112 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc46dcf3-38e6-44bf-9685-87d1e85c2275 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1734 microversion: 2.1 time: 0.183828 Oct 12 09:24:08.755269 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3303/6171] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:08 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:08.780909 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1cc84308-8a7d-42f8-a9a6-c5fb1f9d49ef tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1835 microversion: 2.1 time: 0.175252 Oct 12 09:24:08.781709 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2869/6172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:08 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1835 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:08.811213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:08.814218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:08.820877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.821463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.821998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.822843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:08.823364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:08.824202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:08.972777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lazy-loading 'flavor' on Instance uuid c600912f-2506-4f19-b36d-69a508a27a3a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:24:08.987388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Going to try to live migrate instance to another host {{(pid=127006) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 12 09:24:09.763151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:09.763900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:09.771904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:09.783969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:09.784631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:09.785390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:09.786077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:09.787029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:09.959789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:09.970439 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eec2a49f-c08e-47fa-9d6c-5a2aa1fa7e2b tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1734 microversion: 2.1 time: 0.212136 Oct 12 09:24:09.978266 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2870/6173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:09 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:24:10.505397 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43fd7f41-6b40-46b5-8937-f7fdfa016f3b tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a/action" status: 202 len: 0 microversion: 2.1 time: 1.690504 Oct 12 09:24:10.506207 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3304/6174] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:24:08 2022] POST /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a/action => generated 0 bytes in 1700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:24:10.522122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:10.522748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:10.529795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:10.530284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:10.530720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:10.531426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:10.531877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:10.532304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:10.741019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:10.741639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:10.742418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:10.751367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:10.752283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:10.752937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:10.754017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:10.754790 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a5be43fb-0d6d-4c28-8284-6f1557125b4d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.239215 Oct 12 09:24:10.755027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:10.755666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:10.756982 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2871/6175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:10 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:10.783288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:24:10.929988 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c9e2832-9a4e-4f5a-bd02-c8437be52c48 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 204 len: 0 microversion: 2.1 time: 0.191799 Oct 12 09:24:10.931382 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3305/6176] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:24:10 2022] DELETE /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:24:10.940495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:10.941797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:10.950957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:10.951763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:10.952430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:10.953732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:10.954405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:10.955248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:10.995917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:10.997051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:11.012404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:11.013223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:11.013860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:11.014751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:11.015362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:11.016117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:11.312031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:11.321977 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b6c8876-f9bb-41ec-80a8-1e54acacf7a3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1514 microversion: 2.1 time: 0.386029 Oct 12 09:24:11.322606 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2872/6177] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:10 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:11.327431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5ba0fdbb-de92-484c-b399-091a87e2045d req-66236efc-9889-4c67-bee9-c9cee3f96d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c35cc4-36a6-4abc-8b26-4bd11fcbea79", "name": "network-vif-deleted", "tag": "1b02627b-3da4-4fde-b9aa-6f900c16c1c7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:11.337110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ba0fdbb-de92-484c-b399-091a87e2045d req-66236efc-9889-4c67-bee9-c9cee3f96d66 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:11.337631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ba0fdbb-de92-484c-b399-091a87e2045d req-66236efc-9889-4c67-bee9-c9cee3f96d66 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:11.338073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5ba0fdbb-de92-484c-b399-091a87e2045d req-66236efc-9889-4c67-bee9-c9cee3f96d66 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:11.341906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2548c7b1ac54751848fb24103fb6ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a01f8e9cf42d596c1bfd4ffb60635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:11.351105 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5ba0fdbb-de92-484c-b399-091a87e2045d req-66236efc-9889-4c67-bee9-c9cee3f96d66 service nova] Creating event network-vif-deleted:1b02627b-3da4-4fde-b9aa-6f900c16c1c7 for instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 on n-h1-858383-10 Oct 12 09:24:11.356096 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f95ca6b6-a03e-4b4f-b9b1-ad6d9d73c4fe tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 200 len: 1666 microversion: 2.1 time: 0.365300 Oct 12 09:24:11.356316 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5ba0fdbb-de92-484c-b399-091a87e2045d req-66236efc-9889-4c67-bee9-c9cee3f96d66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032381 Oct 12 09:24:11.357121 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2873/6178] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:11.358197 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3306/6179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:10 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 1666 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:24:11.780374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:11.781082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:11.788138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:11.788584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:11.789230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:11.789971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:11.790422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:11.790847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:11.955494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:11.968902 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-158387a2-9bb4-48aa-8e1d-fcfa4d7eb574 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.192564 Oct 12 09:24:11.970451 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2874/6180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:11 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:12.346378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:12.347635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:12.355226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:12.356019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:12.356640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:12.357570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:12.358192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:12.358790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:12.385729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:12.386348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:12.397016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:12.397761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:12.398392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:12.399608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:12.405186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:12.406471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:12.427062 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] HTTP exception thrown: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Request method failure captured: Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 HTTP/1.1 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoZ92B0osoe_QPvqjfd8cqASubQ4Kirfetr5Fs38WfeoVCJ7uae5g6ZDyPiSbMnP3eLkb0PnY1e1Uk0l990teQD6PwYQH25d_QbTpSAzYhmk1rLZoE84x6aygIpFlCWlHC1ox60p-2t53RiGEoQfxTw0sW-lFArQhgtU-7YGD14-9GM Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c54a01f8e9cf42d596c1bfd4ffb60635 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c54a01f8e9cf42d596c1bfd4ffb60635"}]}] Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c54a01f8e9cf42d596c1bfd4ffb60635 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestServerBasicOps-1583100458-project Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f2548c7b1ac54751848fb24103fb6ff3 Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestServerBasicOps-1583100458-project Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '68c35cc4-36a6-4abc-8b26-4bd11fcbea79'} Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:12.429133 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Returning 404 to user: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:24:12.433934 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-47018e11-c193-45ff-a319-a00290758f01 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 404 len: 111 microversion: 2.1 time: 0.048855 Oct 12 09:24:12.435211 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2875/6181] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:12 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:24:12.639747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:12.656866 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7b39cf88-3744-41fe-8044-4a45b724df33 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1514 microversion: 2.1 time: 0.314226 Oct 12 09:24:12.658928 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3307/6182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:12 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:12.826484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f05e519a-6f2b-4964-a32a-91019b1935ba req-b72220db-fa7f-4122-9376-101413e95a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c600912f-2506-4f19-b36d-69a508a27a3a", "name": "network-vif-unplugged", "status": "completed", "tag": "faf40fa9-96f1-4381-bd1f-a37354df784a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:12.837290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f05e519a-6f2b-4964-a32a-91019b1935ba req-b72220db-fa7f-4122-9376-101413e95a65 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:12.838248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f05e519a-6f2b-4964-a32a-91019b1935ba req-b72220db-fa7f-4122-9376-101413e95a65 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:12.838862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f05e519a-6f2b-4964-a32a-91019b1935ba req-b72220db-fa7f-4122-9376-101413e95a65 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:12.865361 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f05e519a-6f2b-4964-a32a-91019b1935ba req-b72220db-fa7f-4122-9376-101413e95a65 service nova] Creating event network-vif-unplugged:faf40fa9-96f1-4381-bd1f-a37354df784a for instance c600912f-2506-4f19-b36d-69a508a27a3a on n-h2-858383-10 Oct 12 09:24:12.877978 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f05e519a-6f2b-4964-a32a-91019b1935ba req-b72220db-fa7f-4122-9376-101413e95a65 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151284 Oct 12 09:24:12.879150 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2876/6183] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:13.002331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:13.003355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:13.019403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.020400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.021209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.022175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.023140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.023797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.243131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:13.254277 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bfdc6e64-29a1-43c1-88ab-b3fddcbc524e tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.260312 Oct 12 09:24:13.270715 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3308/6184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:12 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:13.640489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:13.641759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:13.650576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.651290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.651905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.652824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.653451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.654025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.668773 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] HTTP exception thrown: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Request method failure captured: Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 HTTP/1.1 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoZ92B0osoe_QPvqjfd8cqASubQ4Kirfetr5Fs38WfeoVCJ7uae5g6ZDyPiSbMnP3eLkb0PnY1e1Uk0l990teQD6PwYQH25d_QbTpSAzYhmk1rLZoE84x6aygIpFlCWlHC1ox60p-2t53RiGEoQfxTw0sW-lFArQhgtU-7YGD14-9GM Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c54a01f8e9cf42d596c1bfd4ffb60635 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c54a01f8e9cf42d596c1bfd4ffb60635"}]}] Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c54a01f8e9cf42d596c1bfd4ffb60635 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestServerBasicOps-1583100458-project Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f2548c7b1ac54751848fb24103fb6ff3 Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestServerBasicOps-1583100458-project Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '68c35cc4-36a6-4abc-8b26-4bd11fcbea79'} Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:24:13.670824 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.675472 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.676804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Returning 404 to user: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:24:13.677890 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a3d1d22e-ef86-48a4-8d1f-e25d1a75b578 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 404 len: 111 microversion: 2.1 time: 0.043295 Oct 12 09:24:13.681867 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2877/6185] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:24:13 2022] DELETE /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:24:13.682031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:13.682602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:13.687799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:13.688888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] [instance: 68c35cc4-36a6-4abc-8b26-4bd11fcbea79] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:13.695597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.696110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.696549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.699000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.699859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.700477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.701395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.702067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.702656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.703667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.704229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.704759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.721671 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] HTTP exception thrown: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Request method failure captured: Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 HTTP/1.1 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoZ92B0osoe_QPvqjfd8cqASubQ4Kirfetr5Fs38WfeoVCJ7uae5g6ZDyPiSbMnP3eLkb0PnY1e1Uk0l990teQD6PwYQH25d_QbTpSAzYhmk1rLZoE84x6aygIpFlCWlHC1ox60p-2t53RiGEoQfxTw0sW-lFArQhgtU-7YGD14-9GM Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c54a01f8e9cf42d596c1bfd4ffb60635 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c54a01f8e9cf42d596c1bfd4ffb60635"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c54a01f8e9cf42d596c1bfd4ffb60635"}]}] Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c54a01f8e9cf42d596c1bfd4ffb60635 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestServerBasicOps-1583100458 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestServerBasicOps-1583100458-project Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f2548c7b1ac54751848fb24103fb6ff3 Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestServerBasicOps-1583100458-project Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '68c35cc4-36a6-4abc-8b26-4bd11fcbea79'} Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:13.723703 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.728604 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:13.728604 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:13.728604 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:13.728604 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:24:13.728604 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:24:13.728604 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. Oct 12 09:24:13.728604 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:13.729933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Returning 404 to user: Instance 68c35cc4-36a6-4abc-8b26-4bd11fcbea79 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:24:13.731024 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a1926b6-9501-4484-bdee-65c59d241c2f tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79" status: 404 len: 111 microversion: 2.1 time: 0.047307 Oct 12 09:24:13.735141 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2878/6186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:13 2022] GET /compute/v2.1/servers/68c35cc4-36a6-4abc-8b26-4bd11fcbea79 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:24:13.830129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:13.838969 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-49696385-d7a5-47b6-971b-04c2b9d3d88b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 200 len: 1472 microversion: 2.1 time: 0.160999 Oct 12 09:24:13.839579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3309/6187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:13 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:13.861710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-adc4c1a5-a0b3-44fc-a950-570c7ec80f0c req-ec9be025-94c6-4927-98b8-bfde4d50f350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d6469a-6180-41fd-9716-2e8c5819829e", "name": "network-vif-deleted", "tag": "ebff6692-66c7-4ea1-872d-48ba519be6c2"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:13.873059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-adc4c1a5-a0b3-44fc-a950-570c7ec80f0c req-ec9be025-94c6-4927-98b8-bfde4d50f350 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:13.873810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-adc4c1a5-a0b3-44fc-a950-570c7ec80f0c req-ec9be025-94c6-4927-98b8-bfde4d50f350 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:13.874702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-adc4c1a5-a0b3-44fc-a950-570c7ec80f0c req-ec9be025-94c6-4927-98b8-bfde4d50f350 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:13.889149 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-adc4c1a5-a0b3-44fc-a950-570c7ec80f0c req-ec9be025-94c6-4927-98b8-bfde4d50f350 service nova] Creating event network-vif-deleted:ebff6692-66c7-4ea1-872d-48ba519be6c2 for instance f1d6469a-6180-41fd-9716-2e8c5819829e on n-h2-858383-10 Oct 12 09:24:13.894176 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-adc4c1a5-a0b3-44fc-a950-570c7ec80f0c req-ec9be025-94c6-4927-98b8-bfde4d50f350 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130329 Oct 12 09:24:13.894953 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2879/6188] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:24:13.996991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0897a643-710e-4ff2-b5be-826a4f1dd411 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] Calling method '.version_select at 0x7f9843540f70>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:14.029626 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0897a643-710e-4ff2-b5be-826a4f1dd411 tempest-TestServerBasicOps-1583100458 tempest-TestServerBasicOps-1583100458-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-959854354" status: 202 len: 0 microversion: 2.1 time: 0.037841 Oct 12 09:24:14.030629 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3310/6189] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 09:24:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-959854354 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:24:14.282169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:14.283132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:14.290740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:14.291601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:14.292110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:14.292902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:14.293422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:14.294063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:14.551856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:14.563356 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-53326fe4-5338-426a-95cb-6d25b480c31c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.285839 Oct 12 09:24:14.577814 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2880/6190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:14 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:14.863569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:14.864738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: f1d6469a-6180-41fd-9716-2e8c5819829e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:14.871724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:14.872207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:14.872644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:14.873343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:14.873826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:14.874248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:14.888274 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] HTTP exception thrown: Instance f1d6469a-6180-41fd-9716-2e8c5819829e could not be found. Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Request method failure captured: Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e HTTP/1.1 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRocs-XxSiiSYZhFfAcrK9pvm_m7a-JQ2lYlWO0bqfhhwpiUZLc77axgYFXtL_XS4jjxT2uPjjDN-HU0KYGUMj8reIp4_Ulf52rfqSpcYlHT5pc5BUGKg4xkAR9Ed2UXdNWquJ1h26segGWpPpQtgjUtWpGyYVglvRo5RrCL4e9C87rY Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: acd07246242946faa59f545c56224da3 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesSnapshotTestJSON-595442432 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acd07246242946faa59f545c56224da3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/acd07246242946faa59f545c56224da3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_acd07246242946faa59f545c56224da3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acd07246242946faa59f545c56224da3"}]}] Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesSnapshotTestJSON-595442432 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: acd07246242946faa59f545c56224da3 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-595442432 Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesSnapshotTestJSON-595442432-project Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 506e0f8369d84d4abe82bc00f9928e0f Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesSnapshotTestJSON-595442432-project Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance f1d6469a-6180-41fd-9716-2e8c5819829e could not be found. Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'f1d6469a-6180-41fd-9716-2e8c5819829e'} Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d6469a-6180-41fd-9716-2e8c5819829e could not be found. Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d6469a-6180-41fd-9716-2e8c5819829e could not be found. Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:14.890106 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d6469a-6180-41fd-9716-2e8c5819829e could not be found. Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Returning 404 to user: Instance f1d6469a-6180-41fd-9716-2e8c5819829e could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc7b4b62-124b-4430-aa5f-a70898e813b1 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e" status: 404 len: 111 microversion: 2.1 time: 0.032486 Oct 12 09:24:14.894756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3311/6191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:14 2022] GET /compute/v2.1/servers/f1d6469a-6180-41fd-9716-2e8c5819829e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:24:14.920127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1a8f9e06-24a8-4e0c-8bd8-7e000ae851bb req-56e4d038-2be3-404b-9e5e-f465816ddd1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c600912f-2506-4f19-b36d-69a508a27a3a", "tag": "faf40fa9-96f1-4381-bd1f-a37354df784a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:14.931955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a8f9e06-24a8-4e0c-8bd8-7e000ae851bb req-56e4d038-2be3-404b-9e5e-f465816ddd1d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:14.932925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a8f9e06-24a8-4e0c-8bd8-7e000ae851bb req-56e4d038-2be3-404b-9e5e-f465816ddd1d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:14.933870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1a8f9e06-24a8-4e0c-8bd8-7e000ae851bb req-56e4d038-2be3-404b-9e5e-f465816ddd1d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:14.946972 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1a8f9e06-24a8-4e0c-8bd8-7e000ae851bb req-56e4d038-2be3-404b-9e5e-f465816ddd1d service nova] Creating event network-changed:faf40fa9-96f1-4381-bd1f-a37354df784a for instance c600912f-2506-4f19-b36d-69a508a27a3a on n-h2-858383-10 Oct 12 09:24:14.952925 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1a8f9e06-24a8-4e0c-8bd8-7e000ae851bb req-56e4d038-2be3-404b-9e5e-f465816ddd1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037028 Oct 12 09:24:14.954181 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2881/6192] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:15.588240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:15.588866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:15.615727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:15.616237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:15.616679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:15.617399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:15.617899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:15.618327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:15.805410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:15.830323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3262a8f7-9184-49b7-9d51-987c58b8e1f2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.244551 Oct 12 09:24:15.836685 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3312/6193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:15 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:16.867853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:16.869129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:16.879401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:16.880147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:16.880804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:16.881733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:16.886821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:16.887264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:17.150050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:17.161023 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6fddcf2-ee17-478d-8e5f-d8e4d2fd15a8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.300307 Oct 12 09:24:17.164182 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2882/6194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:16 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:24:18.193198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:18.194566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:18.207547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:18.208057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:18.208506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:18.210116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:18.210733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:18.211494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:18.482957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:18.492388 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14c1ead3-5213-4220-8292-e31967a21abf tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.304605 Oct 12 09:24:18.513056 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3313/6195] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:18 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:19.529628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:19.531189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:19.548882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:19.552698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:19.556336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:19.557096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:19.559048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:19.561462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:19.949212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:19.959539 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37688537-dbcb-4501-b700-c6be44e4f8f6 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.433931 Oct 12 09:24:19.965517 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2883/6196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:19 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:20.988959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:20.989619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:21.008643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:21.009959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:21.010506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:21.013316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:21.013918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:21.014468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:21.509030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:21.519978 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-98026c77-2ae5-4a1b-8445-da99e1c6cf50 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1692 microversion: 2.1 time: 0.535374 Oct 12 09:24:21.521323 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3314/6197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:20 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1692 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:22.101559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-47575199", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "757ab4d8-4c55-4b2e-b526-e367fce1e868"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:22.179095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] validate_networks() for [('757ab4d8-4c55-4b2e-b526-e367fce1e868', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:24:22.544913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:22.546192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:22.554084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:22.554790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:22.555424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:22.556295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:22.557002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:22.557431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:22.759256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:22.773615 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89af2f21-b256-4b96-bc8d-20275c39d890 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1682 microversion: 2.1 time: 0.233306 Oct 12 09:24:22.774877 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3315/6198] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:22 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1682 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:22.799869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:22.800659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:22.813898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:22.814612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:22.815060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:22.815783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:22.816527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:22.816985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:22.827980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:23.057491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:24:23.057491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:24:23.057866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:24:23.058583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:24:23.058692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:24:23.069112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:23.069936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:23.070539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:23.071461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:23.072078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:23.072646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:23.091601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Getting quotas for project acd07246242946faa59f545c56224da3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:24:23.097613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Getting quotas for user 506e0f8369d84d4abe82bc00f9928e0f and project acd07246242946faa59f545c56224da3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:24:23.109879 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6a613c2-0e57-48b5-8a35-7bd57277c3c4 tempest-TestNetworkAdvancedServerOps-1463077323 tempest-TestNetworkAdvancedServerOps-1463077323-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1835 microversion: 2.1 time: 0.314443 Oct 12 09:24:23.110947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:24:23.111406 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3316/6199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:22 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1835 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:24:23.113915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:24:23.133995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:23.134620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:23.141046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:23.141838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:23.142537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:23.143517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:23.144162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:23.144845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:23.167279 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-498cd9e5-a31f-4a71-82d3-99453aa618d5 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069531 Oct 12 09:24:23.168235 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2884/6200] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:24:23.194178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-497d0598-0246-460f-8356-8ded020b5d1e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:23.195230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-497d0598-0246-460f-8356-8ded020b5d1e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:23.328014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-497d0598-0246-460f-8356-8ded020b5d1e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:23.336933 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-497d0598-0246-460f-8356-8ded020b5d1e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1217 microversion: 2.1 time: 0.148846 Oct 12 09:24:23.338552 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2885/6201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:23 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:23.470974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:23.484882 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-02a4bada-1257-40fa-bc4f-170dd563cbb7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1682 microversion: 2.1 time: 0.354481 Oct 12 09:24:23.486198 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3317/6202] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:23 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1682 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:24:24.360672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:24.361941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:24.370945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:24.371434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:24.371870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:24.372754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:24.373209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:24.373755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:24.453905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:24.462942 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0da70b3e-4483-4f66-9fcf-c961d36e134b tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1269 microversion: 2.1 time: 0.106473 Oct 12 09:24:24.463984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2886/6203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:24 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:25.487603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:25.488164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:25.496332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:25.497039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:25.497724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:25.498586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:25.499454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:25.500187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:25.572578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:25.582715 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05e7e444-ab85-4520-88c9-735b8b834087 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1275 microversion: 2.1 time: 0.100029 Oct 12 09:24:25.584073 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3318/6204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:25 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:24:25.677691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:25.680231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:25.694355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:25.695397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:25.696026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:25.696906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:25.697712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:25.698299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:25.720329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:25.770270 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bed863e6-0908-4a6e-aa96-765ffbc07dba tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a/action" status: 200 len: 38622 microversion: 2.1 time: 0.097733 Oct 12 09:24:25.771436 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2887/6205] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:24:25 2022] POST /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a/action => generated 38622 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:24:26.610881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:26.612599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:26.624671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:26.625496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:26.626388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:26.627407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:26.629018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:26.630198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:26.705026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-fe368f1d-2ca3-4230-a937-87a48145fd25 req-1ec6b92e-67f2-403e-9944-e84d4683041b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0896cd6a-3ab2-43c3-85fb-565254f1e8a9", "tag": "714b804c-f8ac-4eb6-88f6-f22764165dda"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:26.732431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fe368f1d-2ca3-4230-a937-87a48145fd25 req-1ec6b92e-67f2-403e-9944-e84d4683041b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:26.733324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fe368f1d-2ca3-4230-a937-87a48145fd25 req-1ec6b92e-67f2-403e-9944-e84d4683041b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:26.739090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-fe368f1d-2ca3-4230-a937-87a48145fd25 req-1ec6b92e-67f2-403e-9944-e84d4683041b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:26.754203 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-fe368f1d-2ca3-4230-a937-87a48145fd25 req-1ec6b92e-67f2-403e-9944-e84d4683041b service nova] Creating event network-changed:714b804c-f8ac-4eb6-88f6-f22764165dda for instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 on n-h2-858383-10 Oct 12 09:24:26.760146 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-fe368f1d-2ca3-4230-a937-87a48145fd25 req-1ec6b92e-67f2-403e-9944-e84d4683041b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060590 Oct 12 09:24:26.761092 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2888/6206] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:24:26.909115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:26.921300 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b3e09a11-9643-432e-be1c-e264d53b823f tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1317 microversion: 2.1 time: 0.317736 Oct 12 09:24:26.923256 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3319/6207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:26 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:27.192271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:27.192868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:27.197649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-92e6cdf2-cd90-4511-94ce-04df26072d27 req-7f731978-d4e6-4d9d-8c08-037a6eda51f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c600912f-2506-4f19-b36d-69a508a27a3a", "tag": "faf40fa9-96f1-4381-bd1f-a37354df784a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:27.203343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:27.206846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:27.207770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:27.209626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:27.210302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:27.211737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:27.218913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-92e6cdf2-cd90-4511-94ce-04df26072d27 req-7f731978-d4e6-4d9d-8c08-037a6eda51f4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:27.219574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-92e6cdf2-cd90-4511-94ce-04df26072d27 req-7f731978-d4e6-4d9d-8c08-037a6eda51f4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:27.220139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-92e6cdf2-cd90-4511-94ce-04df26072d27 req-7f731978-d4e6-4d9d-8c08-037a6eda51f4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:27.244672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:24:27.266669 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-92e6cdf2-cd90-4511-94ce-04df26072d27 req-7f731978-d4e6-4d9d-8c08-037a6eda51f4 service nova] Creating event network-changed:faf40fa9-96f1-4381-bd1f-a37354df784a for instance c600912f-2506-4f19-b36d-69a508a27a3a on n-h1-858383-10 Oct 12 09:24:27.279579 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-92e6cdf2-cd90-4511-94ce-04df26072d27 req-7f731978-d4e6-4d9d-8c08-037a6eda51f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085694 Oct 12 09:24:27.283805 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3320/6208] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:27.367649 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-52d84ab6-0ec0-4ce6-b6c5-ab8af5731563 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 204 len: 0 microversion: 2.1 time: 0.179290 Oct 12 09:24:27.372380 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2889/6209] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:24:27 2022] DELETE /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:24:27.378615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:27.380916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:27.404976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:27.406054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:27.407566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:27.408643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:27.409455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:27.409975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:27.675952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:27.687488 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7fb65699-e011-45f6-8a00-72f301e63a37 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1688 microversion: 2.1 time: 0.314122 Oct 12 09:24:27.718143 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3321/6210] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:27 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1688 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:27.945503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:27.946220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:27.974624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:27.975646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:27.977481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:27.979309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:27.980809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:27.982144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:28.746558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:28.747288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:28.755158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:28.755891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:28.756574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:28.757517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:28.758197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:28.758795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:28.950889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:28.960100 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8f83ded-df9f-47c1-ba80-d447e69734ec tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1569 microversion: 2.1 time: 0.218199 Oct 12 09:24:28.960697 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3322/6211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:28 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:24:29.035693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:29.045272 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fdd359ca-6a18-45fa-b174-bf5ce8a306ca tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1317 microversion: 2.1 time: 1.104556 Oct 12 09:24:29.045992 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2890/6212] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:27 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1317 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:29.772772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-dbd11a2f-04a7-4210-b947-cc2e6a5a7498 req-81daa95c-2394-430c-a806-d60df69b0120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c600912f-2506-4f19-b36d-69a508a27a3a", "name": "network-vif-deleted", "tag": "faf40fa9-96f1-4381-bd1f-a37354df784a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:29.792853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dbd11a2f-04a7-4210-b947-cc2e6a5a7498 req-81daa95c-2394-430c-a806-d60df69b0120 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:29.793488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dbd11a2f-04a7-4210-b947-cc2e6a5a7498 req-81daa95c-2394-430c-a806-d60df69b0120 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:29.794199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dbd11a2f-04a7-4210-b947-cc2e6a5a7498 req-81daa95c-2394-430c-a806-d60df69b0120 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:29.826270 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-dbd11a2f-04a7-4210-b947-cc2e6a5a7498 req-81daa95c-2394-430c-a806-d60df69b0120 service nova] Creating event network-vif-deleted:faf40fa9-96f1-4381-bd1f-a37354df784a for instance c600912f-2506-4f19-b36d-69a508a27a3a on n-h1-858383-10 Oct 12 09:24:29.843724 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-dbd11a2f-04a7-4210-b947-cc2e6a5a7498 req-81daa95c-2394-430c-a806-d60df69b0120 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076213 Oct 12 09:24:29.855490 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3323/6213] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:29.990537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:29.991203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:30.022012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:30.023406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:30.024027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:30.024909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:30.025547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:30.026171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:30.070260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:30.071156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:30.088839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:30.089719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:30.090479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:30.091378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:30.092000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:30.092590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:30.117421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:30.118701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:30.120516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:30.120994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lazy-loading 'fault' on Instance uuid c600912f-2506-4f19-b36d-69a508a27a3a {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:24:30.276352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:30.286669 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3053fb0d-5b23-47db-b888-9519aac9a5be tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 200 len: 1356 microversion: 2.1 time: 0.305580 Oct 12 09:24:30.287936 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2891/6214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:29 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 1356 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:30.364328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:30.374587 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d78a8cb-b10b-4894-ab80-c16d69d5a8c2 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1317 microversion: 2.1 time: 0.308943 Oct 12 09:24:30.390984 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3324/6215] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:30 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:31.315670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:31.316618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: c600912f-2506-4f19-b36d-69a508a27a3a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:31.324300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:31.325093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:31.325807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:31.327006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:31.327696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:31.328351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:31.345033 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] HTTP exception thrown: Instance c600912f-2506-4f19-b36d-69a508a27a3a could not be found. Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Request method failure captured: Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a HTTP/1.1 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoZHs9OCmMfgFTAW5s5TKsdNvhEgMjtY2IwEwqgbpTOZaYH47TuzA4aLKKIZjP7v1vTyD0z-vVJEQsWgm9Dai8u6XRn9LQsC_awu6eyynstyGA6XoG_eGwhigzCdK3govzbDJ2aaZBWwd1KZ8BMC0BzDT7FAVnW5PaHuxvLUJmgAZ4I Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 1c149b7c2f3345fb90935d70bbbb66c3 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c149b7c2f3345fb90935d70bbbb66c3"}]}] Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 1c149b7c2f3345fb90935d70bbbb66c3 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestNetworkAdvancedServerOps-1590050818-project Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 98e7287fdde34fe198d4f43acd3da903 Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1590050818-project Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance c600912f-2506-4f19-b36d-69a508a27a3a could not be found. Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'c600912f-2506-4f19-b36d-69a508a27a3a'} Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c600912f-2506-4f19-b36d-69a508a27a3a could not be found. Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c600912f-2506-4f19-b36d-69a508a27a3a could not be found. Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:31.347891 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:24:31.352582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:31.352582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:24:31.352582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:24:31.352582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:24:31.352582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:24:31.352582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:24:31.352582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c600912f-2506-4f19-b36d-69a508a27a3a could not be found. Oct 12 09:24:31.352582 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:24:31.355831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Returning 404 to user: Instance c600912f-2506-4f19-b36d-69a508a27a3a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:24:31.356988 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58d67d65-c4cd-437a-ba75-387029948750 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a" status: 404 len: 111 microversion: 2.1 time: 0.046402 Oct 12 09:24:31.358088 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2892/6216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:31 2022] GET /compute/v2.1/servers/c600912f-2506-4f19-b36d-69a508a27a3a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:24:31.399762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:31.401101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:31.433394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:31.434699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:31.440368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:31.445734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:31.446788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:31.447534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:32.306416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:32.319825 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79f9d62b-a9b5-4e4e-ae59-4ea0f4fbf5b6 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1317 microversion: 2.1 time: 0.923941 Oct 12 09:24:32.320439 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3325/6217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:31 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:33.030765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9fce65af-3e83-42e3-b88d-cb22c46873bc req-49e753e7-1ed5-4046-b163-4e2cbba94013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0896cd6a-3ab2-43c3-85fb-565254f1e8a9", "name": "network-vif-plugged", "status": "completed", "tag": "714b804c-f8ac-4eb6-88f6-f22764165dda"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:33.050792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9fce65af-3e83-42e3-b88d-cb22c46873bc req-49e753e7-1ed5-4046-b163-4e2cbba94013 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:33.051290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9fce65af-3e83-42e3-b88d-cb22c46873bc req-49e753e7-1ed5-4046-b163-4e2cbba94013 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:33.051734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9fce65af-3e83-42e3-b88d-cb22c46873bc req-49e753e7-1ed5-4046-b163-4e2cbba94013 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:33.071124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9fce65af-3e83-42e3-b88d-cb22c46873bc req-49e753e7-1ed5-4046-b163-4e2cbba94013 service nova] Creating event network-vif-plugged:714b804c-f8ac-4eb6-88f6-f22764165dda for instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 on n-h2-858383-10 Oct 12 09:24:33.083366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9fce65af-3e83-42e3-b88d-cb22c46873bc req-49e753e7-1ed5-4046-b163-4e2cbba94013 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056772 Oct 12 09:24:33.084204 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2893/6218] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:33.344784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:33.346255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:33.358000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:33.360162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:33.360646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:33.363360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:33.365079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:33.365580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:33.634699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:33.659868 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac8e8cc5-2a81-49e8-b210-848b13065f41 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1317 microversion: 2.1 time: 0.320176 Oct 12 09:24:33.660883 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3326/6219] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:33 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:34.685273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:34.688980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=8 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:34.721950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:34.726622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:34.775317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:34.778836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:34.779842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:34.819239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:34.819741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:34.820191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:35.157830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:35.168657 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac840f77-bdcc-424a-bf34-983fdc07e6c3 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.486439 Oct 12 09:24:35.169264 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2894/6220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:34 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:35.195392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50bf7de7-a0c2-4fa9-9970-ffb5270ff41d", "device": "/dev/sdb"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:35.207416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:35.219870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:35.224787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:35.225743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:35.226714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:35.227718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:35.228163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:35.715844 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6f0592b6-dc93-4bfc-bbf7-6b001ca2d202 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "POST /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.519079 Oct 12 09:24:35.722375 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3327/6221] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:24:35 2022] POST /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:38.688412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ab72659-9e0c-403d-8963-c9698179e24b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '.version_select at 0x7f9848856280>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:38.721339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:38.802984 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ab72659-9e0c-403d-8963-c9698179e24b tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-526017776" status: 202 len: 0 microversion: 2.1 time: 0.118771 Oct 12 09:24:38.806086 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2895/6222] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 12 09:24:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-526017776 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:24:38.840760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-52bb7dc1-04b3-49a7-9d4c-441f82918c99 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'create', calling method: .version_select at 0x7f9843aeaca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2029848655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgCh00DAppAKx3E2Rs4Bx2Au8WvbiaSC4j1ym0PjV/aMGXJEBl90ozmWyGMsHPExyUFOf4XZPJHoj0QtjWVOLONFnXMKDSVtcb+VXn0fvRZOkrqvHNzIu2ylNFlMmle0Q=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:38.854857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:38.889389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-52bb7dc1-04b3-49a7-9d4c-441f82918c99 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:24:38.899627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-52bb7dc1-04b3-49a7-9d4c-441f82918c99 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for user 98e7287fdde34fe198d4f43acd3da903 and project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:24:38.981125 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-52bb7dc1-04b3-49a7-9d4c-441f82918c99 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.146828 Oct 12 09:24:38.981876 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3328/6223] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:24:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:49.238024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-550840703", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "b329e007-c77e-4ff9-90d8-ae2eb88918e3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2029848655", "security_groups": [{"name": "tempest-secgroup-smoke-1177655582"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:49.266054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:49.471915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] validate_networks() for [('b329e007-c77e-4ff9-90d8-ae2eb88918e3', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:24:50.135653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:24:50.136764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:24:50.137504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:24:50.138133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:24:50.138780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:24:50.152755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:50.153431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:50.154092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:50.154821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:50.155272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:50.155970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:50.180586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:24:50.187088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Getting quotas for user 98e7287fdde34fe198d4f43acd3da903 and project 1c149b7c2f3345fb90935d70bbbb66c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:24:50.207075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:24:50.209544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:24:50.321669 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9a4240f2-7269-4262-8182-f614e3e7e8ef tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.087516 Oct 12 09:24:50.325548 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2896/6224] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:24:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:24:50.337475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:50.342661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:50.344661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:24:50.365555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f1d73d7-705e-45ba-9f92-e654e77bfd45 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:50.366470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9f1d73d7-705e-45ba-9f92-e654e77bfd45 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:50.575374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f1d73d7-705e-45ba-9f92-e654e77bfd45 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:50.599698 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f1d73d7-705e-45ba-9f92-e654e77bfd45 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1266 microversion: 2.1 time: 0.265461 Oct 12 09:24:50.602556 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3329/6225] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:50 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:51.629955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:51.631385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:51.642389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:51.643403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:51.644010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:51.645163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:51.646322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:51.646920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:51.753973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:51.763251 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4557cd0-73d1-49ca-a532-27f1d25c8f54 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1318 microversion: 2.1 time: 0.140074 Oct 12 09:24:51.763928 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2897/6226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:51 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:52.791745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:52.793095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:52.806897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:52.810840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:52.816948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:52.818653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:52.819136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:52.819738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:52.939470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:52.951628 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e847b8c2-1fef-42e2-8c93-d2ca120bd08a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1324 microversion: 2.1 time: 0.163682 Oct 12 09:24:52.952724 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3330/6227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:52 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:24:53.977988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:53.979466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:53.987297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:53.993324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:53.994097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:53.995095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:53.995780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:53.996281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:54.288435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:54.312859 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-216cfbfb-8292-4352-8b30-2cc13b43cd49 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1392 microversion: 2.1 time: 0.331394 Oct 12 09:24:54.330831 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2898/6228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:53 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1392 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:54.864261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-470bf956-48e7-4986-88c7-99dfd242a434 req-563b9072-1ebc-4668-ac98-00ba8fcfa049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b430d78b-5d2a-497b-a341-7405fc7b1327", "tag": "09eee585-1d30-46f1-b26b-01a85a0416c5"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:24:54.894613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-470bf956-48e7-4986-88c7-99dfd242a434 req-563b9072-1ebc-4668-ac98-00ba8fcfa049 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:54.895855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-470bf956-48e7-4986-88c7-99dfd242a434 req-563b9072-1ebc-4668-ac98-00ba8fcfa049 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:54.896305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-470bf956-48e7-4986-88c7-99dfd242a434 req-563b9072-1ebc-4668-ac98-00ba8fcfa049 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:54.914275 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-470bf956-48e7-4986-88c7-99dfd242a434 req-563b9072-1ebc-4668-ac98-00ba8fcfa049 service nova] Creating event network-changed:09eee585-1d30-46f1-b26b-01a85a0416c5 for instance b430d78b-5d2a-497b-a341-7405fc7b1327 on n-h1-858383-10 Oct 12 09:24:54.931928 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-470bf956-48e7-4986-88c7-99dfd242a434 req-563b9072-1ebc-4668-ac98-00ba8fcfa049 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079063 Oct 12 09:24:54.933660 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3331/6229] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:24:55.338990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:55.340599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:55.354352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:55.356150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:55.358853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:55.362975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:55.365225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:55.365975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:56.064922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:56.074035 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c59f2367-5059-47b8-b3c6-ae75b930bec4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1392 microversion: 2.1 time: 0.739623 Oct 12 09:24:56.086046 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2899/6230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:55 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1392 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:57.103708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:57.105124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:57.133156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:57.136347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:57.136806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:57.137590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:57.138505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:57.138905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:57.368102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:57.378429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c93bd7ad-2748-4bea-ade9-7064441098bd tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1392 microversion: 2.1 time: 0.281040 Oct 12 09:24:57.394203 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3332/6231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:57 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1392 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:58.406976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:58.411079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:58.428036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:58.428036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:58.428036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:58.428681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:58.435458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:58.436226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:58.697969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:58.721424 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8ae0d0b5-b715-414c-a873-0a982623b5b2 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1392 microversion: 2.1 time: 0.319315 Oct 12 09:24:58.746547 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2900/6232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:58 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:24:59.751051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:24:59.751759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:24:59.760039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:59.760570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:59.761066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:59.761879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:24:59.762408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:24:59.762879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:24:59.951393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:24:59.960473 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c0009195-4fce-4b25-ad78-024a3033bfc4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1392 microversion: 2.1 time: 0.213710 Oct 12 09:24:59.962060 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3333/6233] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:24:59 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:00.743141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-07d4885e-8cda-4da8-ad1a-792d1605819f req-b74885f9-35f5-4b6b-a88b-25755ea1862d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b430d78b-5d2a-497b-a341-7405fc7b1327", "name": "network-vif-plugged", "status": "completed", "tag": "09eee585-1d30-46f1-b26b-01a85a0416c5"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:25:00.764874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:00.767018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:00.774198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-07d4885e-8cda-4da8-ad1a-792d1605819f req-b74885f9-35f5-4b6b-a88b-25755ea1862d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:00.775457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-07d4885e-8cda-4da8-ad1a-792d1605819f req-b74885f9-35f5-4b6b-a88b-25755ea1862d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:00.778066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-07d4885e-8cda-4da8-ad1a-792d1605819f req-b74885f9-35f5-4b6b-a88b-25755ea1862d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:00.799396 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-07d4885e-8cda-4da8-ad1a-792d1605819f req-b74885f9-35f5-4b6b-a88b-25755ea1862d service nova] Creating event network-vif-plugged:09eee585-1d30-46f1-b26b-01a85a0416c5 for instance b430d78b-5d2a-497b-a341-7405fc7b1327 on n-h1-858383-10 Oct 12 09:25:00.807307 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-07d4885e-8cda-4da8-ad1a-792d1605819f req-b74885f9-35f5-4b6b-a88b-25755ea1862d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073590 Oct 12 09:25:00.808334 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2901/6234] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:25:00.985228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:00.985866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:00.994476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:00.999536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:01.000042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:01.000480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:01.002412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:01.003377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:01.003880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:01.199398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:01.224905 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a30fdfe-b340-4129-b39f-6d7a529d652c tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1392 microversion: 2.1 time: 0.239820 Oct 12 09:25:01.226165 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3334/6235] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:00 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:02.254276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:02.256573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:02.271255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:02.272150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:02.272855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:02.273958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:02.274626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:02.275291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:02.480565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:02.494987 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ced82b4-ce29-4277-a879-13d9b7413dbe tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1564 microversion: 2.1 time: 0.246562 Oct 12 09:25:02.496289 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2902/6236] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:02 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1564 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:02.518165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:02.519371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:02.526647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:02.527403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:02.528053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:02.528945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:02.529624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:02.530251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:02.710251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:02.719901 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d64be2f9-c3f2-4720-ab64-d63ea39fe478 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1564 microversion: 2.1 time: 0.205484 Oct 12 09:25:02.720507 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3335/6237] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:02 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1564 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:04.231750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:04.232341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:04.258336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:04.259897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:04.262418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:04.263214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:04.266099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:04.268359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:04.391529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lazy-loading 'services' on Instance uuid 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:25:04.509109 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6924401d-8b00-4085-8b87-5f3436e21a3e tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9/os-volume_attachments/50bf7de7-a0c2-4fa9-9970-ffb5270ff41d" status: 202 len: 0 microversion: 2.1 time: 0.280608 Oct 12 09:25:04.526689 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2903/6238] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:25:04 2022] DELETE /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9/os-volume_attachments/50bf7de7-a0c2-4fa9-9970-ffb5270ff41d => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:25:05.021867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:05.022485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:05.028574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d81e980e-5a93-4f9d-affa-1421f9b58566 req-c8e4ce07-efd2-4b29-ab9e-484e941849c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b430d78b-5d2a-497b-a341-7405fc7b1327", "tag": "09eee585-1d30-46f1-b26b-01a85a0416c5"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:25:05.040267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:05.040756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:05.041192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:05.050558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:05.051746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:05.054103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:05.081494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d81e980e-5a93-4f9d-affa-1421f9b58566 req-c8e4ce07-efd2-4b29-ab9e-484e941849c9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:05.086436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d81e980e-5a93-4f9d-affa-1421f9b58566 req-c8e4ce07-efd2-4b29-ab9e-484e941849c9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:05.090757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d81e980e-5a93-4f9d-affa-1421f9b58566 req-c8e4ce07-efd2-4b29-ab9e-484e941849c9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:05.137423 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d81e980e-5a93-4f9d-affa-1421f9b58566 req-c8e4ce07-efd2-4b29-ab9e-484e941849c9 service nova] Creating event network-changed:09eee585-1d30-46f1-b26b-01a85a0416c5 for instance b430d78b-5d2a-497b-a341-7405fc7b1327 on n-h1-858383-10 Oct 12 09:25:05.153961 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d81e980e-5a93-4f9d-affa-1421f9b58566 req-c8e4ce07-efd2-4b29-ab9e-484e941849c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129627 Oct 12 09:25:05.154901 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2904/6239] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:25:05.296701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:05.309710 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-77cc9136-9b2b-4b99-ba16-30c0f14ed345 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1564 microversion: 2.1 time: 0.291676 Oct 12 09:25:05.313698 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3336/6240] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:05 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1564 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:11.158303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:11.170017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:11.177607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:11.178297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:11.179001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:11.179712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:11.180168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:11.180714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:11.207340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:25:11.308055 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3dd67b08-ec6d-4e7f-8ae5-1f2246740d4c tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 204 len: 0 microversion: 2.1 time: 0.154176 Oct 12 09:25:11.309145 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2905/6241] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:25:11 2022] DELETE /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:25:11.317709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:11.318633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:11.327213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:11.327703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:11.328339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:11.329066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:11.329544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:11.329972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:11.512834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:11.531369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac1f9d71-cbc3-4580-8910-dc9e591a252d tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1513 microversion: 2.1 time: 0.217859 Oct 12 09:25:11.532231 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3337/6242] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:11 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:25:12.555878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:12.556577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:12.574568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:12.575058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:12.575608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:12.576330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:12.576782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:12.577265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:12.713939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:12.722076 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad7ff7d6-a121-44e8-ba17-c6f60fbb27d7 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1513 microversion: 2.1 time: 0.170628 Oct 12 09:25:12.723134 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2906/6243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:12 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:13.559600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0b11809b-b3f1-45dd-9acc-cc15084dd515 req-1d75fa85-a338-4226-b160-d8195105f71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0896cd6a-3ab2-43c3-85fb-565254f1e8a9", "name": "network-vif-deleted", "tag": "714b804c-f8ac-4eb6-88f6-f22764165dda"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:25:13.583801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0b11809b-b3f1-45dd-9acc-cc15084dd515 req-1d75fa85-a338-4226-b160-d8195105f71d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:13.584630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0b11809b-b3f1-45dd-9acc-cc15084dd515 req-1d75fa85-a338-4226-b160-d8195105f71d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:13.585663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0b11809b-b3f1-45dd-9acc-cc15084dd515 req-1d75fa85-a338-4226-b160-d8195105f71d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:13.604533 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0b11809b-b3f1-45dd-9acc-cc15084dd515 req-1d75fa85-a338-4226-b160-d8195105f71d service nova] Creating event network-vif-deleted:714b804c-f8ac-4eb6-88f6-f22764165dda for instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 on n-h2-858383-10 Oct 12 09:25:13.611112 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0b11809b-b3f1-45dd-9acc-cc15084dd515 req-1d75fa85-a338-4226-b160-d8195105f71d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059205 Oct 12 09:25:13.616071 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3338/6244] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:25:13.746909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:13.747942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:13.756517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:13.757132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:13.757854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:13.758868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:13.759554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:13.760197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:13.812726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:13.813221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:13.813694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:13.814151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lazy-loading 'fault' on Instance uuid 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:25:13.866153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '506e0f8369d84d4abe82bc00f9928e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd07246242946faa59f545c56224da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:13.875563 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f203d438-dcf0-43e1-a69b-39b194ccf250 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 200 len: 1307 microversion: 2.1 time: 0.134164 Oct 12 09:25:13.876333 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2907/6245] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:13 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:14.901016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:14.902473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] [instance: 0896cd6a-3ab2-43c3-85fb-565254f1e8a9] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:14.911128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:14.911969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:14.912476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:14.913301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:14.913870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:14.914361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:14.929944 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] HTTP exception thrown: Instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 could not be found. Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Request method failure captured: Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 HTTP/1.1 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRocs-XxSiiSYZhFfAcrK9pvm_m7a-JQ2lYlWO0bqfhhwpiUZLc77axgYFXtL_XS4jjxT2uPjjDN-HU0KYGUMj8reIp4_Ulf52rfqSpcYlHT5pc5BUGKg4xkAR9Ed2UXdNWquJ1h26segGWpPpQtgjUtWpGyYVglvRo5RrCL4e9C87rY Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: acd07246242946faa59f545c56224da3 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-VolumesSnapshotTestJSON-595442432 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acd07246242946faa59f545c56224da3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/acd07246242946faa59f545c56224da3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_acd07246242946faa59f545c56224da3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acd07246242946faa59f545c56224da3"}]}] Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-VolumesSnapshotTestJSON-595442432 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: acd07246242946faa59f545c56224da3 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-595442432 Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-VolumesSnapshotTestJSON-595442432-project Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 506e0f8369d84d4abe82bc00f9928e0f Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-VolumesSnapshotTestJSON-595442432-project Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 could not be found. Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '0896cd6a-3ab2-43c3-85fb-565254f1e8a9'} Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 could not be found. Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 could not be found. Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:25:14.931931 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 could not be found. Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] Returning 404 to user: Instance 0896cd6a-3ab2-43c3-85fb-565254f1e8a9 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:25:14.936803 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9b7d622a-ff61-493f-93e7-1b7f36578e01 tempest-VolumesSnapshotTestJSON-595442432 tempest-VolumesSnapshotTestJSON-595442432-project] 10.222.0.40 "GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9" status: 404 len: 111 microversion: 2.1 time: 0.037060 Oct 12 09:25:14.938004 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3339/6246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:14 2022] GET /compute/v2.1/servers/0896cd6a-3ab2-43c3-85fb-565254f1e8a9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:25:29.784025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:25:29.786954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:29.790579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:29.791435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:29.798315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:29.799035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:29.799472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:29.800439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:29.801093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:29.802357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:29.875503 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f0eacec0-1931-451a-aea8-86d891867de4 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327/action" status: 200 len: 24572 microversion: 2.1 time: 0.095613 Oct 12 09:25:29.877285 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2908/6247] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:25:29 2022] POST /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327/action => generated 24572 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:25:40.933522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3816cc90-eecd-445f-9498-be8ec212c308"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:25:40.937008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:40.967146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=24 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:40.967925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=48 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:40.977247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:40.978306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:40.979298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:40.980801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:40.983842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:40.984405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:41.126441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:25:41.133938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:25:41.134606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:25:41.135197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:25:41.135792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:25:41.321192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:41.328074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:41.328581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:41.329028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:41.329770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:41.330235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:41.330659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:41.395376 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9bb3d68a-c175-4592-979c-e8b7aed8625a tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327/action" status: 202 len: 1135 microversion: 2.1 time: 0.474125 Oct 12 09:25:41.398022 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3340/6248] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:25:40 2022] POST /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327/action => generated 1135 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 12 09:25:41.419091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:41.420683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:41.427189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:41.428339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:25:41.431039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:41.433682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:41.433682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:41.433682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:41.433682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:41.437249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:41.676088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:41.711127 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-09565d1b-8ec4-4cba-9469-7ea66067b89f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.292638 Oct 12 09:25:41.711858 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2909/6249] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:41 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:25:42.736463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:42.737722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:42.752092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:42.752766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:42.753377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:42.754287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:42.754942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:42.755640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:42.945343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:42.956942 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78af58bc-5968-449d-b4fa-2f18d1cbc902 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.224201 Oct 12 09:25:42.961544 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3341/6250] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:42 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:43.982251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:43.982864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:43.991010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:43.991512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:43.991968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:43.992702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:43.993222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:43.993613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:44.161153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:44.193209 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a6eddf6a-e514-4f54-83f4-740c9da7ca21 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.214988 Oct 12 09:25:44.195949 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2910/6251] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:43 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:45.220477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:45.221946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:45.229950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:45.230849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:45.231523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:45.232566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:45.235901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:45.238297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:45.434775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:45.443594 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb41d9a3-ecee-4e7c-bf0d-888e7af00eca tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.227165 Oct 12 09:25:45.444763 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3342/6252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:45 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:46.473161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:46.474486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:46.492717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:46.493561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:46.494642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:46.495479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:46.496486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:46.497021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:46.693551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:46.702953 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8a48046-aaf1-4e64-aa09-5b9abd441900 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.237187 Oct 12 09:25:46.704934 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2911/6253] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:46 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:47.728536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:47.729060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:47.736355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:47.737051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:47.737697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:47.739344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:47.739982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:47.740588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:48.021490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:48.029818 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0cf4030-f8a3-4bda-bc7d-0e8340b9d588 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.305227 Oct 12 09:25:48.031108 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3343/6254] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:47 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:49.069344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:49.073907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:49.087231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:49.087836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:49.088348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:49.089132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:49.090219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:49.090732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:49.255125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:49.267043 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71ad36cc-f376-4fbc-9be2-a5da6d298c6f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.201557 Oct 12 09:25:49.268924 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2912/6255] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:49 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:50.297115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:50.299705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:50.307922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:50.308677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:50.309294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:50.310263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:50.310896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:50.311486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:50.467598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:50.477212 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3d0c4ef5-2b98-49f2-b26d-65f7d8c6de76 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.187773 Oct 12 09:25:50.481405 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3344/6256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:50 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:51.503395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:51.511864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:51.523658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:51.524967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:51.526305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:51.527937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:51.528770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:51.529539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:51.745588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:51.760501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-60d153a1-dc2b-40f3-9e55-219216ca6a66 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.263661 Oct 12 09:25:51.761081 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2913/6257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:51 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:52.789878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:52.791200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:52.806657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:52.807417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:52.811291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:52.812201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:52.812838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:52.813494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:52.996350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:53.007315 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2fb4af04-b657-44aa-a8c0-40ebd747ba3d tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.223549 Oct 12 09:25:53.007315 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3345/6258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:52 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:54.029575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:54.030138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:54.039560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:54.040279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:54.040886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:54.041931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:54.042378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:54.042985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:54.312854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:54.322768 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c5bf0ef-8441-4f5d-bb36-1f5f0d94a079 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.297159 Oct 12 09:25:54.323880 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2914/6259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:54 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:55.352516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:55.354396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:55.363032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:55.363966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:55.364793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:55.365729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:55.366357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:55.366959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:55.529389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:55.548679 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c43dd17c-2126-448b-872c-50e778f176d7 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.201352 Oct 12 09:25:55.550022 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3346/6260] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:55 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:56.579309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:56.579934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:56.596912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:56.597629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:56.598224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:56.599328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:56.599940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:56.600535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:56.803641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:56.816329 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71b06d20-c61a-4a7c-b707-6d0da3e6fbde tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.240863 Oct 12 09:25:56.817161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2915/6261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:56 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:57.840999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:57.841772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:57.849878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:57.850409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:57.850952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:57.851682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:57.852128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:57.852563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:58.044283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:58.053456 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-37fd119d-5395-44bc-96c0-6b646b93fe72 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1690 microversion: 2.1 time: 0.216914 Oct 12 09:25:58.066185 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3347/6262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:57 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1690 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:25:59.078293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:25:59.078910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:25:59.086189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:59.086917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:59.087594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:59.088477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:25:59.089093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:25:59.089711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:25:59.247236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:25:59.256397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a8b39cb-8e9b-475d-944a-cd0e9b0e4fa8 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1696 microversion: 2.1 time: 0.182120 Oct 12 09:25:59.257143 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2916/6263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:25:59 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:26:00.280498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:26:00.281117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:26:00.297353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:00.310215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:00.310866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:00.311797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:00.312427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:00.313335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:00.542516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:26:00.551256 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2633ea6b-416d-45c9-bb16-6623a15ce6ed tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1696 microversion: 2.1 time: 0.274818 Oct 12 09:26:00.565993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3348/6264] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:26:00 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1696 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:26:01.095200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1310c05c-05e6-4bfd-a972-d63f6f187147 req-fbf72722-a3c3-4f33-881d-93ab98e68052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b430d78b-5d2a-497b-a341-7405fc7b1327", "name": "network-vif-unplugged", "status": "completed", "tag": "09eee585-1d30-46f1-b26b-01a85a0416c5"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:01.141826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1310c05c-05e6-4bfd-a972-d63f6f187147 req-fbf72722-a3c3-4f33-881d-93ab98e68052 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:01.144454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1310c05c-05e6-4bfd-a972-d63f6f187147 req-fbf72722-a3c3-4f33-881d-93ab98e68052 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:01.147615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1310c05c-05e6-4bfd-a972-d63f6f187147 req-fbf72722-a3c3-4f33-881d-93ab98e68052 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:01.175846 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1310c05c-05e6-4bfd-a972-d63f6f187147 req-fbf72722-a3c3-4f33-881d-93ab98e68052 service nova] Creating event network-vif-unplugged:09eee585-1d30-46f1-b26b-01a85a0416c5 for instance b430d78b-5d2a-497b-a341-7405fc7b1327 on n-h1-858383-10 Oct 12 09:26:01.200268 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1310c05c-05e6-4bfd-a972-d63f6f187147 req-fbf72722-a3c3-4f33-881d-93ab98e68052 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106677 Oct 12 09:26:01.201134 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2917/6265] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:26:01.577659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:26:01.578379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:26:01.594467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:01.595833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:01.599185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:01.599985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:01.602139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:01.602595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:01.829298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:26:01.845994 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c4a77b20-5c49-4e58-bd0d-acdc2d01e6f3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1681 microversion: 2.1 time: 0.273118 Oct 12 09:26:01.846864 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3349/6266] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:26:01 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1681 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:26:05.006536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-170c5886-cc2f-4e5e-b359-17a77a376eec req-8e9a28be-f8bb-4eb7-9d02-08a361f47779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b430d78b-5d2a-497b-a341-7405fc7b1327", "name": "network-vif-plugged", "status": "completed", "tag": "09eee585-1d30-46f1-b26b-01a85a0416c5"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:05.026652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-170c5886-cc2f-4e5e-b359-17a77a376eec req-8e9a28be-f8bb-4eb7-9d02-08a361f47779 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:05.027084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-170c5886-cc2f-4e5e-b359-17a77a376eec req-8e9a28be-f8bb-4eb7-9d02-08a361f47779 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:05.027564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-170c5886-cc2f-4e5e-b359-17a77a376eec req-8e9a28be-f8bb-4eb7-9d02-08a361f47779 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:05.040030 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-170c5886-cc2f-4e5e-b359-17a77a376eec req-8e9a28be-f8bb-4eb7-9d02-08a361f47779 service nova] Creating event network-vif-plugged:09eee585-1d30-46f1-b26b-01a85a0416c5 for instance b430d78b-5d2a-497b-a341-7405fc7b1327 on n-h1-858383-10 Oct 12 09:26:05.049686 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-170c5886-cc2f-4e5e-b359-17a77a376eec req-8e9a28be-f8bb-4eb7-9d02-08a361f47779 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047749 Oct 12 09:26:05.051203 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2918/6267] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:26:28.079836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:28.083042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:26:28.088460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=24 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:28.089696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:28.091694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:28.092769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:28.093286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:28.093954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:28.094716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:28.095192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:28.152271 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f4785b7-b43c-44c6-97e2-2a0234d5243f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "POST /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327/action" status: 200 len: 24565 microversion: 2.1 time: 0.077183 Oct 12 09:26:28.153279 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3350/6268] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:26:28 2022] POST /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327/action => generated 24565 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:26:40.400103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:26:40.406677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2ddac40b-98ed-4aa5-9059-889e52341941 req-3b5df834-07eb-408c-9dab-ddc4203a36d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b430d78b-5d2a-497b-a341-7405fc7b1327", "tag": "09eee585-1d30-46f1-b26b-01a85a0416c5"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:40.412459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:26:40.424438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=20 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:40.426278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=52 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:40.431668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:40.434480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:40.436185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:40.437361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:40.438104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:40.438683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2ddac40b-98ed-4aa5-9059-889e52341941 req-3b5df834-07eb-408c-9dab-ddc4203a36d4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:40.439184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2ddac40b-98ed-4aa5-9059-889e52341941 req-3b5df834-07eb-408c-9dab-ddc4203a36d4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:40.439595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:40.439720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2ddac40b-98ed-4aa5-9059-889e52341941 req-3b5df834-07eb-408c-9dab-ddc4203a36d4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:40.440433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:40.441125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:40.464918 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-2ddac40b-98ed-4aa5-9059-889e52341941 req-3b5df834-07eb-408c-9dab-ddc4203a36d4 service nova] Creating event network-changed:09eee585-1d30-46f1-b26b-01a85a0416c5 for instance b430d78b-5d2a-497b-a341-7405fc7b1327 on n-h1-858383-10 Oct 12 09:26:40.476341 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2ddac40b-98ed-4aa5-9059-889e52341941 req-3b5df834-07eb-408c-9dab-ddc4203a36d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068638 Oct 12 09:26:40.478640 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3351/6269] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:26:40.481011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:26:40.615411 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d9229a4-4f09-4f82-a0a9-6e78cccdb864 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 204 len: 0 microversion: 2.1 time: 0.217599 Oct 12 09:26:40.621235 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2919/6270] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:26:40 2022] DELETE /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:26:40.643363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:26:40.644823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:26:40.667481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:40.668203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:40.669285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:40.672324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:40.672922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:40.674024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:41.362216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:26:41.373485 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7618dd7b-3ac6-4008-bff9-d27e5305a449 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1687 microversion: 2.1 time: 0.742767 Oct 12 09:26:41.376452 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3352/6271] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:26:40 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1687 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:26:42.401978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:26:42.404148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:26:42.415154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:42.421291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:42.422238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:42.423717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:42.424812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:42.425803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:42.640824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e7287fdde34fe198d4f43acd3da903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c149b7c2f3345fb90935d70bbbb66c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:26:42.652072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad647102-9d78-4b90-a3b6-5f71708b270f tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 200 len: 1502 microversion: 2.1 time: 0.255898 Oct 12 09:26:42.669608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-11db2942-56fa-49d2-b5b7-0e613c9a83ae req-8835d6f6-87c7-403c-9d4d-a91b2e70c4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b430d78b-5d2a-497b-a341-7405fc7b1327", "name": "network-vif-deleted", "tag": "09eee585-1d30-46f1-b26b-01a85a0416c5"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:42.673610 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2920/6272] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:26:42 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:26:42.683024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-11db2942-56fa-49d2-b5b7-0e613c9a83ae req-8835d6f6-87c7-403c-9d4d-a91b2e70c4ec service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:42.683512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-11db2942-56fa-49d2-b5b7-0e613c9a83ae req-8835d6f6-87c7-403c-9d4d-a91b2e70c4ec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:42.683951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-11db2942-56fa-49d2-b5b7-0e613c9a83ae req-8835d6f6-87c7-403c-9d4d-a91b2e70c4ec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:42.696694 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-11db2942-56fa-49d2-b5b7-0e613c9a83ae req-8835d6f6-87c7-403c-9d4d-a91b2e70c4ec service nova] Creating event network-vif-deleted:09eee585-1d30-46f1-b26b-01a85a0416c5 for instance b430d78b-5d2a-497b-a341-7405fc7b1327 on n-h1-858383-10 Oct 12 09:26:42.702691 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-11db2942-56fa-49d2-b5b7-0e613c9a83ae req-8835d6f6-87c7-403c-9d4d-a91b2e70c4ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042098 Oct 12 09:26:42.706617 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3353/6273] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:26:43.677886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:26:43.681703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] [instance: b430d78b-5d2a-497b-a341-7405fc7b1327] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:26:43.689185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:43.689701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:43.690138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:43.691515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:43.693080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:43.693558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:43.721942 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] HTTP exception thrown: Instance b430d78b-5d2a-497b-a341-7405fc7b1327 could not be found. Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Request method failure captured: Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 HTTP/1.1 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRoZHs9OCmMfgFTAW5s5TKsdNvhEgMjtY2IwEwqgbpTOZaYH47TuzA4aLKKIZjP7v1vTyD0z-vVJEQsWgm9Dai8u6XRn9LQsC_awu6eyynstyGA6XoG_eGwhigzCdK3govzbDJ2aaZBWwd1KZ8BMC0BzDT7FAVnW5PaHuxvLUJmgAZ4I Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 1c149b7c2f3345fb90935d70bbbb66c3 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1c149b7c2f3345fb90935d70bbbb66c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1c149b7c2f3345fb90935d70bbbb66c3"}]}] Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 1c149b7c2f3345fb90935d70bbbb66c3 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1590050818 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestNetworkAdvancedServerOps-1590050818-project Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 98e7287fdde34fe198d4f43acd3da903 Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1590050818-project Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance b430d78b-5d2a-497b-a341-7405fc7b1327 could not be found. Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'b430d78b-5d2a-497b-a341-7405fc7b1327'} Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b430d78b-5d2a-497b-a341-7405fc7b1327 could not be found. Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b430d78b-5d2a-497b-a341-7405fc7b1327 could not be found. Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:26:43.723901 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:26:43.729509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:26:43.729509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:26:43.729509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:26:43.729509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:26:43.729509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:26:43.729509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:26:43.729509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b430d78b-5d2a-497b-a341-7405fc7b1327 could not be found. Oct 12 09:26:43.729509 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:26:43.731043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Returning 404 to user: Instance b430d78b-5d2a-497b-a341-7405fc7b1327 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:26:43.732573 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45c18544-02bc-434a-86f8-e69f8c8c2e88 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327" status: 404 len: 111 microversion: 2.1 time: 0.058625 Oct 12 09:26:43.733679 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2921/6274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:26:43 2022] GET /compute/v2.1/servers/b430d78b-5d2a-497b-a341-7405fc7b1327 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:26:47.706101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3362dabb-1860-4600-9f2e-d2a0d54648a3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] Calling method '.version_select at 0x7f9843da3d30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:26:47.775097 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3362dabb-1860-4600-9f2e-d2a0d54648a3 tempest-TestNetworkAdvancedServerOps-1590050818 tempest-TestNetworkAdvancedServerOps-1590050818-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2029848655" status: 202 len: 0 microversion: 2.1 time: 0.075219 Oct 12 09:26:47.775787 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3354/6275] 10.222.0.40 () {58 vars in 1284 bytes} [Wed Oct 12 09:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2029848655 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:26:57.538400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88a5423a-9f02-47c5-b50e-65106abcd449 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Action: 'create', calling method: .version_select at 0x7f9848c87310>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1412743747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5dmghWHLmBzcwW6IkwpVTAdctNPzu7eC2k75DgeAk8ABA6rziz/eGdx7EzS0tqsoYnlH4yZVUunqSNkmtEyb0tjN8VbOlGU0pwclyY9JPnXE5HYEG3LzpwGhelAUK5lg=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:57.551265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:57.551945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:57.566445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-88a5423a-9f02-47c5-b50e-65106abcd449 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Getting quotas for project 976871df032c4a1abd4e7f1dd7cc1fca. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:26:57.579982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-88a5423a-9f02-47c5-b50e-65106abcd449 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Getting quotas for user 8f337d8dcd794de9a371e5ad2799e8ea and project 976871df032c4a1abd4e7f1dd7cc1fca. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:26:57.617915 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-88a5423a-9f02-47c5-b50e-65106abcd449 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.086548 Oct 12 09:26:57.619806 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2922/6276] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:26:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:26:57.745323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7681504-a0ef-469b-ae39-91e4d6bfc351 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'create', calling method: .version_select at 0x7f9843e2a3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1859728364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNmmKute5Od6bfTjYSCdaF3s1PTB7NpN0/nSCAD+huco1Zc3rtQM6R+uewfQGnhOTWThV/ajzCp4lldbiL6fozpec9aAB0xyIiCBk5k9NV6bYnhxmr0+SRsm7fCXaR0Zg=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:57.764519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=10 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:26:57.778161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e7681504-a0ef-469b-ae39-91e4d6bfc351 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:26:57.784630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e7681504-a0ef-469b-ae39-91e4d6bfc351 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for user 562d9e9e0bdf46b0ab865ed565f8d7cb and project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:26:57.813538 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7681504-a0ef-469b-ae39-91e4d6bfc351 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.073694 Oct 12 09:26:57.814717 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3355/6277] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:26:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:26:59.236201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1329848100", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "70a53181-f624-445f-8db9-ecce73e05746", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1412743747", "security_groups": [{"name": "tempest-secgroup-smoke-2119740842"}], "networks": [{"uuid": "6898766c-eaa8-4158-8d4e-f22f6551626f"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:59.412740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] validate_networks() for [('6898766c-eaa8-4158-8d4e-f22f6551626f', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:26:59.433032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1618741647", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "d294243f-3094-47f2-ba21-cb59f1d1126a"}], "key_name": "tempest-TestNetworkBasicOps-1859728364", "security_groups": [{"name": "tempest-secgroup-smoke-1632280620"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:26:59.595280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] validate_networks() for [('d294243f-3094-47f2-ba21-cb59f1d1126a', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:26:59.898941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:26:59.901110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:26:59.901675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:26:59.902306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:26:59.902814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:26:59.912673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:59.913514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:59.914199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:59.915181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:26:59.921298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:26:59.922125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:26:59.942170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Getting quotas for project 976871df032c4a1abd4e7f1dd7cc1fca. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:26:59.948566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Getting quotas for user 8f337d8dcd794de9a371e5ad2799e8ea and project 976871df032c4a1abd4e7f1dd7cc1fca. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:27:00.037618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:27:00.039793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70a53181-f624-445f-8db9-ecce73e05746',volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:27:00.151315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:27:00.151741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:27:00.152226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:27:00.152643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:27:00.153319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:27:00.166083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:00.166974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:00.167733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:00.168737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:00.170086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:00.170909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:00.191758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:27:00.198686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for user 562d9e9e0bdf46b0ab865ed565f8d7cb and project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:27:00.219529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:27:00.222201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:27:00.301123 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-344a8f5f-9f6e-473a-a593-bd6a2c08e65a tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.069321 Oct 12 09:27:00.304021 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2923/6278] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:26:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:27:00.315572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a0c9c6df-bb0a-406f-875a-2ad4a5f00f16 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:00.316524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a0c9c6df-bb0a-406f-875a-2ad4a5f00f16 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:00.349989 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4f85c7d0-8904-4897-aace-b7085838d87b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.919121 Oct 12 09:27:00.350722 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3356/6279] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:26:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:27:00.376588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bbe84b2b-9bd4-430f-b50b-17ac8cd880aa tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:00.377238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bbe84b2b-9bd4-430f-b50b-17ac8cd880aa tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:00.513259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bbe84b2b-9bd4-430f-b50b-17ac8cd880aa tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:00.522825 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bbe84b2b-9bd4-430f-b50b-17ac8cd880aa tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1249 microversion: 2.1 time: 0.163369 Oct 12 09:27:00.523382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a0c9c6df-bb0a-406f-875a-2ad4a5f00f16 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:00.530636 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a0c9c6df-bb0a-406f-875a-2ad4a5f00f16 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1099 microversion: 2.1 time: 0.219078 Oct 12 09:27:00.541193 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3357/6280] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:00 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1249 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:27:00.545616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2924/6281] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:00 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1099 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:01.550682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:01.551384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:01.556316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4c86898e-6c5a-4f83-81b8-e553b3c22bcf tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:01.558225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4c86898e-6c5a-4f83-81b8-e553b3c22bcf tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:01.560982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:01.561756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:01.562129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:01.562970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:01.563517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:01.563991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:01.621274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4c86898e-6c5a-4f83-81b8-e553b3c22bcf tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:01.641712 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4c86898e-6c5a-4f83-81b8-e553b3c22bcf tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1099 microversion: 2.1 time: 0.091498 Oct 12 09:27:01.642244 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2925/6282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:01 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1099 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:01.644941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:01.653399 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47c0181d-f1be-470f-8c9c-c6fbafecf9c7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1301 microversion: 2.1 time: 0.107021 Oct 12 09:27:01.654016 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3358/6283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:01 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:02.675125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88930ea9-90e7-450d-8906-6b99e650b086 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:02.676580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-88930ea9-90e7-450d-8906-6b99e650b086 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:02.679085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:02.679710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:02.690746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:02.694150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:02.694815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:02.695770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:02.696976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:02.699845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:02.768495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-88930ea9-90e7-450d-8906-6b99e650b086 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:02.776490 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-88930ea9-90e7-450d-8906-6b99e650b086 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1099 microversion: 2.1 time: 0.107439 Oct 12 09:27:02.777413 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2926/6284] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:02 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1099 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:02.900977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:02.910196 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6bd8d39-5450-427b-9891-1f7a2dfcf22b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1375 microversion: 2.1 time: 0.235029 Oct 12 09:27:02.910806 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3359/6285] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:02 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1375 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:03.592585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3fdc94e8-a3a8-4f53-bd69-82246bfc9b57 req-8a3a5716-2362-436f-8b12-d0b830e8243f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a878180a-8a71-4b1b-a96b-a6c9b59c0f81", "tag": "cc427d41-cc9d-48b2-838d-87427ae571f1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:03.604271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3fdc94e8-a3a8-4f53-bd69-82246bfc9b57 req-8a3a5716-2362-436f-8b12-d0b830e8243f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:03.605058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3fdc94e8-a3a8-4f53-bd69-82246bfc9b57 req-8a3a5716-2362-436f-8b12-d0b830e8243f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:03.605763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3fdc94e8-a3a8-4f53-bd69-82246bfc9b57 req-8a3a5716-2362-436f-8b12-d0b830e8243f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:03.618544 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3fdc94e8-a3a8-4f53-bd69-82246bfc9b57 req-8a3a5716-2362-436f-8b12-d0b830e8243f service nova] Creating event network-changed:cc427d41-cc9d-48b2-838d-87427ae571f1 for instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 on n-h2-858383-10 Oct 12 09:27:03.624368 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3fdc94e8-a3a8-4f53-bd69-82246bfc9b57 req-8a3a5716-2362-436f-8b12-d0b830e8243f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038438 Oct 12 09:27:03.625633 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2927/6286] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:27:03.804301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2871d311-304f-49d5-b8a4-c96359dfe2f1 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:03.805895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2871d311-304f-49d5-b8a4-c96359dfe2f1 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:03.895425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2871d311-304f-49d5-b8a4-c96359dfe2f1 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:03.909039 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2871d311-304f-49d5-b8a4-c96359dfe2f1 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1099 microversion: 2.1 time: 0.110384 Oct 12 09:27:03.909927 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3360/6287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:03 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1099 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:03.939124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:03.940343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:03.952137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:03.954662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:03.956230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:03.957633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:03.958142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:03.958656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:04.281696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:04.298403 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7d4fafd3-8357-44fd-9b7e-a0f9c3d9efb4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1375 microversion: 2.1 time: 0.366999 Oct 12 09:27:04.299235 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2928/6288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:03 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1375 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:04.932389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:04.933012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:04.940265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:04.940766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:04.941209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:04.941953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:04.942408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:04.942839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:05.020326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:05.031071 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e1db06d8-df24-4400-a3ab-0100b8f349a3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1149 microversion: 2.1 time: 0.102740 Oct 12 09:27:05.031752 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3361/6289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:04 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1149 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:05.332007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:05.332563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:05.340271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:05.341150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:05.342471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:05.343263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:05.343725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:05.344413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:05.603851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:05.615398 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5c8a0946-9649-4575-b52f-1515f6506090 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1375 microversion: 2.1 time: 0.293806 Oct 12 09:27:05.639410 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2929/6290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:05 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1375 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:06.056650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:06.067589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:06.085035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:06.085791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:06.086490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:06.088455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:06.088945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:06.089389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:06.191936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:06.206365 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3c65dff-3a39-44aa-9f78-8807de4559bb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1215 microversion: 2.1 time: 0.154675 Oct 12 09:27:06.207015 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3362/6291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:06 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:06.646813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:06.647535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:06.654720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:06.655205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:06.655889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:06.656618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:06.657246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:06.658749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:06.830633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:06.840196 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2a207ee7-5638-4e82-b127-d78486ec9c32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1375 microversion: 2.1 time: 0.197513 Oct 12 09:27:06.870745 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2930/6292] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:06 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1375 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:07.233488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:07.234856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:07.242045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:07.242896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:07.243575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:07.244684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:07.245375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:07.246049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:07.680667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:07.694976 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fa8dbb54-140b-47e2-81e9-59f1c77b3dd3 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1283 microversion: 2.1 time: 0.465559 Oct 12 09:27:07.697039 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3363/6293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:07 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1283 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:07.870614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:07.871987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:07.880182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:07.881324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:07.882400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:07.883530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:07.884248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:07.884908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:08.142723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:08.152795 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d52dc7af-980f-4eb9-a7d2-bd1c6e738395 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1375 microversion: 2.1 time: 0.286131 Oct 12 09:27:08.154490 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2931/6294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:07 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1375 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:08.225105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-687009022", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "97de7dbe-b6ac-4dd7-aa4b-97f741065f0b"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:08.289421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] validate_networks() for [('97de7dbe-b6ac-4dd7-aa4b-97f741065f0b', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:27:08.415064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4d8f7309-ecbf-4782-9e14-de5746aa5c33 req-7388e5d4-1f43-4f48-9e26-0e73881197db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecc95e9-73d7-4941-b5d2-5e911f4939c1", "tag": "d8571ff2-2253-4163-bd05-a3c91cd2dfbe"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:08.434889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4d8f7309-ecbf-4782-9e14-de5746aa5c33 req-7388e5d4-1f43-4f48-9e26-0e73881197db service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:08.436048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4d8f7309-ecbf-4782-9e14-de5746aa5c33 req-7388e5d4-1f43-4f48-9e26-0e73881197db service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:08.437660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4d8f7309-ecbf-4782-9e14-de5746aa5c33 req-7388e5d4-1f43-4f48-9e26-0e73881197db service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:08.457737 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4d8f7309-ecbf-4782-9e14-de5746aa5c33 req-7388e5d4-1f43-4f48-9e26-0e73881197db service nova] Creating event network-changed:d8571ff2-2253-4163-bd05-a3c91cd2dfbe for instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 on n-h1-858383-10 Oct 12 09:27:08.465128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4d8f7309-ecbf-4782-9e14-de5746aa5c33 req-7388e5d4-1f43-4f48-9e26-0e73881197db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054581 Oct 12 09:27:08.466331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2932/6295] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:27:08.721781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:08.722500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:08.729828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:08.730325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:08.730769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:08.732497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:08.733197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:08.733675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:08.901717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:08.910343 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d095ab92-435f-474a-a1c5-9d814dc72325 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1283 microversion: 2.1 time: 0.193685 Oct 12 09:27:08.911091 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2933/6296] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:08 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1283 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:08.952390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:27:08.952817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:27:08.953292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:27:08.954122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:27:08.954544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:27:08.968174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:08.968766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:08.969279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:08.970124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:08.970649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:08.971145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:08.988846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Getting quotas for project d9ee66cd0e7245abafd3f63eb3bc06b5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:27:08.994015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Getting quotas for user 28104edab622410b99d9facf6b75f990 and project d9ee66cd0e7245abafd3f63eb3bc06b5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:27:09.006285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:27:09.008479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:27:09.057412 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2c905ba-9508-417b-b4e8-97e57f168c99 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019810 Oct 12 09:27:09.058327 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3364/6297] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:27:09.069729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8e49a2c-677d-4deb-8ae3-08e4754f51e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:09.070662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e8e49a2c-677d-4deb-8ae3-08e4754f51e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:09.160055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e8e49a2c-677d-4deb-8ae3-08e4754f51e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:09.167895 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8e49a2c-677d-4deb-8ae3-08e4754f51e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1214 microversion: 2.1 time: 0.102004 Oct 12 09:27:09.169075 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2934/6298] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:09 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:09.192543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:09.193563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:09.201937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:09.202711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:09.203350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:09.204336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:09.205003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:09.205674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:09.474857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:09.485532 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14384947-80c9-47bd-b7bc-727e1e216ca8 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1375 microversion: 2.1 time: 0.298762 Oct 12 09:27:09.487460 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3365/6299] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:09 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1375 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:09.691209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bf3ca52a-1250-412b-a6c6-671da5dc7fef req-327870fd-ccff-443f-bb33-958d259235a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a878180a-8a71-4b1b-a96b-a6c9b59c0f81", "name": "network-vif-plugged", "status": "completed", "tag": "cc427d41-cc9d-48b2-838d-87427ae571f1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:09.702875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf3ca52a-1250-412b-a6c6-671da5dc7fef req-327870fd-ccff-443f-bb33-958d259235a3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:09.703634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf3ca52a-1250-412b-a6c6-671da5dc7fef req-327870fd-ccff-443f-bb33-958d259235a3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:09.704408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf3ca52a-1250-412b-a6c6-671da5dc7fef req-327870fd-ccff-443f-bb33-958d259235a3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:09.716522 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bf3ca52a-1250-412b-a6c6-671da5dc7fef req-327870fd-ccff-443f-bb33-958d259235a3 service nova] Creating event network-vif-plugged:cc427d41-cc9d-48b2-838d-87427ae571f1 for instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 on n-h2-858383-10 Oct 12 09:27:09.724302 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bf3ca52a-1250-412b-a6c6-671da5dc7fef req-327870fd-ccff-443f-bb33-958d259235a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155670 Oct 12 09:27:09.725709 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2935/6300] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:27:09.933955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:09.934693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:09.940852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:09.941591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:09.942030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:09.942745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:09.943198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:09.943623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:10.084645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:10.092947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-989c66a3-03c2-4962-8ef5-1beda689842b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1283 microversion: 2.1 time: 0.163078 Oct 12 09:27:10.093581 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3366/6301] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:09 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1283 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:10.197343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:10.202444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:10.203162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:10.210293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:10.210790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:10.211236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:10.211943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:10.212402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:10.212833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:10.285029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:10.293769 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9e801c0-8675-4534-aa90-66276794d180 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1266 microversion: 2.1 time: 0.098543 Oct 12 09:27:10.294344 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2936/6302] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:10 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:10.512019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:10.512566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:10.515414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:10.522142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:10.522677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:10.523242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:10.523955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:10.524437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:10.524990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:10.661299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:10.669830 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1cfa4615-3cf3-4cba-a5e5-e10332ceeb63 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1375 microversion: 2.1 time: 0.161965 Oct 12 09:27:10.670415 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3367/6303] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:10 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:11.117053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:11.117931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:11.125394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:11.126318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:11.126995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:11.128281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:11.128991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:11.129710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:11.317141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:11.317924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:11.324312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:11.324905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:11.325420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:11.326220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:11.326928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:11.327433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:11.362668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:11.372779 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-16fbd276-a86b-4420-9718-5789d7bf8265 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1283 microversion: 2.1 time: 0.259866 Oct 12 09:27:11.376783 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2937/6304] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:11 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1283 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:11.410567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:11.418967 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5dfcfa5f-31c8-4b3d-97ae-ddeb5b9139c5 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1272 microversion: 2.1 time: 0.105953 Oct 12 09:27:11.419903 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3368/6305] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:11 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:11.692686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:11.693421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:11.700818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:11.701312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:11.701822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:11.702842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:11.703304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:11.703739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:11.952481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:11.960836 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b1e544d3-dbec-451c-9a29-72b69f431b72 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1545 microversion: 2.1 time: 0.272199 Oct 12 09:27:11.961507 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2938/6306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:11 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1545 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:11.983976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:11.984575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:11.991618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:11.992114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:11.992567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:11.993265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:11.993826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:11.994264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:12.138934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:12.147072 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12f52288-93bf-47e3-a85a-21e9de533950 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1545 microversion: 2.1 time: 0.167071 Oct 12 09:27:12.147655 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3369/6307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:11 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1545 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:12.367478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b33f1a19-2d59-4a7a-9003-6423ee14f327 req-4ee608e7-30ee-480d-9eca-6ab1ca083e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e78b3d-db47-4ca0-816a-cfa305d2a3ea", "tag": "93928d19-893b-44d4-b8d6-ce7c71e42ba9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:12.378960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b33f1a19-2d59-4a7a-9003-6423ee14f327 req-4ee608e7-30ee-480d-9eca-6ab1ca083e53 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:12.379721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b33f1a19-2d59-4a7a-9003-6423ee14f327 req-4ee608e7-30ee-480d-9eca-6ab1ca083e53 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:12.380321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b33f1a19-2d59-4a7a-9003-6423ee14f327 req-4ee608e7-30ee-480d-9eca-6ab1ca083e53 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:12.392184 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b33f1a19-2d59-4a7a-9003-6423ee14f327 req-4ee608e7-30ee-480d-9eca-6ab1ca083e53 service nova] Creating event network-changed:93928d19-893b-44d4-b8d6-ce7c71e42ba9 for instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea on n-h2-858383-10 Oct 12 09:27:12.399169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:12.399828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:12.407874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:12.408366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:12.410185 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b33f1a19-2d59-4a7a-9003-6423ee14f327 req-4ee608e7-30ee-480d-9eca-6ab1ca083e53 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046375 Oct 12 09:27:12.411010 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2939/6308] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:27:12.411649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:12.412585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:12.413719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:12.414108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:12.442216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:12.443199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:12.457271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:12.458263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:12.459836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:12.460885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:12.461662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:12.462043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:12.638311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:12.650048 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2be9ac1b-2cd7-4e64-b8bb-59d6f0e0d75f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.254110 Oct 12 09:27:12.650844 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3370/6309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:12 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:27:12.715030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:12.723363 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5b6886b5-eca0-48ef-b5f5-9356571fc0af tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1314 microversion: 2.1 time: 0.285563 Oct 12 09:27:12.737941 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2940/6310] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:12 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:27:13.674008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:13.674594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:13.682090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:13.682590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:13.683037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:13.683932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:13.684479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:13.684907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:13.747119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:13.747733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:13.765230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:13.766190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:13.766642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:13.768062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:13.768493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:13.769157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:13.908362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:13.917162 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80c0d54b-b392-4b05-9d7c-04e14e3e729d tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.247256 Oct 12 09:27:13.918071 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3371/6311] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:13 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:14.009333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:14.018503 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9177c956-1aba-42c1-99d4-ae28ed1b6aa1 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1314 microversion: 2.1 time: 0.275362 Oct 12 09:27:14.019307 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2941/6312] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:13 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:27:14.416036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0859491a-fc15-4bdc-8f8b-e80f3d0db49f req-5943eeab-dcec-4892-9bf6-fcac2922a904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a878180a-8a71-4b1b-a96b-a6c9b59c0f81", "tag": "cc427d41-cc9d-48b2-838d-87427ae571f1"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:14.431900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0859491a-fc15-4bdc-8f8b-e80f3d0db49f req-5943eeab-dcec-4892-9bf6-fcac2922a904 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:14.432668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0859491a-fc15-4bdc-8f8b-e80f3d0db49f req-5943eeab-dcec-4892-9bf6-fcac2922a904 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:14.433287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0859491a-fc15-4bdc-8f8b-e80f3d0db49f req-5943eeab-dcec-4892-9bf6-fcac2922a904 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:14.446705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0859491a-fc15-4bdc-8f8b-e80f3d0db49f req-5943eeab-dcec-4892-9bf6-fcac2922a904 service nova] Creating event network-changed:cc427d41-cc9d-48b2-838d-87427ae571f1 for instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 on n-h2-858383-10 Oct 12 09:27:14.451965 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0859491a-fc15-4bdc-8f8b-e80f3d0db49f req-5943eeab-dcec-4892-9bf6-fcac2922a904 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039813 Oct 12 09:27:14.452575 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3372/6313] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:27:14.940373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:14.940964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:14.948165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:14.948667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:14.949141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:14.949842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:14.950480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:14.950926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:15.044512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:15.045356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:15.051800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:15.052496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:15.053151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:15.054052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:15.054752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:15.055207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:15.103154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:15.115453 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-58d89d2c-3147-4821-ae0d-4d09ae85f303 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.178972 Oct 12 09:27:15.116307 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2942/6314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:14 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:15.200693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:15.208701 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5603e91a-d63b-472d-838a-3c983f84b94b tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1314 microversion: 2.1 time: 0.169754 Oct 12 09:27:15.209934 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3373/6315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:15 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:16.140147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:16.140717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:16.148488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:16.148973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:16.149409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:16.150163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:16.150585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:16.151005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:16.231575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:16.232289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:16.239932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:16.240509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:16.241055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:16.241877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:16.242407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:16.242910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:16.293955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:16.302363 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24493761-6fa6-497a-9dda-4ec3bf96cdfb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.166664 Oct 12 09:27:16.303597 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2943/6316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:16 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:16.389252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:16.400728 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bcb3635c-180c-4c4a-bc9f-e7947b513faa tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1314 microversion: 2.1 time: 0.173143 Oct 12 09:27:16.401233 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3374/6317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:16 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:17.330775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:17.331789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:17.341169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:17.341695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:17.342794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:17.343499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:17.343952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:17.344382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:17.424261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:17.425339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:17.434870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:17.435456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:17.435970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:17.436785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:17.437316 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:17.438041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:17.485037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:17.493471 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f1a9dd32-7d28-436c-9870-a42cc1c81e67 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.169246 Oct 12 09:27:17.494067 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2944/6318] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:17 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:17.530863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9c1d4974-be5d-4289-aa87-1ee6d90b5cfc req-5ff1f0ee-4530-4930-8f9a-48e42428b0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e78b3d-db47-4ca0-816a-cfa305d2a3ea", "name": "network-vif-plugged", "status": "completed", "tag": "93928d19-893b-44d4-b8d6-ce7c71e42ba9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:17.541831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9c1d4974-be5d-4289-aa87-1ee6d90b5cfc req-5ff1f0ee-4530-4930-8f9a-48e42428b0df service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:17.542321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9c1d4974-be5d-4289-aa87-1ee6d90b5cfc req-5ff1f0ee-4530-4930-8f9a-48e42428b0df service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:17.542793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9c1d4974-be5d-4289-aa87-1ee6d90b5cfc req-5ff1f0ee-4530-4930-8f9a-48e42428b0df service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:17.556508 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9c1d4974-be5d-4289-aa87-1ee6d90b5cfc req-5ff1f0ee-4530-4930-8f9a-48e42428b0df service nova] Creating event network-vif-plugged:93928d19-893b-44d4-b8d6-ce7c71e42ba9 for instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea on n-h2-858383-10 Oct 12 09:27:17.561968 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9c1d4974-be5d-4289-aa87-1ee6d90b5cfc req-5ff1f0ee-4530-4930-8f9a-48e42428b0df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035218 Oct 12 09:27:17.562932 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2945/6319] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:27:17.579556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:17.590989 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-32c8a49c-5c59-428d-ae4b-8297db47db6f tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1314 microversion: 2.1 time: 0.171217 Oct 12 09:27:17.591595 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3375/6320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:17 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:27:18.523164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:18.524201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:18.535247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:18.536052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:18.536787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:18.537985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:18.538748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:18.539468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:18.615835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:18.616455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:18.623625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:18.624075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:18.624554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:18.625266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:18.625755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:18.626183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:18.645090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:18.681914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:18.691873 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-31d1eea5-667a-4582-812c-3278a5f81bdb tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.177511 Oct 12 09:27:18.693057 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2946/6321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:18 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:18.775901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:18.784244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-669096e0-5192-401a-9646-d62973b3f1d9 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1314 microversion: 2.1 time: 0.172295 Oct 12 09:27:18.785627 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3376/6322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:18 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:19.715662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:19.716338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:19.718551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=18 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:19.725218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:19.725776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:19.726247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:19.726981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:19.727510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:19.728022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:19.746334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:19.808656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:19.809282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:19.811264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:19.811942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=20 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:19.820794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:19.821408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:19.821848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:19.822563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:19.823022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:19.823453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:19.869318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:19.877423 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54f67924-165a-4dd2-ac3a-f428aefde6ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.165977 Oct 12 09:27:19.878082 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2947/6323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:19 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:19.957873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:19.970020 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1da22a86-8ef6-4094-a2d2-cef701b245e0 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1500 microversion: 2.1 time: 0.165287 Oct 12 09:27:19.970828 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3377/6324] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:19 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:27:19.992386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:19.993009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:19.999452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:19.999969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:20.000413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:20.001110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:20.001595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:20.002028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:20.136209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:20.144721 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0ea2873f-585c-4942-a259-04c2effeb493 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1500 microversion: 2.1 time: 0.156280 Oct 12 09:27:20.145306 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2948/6325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:19 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:20.167606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:20.168151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:20.174381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:20.174859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:20.175296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:20.175977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:20.176430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:20.176846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:20.205715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lazy-loading 'flavor' on Instance uuid 10e78b3d-db47-4ca0-816a-cfa305d2a3ea {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:27:20.274327 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3e2a45e-47a4-481f-ad86-884ecf177ba2 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "POST /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea/action" status: 202 len: 0 microversion: 2.1 time: 0.110566 Oct 12 09:27:20.274970 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3378/6326] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:27:20 2022] POST /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:27:20.283539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:20.284290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:20.290549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:20.291040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:20.291478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:20.292181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:20.292660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:20.293059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:20.424776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:20.433921 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eac0388b-367c-44a5-b49f-4a95cf6a4a7d tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1508 microversion: 2.1 time: 0.154532 Oct 12 09:27:20.434494 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2949/6327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:20 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:20.901496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:20.902223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:20.909174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:20.909684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:20.910126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:20.910822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:20.911275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:20.911707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:21.054210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:21.062512 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f5935fb-5196-42a5-8063-4f3a1412590e tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.166497 Oct 12 09:27:21.063090 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3379/6328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:20 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:21.456452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:21.457148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:21.464369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:21.464907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:21.465429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:21.466231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:21.466679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:21.467092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:21.607667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:21.616001 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dc706a7e-1d23-4c6c-94a1-32ad8fe68591 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1491 microversion: 2.1 time: 0.163601 Oct 12 09:27:21.616589 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2950/6329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:21 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1491 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:21.639408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:21.639947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:21.646494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:21.646986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:21.647430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:21.648372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:21.648829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:21.649249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:21.721588 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3883025e-7b17-4a71-bef3-8e70fc09059e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "POST /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea/action" status: 202 len: 0 microversion: 2.1 time: 0.085990 Oct 12 09:27:21.725057 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3380/6330] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:27:21 2022] POST /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:27:21.730692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:21.731438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:21.738253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:21.738988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:21.739426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:21.740257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:21.740727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:21.741150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:21.960084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:21.968586 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b4dd0cea-dec2-4c20-bd03-28c068d69dfc tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1497 microversion: 2.1 time: 0.241904 Oct 12 09:27:21.969203 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2951/6331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:21 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1497 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:22.086614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:22.087373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:22.095506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:22.095998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:22.096429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:22.097155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:22.097775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:22.098338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:22.242494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:22.250552 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-804f809f-fb23-4d6c-bcfb-1f0fb7d7ef40 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.168486 Oct 12 09:27:22.251124 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3381/6332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:22 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:22.992193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:22.992910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:23.000072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.000578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.001024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.001753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.002230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.002751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.274880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:23.275508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:23.282877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.283367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.283994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.284987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.285491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.285891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.442326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:23.450780 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86a1e510-ca87-450e-882c-63824578ce17 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.180275 Oct 12 09:27:23.451370 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3382/6333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:23 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:23.451679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:23.455972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8bd5bca5-c812-4055-a3c9-78ea082f963e req-d15f4f07-3c16-4615-be77-1b2684ebb6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecc95e9-73d7-4941-b5d2-5e911f4939c1", "name": "network-vif-plugged", "status": "completed", "tag": "d8571ff2-2253-4163-bd05-a3c91cd2dfbe"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:23.459483 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7b29463e-3bab-4522-ba87-111e9d01f882 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1500 microversion: 2.1 time: 0.471285 Oct 12 09:27:23.460111 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2952/6334] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:22 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1500 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:23.473141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8bd5bca5-c812-4055-a3c9-78ea082f963e req-d15f4f07-3c16-4615-be77-1b2684ebb6cd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.473672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8bd5bca5-c812-4055-a3c9-78ea082f963e req-d15f4f07-3c16-4615-be77-1b2684ebb6cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.474106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8bd5bca5-c812-4055-a3c9-78ea082f963e req-d15f4f07-3c16-4615-be77-1b2684ebb6cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.481884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:23.482433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:23.488492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.488971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.489406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.490038 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8bd5bca5-c812-4055-a3c9-78ea082f963e req-d15f4f07-3c16-4615-be77-1b2684ebb6cd service nova] Creating event network-vif-plugged:d8571ff2-2253-4163-bd05-a3c91cd2dfbe for instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 on n-h1-858383-10 Oct 12 09:27:23.490188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.490637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.491059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.495385 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8bd5bca5-c812-4055-a3c9-78ea082f963e req-d15f4f07-3c16-4615-be77-1b2684ebb6cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042913 Oct 12 09:27:23.496204 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3383/6335] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:27:23.514610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lazy-loading 'flavor' on Instance uuid 10e78b3d-db47-4ca0-816a-cfa305d2a3ea {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:27:23.584350 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-19ad9492-f8f9-41e3-966c-3fe358e1ee4a tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "POST /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea/action" status: 202 len: 0 microversion: 2.1 time: 0.106164 Oct 12 09:27:23.588176 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2953/6336] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:27:23 2022] POST /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:27:23.593831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:23.594550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:23.602209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.602854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.603283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.603962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:23.604584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:23.605343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:23.751837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:23.759889 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-817dada9-d05c-4e61-b8df-193977119b48 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1508 microversion: 2.1 time: 0.170433 Oct 12 09:27:23.760472 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3384/6337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:23 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:24.478926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:24.479621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:24.482974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:24.486950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:24.487439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:24.487876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:24.488570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:24.489020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:24.489475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:24.629474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:24.637865 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4173214-00cf-465c-8f52-fb6ed4d19726 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1271 microversion: 2.1 time: 0.166808 Oct 12 09:27:24.638436 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2954/6338] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:24 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:24.784088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:24.784740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:24.792674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:24.793238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:24.793824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:24.794572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:24.795063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:24.795559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:24.937103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:24.945014 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c01b53c-bf2c-4d69-a0e2-4f7ad62fd68e tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1491 microversion: 2.1 time: 0.165712 Oct 12 09:27:24.945595 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3385/6339] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:24 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1491 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:24.968791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:24.969332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:24.975974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:24.976463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:24.976900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:24.977748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:24.978203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:24.978630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:25.047306 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c1f7e1d-a4f4-4228-a3a2-c487cb48c424 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "POST /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea/action" status: 202 len: 0 microversion: 2.1 time: 0.082907 Oct 12 09:27:25.049483 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2955/6340] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:27:24 2022] POST /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:27:25.057694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:25.058367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:25.065660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:25.066249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:25.066772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:25.067623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:25.068083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:25.069315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:25.207007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:25.215433 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b85cd92a-024d-4a03-9258-a045eab6c92c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1497 microversion: 2.1 time: 0.162304 Oct 12 09:27:25.216015 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3386/6341] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:25 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:25.662754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:25.663444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:25.670296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:25.670802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:25.671232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:25.671925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:25.672370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:25.672792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:25.817915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:25.826385 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5367015-80dd-4c3e-a93e-eb7c52fda4ce tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1460 microversion: 2.1 time: 0.169236 Oct 12 09:27:25.826964 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2956/6342] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:25 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1460 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:25.850378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:25.851887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:25.859719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:25.860196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:25.860624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:25.861340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:25.861828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:25.862260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:25.998489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:26.006843 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3e3d4799-047b-4cc2-a4ce-22b2183130c9 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1460 microversion: 2.1 time: 0.161540 Oct 12 09:27:26.007418 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3387/6343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:25 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1460 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:26.239259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:26.240665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:26.247197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:26.247678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:26.248148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:26.248843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:26.249472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:26.249904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:26.459188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:26.467610 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bd9df680-e1ba-420f-839a-c14ddd9f8099 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1500 microversion: 2.1 time: 0.232760 Oct 12 09:27:26.468229 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2957/6344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:26 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1500 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:26.490662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:26.491160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:26.497306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:26.497840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:26.498314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:26.499018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:26.499479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:26.499922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:26.527354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:27:26.610488 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df153018-7369-45da-ba2e-778d3f755835 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "DELETE /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 204 len: 0 microversion: 2.1 time: 0.123301 Oct 12 09:27:26.611230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3388/6345] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:27:26 2022] DELETE /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:27:26.622503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:26.623138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:26.629682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:26.630184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:26.630629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:26.631338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:26.631793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:26.632209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:26.883646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:26.891738 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1f46f7c9-5619-4b23-a72f-6c3d50959ed3 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1506 microversion: 2.1 time: 0.274042 Oct 12 09:27:26.892289 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2958/6346] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:26 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:27.916480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:27.917395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:27.933009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-923bd08b-7974-47b0-bb97-8f529c510a58 req-282050f2-e20c-4b29-bdd5-55360a604393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecc95e9-73d7-4941-b5d2-5e911f4939c1", "tag": "d8571ff2-2253-4163-bd05-a3c91cd2dfbe"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:27.934451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:27.935326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:27.935845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:27.936650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:27.937180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:27.937938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:27.948281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-923bd08b-7974-47b0-bb97-8f529c510a58 req-282050f2-e20c-4b29-bdd5-55360a604393 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:27.949166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-923bd08b-7974-47b0-bb97-8f529c510a58 req-282050f2-e20c-4b29-bdd5-55360a604393 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:27.949853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-923bd08b-7974-47b0-bb97-8f529c510a58 req-282050f2-e20c-4b29-bdd5-55360a604393 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:27.959138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:27.970242 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-923bd08b-7974-47b0-bb97-8f529c510a58 req-282050f2-e20c-4b29-bdd5-55360a604393 service nova] Creating event network-changed:d8571ff2-2253-4163-bd05-a3c91cd2dfbe for instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 on n-h1-858383-10 Oct 12 09:27:27.976900 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-923bd08b-7974-47b0-bb97-8f529c510a58 req-282050f2-e20c-4b29-bdd5-55360a604393 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048002 Oct 12 09:27:27.977886 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2959/6347] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:27:28.165574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:28.175565 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-91d91ae3-c942-4924-b951-fceb687cbc82 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1506 microversion: 2.1 time: 0.263529 Oct 12 09:27:28.182244 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3389/6348] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:27 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:29.201313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:29.202025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:29.209330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:29.209931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:29.210378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:29.211134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:29.211694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:29.212219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:29.729179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28104edab622410b99d9facf6b75f990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ee66cd0e7245abafd3f63eb3bc06b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:29.738118 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-00c37d30-e178-423b-ba76-47723df54d5c tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 200 len: 1506 microversion: 2.1 time: 0.542314 Oct 12 09:27:29.738758 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2960/6349] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:29 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:29.993300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-367f1559-a9bf-4060-be61-0d487c01cd70 req-c315cc38-2e13-4b32-8ecc-1851fba4748c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecc95e9-73d7-4941-b5d2-5e911f4939c1", "tag": "d8571ff2-2253-4163-bd05-a3c91cd2dfbe"}, {"name": "network-changed", "server_uuid": "3ecc95e9-73d7-4941-b5d2-5e911f4939c1", "tag": "d8571ff2-2253-4163-bd05-a3c91cd2dfbe"}, {"server_uuid": "10e78b3d-db47-4ca0-816a-cfa305d2a3ea", "name": "network-vif-deleted", "tag": "93928d19-893b-44d4-b8d6-ce7c71e42ba9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:30.005561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-367f1559-a9bf-4060-be61-0d487c01cd70 req-c315cc38-2e13-4b32-8ecc-1851fba4748c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:30.006041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-367f1559-a9bf-4060-be61-0d487c01cd70 req-c315cc38-2e13-4b32-8ecc-1851fba4748c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:30.006467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-367f1559-a9bf-4060-be61-0d487c01cd70 req-c315cc38-2e13-4b32-8ecc-1851fba4748c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:30.019528 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-367f1559-a9bf-4060-be61-0d487c01cd70 req-c315cc38-2e13-4b32-8ecc-1851fba4748c service nova] Creating event network-changed:d8571ff2-2253-4163-bd05-a3c91cd2dfbe for instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 on n-h1-858383-10 Oct 12 09:27:30.020027 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-367f1559-a9bf-4060-be61-0d487c01cd70 req-c315cc38-2e13-4b32-8ecc-1851fba4748c service nova] Creating event network-changed:d8571ff2-2253-4163-bd05-a3c91cd2dfbe for instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 on n-h1-858383-10 Oct 12 09:27:30.020523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-367f1559-a9bf-4060-be61-0d487c01cd70 req-c315cc38-2e13-4b32-8ecc-1851fba4748c service nova] Creating event network-vif-deleted:93928d19-893b-44d4-b8d6-ce7c71e42ba9 for instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea on n-h2-858383-10 Oct 12 09:27:30.028979 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-367f1559-a9bf-4060-be61-0d487c01cd70 req-c315cc38-2e13-4b32-8ecc-1851fba4748c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.039621 Oct 12 09:27:30.029584 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3390/6350] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:27:30.761863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:30.762523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] [instance: 10e78b3d-db47-4ca0-816a-cfa305d2a3ea] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:30.770678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:30.771329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:30.772022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:30.773113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:30.774036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:30.774494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:30.788589 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] HTTP exception thrown: Instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea could not be found. Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Request method failure captured: Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea HTTP/1.1 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRohqfieb9NXEd9yeLTohlhyHj-kwPg4xyPubiyYC4PVIT0jBy2K8WEfuCDyRygWBAP9NArkUrzOxyc1FsPboVTLTlXjZmfwQbMHgkCnk8NypNbNAFe2CjI67IissJh0Xm-E4dVgbEoyfWpD9iUwPYWBWSBUpjR_lQcltFNT_NTTjiCI Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: d9ee66cd0e7245abafd3f63eb3bc06b5 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestServerAdvancedOps-1689494439 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d9ee66cd0e7245abafd3f63eb3bc06b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d9ee66cd0e7245abafd3f63eb3bc06b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d9ee66cd0e7245abafd3f63eb3bc06b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d9ee66cd0e7245abafd3f63eb3bc06b5"}]}] Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestServerAdvancedOps-1689494439 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: d9ee66cd0e7245abafd3f63eb3bc06b5 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestServerAdvancedOps-1689494439 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestServerAdvancedOps-1689494439-project Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 28104edab622410b99d9facf6b75f990 Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestServerAdvancedOps-1689494439-project Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea could not be found. Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '10e78b3d-db47-4ca0-816a-cfa305d2a3ea'} Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea could not be found. Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea could not be found. Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:27:30.790307 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea could not be found. Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] Returning 404 to user: Instance 10e78b3d-db47-4ca0-816a-cfa305d2a3ea could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86451a6c-ad7d-47d4-b6a5-d27099df80c6 tempest-TestServerAdvancedOps-1689494439 tempest-TestServerAdvancedOps-1689494439-project] 10.222.0.40 "GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea" status: 404 len: 111 microversion: 2.1 time: 0.034305 Oct 12 09:27:30.795339 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2961/6351] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:30 2022] GET /compute/v2.1/servers/10e78b3d-db47-4ca0-816a-cfa305d2a3ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:27:37.764365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:37.766703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:37.775205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:37.775694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:37.776132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:37.776830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:37.777280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:37.777737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:37.835320 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a5895904-108e-47e9-9b9e-24854745a5e0 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81/action" status: 200 len: 24542 microversion: 2.1 time: 0.076980 Oct 12 09:27:37.835898 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3391/6352] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:27:37 2022] POST /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81/action => generated 24542 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:27:54.531678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39d91e22-94e7-4451-8925-28a5f8d087af tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'create', calling method: .version_select at 0x7f9848cbc940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1054317746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPYWeUe8kslHmqJVtkXmUQh5ihBW27SOKtUDdtZA1ouyAyXWzO7mfPLzd7uas/cZ2DfArsDLb1zTAxpxUoErXdOQu4z7A4yrroTEYmisW+EQx73zsR7e675KYPvQ9pogg=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:54.538501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=14 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:54.539122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:54.552422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-39d91e22-94e7-4451-8925-28a5f8d087af tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:27:54.558340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-39d91e22-94e7-4451-8925-28a5f8d087af tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for user 562d9e9e0bdf46b0ab865ed565f8d7cb and project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:27:54.585169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-39d91e22-94e7-4451-8925-28a5f8d087af tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.057859 Oct 12 09:27:54.585833 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2962/6353] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:27:54 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:27:55.782802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-538681435", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "5d935f47-497a-4413-a970-d1965d914060"}], "key_name": "tempest-TestNetworkBasicOps-1054317746", "security_groups": [{"name": "tempest-secgroup-smoke-510346610"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:55.793022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:55.793747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:27:55.901135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] validate_networks() for [('5d935f47-497a-4413-a970-d1965d914060', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:27:56.299475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:27:56.299977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:27:56.300470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:27:56.301045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:27:56.301482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:27:56.310822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:56.311357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:56.311739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:56.312639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:56.312897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:56.313320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:56.332221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:27:56.337737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for user 562d9e9e0bdf46b0ab865ed565f8d7cb and project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:27:56.350692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:27:56.353128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:27:56.414009 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f177189d-ac43-4970-8584-4d6b3388607f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.636132 Oct 12 09:27:56.414687 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3392/6354] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:27:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:27:56.427809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-859ef7e7-7994-4288-a4e4-323a9169a071 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:56.428527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-859ef7e7-7994-4288-a4e4-323a9169a071 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:56.486593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-859ef7e7-7994-4288-a4e4-323a9169a071 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:56.498116 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-859ef7e7-7994-4288-a4e4-323a9169a071 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1248 microversion: 2.1 time: 0.075688 Oct 12 09:27:56.499170 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2963/6355] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:56 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:57.523271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:57.523898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:57.531996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:57.532531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:57.532966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:57.533708 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:57.534157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:57.534579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:57.637271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:57.645429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0743bb72-ab94-4ac9-8f9a-2ad57292551e tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1308 microversion: 2.1 time: 0.126988 Oct 12 09:27:57.646036 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3393/6356] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:57 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:58.669920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:58.670750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:58.677842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:58.678402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:58.678913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:58.679697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:58.680244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:58.680790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:58.817755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:27:58.826132 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5de3952c-dee6-426d-9df5-6c09cdec74e6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1373 microversion: 2.1 time: 0.160340 Oct 12 09:27:58.826847 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2964/6357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:58 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:27:59.084227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-44c79a7d-b59d-40cf-bc6e-5d551af8641c req-1bbdd66b-074e-47c2-aad6-5ef52796704c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0deeb7-5594-4e27-a178-d647202f8260", "tag": "4aee2c62-11ff-4adc-911c-fbd46d5eeec9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:27:59.095525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-44c79a7d-b59d-40cf-bc6e-5d551af8641c req-1bbdd66b-074e-47c2-aad6-5ef52796704c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:59.096004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-44c79a7d-b59d-40cf-bc6e-5d551af8641c req-1bbdd66b-074e-47c2-aad6-5ef52796704c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:59.096431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-44c79a7d-b59d-40cf-bc6e-5d551af8641c req-1bbdd66b-074e-47c2-aad6-5ef52796704c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:59.108873 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-44c79a7d-b59d-40cf-bc6e-5d551af8641c req-1bbdd66b-074e-47c2-aad6-5ef52796704c service nova] Creating event network-changed:4aee2c62-11ff-4adc-911c-fbd46d5eeec9 for instance 7c0deeb7-5594-4e27-a178-d647202f8260 on n-h1-858383-10 Oct 12 09:27:59.114142 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-44c79a7d-b59d-40cf-bc6e-5d551af8641c req-1bbdd66b-074e-47c2-aad6-5ef52796704c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033677 Oct 12 09:27:59.114788 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3394/6358] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:27:59.851571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:27:59.852289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:27:59.860916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:59.861488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:59.862052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:27:59.862883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:27:59.863418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:27:59.863922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:00.001841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:00.010334 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-de3d61cb-7974-48c9-858a-3ba44d7af56d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1373 microversion: 2.1 time: 0.163558 Oct 12 09:28:00.010914 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2965/6359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:27:59 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:01.038388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:01.039083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:01.045994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:01.046529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:01.046969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:01.047673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:01.048130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:01.048556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:01.184200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:01.192221 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f80448ee-f524-4907-8e16-aacc993b3bc7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1373 microversion: 2.1 time: 0.162075 Oct 12 09:28:01.192809 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3395/6360] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:01 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:02.228902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:02.229873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:02.240025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:02.240517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:02.240957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:02.241690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:02.242150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:02.242580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:02.378432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:02.387042 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7597a040-be60-446a-9a22-40300fd69569 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1373 microversion: 2.1 time: 0.164915 Oct 12 09:28:02.387617 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2966/6361] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:02 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:03.411247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:03.411850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:03.419347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:03.419835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:03.420271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:03.420970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:03.421424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:03.421878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:03.556697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:03.564664 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6560c721-1f21-4f98-b68f-0b621483a2ce tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1373 microversion: 2.1 time: 0.157513 Oct 12 09:28:03.565469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3396/6362] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:03 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:04.592357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:04.593564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:04.605609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:04.606407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:04.607137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:04.608297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:04.609058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:04.609975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:04.759453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:04.767737 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0ab06768-d716-4d4e-8901-f28ca5d40c96 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1373 microversion: 2.1 time: 0.182000 Oct 12 09:28:04.768349 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2967/6363] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:04 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:05.567885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-1660d067-b99e-45ba-a20e-19d6f7ae4e38 req-5ea79f7e-381f-437f-9605-5117de0bbf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0deeb7-5594-4e27-a178-d647202f8260", "name": "network-vif-plugged", "status": "completed", "tag": "4aee2c62-11ff-4adc-911c-fbd46d5eeec9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:05.581656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1660d067-b99e-45ba-a20e-19d6f7ae4e38 req-5ea79f7e-381f-437f-9605-5117de0bbf4b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:05.582249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1660d067-b99e-45ba-a20e-19d6f7ae4e38 req-5ea79f7e-381f-437f-9605-5117de0bbf4b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:05.582757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-1660d067-b99e-45ba-a20e-19d6f7ae4e38 req-5ea79f7e-381f-437f-9605-5117de0bbf4b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:05.596946 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-1660d067-b99e-45ba-a20e-19d6f7ae4e38 req-5ea79f7e-381f-437f-9605-5117de0bbf4b service nova] Creating event network-vif-plugged:4aee2c62-11ff-4adc-911c-fbd46d5eeec9 for instance 7c0deeb7-5594-4e27-a178-d647202f8260 on n-h1-858383-10 Oct 12 09:28:05.604628 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-1660d067-b99e-45ba-a20e-19d6f7ae4e38 req-5ea79f7e-381f-437f-9605-5117de0bbf4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040920 Oct 12 09:28:05.605950 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3397/6364] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:28:05.793338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:05.794095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:05.802753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:05.803345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:05.803783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:05.804792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:05.805349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:05.805954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:05.926447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:05.927290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:05.933967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:05.934598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:05.935208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:05.936005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:05.936699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:05.937321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:05.968543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:28:05.982023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:05.991017 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c154e3f-ac8c-4648-a859-62826d5797da tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1373 microversion: 2.1 time: 0.202761 Oct 12 09:28:05.991611 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2968/6365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:05 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1373 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:05.997582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f7a0a382-71a1-45f8-a59c-6fb33d064c81 req-e97741fd-3a51-455a-b145-56377c7d7d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecc95e9-73d7-4941-b5d2-5e911f4939c1", "tag": "d8571ff2-2253-4163-bd05-a3c91cd2dfbe"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:06.011956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f7a0a382-71a1-45f8-a59c-6fb33d064c81 req-e97741fd-3a51-455a-b145-56377c7d7d90 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:06.012567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f7a0a382-71a1-45f8-a59c-6fb33d064c81 req-e97741fd-3a51-455a-b145-56377c7d7d90 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:06.013255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f7a0a382-71a1-45f8-a59c-6fb33d064c81 req-e97741fd-3a51-455a-b145-56377c7d7d90 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:06.028932 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f7a0a382-71a1-45f8-a59c-6fb33d064c81 req-e97741fd-3a51-455a-b145-56377c7d7d90 service nova] Creating event network-changed:d8571ff2-2253-4163-bd05-a3c91cd2dfbe for instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 on n-h1-858383-10 Oct 12 09:28:06.035200 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f7a0a382-71a1-45f8-a59c-6fb33d064c81 req-e97741fd-3a51-455a-b145-56377c7d7d90 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042040 Oct 12 09:28:06.036514 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2969/6366] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:28:06.066858 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8ee004f3-d7cd-46e8-a868-89cc52fe019f tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 204 len: 0 microversion: 2.1 time: 0.144833 Oct 12 09:28:06.067581 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3398/6367] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:28:05 2022] DELETE /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:28:06.076868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:06.077605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:06.084154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:06.084647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:06.085083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:06.085817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:06.086275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:06.086701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:06.224816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:06.232980 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-361d71b9-d217-4f5d-80e1-3ec95b2b0083 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1585 microversion: 2.1 time: 0.160408 Oct 12 09:28:06.233549 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2970/6368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:06 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1585 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:28:07.020961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:07.022156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:07.025411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:07.026563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:07.037104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:07.037625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:07.038069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:07.038762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:07.039215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:07.039651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:07.187334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:07.195619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d002a69c-f867-43b8-b39f-bcf7a1947c2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1373 microversion: 2.1 time: 0.182015 Oct 12 09:28:07.196146 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3399/6369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:07 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:07.261249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:07.262243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:07.265488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:07.276021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:07.276812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:07.277540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:07.278757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:07.279451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:07.280174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:07.422239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:07.431717 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-60459a40-5baa-45a2-aa3e-e115d69c06ad tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1585 microversion: 2.1 time: 0.177070 Oct 12 09:28:07.432276 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2971/6370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:07 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1585 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:08.219236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:08.219876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:08.228840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:08.229319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:08.229864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:08.230572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:08.231055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:08.231472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:08.455743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:08.457003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:08.465048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:08.465542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:08.466179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:08.467187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:08.467626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:08.468233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:08.479781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:08.487978 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d4f3eeb6-ba3a-4c87-906f-a9bc02c43250 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1545 microversion: 2.1 time: 0.272842 Oct 12 09:28:08.488808 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3400/6371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:08 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1545 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:08.517972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:08.520509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:08.527964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:08.528449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:08.528922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:08.529707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:08.530170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:08.530605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:08.672507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:08.673796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:08.681290 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7be10c0a-717e-45a5-9169-2d270a97d066 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1585 microversion: 2.1 time: 0.229637 Oct 12 09:28:08.681596 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1e5f4649-b059-4897-b50e-6e4351146539 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1545 microversion: 2.1 time: 0.170677 Oct 12 09:28:08.693460 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3401/6372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:08 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1545 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:08.693919 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2972/6373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:08 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1585 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:08.789815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-df83da45-5ab5-4ecf-8480-295cf27a6033 req-b6139c4c-a90b-4e25-a943-46d33b5be5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecc95e9-73d7-4941-b5d2-5e911f4939c1", "name": "network-vif-deleted", "tag": "d8571ff2-2253-4163-bd05-a3c91cd2dfbe"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:08.801043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df83da45-5ab5-4ecf-8480-295cf27a6033 req-b6139c4c-a90b-4e25-a943-46d33b5be5d4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:08.801691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df83da45-5ab5-4ecf-8480-295cf27a6033 req-b6139c4c-a90b-4e25-a943-46d33b5be5d4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:08.802241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df83da45-5ab5-4ecf-8480-295cf27a6033 req-b6139c4c-a90b-4e25-a943-46d33b5be5d4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:08.814845 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-df83da45-5ab5-4ecf-8480-295cf27a6033 req-b6139c4c-a90b-4e25-a943-46d33b5be5d4 service nova] Creating event network-vif-deleted:d8571ff2-2253-4163-bd05-a3c91cd2dfbe for instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 on n-h1-858383-10 Oct 12 09:28:08.820890 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-df83da45-5ab5-4ecf-8480-295cf27a6033 req-b6139c4c-a90b-4e25-a943-46d33b5be5d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035201 Oct 12 09:28:08.821522 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3402/6374] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:28:09.706356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:09.707149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:09.714723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:09.715326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:09.715839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:09.716644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:09.717208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:09.717695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:09.780411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:09.788976 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-abb08c54-6643-4953-b37c-7d5caa9b99ea tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1230 microversion: 2.1 time: 0.086633 Oct 12 09:28:09.789571 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2973/6375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:09 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1230 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:10.813069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:10.814129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:10.822168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:10.822664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:10.823102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:10.824058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:10.824679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:10.825131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:10.909839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:10.918256 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd4ada97-48de-4831-930d-ce17856c62ac tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1230 microversion: 2.1 time: 0.109537 Oct 12 09:28:10.933373 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3403/6376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:10 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:11.941190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:11.942066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:11.949173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:11.949700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:11.950142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:11.950847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:11.951301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:11.951876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:12.014384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:12.023111 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7facd05a-134c-4c95-96a9-c11eed7a0871 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1230 microversion: 2.1 time: 0.085780 Oct 12 09:28:12.025104 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2974/6377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:11 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:13.048161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:13.048767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:13.056606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:13.057155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:13.057646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:13.058610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:13.059266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:13.060219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:13.095383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:13.095869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:13.096304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:13.096748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lazy-loading 'fault' on Instance uuid 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:28:13.155467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f337d8dcd794de9a371e5ad2799e8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976871df032c4a1abd4e7f1dd7cc1fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:13.165318 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aca395e6-02fe-4ea5-8002-70ba299c890b tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 200 len: 1235 microversion: 2.1 time: 0.121324 Oct 12 09:28:13.165974 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3404/6378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:13 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 1235 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:14.188750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:14.189327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] [instance: 3ecc95e9-73d7-4941-b5d2-5e911f4939c1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:14.198888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:14.199361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:14.199836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:14.200561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:14.201022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:14.201427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:14.217506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] HTTP exception thrown: Instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 could not be found. Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Request method failure captured: Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 HTTP/1.1 Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRofRwCROCtTddDMwEW9wGP8r8r5oxOuE3S486fXz_2xpwLw_RPyNoFE9bZSZyk_6l3viMGvv8nicMyFhBjK_VqVZHRU3eCot82bM6ibkViCCbQUhVK_T2eAzRXci28jfF-LO2XDjt7QUDnCiMzv4um39jC6SJQDJDbSFj4QrggR1hE8 Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 976871df032c4a1abd4e7f1dd7cc1fca Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestVolumeBackupRestore-1240772639 Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976871df032c4a1abd4e7f1dd7cc1fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/976871df032c4a1abd4e7f1dd7cc1fca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_976871df032c4a1abd4e7f1dd7cc1fca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976871df032c4a1abd4e7f1dd7cc1fca"}]}] Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestVolumeBackupRestore-1240772639 Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 976871df032c4a1abd4e7f1dd7cc1fca Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1240772639 Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestVolumeBackupRestore-1240772639-project Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 8f337d8dcd794de9a371e5ad2799e8ea Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestVolumeBackupRestore-1240772639-project Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 could not be found. Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '3ecc95e9-73d7-4941-b5d2-5e911f4939c1'} Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 could not be found. Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 could not be found. Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:28:14.219346 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 could not be found. Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Returning 404 to user: Instance 3ecc95e9-73d7-4941-b5d2-5e911f4939c1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bdd744b6-6293-461b-abc0-75ba05a34c5c tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1" status: 404 len: 111 microversion: 2.1 time: 0.036420 Oct 12 09:28:14.225684 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2975/6379] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:14 2022] GET /compute/v2.1/servers/3ecc95e9-73d7-4941-b5d2-5e911f4939c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:28:14.395048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8dde188a-d226-4f8a-bb7b-495fc990d637 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] Calling method '.version_select at 0x7f9843a87280>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:14.423578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8dde188a-d226-4f8a-bb7b-495fc990d637 tempest-TestVolumeBackupRestore-1240772639 tempest-TestVolumeBackupRestore-1240772639-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1412743747" status: 202 len: 0 microversion: 2.1 time: 0.032422 Oct 12 09:28:14.424315 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3405/6380] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 09:28:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1412743747 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:28:36.839360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:36.839863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:36.843041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:36.844174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=64 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:36.849179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:36.849918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:36.850549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:36.851427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:36.852049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:36.852620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:36.883401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:28:36.972560 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4f1688c8-dbc4-4bb1-9dd0-62691cd9f171 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 204 len: 0 microversion: 2.1 time: 0.136914 Oct 12 09:28:36.976321 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2976/6381] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:28:36 2022] DELETE /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:28:36.980572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:36.981911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:36.986910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:36.988130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:37.003006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:37.003642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:37.004203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:37.005359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:37.005978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:37.006408 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:37.153201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:37.162107 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4503256e-c3e6-47c9-882e-7c2773bc9c08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1551 microversion: 2.1 time: 0.184192 Oct 12 09:28:37.162934 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3406/6382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:36 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1551 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:38.191245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:38.192305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:38.203412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:38.204232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:38.204956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:38.206173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:38.206949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:38.207672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:38.347925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:38.356098 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a67427be-ccfd-491b-8c6b-94df1df14d81 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1551 microversion: 2.1 time: 0.172693 Oct 12 09:28:38.356685 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2977/6383] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:38 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:38.925905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-715a7c0d-2275-44f6-ad63-39704af0c740 req-d545c5c2-6efe-499f-9efe-8797ff5ddbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0deeb7-5594-4e27-a178-d647202f8260", "name": "network-vif-deleted", "tag": "4aee2c62-11ff-4adc-911c-fbd46d5eeec9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:38.938067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-715a7c0d-2275-44f6-ad63-39704af0c740 req-d545c5c2-6efe-499f-9efe-8797ff5ddbc8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:38.938550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-715a7c0d-2275-44f6-ad63-39704af0c740 req-d545c5c2-6efe-499f-9efe-8797ff5ddbc8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:38.938993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-715a7c0d-2275-44f6-ad63-39704af0c740 req-d545c5c2-6efe-499f-9efe-8797ff5ddbc8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:38.951062 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-715a7c0d-2275-44f6-ad63-39704af0c740 req-d545c5c2-6efe-499f-9efe-8797ff5ddbc8 service nova] Creating event network-vif-deleted:4aee2c62-11ff-4adc-911c-fbd46d5eeec9 for instance 7c0deeb7-5594-4e27-a178-d647202f8260 on n-h1-858383-10 Oct 12 09:28:38.956222 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-715a7c0d-2275-44f6-ad63-39704af0c740 req-d545c5c2-6efe-499f-9efe-8797ff5ddbc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034228 Oct 12 09:28:38.956835 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3407/6384] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:28:39.380133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:39.380757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:39.388103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:39.388590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:39.389016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:39.389775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:39.390217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:39.390648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:39.427581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:39.428076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:39.428518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:39.428967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lazy-loading 'fault' on Instance uuid 7c0deeb7-5594-4e27-a178-d647202f8260 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:28:39.471206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:39.479356 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4500bbfd-4245-4788-b4a6-e25bf017421b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 200 len: 1338 microversion: 2.1 time: 0.103317 Oct 12 09:28:39.480169 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2978/6385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:39 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:40.509561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:40.510748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 7c0deeb7-5594-4e27-a178-d647202f8260] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:40.521405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:40.522262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:40.523000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:40.524150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:40.524973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:40.525741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:40.540200 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] HTTP exception thrown: Instance 7c0deeb7-5594-4e27-a178-d647202f8260 could not be found. Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Request method failure captured: Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 HTTP/1.1 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRohazZPD5i7qoDKTM86pyZpsffaZrKABR6b3ZG_h_msjnKj4NlsOidlAjmXRv_tXIuRzJoYjZgV7LEIs3by4zfhmMOkh_Fl-S537GbgcX3acFYAO0idWnOa8p0oy6Q8vLVEUnrqoaxWRsSI7pCRoFxLKv3rsYOLq3J5Mf77EgOBTPBk Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 7aafd5c09ce44f7f97731dc7e8674be5 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7aafd5c09ce44f7f97731dc7e8674be5"}]}] Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 7aafd5c09ce44f7f97731dc7e8674be5 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestNetworkBasicOps-1682439963-project Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 562d9e9e0bdf46b0ab865ed565f8d7cb Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestNetworkBasicOps-1682439963-project Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 7c0deeb7-5594-4e27-a178-d647202f8260 could not be found. Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '7c0deeb7-5594-4e27-a178-d647202f8260'} Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0deeb7-5594-4e27-a178-d647202f8260 could not be found. Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0deeb7-5594-4e27-a178-d647202f8260 could not be found. Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:28:40.541891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0deeb7-5594-4e27-a178-d647202f8260 could not be found. Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Returning 404 to user: Instance 7c0deeb7-5594-4e27-a178-d647202f8260 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-64aa0f0f-5d78-4d5f-8f84-41edae543cb3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260" status: 404 len: 111 microversion: 2.1 time: 0.042498 Oct 12 09:28:40.545362 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3408/6386] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:40 2022] GET /compute/v2.1/servers/7c0deeb7-5594-4e27-a178-d647202f8260 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:28:40.731889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fc5d476a-692f-4cdf-8746-0024b547d349 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '.version_select at 0x7f9848a6f700>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:40.753532 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fc5d476a-692f-4cdf-8746-0024b547d349 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1054317746" status: 202 len: 0 microversion: 2.1 time: 0.026472 Oct 12 09:28:40.754131 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2979/6387] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 12 09:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1054317746 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:28:42.478604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:42.479099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:42.482117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3301176b-c929-4597-881b-fa10cc2866f2 req-216b08fa-a82a-4fcb-b77c-efe4b1ce5b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a878180a-8a71-4b1b-a96b-a6c9b59c0f81", "tag": "cc427d41-cc9d-48b2-838d-87427ae571f1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:42.488751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:42.489199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:42.489690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:42.490413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:42.490881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:42.491317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:42.502321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3301176b-c929-4597-881b-fa10cc2866f2 req-216b08fa-a82a-4fcb-b77c-efe4b1ce5b94 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:42.502922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3301176b-c929-4597-881b-fa10cc2866f2 req-216b08fa-a82a-4fcb-b77c-efe4b1ce5b94 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:42.503466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3301176b-c929-4597-881b-fa10cc2866f2 req-216b08fa-a82a-4fcb-b77c-efe4b1ce5b94 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:42.515080 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3301176b-c929-4597-881b-fa10cc2866f2 req-216b08fa-a82a-4fcb-b77c-efe4b1ce5b94 service nova] Creating event network-changed:cc427d41-cc9d-48b2-838d-87427ae571f1 for instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 on n-h2-858383-10 Oct 12 09:28:42.519956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:28:42.521490 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3301176b-c929-4597-881b-fa10cc2866f2 req-216b08fa-a82a-4fcb-b77c-efe4b1ce5b94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043688 Oct 12 09:28:42.522146 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2980/6388] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:28:42.617373 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eda930a9-909d-4393-a85b-dc3b18ad5a43 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 204 len: 0 microversion: 2.1 time: 0.142107 Oct 12 09:28:42.618298 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3409/6389] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:28:42 2022] DELETE /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:28:42.629055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:42.629923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:42.636879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:42.637479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:42.638000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:42.638851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:42.639499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:42.640064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:42.805226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:42.813263 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-01065aec-a268-4e7a-9341-2e742f2392ff tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1669 microversion: 2.1 time: 0.189345 Oct 12 09:28:42.813864 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2981/6390] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:42 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1669 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:28:43.837467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:43.843783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:43.850948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:43.851633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:43.852075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:43.852844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:43.853328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:43.854247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:43.995065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:44.003348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2622f502-7a00-4490-8608-74f41bd0c67d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1669 microversion: 2.1 time: 0.170543 Oct 12 09:28:44.003950 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3410/6391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:43 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:44.494325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4f2b4a0e-51b7-45f8-8f04-7d0bcc5953b7 req-adb3fcd9-db4b-44dd-9fe8-9efa3e4705b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a878180a-8a71-4b1b-a96b-a6c9b59c0f81", "name": "network-vif-deleted", "tag": "cc427d41-cc9d-48b2-838d-87427ae571f1"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:44.505373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4f2b4a0e-51b7-45f8-8f04-7d0bcc5953b7 req-adb3fcd9-db4b-44dd-9fe8-9efa3e4705b6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:44.505878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4f2b4a0e-51b7-45f8-8f04-7d0bcc5953b7 req-adb3fcd9-db4b-44dd-9fe8-9efa3e4705b6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:44.506340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4f2b4a0e-51b7-45f8-8f04-7d0bcc5953b7 req-adb3fcd9-db4b-44dd-9fe8-9efa3e4705b6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:44.518640 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4f2b4a0e-51b7-45f8-8f04-7d0bcc5953b7 req-adb3fcd9-db4b-44dd-9fe8-9efa3e4705b6 service nova] Creating event network-vif-deleted:cc427d41-cc9d-48b2-838d-87427ae571f1 for instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 on n-h2-858383-10 Oct 12 09:28:44.524099 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4f2b4a0e-51b7-45f8-8f04-7d0bcc5953b7 req-adb3fcd9-db4b-44dd-9fe8-9efa3e4705b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033381 Oct 12 09:28:44.524729 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2982/6392] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:28:45.027493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:45.028036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:45.035770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:45.036274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:45.036717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:45.037428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:45.037923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:45.038354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:45.070099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:45.070587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:45.071029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:45.071475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lazy-loading 'fault' on Instance uuid a878180a-8a71-4b1b-a96b-a6c9b59c0f81 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:28:45.117001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:45.124293 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3126b43e-10e6-41d8-8531-51f938a0e988 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 200 len: 1339 microversion: 2.1 time: 0.100877 Oct 12 09:28:45.124872 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3411/6393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:45 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:46.153138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:46.153775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: a878180a-8a71-4b1b-a96b-a6c9b59c0f81] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:46.161018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:46.161543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:46.162007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:46.162694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:46.163156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:46.163588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:46.177968 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] HTTP exception thrown: Instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 could not be found. Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Request method failure captured: Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 HTTP/1.1 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRohazZPD5i7qoDKTM86pyZpsffaZrKABR6b3ZG_h_msjnKj4NlsOidlAjmXRv_tXIuRzJoYjZgV7LEIs3by4zfhmMOkh_Fl-S537GbgcX3acFYAO0idWnOa8p0oy6Q8vLVEUnrqoaxWRsSI7pCRoFxLKv3rsYOLq3J5Mf77EgOBTPBk Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 7aafd5c09ce44f7f97731dc7e8674be5 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7aafd5c09ce44f7f97731dc7e8674be5"}]}] Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 7aafd5c09ce44f7f97731dc7e8674be5 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestNetworkBasicOps-1682439963-project Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 562d9e9e0bdf46b0ab865ed565f8d7cb Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestNetworkBasicOps-1682439963-project Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 could not be found. Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a878180a-8a71-4b1b-a96b-a6c9b59c0f81'} Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 could not be found. Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 could not be found. Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:28:46.179603 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 could not be found. Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Returning 404 to user: Instance a878180a-8a71-4b1b-a96b-a6c9b59c0f81 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-26156f58-f8ae-4be8-abb7-94a9a242c642 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81" status: 404 len: 111 microversion: 2.1 time: 0.035839 Oct 12 09:28:46.183324 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2983/6394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:46 2022] GET /compute/v2.1/servers/a878180a-8a71-4b1b-a96b-a6c9b59c0f81 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:28:46.364573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68871254-caf7-45ac-a2c9-b0832f44a3c6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '.version_select at 0x7f9843d65e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:46.386496 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68871254-caf7-45ac-a2c9-b0832f44a3c6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1859728364" status: 202 len: 0 microversion: 2.1 time: 0.025897 Oct 12 09:28:46.387089 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3412/6395] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 12 09:28:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1859728364 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:28:54.957146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db49d4aa-c290-4c0d-b1bc-128da3006b2b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'create', calling method: .version_select at 0x7f9848832790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-326284199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvrC2WLQgZUW491aBNN0uvycoaPyrhFrlgk0QBpqusLrIl3h0FmNeJ1TPkxNfS6klpKTNiEMvApu5lduLFHAIminChoDJNa9plNA7BBlsK4nrFwYpOKZTgynEb9eJqW/A=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:54.976124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-db49d4aa-c290-4c0d-b1bc-128da3006b2b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:28:54.981959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-db49d4aa-c290-4c0d-b1bc-128da3006b2b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for user 562d9e9e0bdf46b0ab865ed565f8d7cb and project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:28:55.007156 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db49d4aa-c290-4c0d-b1bc-128da3006b2b tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054067 Oct 12 09:28:55.007777 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2984/6396] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:28:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:28:56.068206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:56.073071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1608760460", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "56a5e148-f1cd-4e2a-86ca-db4936662e2e"}], "key_name": "tempest-TestNetworkBasicOps-326284199", "security_groups": [{"name": "tempest-secgroup-smoke-1425791496"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:56.191342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] validate_networks() for [('56a5e148-f1cd-4e2a-86ca-db4936662e2e', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:28:56.616571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:28:56.617132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:28:56.617484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:28:56.617898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:28:56.618327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:28:56.627519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:56.628009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:56.628443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:56.629412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:56.630088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:56.630612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:56.659848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:28:56.665571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Getting quotas for user 562d9e9e0bdf46b0ab865ed565f8d7cb and project 7aafd5c09ce44f7f97731dc7e8674be5. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:28:56.678617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:28:56.680865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:28:56.738719 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d81bfe87-1b2e-4480-b837-2f3b2ef222f2 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.672426 Oct 12 09:28:56.746047 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3413/6397] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:28:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:28:56.749624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:28:56.754967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2d22bffe-229b-49e8-a9bb-900cef07cae3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:56.756453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2d22bffe-229b-49e8-a9bb-900cef07cae3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:56.822106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2d22bffe-229b-49e8-a9bb-900cef07cae3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:56.833179 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2d22bffe-229b-49e8-a9bb-900cef07cae3 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1248 microversion: 2.1 time: 0.084876 Oct 12 09:28:56.835658 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2985/6398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:56 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:28:57.859817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:57.860495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:57.868315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:57.868870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:57.869367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:57.870147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:57.870806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:57.871227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:57.956239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:57.964531 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5dde827d-3be2-456e-8d84-0af35c005147 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1308 microversion: 2.1 time: 0.109826 Oct 12 09:28:57.965114 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3414/6399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:57 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:58.988629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:28:58.989419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:28:58.997429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:58.998061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:58.998571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:58.999332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:58.999882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:59.000318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:59.131740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:28:59.139742 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-614ee02f-af8d-4412-93f0-dddbf6fda9d9 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1374 microversion: 2.1 time: 0.155269 Oct 12 09:28:59.140396 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2986/6400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:28:58 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:28:59.407903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b48c6ad5-6793-40d8-b505-59375606408f req-b3685dab-d1d5-4000-8904-c256bd5def35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a662d60-6257-4f74-ab76-d2c93cf7ee21", "tag": "a508342a-9e01-4e0c-be38-6de7e6c4ba8f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:28:59.425293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b48c6ad5-6793-40d8-b505-59375606408f req-b3685dab-d1d5-4000-8904-c256bd5def35 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:28:59.425906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b48c6ad5-6793-40d8-b505-59375606408f req-b3685dab-d1d5-4000-8904-c256bd5def35 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:28:59.426447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b48c6ad5-6793-40d8-b505-59375606408f req-b3685dab-d1d5-4000-8904-c256bd5def35 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:28:59.438328 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b48c6ad5-6793-40d8-b505-59375606408f req-b3685dab-d1d5-4000-8904-c256bd5def35 service nova] Creating event network-changed:a508342a-9e01-4e0c-be38-6de7e6c4ba8f for instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 on n-h2-858383-10 Oct 12 09:28:59.443297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b48c6ad5-6793-40d8-b505-59375606408f req-b3685dab-d1d5-4000-8904-c256bd5def35 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039813 Oct 12 09:28:59.443881 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3415/6401] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:29:00.168287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:00.169118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:00.177730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:00.178315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:00.178834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:00.179702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:00.180247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:00.180755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:00.320188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:00.328046 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7921af10-5319-4d09-a234-3c0fb7ef01ef tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1374 microversion: 2.1 time: 0.166689 Oct 12 09:29:00.328628 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2987/6402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:00 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:01.352344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:01.353095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:01.359709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:01.360193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:01.360637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:01.361342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:01.361835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:01.362263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:01.501652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:01.509524 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3f237c1-494a-4bad-a2b8-c2db1b551adc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1374 microversion: 2.1 time: 0.162736 Oct 12 09:29:01.510116 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3416/6403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:01 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:02.533118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:02.533819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:02.541198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:02.541716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:02.542169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:02.542869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:02.543371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:02.543803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:02.673030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:02.683474 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e3d72ed-536a-435b-b667-a64ba8cb8b32 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1374 microversion: 2.1 time: 0.154644 Oct 12 09:29:02.684283 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2988/6404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:02 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:03.716596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:03.717668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:03.729340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:03.730213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:03.731040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:03.731744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:03.732206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:03.732635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:03.868806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:03.876913 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-53f29963-a7cf-4bdc-b1c5-e89cef9a8f2d tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1374 microversion: 2.1 time: 0.167020 Oct 12 09:29:03.877473 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3417/6405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:03 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:04.067323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-22a78470-e3ef-40f4-b20f-f601a0ffd959 req-094ee6fa-df20-4322-8630-33070fbe96a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a662d60-6257-4f74-ab76-d2c93cf7ee21", "name": "network-vif-plugged", "status": "completed", "tag": "a508342a-9e01-4e0c-be38-6de7e6c4ba8f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:29:04.079521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-22a78470-e3ef-40f4-b20f-f601a0ffd959 req-094ee6fa-df20-4322-8630-33070fbe96a0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:04.080275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-22a78470-e3ef-40f4-b20f-f601a0ffd959 req-094ee6fa-df20-4322-8630-33070fbe96a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:04.080724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-22a78470-e3ef-40f4-b20f-f601a0ffd959 req-094ee6fa-df20-4322-8630-33070fbe96a0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:04.094894 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-22a78470-e3ef-40f4-b20f-f601a0ffd959 req-094ee6fa-df20-4322-8630-33070fbe96a0 service nova] Creating event network-vif-plugged:a508342a-9e01-4e0c-be38-6de7e6c4ba8f for instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 on n-h2-858383-10 Oct 12 09:29:04.100063 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-22a78470-e3ef-40f4-b20f-f601a0ffd959 req-094ee6fa-df20-4322-8630-33070fbe96a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036589 Oct 12 09:29:04.100684 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2989/6406] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:29:04.900287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:04.900882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:04.908543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:04.909189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:04.909783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:04.910801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:04.911472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:04.911905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:05.059626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:05.070108 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04b55578-85c2-41d4-968b-7d1358f7aa08 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1374 microversion: 2.1 time: 0.173853 Oct 12 09:29:05.070686 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3418/6407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:04 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:06.094377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:06.095073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:06.102830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:06.103326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:06.103748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:06.104438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:06.104892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:06.105316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:06.256858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:06.268341 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3bf23ec-6e17-4e1e-a74d-1e036300cb5f tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1545 microversion: 2.1 time: 0.178239 Oct 12 09:29:06.269000 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2990/6408] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:06 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1545 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:06.294440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:06.295057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:06.302139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:06.302638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:06.303085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:06.303784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:06.304245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:06.304673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:06.445661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:06.453985 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dc9b5de5-bb7f-42c8-823f-077575e5bf91 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1545 microversion: 2.1 time: 0.163577 Oct 12 09:29:06.454534 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3419/6409] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:06 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1545 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:08.389559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c8016cdd-c713-491e-bfc3-6fed647dba09 req-b9513e10-8ada-496b-ba4c-efb39b40456a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a662d60-6257-4f74-ab76-d2c93cf7ee21", "tag": "a508342a-9e01-4e0c-be38-6de7e6c4ba8f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:29:08.395455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:08.396983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:08.406798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c8016cdd-c713-491e-bfc3-6fed647dba09 req-b9513e10-8ada-496b-ba4c-efb39b40456a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:08.407573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c8016cdd-c713-491e-bfc3-6fed647dba09 req-b9513e10-8ada-496b-ba4c-efb39b40456a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:08.408213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c8016cdd-c713-491e-bfc3-6fed647dba09 req-b9513e10-8ada-496b-ba4c-efb39b40456a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:08.427529 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c8016cdd-c713-491e-bfc3-6fed647dba09 req-b9513e10-8ada-496b-ba4c-efb39b40456a service nova] Creating event network-changed:a508342a-9e01-4e0c-be38-6de7e6c4ba8f for instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 on n-h2-858383-10 Oct 12 09:29:08.432822 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c8016cdd-c713-491e-bfc3-6fed647dba09 req-b9513e10-8ada-496b-ba4c-efb39b40456a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047047 Oct 12 09:29:08.433971 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2991/6410] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:29:31.700882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:29:31.703215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:31.705385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:31.706229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:31.707569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:31.708290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=34 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:31.715183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:31.715674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:31.716113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:31.716820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:31.717283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:31.717745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:31.777828 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8a28549a-110c-4d9f-9c62-2c918c99a3c1 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21/action" status: 200 len: 24560 microversion: 2.1 time: 0.081100 Oct 12 09:29:31.778471 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3420/6411] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:29:31 2022] POST /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21/action => generated 24560 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:29:42.780669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:29:42.783055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:42.786043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=28 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:42.792005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:42.792502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:42.792943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:42.793672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:42.794120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:42.794548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:42.847467 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eabb9951-eec6-4a49-b401-dece1e9c20d4 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "POST /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21/action" status: 200 len: 32630 microversion: 2.1 time: 0.071396 Oct 12 09:29:42.848125 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2992/6412] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:29:42 2022] POST /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21/action => generated 32630 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 09:29:43.934516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:43.935141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:43.945215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:43.946003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:29:43.954437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:43.955087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:43.955623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:43.956438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:43.956963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:43.957538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:43.986965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:29:44.073760 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4dc3738c-a212-4e27-a80f-f98a9b60e4dc tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 204 len: 0 microversion: 2.1 time: 0.143610 Oct 12 09:29:44.074721 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3421/6413] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:29:43 2022] DELETE /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:29:44.084580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:44.085401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:44.091677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:44.092171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:44.092609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:44.093314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:44.093826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:44.094258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:44.107666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bc34c916-8067-49bf-b0d3-3f7d4e014c7d req-e8a260ab-9a6a-47cd-b4af-a8f586bb55d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a662d60-6257-4f74-ab76-d2c93cf7ee21", "tag": "a508342a-9e01-4e0c-be38-6de7e6c4ba8f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:29:44.118578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bc34c916-8067-49bf-b0d3-3f7d4e014c7d req-e8a260ab-9a6a-47cd-b4af-a8f586bb55d2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:44.119071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bc34c916-8067-49bf-b0d3-3f7d4e014c7d req-e8a260ab-9a6a-47cd-b4af-a8f586bb55d2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:44.119735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bc34c916-8067-49bf-b0d3-3f7d4e014c7d req-e8a260ab-9a6a-47cd-b4af-a8f586bb55d2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:44.130717 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bc34c916-8067-49bf-b0d3-3f7d4e014c7d req-e8a260ab-9a6a-47cd-b4af-a8f586bb55d2 service nova] Creating event network-changed:a508342a-9e01-4e0c-be38-6de7e6c4ba8f for instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 on n-h2-858383-10 Oct 12 09:29:44.136197 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bc34c916-8067-49bf-b0d3-3f7d4e014c7d req-e8a260ab-9a6a-47cd-b4af-a8f586bb55d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197259 Oct 12 09:29:44.136980 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2993/6414] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:29:44.235205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:44.243616 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-78a980a7-aebc-4f7d-a788-c40cad663354 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1670 microversion: 2.1 time: 0.163465 Oct 12 09:29:44.244469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3422/6415] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:44 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:45.270129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:45.270707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:45.277344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:45.277858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:45.278302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:45.279366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:45.279825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:45.280243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:45.418469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:45.426720 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fdc688e9-cc0d-47dc-b530-6140159ab4f6 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1670 microversion: 2.1 time: 0.161829 Oct 12 09:29:45.427311 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2994/6416] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:45 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:46.151374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8e0f359a-8ed1-402c-b297-33ea0e3b9a81 req-1a17fad2-807f-4e9d-9bdb-5003241c16a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a662d60-6257-4f74-ab76-d2c93cf7ee21", "name": "network-vif-deleted", "tag": "a508342a-9e01-4e0c-be38-6de7e6c4ba8f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:29:46.162932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8e0f359a-8ed1-402c-b297-33ea0e3b9a81 req-1a17fad2-807f-4e9d-9bdb-5003241c16a7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:46.163194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8e0f359a-8ed1-402c-b297-33ea0e3b9a81 req-1a17fad2-807f-4e9d-9bdb-5003241c16a7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:46.163665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8e0f359a-8ed1-402c-b297-33ea0e3b9a81 req-1a17fad2-807f-4e9d-9bdb-5003241c16a7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:46.175236 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8e0f359a-8ed1-402c-b297-33ea0e3b9a81 req-1a17fad2-807f-4e9d-9bdb-5003241c16a7 service nova] Creating event network-vif-deleted:a508342a-9e01-4e0c-be38-6de7e6c4ba8f for instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 on n-h2-858383-10 Oct 12 09:29:46.180713 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8e0f359a-8ed1-402c-b297-33ea0e3b9a81 req-1a17fad2-807f-4e9d-9bdb-5003241c16a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Oct 12 09:29:46.181378 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3423/6417] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:29:46.450611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:46.452157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:46.459954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:46.460671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:46.461129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:46.461933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:46.462390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:46.462992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:46.494961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:46.495446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:46.495884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:46.496328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lazy-loading 'fault' on Instance uuid 3a662d60-6257-4f74-ab76-d2c93cf7ee21 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:29:46.540613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562d9e9e0bdf46b0ab865ed565f8d7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aafd5c09ce44f7f97731dc7e8674be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:29:46.549249 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6072a9b3-5d28-4f20-8e75-836251b2f889 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 200 len: 1338 microversion: 2.1 time: 0.102721 Oct 12 09:29:46.550051 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2995/6418] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:46 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:29:47.577292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:47.578188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] [instance: 3a662d60-6257-4f74-ab76-d2c93cf7ee21] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:29:47.586532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:47.587138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:47.587689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:47.588555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:29:47.589134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:29:47.589707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:29:47.605605 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] HTTP exception thrown: Instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 could not be found. Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Request method failure captured: Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 HTTP/1.1 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRohazZPD5i7qoDKTM86pyZpsffaZrKABR6b3ZG_h_msjnKj4NlsOidlAjmXRv_tXIuRzJoYjZgV7LEIs3by4zfhmMOkh_Fl-S537GbgcX3acFYAO0idWnOa8p0oy6Q8vLVEUnrqoaxWRsSI7pCRoFxLKv3rsYOLq3J5Mf77EgOBTPBk Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 7aafd5c09ce44f7f97731dc7e8674be5 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7aafd5c09ce44f7f97731dc7e8674be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7aafd5c09ce44f7f97731dc7e8674be5"}]}] Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 7aafd5c09ce44f7f97731dc7e8674be5 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestNetworkBasicOps-1682439963 Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestNetworkBasicOps-1682439963-project Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 562d9e9e0bdf46b0ab865ed565f8d7cb Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestNetworkBasicOps-1682439963-project Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 could not be found. Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3a662d60-6257-4f74-ab76-d2c93cf7ee21'} Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 could not be found. Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 could not be found. Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:29:47.607213 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 could not be found. Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Returning 404 to user: Instance 3a662d60-6257-4f74-ab76-d2c93cf7ee21 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:29:47.610909 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be6eb2a3-421c-4cee-a19c-a7f6d92eddb5 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21" status: 404 len: 111 microversion: 2.1 time: 0.037917 Oct 12 09:29:47.612247 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3424/6419] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:29:47 2022] GET /compute/v2.1/servers/3a662d60-6257-4f74-ab76-d2c93cf7ee21 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:29:47.781249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1e10d15a-5cb1-48fb-a2cf-0c678316e1e7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] Calling method '.version_select at 0x7f9848a64f70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:29:47.806120 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1e10d15a-5cb1-48fb-a2cf-0c678316e1e7 tempest-TestNetworkBasicOps-1682439963 tempest-TestNetworkBasicOps-1682439963-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-326284199" status: 202 len: 0 microversion: 2.1 time: 0.029549 Oct 12 09:29:47.810999 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2996/6420] 10.222.0.40 () {58 vars in 1254 bytes} [Wed Oct 12 09:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-326284199 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:30:03.626525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-929125017", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "47f3dd54-3a1d-4339-a54a-d7cdc39250cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3ccd3c8-b0a9-48d0-b379-e64e890e1919"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:30:03.638884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:03.639483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:03.691913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] validate_networks() for [('d3ccd3c8-b0a9-48d0-b379-e64e890e1919', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:30:04.191461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:30:04.191896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:30:04.192347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:30:04.192761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:30:04.193185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:30:04.203036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:04.203551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:04.203994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:04.204725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:04.205193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:04.205654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:04.223847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:30:04.230008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:30:04.289684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:30:04.291741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47f3dd54-3a1d-4339-a54a-d7cdc39250cb',volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:30:04.430523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a2d1793f-2a40-4167-a48c-335e6355c2b2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807839 Oct 12 09:30:04.431108 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3425/6421] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:30:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:30:04.442440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-89a4b664-e840-47c7-b6a5-e582ba13410c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:04.443665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-89a4b664-e840-47c7-b6a5-e582ba13410c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:04.448765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=20 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:04.449841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:04.518801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-89a4b664-e840-47c7-b6a5-e582ba13410c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:04.526349 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-89a4b664-e840-47c7-b6a5-e582ba13410c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1056 microversion: 2.1 time: 0.087877 Oct 12 09:30:04.528755 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2997/6422] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:04 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1056 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:05.556574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb1a57ab-bfa2-45f6-8192-98df2e1dac38 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:05.557373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb1a57ab-bfa2-45f6-8192-98df2e1dac38 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:05.636611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb1a57ab-bfa2-45f6-8192-98df2e1dac38 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:05.644124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb1a57ab-bfa2-45f6-8192-98df2e1dac38 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1056 microversion: 2.1 time: 0.092463 Oct 12 09:30:05.644956 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3426/6423] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:05 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1056 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:06.667889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d586795c-9915-4cfa-be84-b944c7cc5a5d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:06.669052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d586795c-9915-4cfa-be84-b944c7cc5a5d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:06.722575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d586795c-9915-4cfa-be84-b944c7cc5a5d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:06.729784 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d586795c-9915-4cfa-be84-b944c7cc5a5d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1056 microversion: 2.1 time: 0.065832 Oct 12 09:30:06.730410 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2998/6424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:06 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1056 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:07.753670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:07.754059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:07.761855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:07.762418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:07.762841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:07.763554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:07.764025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:07.764487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:07.829323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:07.837480 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0aa92b5a-9188-4bd1-a9ce-e81528eaee91 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1172 microversion: 2.1 time: 0.088417 Oct 12 09:30:07.839152 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3427/6425] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:07 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1172 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:08.860418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:08.862281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:08.869354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:08.870191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:08.870682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:08.871479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:08.872003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:08.872502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:09.054744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:09.063387 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a2fa188-9015-4a3f-9b5b-8d7672a55aaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1214 microversion: 2.1 time: 0.206947 Oct 12 09:30:09.064443 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 2999/6426] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:08 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:09.158624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ff3229b5-2007-4f73-acf7-e0720cd35ba1 req-dec84a6e-aa89-4beb-89dc-3dc8de83c780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a1506e-132a-4bb3-a6a3-17141b246807", "tag": "e19213c0-30d6-414e-b3e1-c01d68e704ee"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:30:09.171817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ff3229b5-2007-4f73-acf7-e0720cd35ba1 req-dec84a6e-aa89-4beb-89dc-3dc8de83c780 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:09.172264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ff3229b5-2007-4f73-acf7-e0720cd35ba1 req-dec84a6e-aa89-4beb-89dc-3dc8de83c780 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:09.172928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ff3229b5-2007-4f73-acf7-e0720cd35ba1 req-dec84a6e-aa89-4beb-89dc-3dc8de83c780 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:09.188827 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ff3229b5-2007-4f73-acf7-e0720cd35ba1 req-dec84a6e-aa89-4beb-89dc-3dc8de83c780 service nova] Creating event network-changed:e19213c0-30d6-414e-b3e1-c01d68e704ee for instance a0a1506e-132a-4bb3-a6a3-17141b246807 on n-h2-858383-10 Oct 12 09:30:09.194229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ff3229b5-2007-4f73-acf7-e0720cd35ba1 req-dec84a6e-aa89-4beb-89dc-3dc8de83c780 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041365 Oct 12 09:30:09.195168 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3428/6427] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:30:10.086973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:10.087715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:10.095367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:10.095993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:10.096510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:10.097329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:10.097952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:10.098456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:10.326781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:10.335062 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e7dc29d6-fff6-4e48-b9b1-56f8ac8b9276 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1214 microversion: 2.1 time: 0.252159 Oct 12 09:30:10.335728 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3000/6428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:10 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:30:11.360816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:11.361690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:11.368246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:11.368788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:11.369230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:11.369960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:11.370419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:11.370850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:11.500036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:11.508148 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d41ddf44-f8eb-4a2f-8a79-5ffb229db842 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1214 microversion: 2.1 time: 0.152838 Oct 12 09:30:11.508812 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3429/6429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:11 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:12.532006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:12.532639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:12.540623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:12.541187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:12.541747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:12.542539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:12.542991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:12.543415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:12.678948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:12.687827 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cfbe6311-c64d-4f22-bcbb-7a21eeb919c4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1214 microversion: 2.1 time: 0.160478 Oct 12 09:30:12.689268 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3001/6430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:12 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:13.715804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:13.716761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:13.727860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:13.728343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:13.728780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:13.729493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:13.729950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:13.730375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:13.871373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:13.879383 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c136990-529e-4371-9e63-761c8e90e88b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.170247 Oct 12 09:30:13.879956 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3430/6431] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:13 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:14.907393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:14.908408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:14.920136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:14.920941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:14.921723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:14.922882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:14.924078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:14.924845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:15.061959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:15.073479 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8b6d0a3b-e6a1-477a-9688-c12328f056cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.173239 Oct 12 09:30:15.074087 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3002/6432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:14 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:16.101123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:16.101922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:16.104062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:16.105801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=8 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:16.112619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:16.113058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:16.113524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:16.114246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:16.114727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:16.115171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:16.253137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:16.263603 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5905681-332e-4a3c-bcb8-d641349bfb99 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.169765 Oct 12 09:30:16.264191 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3431/6433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:16 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:17.287316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:17.288239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:17.291068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:17.296904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:17.297386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:17.297859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:17.298556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:17.299010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:17.299438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:17.442263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:17.451732 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-27ccf337-9d81-4b08-83ba-d2dc078425d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.168563 Oct 12 09:30:17.452318 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3003/6434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:17 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:18.475260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:18.475877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:18.482924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:18.483406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:18.483841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:18.484527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:18.484976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:18.485395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:18.619225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:18.627352 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04d592e1-736a-4e96-9d5d-7b541f40ffea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.156261 Oct 12 09:30:18.627930 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3432/6435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:18 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:19.654996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:19.656065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:19.666649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:19.667127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:19.667564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:19.668253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:19.668701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:19.669120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:19.799333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:19.807244 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d2114fb4-4e04-43f0-9d8a-b7fa37c3a4f4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.159382 Oct 12 09:30:19.807828 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3004/6436] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:19 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:20.831859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:20.832566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:20.841287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:20.841820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:20.842258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:20.842975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:20.843429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:20.843862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:20.977810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:20.986030 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d71cc122-31e9-4c11-8eff-dff92ae745db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.158985 Oct 12 09:30:20.986618 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3433/6437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:20 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:22.013322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:22.014416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:22.026231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:22.027041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:22.028207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:22.029329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:22.030156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:22.030881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:22.176734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:22.184777 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e70a7ef6-ff91-4f88-8401-7d9edb2fbbf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.178120 Oct 12 09:30:22.185351 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3005/6438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:22 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:22.349974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ceb02ce3-0fc4-4744-b4e4-b181244c775c req-8acfcadc-00a8-4dc0-acad-a8aea107ef2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1506e-132a-4bb3-a6a3-17141b246807", "name": "network-vif-plugged", "status": "completed", "tag": "e19213c0-30d6-414e-b3e1-c01d68e704ee"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:30:22.361805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ceb02ce3-0fc4-4744-b4e4-b181244c775c req-8acfcadc-00a8-4dc0-acad-a8aea107ef2d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:22.362248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ceb02ce3-0fc4-4744-b4e4-b181244c775c req-8acfcadc-00a8-4dc0-acad-a8aea107ef2d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:22.362652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ceb02ce3-0fc4-4744-b4e4-b181244c775c req-8acfcadc-00a8-4dc0-acad-a8aea107ef2d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:22.374691 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ceb02ce3-0fc4-4744-b4e4-b181244c775c req-8acfcadc-00a8-4dc0-acad-a8aea107ef2d service nova] Creating event network-vif-plugged:e19213c0-30d6-414e-b3e1-c01d68e704ee for instance a0a1506e-132a-4bb3-a6a3-17141b246807 on n-h2-858383-10 Oct 12 09:30:22.379909 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ceb02ce3-0fc4-4744-b4e4-b181244c775c req-8acfcadc-00a8-4dc0-acad-a8aea107ef2d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Oct 12 09:30:22.380522 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3434/6439] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:30:23.212152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:23.212914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:23.221815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:23.222411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:23.222956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:23.223816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:23.224402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:23.225004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:23.372163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:23.383865 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15f2cdb6-f8c8-4c92-9035-e5af172504b6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1202 microversion: 2.1 time: 0.178311 Oct 12 09:30:23.384447 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3006/6440] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:23 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:24.414196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:24.415305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:24.426441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:24.427238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:24.428004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:24.429096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:24.429899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:24.430606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:24.566479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:24.574638 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06888a37-6251-4a5d-9bc2-617e67737fbd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1389 microversion: 2.1 time: 0.169244 Oct 12 09:30:24.575226 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3435/6441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:24 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:24.597214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:24.597848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:24.605107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:24.605630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:24.606075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:24.606774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:24.607233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:24.607668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:24.739635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:24.747902 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bdffe135-4712-49c9-ada8-cddaba38555d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1389 microversion: 2.1 time: 0.154703 Oct 12 09:30:24.748480 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3007/6442] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:24 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:24.771948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:24.772570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:24.779705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:24.780230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:24.780671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:24.781363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:24.781856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:24.782290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:25.216968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:25.224986 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2ddca19f-1a5a-48d3-b433-5bc407a3adbe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1389 microversion: 2.1 time: 0.457000 Oct 12 09:30:25.225589 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3436/6443] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:24 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1389 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:25.253915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:25.254411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:25.260876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:25.261356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:25.261825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:25.262524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:25.262976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:25.263419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:25.288722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:30:25.372011 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-46d1102d-736a-46fb-8432-092c5d0ca21b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 204 len: 0 microversion: 2.1 time: 0.121938 Oct 12 09:30:25.372626 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3008/6444] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:30:25 2022] DELETE /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:30:25.381065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:25.381705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:25.388009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:25.388498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:25.388933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:25.389662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:25.390119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:25.390545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:25.524364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:25.532786 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e10bddf-f501-42b2-a328-256625652b9b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1395 microversion: 2.1 time: 0.155694 Oct 12 09:30:25.533421 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3437/6445] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:25 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1395 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:26.562154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:26.563322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:26.573146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:26.573697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:26.574143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:26.574847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:26.575310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:26.575750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:26.710472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:26.719090 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-70983c00-d842-4dbe-b1a5-56f8911a629a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1395 microversion: 2.1 time: 0.164558 Oct 12 09:30:26.719708 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3009/6446] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:26 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:27.461759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7c68be37-b377-494d-90f8-a8e6324bae97 req-1af18db1-9333-44bd-93b0-7dd370469817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1506e-132a-4bb3-a6a3-17141b246807", "name": "network-vif-deleted", "tag": "e19213c0-30d6-414e-b3e1-c01d68e704ee"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:30:27.473673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7c68be37-b377-494d-90f8-a8e6324bae97 req-1af18db1-9333-44bd-93b0-7dd370469817 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:27.474193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7c68be37-b377-494d-90f8-a8e6324bae97 req-1af18db1-9333-44bd-93b0-7dd370469817 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:27.474627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7c68be37-b377-494d-90f8-a8e6324bae97 req-1af18db1-9333-44bd-93b0-7dd370469817 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:27.487922 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7c68be37-b377-494d-90f8-a8e6324bae97 req-1af18db1-9333-44bd-93b0-7dd370469817 service nova] Creating event network-vif-deleted:e19213c0-30d6-414e-b3e1-c01d68e704ee for instance a0a1506e-132a-4bb3-a6a3-17141b246807 on n-h2-858383-10 Oct 12 09:30:27.495421 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7c68be37-b377-494d-90f8-a8e6324bae97 req-1af18db1-9333-44bd-93b0-7dd370469817 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037755 Oct 12 09:30:27.496377 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3438/6447] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:30:27.743312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:27.743850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:27.751436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:27.751935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:27.752376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:27.753084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:27.753581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:27.754009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:27.817073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:27.825734 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ab2a5808-accb-4dfc-bbc8-dc72ee065a80 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1187 microversion: 2.1 time: 0.086728 Oct 12 09:30:27.826291 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3010/6448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:27 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:28.849967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:28.850697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:28.857545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:28.858044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:28.858484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:28.859196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:28.859651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:28.860064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:28.927374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:28.935733 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ebd0e30f-4ab2-4c3e-9909-9eb6348acfde tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1187 microversion: 2.1 time: 0.091011 Oct 12 09:30:28.936285 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3439/6449] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:28 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:29.959103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:29.959704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:29.967194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:29.967685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:29.968120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:29.968824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:29.969278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:29.969730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:30.035258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:30.043593 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-52ea3bcb-13b1-443c-a824-dc127fb22126 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1187 microversion: 2.1 time: 0.088562 Oct 12 09:30:30.044178 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3011/6450] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:29 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:31.067220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:31.067914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:31.075506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:31.075993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:31.076431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:31.077126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:31.077619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:31.078042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:31.144903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:31.153937 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6e370bc8-4a26-4855-a0a2-10475bf0ea12 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 200 len: 1187 microversion: 2.1 time: 0.090724 Oct 12 09:30:31.154526 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3440/6451] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:31 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:32.180077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:32.180745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a0a1506e-132a-4bb3-a6a3-17141b246807] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:32.188603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:32.189420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:32.189871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:32.190588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:32.191039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:32.191457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:32.205595 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance a0a1506e-132a-4bb3-a6a3-17141b246807 could not be found. Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 HTTP/1.1 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance a0a1506e-132a-4bb3-a6a3-17141b246807 could not be found. Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'a0a1506e-132a-4bb3-a6a3-17141b246807'} Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1506e-132a-4bb3-a6a3-17141b246807 could not be found. Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1506e-132a-4bb3-a6a3-17141b246807 could not be found. Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:30:32.207270 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1506e-132a-4bb3-a6a3-17141b246807 could not be found. Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance a0a1506e-132a-4bb3-a6a3-17141b246807 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5417f899-d2cd-4112-9122-c9f7448168b8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807" status: 404 len: 111 microversion: 2.1 time: 0.034646 Oct 12 09:30:32.210935 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3012/6452] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:32 2022] GET /compute/v2.1/servers/a0a1506e-132a-4bb3-a6a3-17141b246807 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:30:37.242311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1919951283", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c4337ad7-3e67-401e-bc4a-a08160b8cd6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3ccd3c8-b0a9-48d0-b379-e64e890e1919"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:30:37.253050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:37.306398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] validate_networks() for [('d3ccd3c8-b0a9-48d0-b379-e64e890e1919', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:30:37.689716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:30:37.690141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:30:37.690612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:30:37.691024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:30:37.691433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:30:37.700610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:37.701089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:37.701561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:37.702282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:37.702735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:37.703155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:37.708719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=75 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:37.721463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:30:37.727491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:30:37.786116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:30:37.788147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4337ad7-3e67-401e-bc4a-a08160b8cd6b',volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:30:37.923176 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-036fd00d-095f-4741-9cca-5364ed70ebd3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685230 Oct 12 09:30:37.923842 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3441/6453] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:30:37.935394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef4a5033-f619-4c44-8623-d5e96560a082 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:37.936006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ef4a5033-f619-4c44-8623-d5e96560a082 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:37.940983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:38.003096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ef4a5033-f619-4c44-8623-d5e96560a082 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:38.010579 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef4a5033-f619-4c44-8623-d5e96560a082 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1057 microversion: 2.1 time: 0.079162 Oct 12 09:30:38.011155 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3013/6454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:37 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1057 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:39.035416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:39.036022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:39.042484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:39.043272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:39.043703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:39.044612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:39.045059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:39.045500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:39.112617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:39.120893 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dfaced03-52fc-48c6-96fe-3f33c415bd7c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1163 microversion: 2.1 time: 0.090324 Oct 12 09:30:39.121389 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3442/6455] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:39 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1163 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:40.144634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:40.146016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:40.154965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:40.155465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:40.155900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:40.156791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:40.157934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:40.158358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:40.162723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:40.357683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:40.366800 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae7e6b3d-ef35-423f-9f4e-01f7e1edb819 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1215 microversion: 2.1 time: 0.227013 Oct 12 09:30:40.367759 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3014/6456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:40 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:40.491162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4c617099-e1af-4f65-bdf4-f54c0090e5a5 req-3dba638d-0023-47f3-9cd4-96c988d2bf3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e05a49-4935-4709-b993-9c36fb6f78c7", "tag": "91660d95-5c00-40d1-8beb-3069f9a84a99"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:30:40.504418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4c617099-e1af-4f65-bdf4-f54c0090e5a5 req-3dba638d-0023-47f3-9cd4-96c988d2bf3c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:40.505368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4c617099-e1af-4f65-bdf4-f54c0090e5a5 req-3dba638d-0023-47f3-9cd4-96c988d2bf3c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:40.505958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4c617099-e1af-4f65-bdf4-f54c0090e5a5 req-3dba638d-0023-47f3-9cd4-96c988d2bf3c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:40.519093 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4c617099-e1af-4f65-bdf4-f54c0090e5a5 req-3dba638d-0023-47f3-9cd4-96c988d2bf3c service nova] Creating event network-changed:91660d95-5c00-40d1-8beb-3069f9a84a99 for instance 91e05a49-4935-4709-b993-9c36fb6f78c7 on n-h2-858383-10 Oct 12 09:30:40.524548 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4c617099-e1af-4f65-bdf4-f54c0090e5a5 req-3dba638d-0023-47f3-9cd4-96c988d2bf3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037410 Oct 12 09:30:40.525293 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3443/6457] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:30:41.391082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:41.392009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:41.400104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:41.400718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:41.401236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:41.402656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:41.403158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:41.403654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:41.571807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:41.579914 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1f656233-2841-470a-88dc-98a0869126ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1215 microversion: 2.1 time: 0.192928 Oct 12 09:30:41.580478 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3015/6458] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:41 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:42.605128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:42.605994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:42.612717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:42.613206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:42.613691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:42.614385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:42.614840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:42.615261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:42.751833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:42.759938 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-754c37c6-293f-4f4b-8c2a-691a8a36f5b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1215 microversion: 2.1 time: 0.160080 Oct 12 09:30:42.760512 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3444/6459] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:42 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:43.787559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:43.788457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:43.798408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:43.798938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:43.799343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:43.800086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:43.800539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:43.800971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:43.936119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:43.944990 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2da1aa19-4e2a-4fe0-89e7-792d49d4b13e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1215 microversion: 2.1 time: 0.164177 Oct 12 09:30:43.945588 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3016/6460] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:43 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:44.972692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:44.973760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:44.984348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:44.984864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:44.985261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:44.986032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:44.986495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:44.986927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:45.118482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:45.126530 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42f64c9a-cd7e-4b05-8b6d-6c11857d33ed tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1203 microversion: 2.1 time: 0.160448 Oct 12 09:30:45.127146 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3445/6461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:44 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:46.154540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:46.155560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:46.162979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:46.163468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:46.163904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:46.164593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:46.165042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:46.165487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:46.306643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:46.314787 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-06c97eb2-2b54-4b55-a107-4d4875b67321 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1203 microversion: 2.1 time: 0.167150 Oct 12 09:30:46.315362 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3017/6462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:46 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:47.342089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:47.343080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:47.354807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:47.355622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:47.356359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:47.357576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:47.358523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:47.359175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:47.511298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:47.522763 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f4f549b-84bf-43fd-acbc-110fb2925abb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1203 microversion: 2.1 time: 0.187057 Oct 12 09:30:47.523559 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3446/6463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:47 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1203 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:48.548846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:48.549474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:48.552285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:48.557455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:48.558013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:48.558437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:48.559150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:48.559598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:48.560021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:48.693191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:48.701260 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-16731193-299c-43dd-8129-4a801775f020 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1203 microversion: 2.1 time: 0.156760 Oct 12 09:30:48.701862 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3018/6464] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:48 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:49.728964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:49.730072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:49.738026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:49.738026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:30:49.744735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:49.745609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:49.746339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:49.747488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:49.748239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:49.748994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:49.889246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:49.897486 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-651d825e-e557-473d-aedb-34b722b30425 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1203 microversion: 2.1 time: 0.175351 Oct 12 09:30:49.898093 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3447/6465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:49 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:50.925749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:50.926817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:50.937726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:50.938207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:50.938636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:50.939323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:50.939771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:50.940191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:51.082754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:51.091325 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e0c95efe-57a7-4a3b-a714-f670e902b421 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1203 microversion: 2.1 time: 0.172648 Oct 12 09:30:51.091929 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3019/6466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:50 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:52.118484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:52.119384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:52.131175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:52.131998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:52.132776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:52.133994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:52.134759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:52.135467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:52.274154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:52.282782 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34b5d7f0-77df-4dc4-b43d-6ba6cdba5693 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1203 microversion: 2.1 time: 0.170982 Oct 12 09:30:52.283346 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3448/6467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:52 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:52.428629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1288b046-619c-456f-9461-abb987155a28 req-fd630d40-2068-4816-9b08-57904ec2a366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e05a49-4935-4709-b993-9c36fb6f78c7", "name": "network-vif-plugged", "status": "completed", "tag": "91660d95-5c00-40d1-8beb-3069f9a84a99"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:30:52.439957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1288b046-619c-456f-9461-abb987155a28 req-fd630d40-2068-4816-9b08-57904ec2a366 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:52.440478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1288b046-619c-456f-9461-abb987155a28 req-fd630d40-2068-4816-9b08-57904ec2a366 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:52.440890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1288b046-619c-456f-9461-abb987155a28 req-fd630d40-2068-4816-9b08-57904ec2a366 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:52.452456 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1288b046-619c-456f-9461-abb987155a28 req-fd630d40-2068-4816-9b08-57904ec2a366 service nova] Creating event network-vif-plugged:91660d95-5c00-40d1-8beb-3069f9a84a99 for instance 91e05a49-4935-4709-b993-9c36fb6f78c7 on n-h2-858383-10 Oct 12 09:30:52.457822 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1288b046-619c-456f-9461-abb987155a28 req-fd630d40-2068-4816-9b08-57904ec2a366 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Oct 12 09:30:52.458787 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3020/6468] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:30:53.311585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:53.312572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:53.320105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:53.320597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:53.321028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:53.321766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:53.322225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:53.322648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:53.466063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:53.476582 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-97915dbb-8f25-4123-b54c-b16621d6cc27 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1203 microversion: 2.1 time: 0.173310 Oct 12 09:30:53.477191 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3449/6469] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:53 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:54.501772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:54.502473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:54.509310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:54.509821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:54.510261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:54.510960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:54.511416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:54.511849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:54.656132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:54.664891 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db276af2-13c0-4b1d-95f4-e5e6c4a947d3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1390 microversion: 2.1 time: 0.168334 Oct 12 09:30:54.665468 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3021/6470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:54 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:54.689203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:54.689925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:54.697057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:54.697564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:54.698014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:54.698716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:54.699169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:54.699599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:54.832652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:54.840825 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc6b65b1-e714-4b10-bb8d-86b0d0979196 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1390 microversion: 2.1 time: 0.157277 Oct 12 09:30:54.841396 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3450/6471] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:54 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:54.863108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:54.863716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:54.870081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:54.870563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:54.870991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:54.871677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:54.872124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:54.872552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:55.006935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:55.018059 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7edf88e-e268-485b-a9d1-ad75ab71255f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1390 microversion: 2.1 time: 0.158962 Oct 12 09:30:55.018634 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3022/6472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:54 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:55.040761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:55.041262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:55.048035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:55.048507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:55.048969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:55.049740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:55.050199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:55.050623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:55.076578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:30:55.156256 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd433a33-4a72-4a79-93c4-e85f4481f467 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 204 len: 0 microversion: 2.1 time: 0.119145 Oct 12 09:30:55.156865 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3451/6473] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:30:55 2022] DELETE /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:30:55.165357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:55.166096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:55.172123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:55.172603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:55.173037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:55.173798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:55.174251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:55.174669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:55.304041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:55.315303 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-498bbad0-45b1-4fa7-8d01-b1e9f69071a4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1396 microversion: 2.1 time: 0.153725 Oct 12 09:30:55.315947 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3023/6474] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:55 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:56.343764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:56.344482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:56.351968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:56.352467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:56.352904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:56.353660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:56.354105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:56.354601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:56.489686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:56.497812 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b32e1a5a-f705-44b3-ba2a-4dff21263eec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1396 microversion: 2.1 time: 0.161251 Oct 12 09:30:56.498365 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3452/6475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:56 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:57.248342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1b711bea-cd86-403d-9ddd-9f2a578a7118 req-b94201f4-4204-4129-b7aa-cb59d6a6ee20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e05a49-4935-4709-b993-9c36fb6f78c7", "name": "network-vif-deleted", "tag": "91660d95-5c00-40d1-8beb-3069f9a84a99"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:30:57.259413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1b711bea-cd86-403d-9ddd-9f2a578a7118 req-b94201f4-4204-4129-b7aa-cb59d6a6ee20 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:57.259911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1b711bea-cd86-403d-9ddd-9f2a578a7118 req-b94201f4-4204-4129-b7aa-cb59d6a6ee20 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:57.260333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1b711bea-cd86-403d-9ddd-9f2a578a7118 req-b94201f4-4204-4129-b7aa-cb59d6a6ee20 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:57.273815 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1b711bea-cd86-403d-9ddd-9f2a578a7118 req-b94201f4-4204-4129-b7aa-cb59d6a6ee20 service nova] Creating event network-vif-deleted:91660d95-5c00-40d1-8beb-3069f9a84a99 for instance 91e05a49-4935-4709-b993-9c36fb6f78c7 on n-h2-858383-10 Oct 12 09:30:57.279945 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1b711bea-cd86-403d-9ddd-9f2a578a7118 req-b94201f4-4204-4129-b7aa-cb59d6a6ee20 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035934 Oct 12 09:30:57.280571 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3024/6476] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:30:57.522286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:57.522906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:57.530763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:57.531369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:57.531925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:57.532694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:57.533223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:57.533685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:57.596609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:57.604673 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ebfdf524-5522-4d09-bac0-dd533db2c0f6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1188 microversion: 2.1 time: 0.086658 Oct 12 09:30:57.605249 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3453/6477] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:57 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:58.629873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:58.630562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:58.637573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:58.638057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:58.638491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:58.639177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:58.639627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:58.640048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:58.704430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:58.712449 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a52de8ce-df6c-4c37-bf54-b572bbc725a3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1188 microversion: 2.1 time: 0.088461 Oct 12 09:30:58.713024 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3025/6478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:58 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:30:59.736554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:30:59.737280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:30:59.744499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:59.745086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:59.745619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:59.746320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:30:59.746817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:30:59.747235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:30:59.809749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:30:59.818143 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f0ef96fd-0dc4-4862-a9dd-c0907cc1e5dd tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1188 microversion: 2.1 time: 0.085608 Oct 12 09:30:59.818686 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3454/6479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:30:59 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:00.847090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:00.847663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:00.855019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:00.855521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:00.855968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:00.856673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:00.857125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:00.857609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:00.920166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:00.928516 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3e09c145-0054-4a8d-bdd0-97ef4b62a15c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 200 len: 1188 microversion: 2.1 time: 0.085605 Oct 12 09:31:00.929093 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3026/6480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:00 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:01.952070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:01.952699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 91e05a49-4935-4709-b993-9c36fb6f78c7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:01.959811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:01.960294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:01.960738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:01.961457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:01.961924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:01.962348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:01.976176 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 91e05a49-4935-4709-b993-9c36fb6f78c7 could not be found. Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 HTTP/1.1 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 91e05a49-4935-4709-b993-9c36fb6f78c7 could not be found. Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '91e05a49-4935-4709-b993-9c36fb6f78c7'} Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e05a49-4935-4709-b993-9c36fb6f78c7 could not be found. Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e05a49-4935-4709-b993-9c36fb6f78c7 could not be found. Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:31:01.977857 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e05a49-4935-4709-b993-9c36fb6f78c7 could not be found. Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 91e05a49-4935-4709-b993-9c36fb6f78c7 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9de84d66-4cac-463b-a82f-7f9cf4409aaa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7" status: 404 len: 111 microversion: 2.1 time: 0.031272 Oct 12 09:31:01.981651 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3455/6481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:01 2022] GET /compute/v2.1/servers/91e05a49-4935-4709-b993-9c36fb6f78c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:31:22.992425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1896384287", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cda7afba-b806-4a64-9887-20d538e9cfd5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d3ccd3c8-b0a9-48d0-b379-e64e890e1919"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:31:23.003354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=29 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:23.004035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=69 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:23.089682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] validate_networks() for [('d3ccd3c8-b0a9-48d0-b379-e64e890e1919', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:31:23.540836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:31:23.541270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:31:23.541778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:31:23.542171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:31:23.542581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:31:23.552261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:23.552756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:23.553195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:23.553982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:23.554439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:23.554863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:23.572184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:31:23.577741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:31:23.590965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:31:23.593046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='cda7afba-b806-4a64-9887-20d538e9cfd5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:31:23.674108 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-14c36cfb-13d7-4ea2-95ba-2cad4fdde239 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685855 Oct 12 09:31:23.674786 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3027/6482] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:31:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:31:23.686503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0fd67962-0bce-4093-a7b2-3febfae7c79c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:23.687121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0fd67962-0bce-4093-a7b2-3febfae7c79c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:23.695886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:23.697086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:23.756411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0fd67962-0bce-4093-a7b2-3febfae7c79c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:23.764583 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0fd67962-0bce-4093-a7b2-3febfae7c79c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1057 microversion: 2.1 time: 0.082270 Oct 12 09:31:23.765166 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3456/6483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:23 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1057 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:24.789963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:24.791384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:24.799326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:24.800055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:24.800646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:24.801656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:24.802132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:24.802565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:24.880662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:24.888837 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77c4e276-9fb4-44fb-a84f-3a4eed6cfb9c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1117 microversion: 2.1 time: 0.104420 Oct 12 09:31:24.889384 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3028/6484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:24 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1117 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:25.914810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:25.915622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:25.928029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:25.928530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:25.929176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:25.929925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:25.930542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:25.930981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:26.084835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:26.093370 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-265d4221-43ca-4567-a37e-ef06cd8404f1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.182581 Oct 12 09:31:26.094007 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3457/6485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:25 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:26.474154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2375c7bc-cdf8-476e-82ef-9bed45b7af0b req-0ed0b8bf-6984-4fe7-b46d-35963c0bad0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "255ffdd9-a0fa-4cfd-829a-ab53f7e82999", "tag": "b2f8c797-403c-4977-b5a6-3384383fdc2f"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:31:26.498319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2375c7bc-cdf8-476e-82ef-9bed45b7af0b req-0ed0b8bf-6984-4fe7-b46d-35963c0bad0e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:26.498994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2375c7bc-cdf8-476e-82ef-9bed45b7af0b req-0ed0b8bf-6984-4fe7-b46d-35963c0bad0e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:26.499597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2375c7bc-cdf8-476e-82ef-9bed45b7af0b req-0ed0b8bf-6984-4fe7-b46d-35963c0bad0e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:26.512431 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2375c7bc-cdf8-476e-82ef-9bed45b7af0b req-0ed0b8bf-6984-4fe7-b46d-35963c0bad0e service nova] Creating event network-changed:b2f8c797-403c-4977-b5a6-3384383fdc2f for instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 on n-h2-858383-10 Oct 12 09:31:26.518192 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2375c7bc-cdf8-476e-82ef-9bed45b7af0b req-0ed0b8bf-6984-4fe7-b46d-35963c0bad0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048324 Oct 12 09:31:26.519310 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3029/6486] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:31:27.116469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:27.117205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:27.124085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:27.124813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:27.125354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:27.126177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:27.126727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:27.127248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:27.278338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:27.286547 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-16e000b3-c69a-44f7-8f09-9c15ad11a658 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.174078 Oct 12 09:31:27.287131 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3458/6487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:27 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:28.310349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:28.311045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:28.326877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:28.327888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:28.329864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:28.330817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:28.331761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:28.334020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:28.565200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:28.575475 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-26a74f3a-0836-42a3-a8d2-02633d96f553 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.269608 Oct 12 09:31:28.589600 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3030/6488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:28 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:29.608133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:29.609745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:29.618729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:29.619226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:29.619667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:29.620379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:29.620839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:29.621270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:29.818042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:29.827776 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0b97f70c-82c7-4e58-ba15-5f19c794e359 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.225385 Oct 12 09:31:29.828292 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3459/6489] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:29 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:30.853483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:30.854787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:30.864269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:30.865461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:30.865914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:30.866934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:30.867069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:30.867500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:31.040332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:31.049726 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-516418dd-a111-458c-a8cc-968eab5ad303 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.200715 Oct 12 09:31:31.064975 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3031/6490] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:30 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:32.072555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:32.073195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:32.080887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:32.083845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:32.083845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:32.083845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:32.083845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:32.083845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:32.218843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:32.227099 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-00a75230-b418-4bff-a4d5-2aba1fa9f886 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.158520 Oct 12 09:31:32.228033 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3460/6491] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:32 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:33.254677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:33.256100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:33.268287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:33.268765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:33.269196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:33.269925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:33.270377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:33.270798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:33.413341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:33.421478 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1412f9dd-abee-4ffc-b864-bd3de15838b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.173979 Oct 12 09:31:33.422040 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3032/6492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:33 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:34.448715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:34.449839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:34.454280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:34.464077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:34.464906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:34.465702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:34.466876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:34.467690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:34.468416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:34.603588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:34.612309 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0cc38bfd-a572-41f2-bd94-451eafbb5c28 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.170195 Oct 12 09:31:34.612849 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3461/6493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:34 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:35.635951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:35.636538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:35.638818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:35.639784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:35.646642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:35.647074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:35.647508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:35.648209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:35.648660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:35.649085 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:35.781784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:35.792329 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7dbf013f-9c31-4ac6-ad03-78544d5c4817 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.160358 Oct 12 09:31:35.792897 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3033/6494] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:35 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:36.816040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:36.816615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:36.824069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:36.824532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:36.824986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:36.825726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:36.826177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:36.826605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:36.966369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:36.974713 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b56f6899-ef43-436a-80b7-29ea63deeb18 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.162799 Oct 12 09:31:36.975355 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3462/6495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:36 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:37.998511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:37.999051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:38.006146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:38.006638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:38.007088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:38.007818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:38.008285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:38.008716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:38.142200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:38.150238 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b98c55eb-913c-41f7-835f-8f59cd7bfa6c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.156063 Oct 12 09:31:38.151166 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3034/6496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:37 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:39.174217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:39.174737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:39.182410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:39.182899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:39.183336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:39.184039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:39.184496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:39.184920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:39.325245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:39.333155 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-df9d2b1c-0a5c-4bd1-b20a-2c9561c79f0c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1169 microversion: 2.1 time: 0.163223 Oct 12 09:31:39.333850 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3463/6497] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:39 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:40.361031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:40.362123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:40.374926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:40.375733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:40.376639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:40.377616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:40.378077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:40.378487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:40.514691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:40.522998 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a6894bb-d1ab-47e5-8082-0bc254bc8791 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.168493 Oct 12 09:31:40.523576 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3035/6498] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:40 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:41.550387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:41.550983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:41.558588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:41.559111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:41.559569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:41.560310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:41.560970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:41.561365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:41.819835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:41.828175 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4981d17d-bea5-4cbc-ae15-8ed8ade89680 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.284268 Oct 12 09:31:41.828785 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3464/6499] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:41 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:42.852191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:42.852766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:42.860140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:42.860616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:42.861051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:42.862230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:42.862230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:42.862684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:43.061546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:43.069636 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-10361c19-1309-4782-9785-3f2e5bebb3c0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.221417 Oct 12 09:31:43.070196 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3036/6500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:42 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:44.096484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:44.097477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:44.105093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:44.105619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:44.106059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:44.106759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:44.107217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:44.107649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:44.244255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:44.254037 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d942397-21d7-4859-bd09-718a7a31e609 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.164214 Oct 12 09:31:44.254718 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3465/6501] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:44 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:45.281754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:45.282623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:45.294332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:45.295142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:45.295870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:45.297018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:45.297828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:45.298543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:45.435541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:45.445319 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e10505ca-8aa8-4e04-ab09-05eb023c810a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.170530 Oct 12 09:31:45.445928 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3037/6502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:45 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:46.472641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:46.473650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:46.481478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:46.481965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:46.482404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:46.483095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:46.483551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:46.483978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:46.632068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:46.640239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fd33342c-4705-45f4-9d53-bbf04c8913fa tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.174416 Oct 12 09:31:46.640808 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3466/6503] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:46 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:47.668066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:47.668992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:47.681004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:47.681864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:47.682590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:47.683723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:47.684471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:47.685234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:47.822817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:47.831095 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1cbf97ce-ab5f-478d-9168-a40a5fa8611c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.169782 Oct 12 09:31:47.831710 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3038/6504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:47 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:48.858657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:48.859204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:48.866537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:48.867035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:48.867507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:48.868232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:48.868694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:48.869129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:49.007047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:49.015043 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dbccfad7-3eb2-4cea-9164-e9364dabdaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.160672 Oct 12 09:31:49.015628 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3467/6505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:48 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:50.042407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:50.043480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:50.054444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:50.054928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:50.055366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:50.056058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:50.056508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:50.056930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:50.195646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:50.203595 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-790f6d93-6b3b-493c-8fcf-015bdce8568f tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.168081 Oct 12 09:31:50.204155 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3039/6506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:50 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:50.655406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-dd370090-b7d3-4278-b3f1-651b1bb34e21 req-da681c42-13f3-4b43-8782-8481aa0e85b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255ffdd9-a0fa-4cfd-829a-ab53f7e82999", "name": "network-vif-plugged", "status": "completed", "tag": "b2f8c797-403c-4977-b5a6-3384383fdc2f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:31:50.667376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dd370090-b7d3-4278-b3f1-651b1bb34e21 req-da681c42-13f3-4b43-8782-8481aa0e85b1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:50.668248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dd370090-b7d3-4278-b3f1-651b1bb34e21 req-da681c42-13f3-4b43-8782-8481aa0e85b1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:50.668688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-dd370090-b7d3-4278-b3f1-651b1bb34e21 req-da681c42-13f3-4b43-8782-8481aa0e85b1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:50.680527 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-dd370090-b7d3-4278-b3f1-651b1bb34e21 req-da681c42-13f3-4b43-8782-8481aa0e85b1 service nova] Creating event network-vif-plugged:b2f8c797-403c-4977-b5a6-3384383fdc2f for instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 on n-h2-858383-10 Oct 12 09:31:50.685826 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-dd370090-b7d3-4278-b3f1-651b1bb34e21 req-da681c42-13f3-4b43-8782-8481aa0e85b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034243 Oct 12 09:31:50.686628 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3468/6507] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:31:51.228227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:51.229023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:51.238554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:51.239207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:51.239796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:51.240746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:51.241351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:51.241966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:51.382390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:51.390753 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d157217-5db4-4476-a5c2-f077a1946e82 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1203 microversion: 2.1 time: 0.167454 Oct 12 09:31:51.391356 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3040/6508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:51 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:52.419646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:52.420871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:52.431184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:52.431676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:52.432114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:52.432819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:52.433284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:52.433748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:52.576792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:52.585291 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b54813df-f8d8-41f0-8bba-d7fcf983f275 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1390 microversion: 2.1 time: 0.172937 Oct 12 09:31:52.585882 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3469/6509] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:52 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:52.612713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:52.613367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:52.620551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:52.621038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:52.621473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:52.622211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:52.622667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:52.623097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:52.762991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:52.771539 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f0dcf3ba-196a-4989-8d7d-82ebb95ff4e8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1390 microversion: 2.1 time: 0.162710 Oct 12 09:31:52.772111 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3041/6510] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:52 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:52.793892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:52.794503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:52.800952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:52.801490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:52.801894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:52.802591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:52.803044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:52.803472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:52.942088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:52.954147 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bfd31c73-f04f-4a37-993a-3c163e639b1c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1390 microversion: 2.1 time: 0.163867 Oct 12 09:31:52.954864 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3470/6511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:52 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:53.036143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:53.036640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:53.038569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:53.045347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:53.045900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:53.046339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:53.047604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:53.048073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:53.048696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:53.051905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=83 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:53.076701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:31:53.152649 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6ceffa21-879a-416d-b7cd-6d524ed5f9bf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 204 len: 0 microversion: 2.1 time: 0.121071 Oct 12 09:31:53.153252 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3042/6512] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:31:53 2022] DELETE /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:31:53.161590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:53.162327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:53.168529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:53.169014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:53.169474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:53.170176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:53.170628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:53.171046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:53.300662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:53.312179 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ee8e5640-4996-4e61-bb8a-9a491b1f6da4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1396 microversion: 2.1 time: 0.154245 Oct 12 09:31:53.313000 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3471/6513] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:53 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:54.338462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:54.339122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:54.346662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:54.347159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:54.347595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:54.348283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:54.348734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:54.349152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:54.545129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:54.553465 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5a5b4ca4-4341-4ae5-8b40-7034780c11c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1396 microversion: 2.1 time: 0.219364 Oct 12 09:31:54.554168 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3043/6514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:54 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1396 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:55.351224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8d5a4699-2245-40fc-826c-aee8ffbf3429 req-3e47d809-398b-41ab-8ff4-a5174d045799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "255ffdd9-a0fa-4cfd-829a-ab53f7e82999", "name": "network-vif-deleted", "tag": "b2f8c797-403c-4977-b5a6-3384383fdc2f"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:31:55.356348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=35 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:55.362067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8d5a4699-2245-40fc-826c-aee8ffbf3429 req-3e47d809-398b-41ab-8ff4-a5174d045799 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:55.362966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8d5a4699-2245-40fc-826c-aee8ffbf3429 req-3e47d809-398b-41ab-8ff4-a5174d045799 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:55.363400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8d5a4699-2245-40fc-826c-aee8ffbf3429 req-3e47d809-398b-41ab-8ff4-a5174d045799 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:55.368044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=87 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:31:55.377422 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8d5a4699-2245-40fc-826c-aee8ffbf3429 req-3e47d809-398b-41ab-8ff4-a5174d045799 service nova] Creating event network-vif-deleted:b2f8c797-403c-4977-b5a6-3384383fdc2f for instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 on n-h2-858383-10 Oct 12 09:31:55.383816 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8d5a4699-2245-40fc-826c-aee8ffbf3429 req-3e47d809-398b-41ab-8ff4-a5174d045799 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113848 Oct 12 09:31:55.384785 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3472/6515] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:31:55.576870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:55.577568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:55.584586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:55.585076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:55.585616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:55.586342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:55.586793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:55.587222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:55.653470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:55.661702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1e87e4d3-c414-46e4-b7b2-90c8aa8162c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1188 microversion: 2.1 time: 0.088814 Oct 12 09:31:55.662335 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3044/6516] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:55 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:31:56.686064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:56.686907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:56.693868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:56.694363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:56.694811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:56.695522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:56.695985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:56.696419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:56.760806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:56.769468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de191226-5544-4a04-98fc-0a895e2a3788 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1188 microversion: 2.1 time: 0.088827 Oct 12 09:31:56.770148 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3473/6517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:56 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:57.794038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:57.794775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:57.802038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:57.802544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:57.802957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:57.803653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:57.804165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:57.804597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:57.867744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:57.875965 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97216bef-06a9-4725-9d57-0b706e5e9dce tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1188 microversion: 2.1 time: 0.086051 Oct 12 09:31:57.876542 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3045/6518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:57 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:31:58.899633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:31:58.900619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:31:58.908035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:58.908527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:58.909011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:58.909745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:31:58.910197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:31:58.910623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:31:58.973078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:31:58.981309 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb8c9d1f-ea3e-4f11-8abb-b1300ddb3efe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 200 len: 1188 microversion: 2.1 time: 0.085823 Oct 12 09:31:58.982268 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3474/6519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:58 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:00.004411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:00.005015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:00.012470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:00.012960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:00.013395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:00.014118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:00.014743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:00.015167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:00.034529 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 HTTP/1.1 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '255ffdd9-a0fa-4cfd-829a-ab53f7e82999'} Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:32:00.036403 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-48b959f9-b94f-4f45-843c-53f75337a216 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 404 len: 111 microversion: 2.1 time: 0.037648 Oct 12 09:32:00.040611 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3046/6520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:31:59 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:32:02.183942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:02.184442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:02.187959 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:32:02.188097 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:32:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 (ip 10.222.0.40) !!! Oct 12 09:32:02.200741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:02.201243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:02.201738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:02.202457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:02.202913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:02.203357 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:02.217658 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 HTTP/1.1 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '255ffdd9-a0fa-4cfd-829a-ab53f7e82999'} Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:32:02.219418 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7bbc9a97-b635-4e65-acf5-12f6c6b2b61d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 404 len: 111 microversion: 2.1 time: 0.041004 Oct 12 09:32:02.223380 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3475/6521] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:32:02 2022] DELETE /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:32:02.229752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:02.230372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 255ffdd9-a0fa-4cfd-829a-ab53f7e82999] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:02.237529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:02.238022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:02.238459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:02.239162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:02.239739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:02.240167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:02.257018 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 HTTP/1.1 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '255ffdd9-a0fa-4cfd-829a-ab53f7e82999'} Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:32:02.258634 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 255ffdd9-a0fa-4cfd-829a-ab53f7e82999 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc850c13-1947-4592-8a7e-388b034df347 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999" status: 404 len: 111 microversion: 2.1 time: 0.034225 Oct 12 09:32:02.261994 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3047/6522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:02 2022] GET /compute/v2.1/servers/255ffdd9-a0fa-4cfd-829a-ab53f7e82999 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:32:22.014303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-938365506", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d435a037-db2b-414c-8e87-340775c4711f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d3ccd3c8-b0a9-48d0-b379-e64e890e1919"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:32:22.025377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=7 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:22.026061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=15 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:22.093945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] validate_networks() for [('d3ccd3c8-b0a9-48d0-b379-e64e890e1919', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:32:22.471814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:32:22.472417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:32:22.473169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:32:22.473879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:32:22.474474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:32:22.489259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:22.490041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:22.490834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:22.491582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:22.492042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:22.492475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:22.510478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:32:22.516312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:32:22.577113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:32:22.579249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d435a037-db2b-414c-8e87-340775c4711f',volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:32:22.713124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-63a5e960-24e2-4936-a203-0847b0afb681 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702976 Oct 12 09:32:22.714177 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3476/6523] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:32:22.725243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-28f26e9a-248a-41fd-98a8-688fd9b968c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:22.725912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-28f26e9a-248a-41fd-98a8-688fd9b968c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:22.728727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:22.729386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:22.784997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-28f26e9a-248a-41fd-98a8-688fd9b968c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:22.792221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-28f26e9a-248a-41fd-98a8-688fd9b968c9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1070 microversion: 2.1 time: 0.070931 Oct 12 09:32:22.793185 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3048/6524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:22 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1070 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:23.820782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:23.822057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:23.832287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:23.833156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:23.834338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:23.835271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:23.836200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:23.836901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:23.904788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:23.913582 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca480c8c-af5c-4347-b8fb-91c820cc6c1a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1168 microversion: 2.1 time: 0.100976 Oct 12 09:32:23.914190 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3477/6525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:23 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1168 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:24.937978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:24.939224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:24.947593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:24.948088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:24.948533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:24.949242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:24.949735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:24.950169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:25.082475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:25.091000 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc93c275-41d6-4ddb-84ef-1a518ca60f9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1228 microversion: 2.1 time: 0.156938 Oct 12 09:32:25.093476 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3049/6526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:24 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1228 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:25.492575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2370cc11-d214-4200-bd7e-05d3554bf637 req-e534495e-6ec7-461f-b1f4-ebf604a734c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5772cb91-e323-4119-8b7a-89ede8db530a", "tag": "1f554720-290d-47b8-aced-5ed7350d0232"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:32:25.504165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2370cc11-d214-4200-bd7e-05d3554bf637 req-e534495e-6ec7-461f-b1f4-ebf604a734c5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:25.504783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2370cc11-d214-4200-bd7e-05d3554bf637 req-e534495e-6ec7-461f-b1f4-ebf604a734c5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:25.505491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2370cc11-d214-4200-bd7e-05d3554bf637 req-e534495e-6ec7-461f-b1f4-ebf604a734c5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:25.519188 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-2370cc11-d214-4200-bd7e-05d3554bf637 req-e534495e-6ec7-461f-b1f4-ebf604a734c5 service nova] Creating event network-changed:1f554720-290d-47b8-aced-5ed7350d0232 for instance 5772cb91-e323-4119-8b7a-89ede8db530a on n-h2-858383-10 Oct 12 09:32:25.525416 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2370cc11-d214-4200-bd7e-05d3554bf637 req-e534495e-6ec7-461f-b1f4-ebf604a734c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035941 Oct 12 09:32:25.526088 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3478/6527] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:32:26.114081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:26.114700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:26.121878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:26.122348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:26.122762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:26.123652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:26.124133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:26.124530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:26.266129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:26.274301 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c1f275a7-54b2-4cc3-b09b-2a659f739fb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1228 microversion: 2.1 time: 0.164159 Oct 12 09:32:26.275282 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3050/6528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:26 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1228 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:27.298758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:27.299568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:27.307778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:27.308270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:27.308703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:27.309384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:27.309859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:27.310336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:27.447222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:27.455407 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-99da6c4d-a4dc-4d0f-9a48-70c0f6e4989e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1228 microversion: 2.1 time: 0.161076 Oct 12 09:32:27.456026 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3479/6529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:27 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1228 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:28.479201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:28.479727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:28.487185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:28.487678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:28.488150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:28.488816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:28.489274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:28.489717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:28.621185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:28.629409 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee9cb163-4fe4-4685-9810-fad73e1ff7e5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1228 microversion: 2.1 time: 0.154486 Oct 12 09:32:28.630042 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3051/6530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:28 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1228 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:29.657016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:29.658001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:29.669782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:29.670600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:29.671328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:29.672467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:29.673224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:29.673972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:29.812865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:29.823902 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7322d4e-ea42-4d31-908f-e6c26ea713bb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.173465 Oct 12 09:32:29.824456 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3480/6531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:29 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:30.855946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:30.856541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:30.863925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:30.864415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:30.864860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:30.865596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:30.866058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:30.866490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:31.010478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:31.022471 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2a4e2b21-2b61-4643-b537-75aff4e5ca61 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.172808 Oct 12 09:32:31.023286 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3052/6532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:30 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:32.054371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:32.055390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:32.063982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:32.064474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:32.064909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:32.065711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:32.066174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:32.066609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:32.201247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:32.209614 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5d22fa4d-7df4-477d-81be-21e15d71ce16 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.162126 Oct 12 09:32:32.210201 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3481/6533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:32 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:33.237080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:33.237986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:33.242372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:33.249219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:33.249727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:33.250161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:33.250848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:33.251301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:33.251725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:33.380326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:33.388497 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0510a42d-dd47-49f0-8598-0350f62a8832 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.158259 Oct 12 09:32:33.389061 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3053/6534] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:33 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:34.418806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:34.419576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:34.422060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:34.422932 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:34.431245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:34.431857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:34.432407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:34.433275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:34.433989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:34.434559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:34.575360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:34.583316 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0eb0aace-0e7b-4d86-8ae0-c77776b98dd8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.169894 Oct 12 09:32:34.583932 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3482/6535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:34 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:35.606928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:35.607538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:35.614833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:35.615321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:35.615753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:35.616450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:35.616899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:35.617323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:35.757702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:35.767289 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-00e39160-4386-4eea-bc95-903d32355f25 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.164353 Oct 12 09:32:35.767883 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3054/6536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:35 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:36.790554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:36.791311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:36.798614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:36.799115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:36.799562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:36.800254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:36.800730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:36.801351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:36.932033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:36.940318 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f94838d0-898d-441d-bfa5-a9688cf21c92 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.153958 Oct 12 09:32:36.940906 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3483/6537] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:36 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:37.966884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:37.967636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:37.976122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:37.976730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:37.977282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:37.978199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:37.978771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:37.979309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:38.117049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:38.129128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e402738f-1c20-41b5-ac3e-153ecb173064 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.168531 Oct 12 09:32:38.130052 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3055/6538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:37 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:38.936892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-85d8438e-9ab8-4d67-a279-6e199904cb4d req-3d679dd4-c56c-4f7e-b6d3-4020c344af3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5772cb91-e323-4119-8b7a-89ede8db530a", "name": "network-vif-plugged", "status": "completed", "tag": "1f554720-290d-47b8-aced-5ed7350d0232"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:32:38.946865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-85d8438e-9ab8-4d67-a279-6e199904cb4d req-3d679dd4-c56c-4f7e-b6d3-4020c344af3b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:38.947352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-85d8438e-9ab8-4d67-a279-6e199904cb4d req-3d679dd4-c56c-4f7e-b6d3-4020c344af3b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:38.947770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-85d8438e-9ab8-4d67-a279-6e199904cb4d req-3d679dd4-c56c-4f7e-b6d3-4020c344af3b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:38.962196 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-85d8438e-9ab8-4d67-a279-6e199904cb4d req-3d679dd4-c56c-4f7e-b6d3-4020c344af3b service nova] Creating event network-vif-plugged:1f554720-290d-47b8-aced-5ed7350d0232 for instance 5772cb91-e323-4119-8b7a-89ede8db530a on n-h2-858383-10 Oct 12 09:32:38.967335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-85d8438e-9ab8-4d67-a279-6e199904cb4d req-3d679dd4-c56c-4f7e-b6d3-4020c344af3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099444 Oct 12 09:32:38.967940 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3484/6539] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:32:39.158494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:39.159105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:39.166246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:39.166751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:39.167185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:39.167875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:39.168383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:39.168811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:39.303059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:39.312989 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a26364af-1403-4089-b8ed-6dda768b10e7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1216 microversion: 2.1 time: 0.158510 Oct 12 09:32:39.313602 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3056/6540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:39 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:40.338401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:40.339117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:40.345969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:40.346456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:40.346894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:40.347596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:40.348070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:40.348487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:40.484475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:40.492878 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f9ffb3cb-09c3-4376-a83c-49f220ca716b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1403 microversion: 2.1 time: 0.160031 Oct 12 09:32:40.493472 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3485/6541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:40 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:40.515503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:40.516127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:40.523462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:40.524248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:40.524824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:40.525535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:40.525997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:40.526874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:40.665154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:40.673466 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c4b35583-6a4a-4660-b479-32c3fa10a939 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1403 microversion: 2.1 time: 0.162001 Oct 12 09:32:40.674055 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3057/6542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:40 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1403 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:40.696174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1248328142"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:32:40.698581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:40.705079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:40.705601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:40.706023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:40.706743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:40.707203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:40.707614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:40.808327 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.compute.api [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Attempting to quiesce instance before volume snapshot. Oct 12 09:32:40.875641 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.compute.api [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 12 09:32:40.955421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Creating snapshot from volume d435a037-db2b-414c-8e87-340775c4711f. {{(pid=127006) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 12 09:32:41.775239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9099ec56-a7c8-4227-bdca-c4de4de3da08 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a/action" status: 202 len: 0 microversion: 2.1 time: 1.083101 Oct 12 09:32:41.776022 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3486/6543] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:32:40 2022] POST /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a/action => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 12 09:32:42.941226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1526042537", "imageRef": "f6ee0c12-a13e-4737-b3a3-6bde6bbe2b0d", "flavorRef": "452", "networks": [{"uuid": "d3ccd3c8-b0a9-48d0-b379-e64e890e1919"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:32:42.999038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] validate_networks() for [('d3ccd3c8-b0a9-48d0-b379-e64e890e1919', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:32:43.372943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:32:43.373873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:32:43.374903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:32:43.375479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:32:43.376213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:32:43.389193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:43.389718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:43.390155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:43.390875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:43.391323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:43.391748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:43.409110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:32:43.414755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:32:43.426952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:32:43.429553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1748fb06-a697-4dcf-b07b-9861d52a9fc0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:32:43.507465 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d07cf63f-c665-4c94-8648-d08f4360b66b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570142 Oct 12 09:32:43.508112 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3058/6544] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:32:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:32:43.521389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95bf4a74-084e-4497-a2b1-a7506dfed3e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:43.522220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95bf4a74-084e-4497-a2b1-a7506dfed3e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:43.578613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95bf4a74-084e-4497-a2b1-a7506dfed3e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:43.585669 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95bf4a74-084e-4497-a2b1-a7506dfed3e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1230 microversion: 2.1 time: 0.069643 Oct 12 09:32:43.586255 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3487/6545] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:43 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1230 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:32:44.608810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:44.609568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:44.616504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:44.617079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:44.617546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:44.618241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:44.618719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:44.619142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:44.697892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:44.705971 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b262493-20b8-4e40-be3c-fe458a321d3a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1290 microversion: 2.1 time: 0.101100 Oct 12 09:32:44.706693 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3059/6546] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:44 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:45.731288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:45.731916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:45.742038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:45.742550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:45.742998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:45.744194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:45.744677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:45.745122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:45.900995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:45.932389 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f2c7cffb-d5a1-4025-b261-db4f46f0a988 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.205963 Oct 12 09:32:45.933546 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3488/6547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:45 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:46.154404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-51fa77b0-2746-427f-9e00-0c63bbaec1b4 req-f73411e2-d0f3-4ec3-a6c3-267d2620fef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532459ed-9efa-4d82-9ebc-ac2a4bac376f", "tag": "5dc2ba09-42e4-43e3-a2ed-3dc5575885d7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:32:46.168550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-51fa77b0-2746-427f-9e00-0c63bbaec1b4 req-f73411e2-d0f3-4ec3-a6c3-267d2620fef5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:46.169029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-51fa77b0-2746-427f-9e00-0c63bbaec1b4 req-f73411e2-d0f3-4ec3-a6c3-267d2620fef5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:46.169748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-51fa77b0-2746-427f-9e00-0c63bbaec1b4 req-f73411e2-d0f3-4ec3-a6c3-267d2620fef5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:46.195605 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-51fa77b0-2746-427f-9e00-0c63bbaec1b4 req-f73411e2-d0f3-4ec3-a6c3-267d2620fef5 service nova] Creating event network-changed:5dc2ba09-42e4-43e3-a2ed-3dc5575885d7 for instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f on n-h1-858383-10 Oct 12 09:32:46.201031 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-51fa77b0-2746-427f-9e00-0c63bbaec1b4 req-f73411e2-d0f3-4ec3-a6c3-267d2620fef5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051276 Oct 12 09:32:46.202789 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3060/6548] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:32:46.960005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:46.960863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:46.968317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:46.968888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:46.969406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:46.970218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:46.970746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:46.971249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:47.115300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:47.126410 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-23bfb8a7-afb2-4ac8-aae7-cb1dd143beeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.170935 Oct 12 09:32:47.127415 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3489/6549] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:46 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:48.152973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:48.154434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:48.161223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:48.161929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:48.162542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:48.163375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:48.164101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:48.164663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:48.346696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:48.359099 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-64d62725-ddfc-4ead-9eef-13b0080c95b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.212418 Oct 12 09:32:48.359974 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3061/6550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:48 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:49.389733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:49.390448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:49.401717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:49.402383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:49.402850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:49.403784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:49.404838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:49.405546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:49.616468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:49.626079 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-963df7ff-9bb7-4b5a-92d9-d38e7f298604 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.242369 Oct 12 09:32:49.626665 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3490/6551] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:49 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:50.652972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:50.653674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:50.660956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:50.661454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:50.661894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:50.662581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:50.663188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:50.663846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:50.835840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:50.849102 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b534e140-ce66-40da-a420-2f1315d0a8d7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.200694 Oct 12 09:32:50.849843 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3062/6552] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:50 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:51.874500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:51.875186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:51.882529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:51.883016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:51.883536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:51.884248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:51.884719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:51.885158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:52.033962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:52.042274 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2b635025-4f5a-4056-a322-364f4eb26e36 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.172020 Oct 12 09:32:52.043063 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3491/6553] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:51 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:53.070230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:53.071149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:53.075612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:53.084465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:53.085256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:53.086022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:53.087103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:53.087900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:53.088604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:53.092366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=77 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:53.228745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:53.237237 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eecf58f9-303e-4bf9-b9c5-1782e87d488c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.174042 Oct 12 09:32:53.237866 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3063/6554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:53 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:54.262207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:54.263017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:54.266930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:54.268042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:54.275289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:54.275962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:54.276545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:54.277581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:54.277983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:54.278420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:54.282029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:54.418120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:54.426316 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-38e17539-20d5-4d9c-898c-a5ac29af3e7b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.169431 Oct 12 09:32:54.426911 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3492/6555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:54 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:55.450712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:55.451230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:55.453327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:55.454052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:32:55.461740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:55.462505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:55.462943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:55.463657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:55.464110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:55.464528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:55.607306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:55.616895 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3daced18-40de-4597-87ca-31b7c81f5aec tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.170548 Oct 12 09:32:55.617544 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3064/6556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:55 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:56.640655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:56.641416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:56.649061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:56.649685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:56.650209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:56.650988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:56.651534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:56.652138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:56.786835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:56.796036 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e285f642-08ee-4610-82cb-2eabf2646c87 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.159345 Oct 12 09:32:56.796854 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3493/6557] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:56 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:57.819893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:57.820624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:57.828263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:57.828797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:57.829240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:57.829981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:57.830440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:57.830887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:57.971801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:57.980382 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65b96c66-c798-4638-b22e-2f3eacb03cf3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.164135 Oct 12 09:32:57.981233 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3065/6558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:57 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:32:59.005017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:32:59.005724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:32:59.013913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:59.014423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:59.014875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:59.015620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:32:59.016079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:32:59.016524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:32:59.157243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:32:59.165989 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-adfd2b29-e89d-4951-b1c9-22b3fa262b83 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1342 microversion: 2.1 time: 0.165541 Oct 12 09:32:59.166688 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3494/6559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:32:58 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:00.195247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:00.196211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:00.208452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:00.209290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:00.210109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:00.211227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:00.211993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:00.212705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:00.358940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:00.367323 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e25fbb1b-3f8d-4a25-a870-746aa2845651 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.178929 Oct 12 09:33:00.367915 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3066/6560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:00 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:01.391353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:01.391982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:01.399680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:01.400294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:01.400746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:01.401462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:01.401946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:01.402380 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:01.541619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:01.550311 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-858d1375-001b-497b-a5bc-863959939d48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.163179 Oct 12 09:33:01.550872 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3495/6561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:01 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:02.574275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:02.574931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:02.582776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:02.583286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:02.583739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:02.584478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:02.584950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:02.585409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:02.729193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:02.742072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-80c1b324-b429-4d62-94f8-c7bae1c2101d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.171252 Oct 12 09:33:02.742881 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3067/6562] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:02 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:03.769490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:03.770219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:03.779615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:03.780246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:03.780815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:03.781759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:03.782353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:03.782913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:03.922234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:03.930665 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ae09df60-10ab-4802-8da8-39871e0af655 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.166114 Oct 12 09:33:03.931250 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3496/6563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:03 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:04.955409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:04.956021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:04.963507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:04.963992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:04.964429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:04.965118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:04.965682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:04.966107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:05.104891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:05.113094 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-18700265-002b-412a-a2bd-5ce0b5e1f3e0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.161989 Oct 12 09:33:05.113630 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3068/6564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:04 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:06.138085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:06.138813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:06.146209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:06.146737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:06.147187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:06.147947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:06.148775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:06.149214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:06.286482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:06.294917 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-19fbfc9c-16d2-453d-b622-e43830325e85 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.161373 Oct 12 09:33:06.295676 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3497/6565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:06 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:33:07.319337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:07.319969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:07.329881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:07.330588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:07.331335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:07.332401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:07.333322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:07.334025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:07.479985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:07.491911 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-08493f61-f670-40c4-85dd-48b8c60aa9d0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.176617 Oct 12 09:33:07.492771 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3069/6566] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:07 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:08.519262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:08.519917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:08.528859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:08.529466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:08.530010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:08.530784 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:08.531255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:08.531676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:08.685312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:08.693645 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e2efffe9-a554-4f2b-9ed9-a44f99ae32b0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.179631 Oct 12 09:33:08.694264 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3498/6567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:08 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:08.823801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ee51d091-a7d3-460b-9e79-b512b1763054 req-5b4d9cf8-d583-4861-ae84-9f0b875430ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532459ed-9efa-4d82-9ebc-ac2a4bac376f", "name": "network-vif-plugged", "status": "completed", "tag": "5dc2ba09-42e4-43e3-a2ed-3dc5575885d7"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:33:08.834459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ee51d091-a7d3-460b-9e79-b512b1763054 req-5b4d9cf8-d583-4861-ae84-9f0b875430ce service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:08.834964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ee51d091-a7d3-460b-9e79-b512b1763054 req-5b4d9cf8-d583-4861-ae84-9f0b875430ce service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:08.835421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ee51d091-a7d3-460b-9e79-b512b1763054 req-5b4d9cf8-d583-4861-ae84-9f0b875430ce service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:08.847275 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ee51d091-a7d3-460b-9e79-b512b1763054 req-5b4d9cf8-d583-4861-ae84-9f0b875430ce service nova] Creating event network-vif-plugged:5dc2ba09-42e4-43e3-a2ed-3dc5575885d7 for instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f on n-h1-858383-10 Oct 12 09:33:08.852506 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ee51d091-a7d3-460b-9e79-b512b1763054 req-5b4d9cf8-d583-4861-ae84-9f0b875430ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032640 Oct 12 09:33:08.853106 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3070/6568] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:33:09.721186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:09.721836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:09.731171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:09.731742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:09.732355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:09.733162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:09.733895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:09.734419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:09.875916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:09.885036 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2b38f20f-1732-4592-bf97-5e944cdfa623 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1376 microversion: 2.1 time: 0.170547 Oct 12 09:33:09.885694 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3499/6569] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:09 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:10.913252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:10.914019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:10.921160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:10.921684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:10.922176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:10.922892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:10.923341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:10.923745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:11.071759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:11.080138 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-df7b4e3f-06fe-4b5d-812e-33b2671140b3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1563 microversion: 2.1 time: 0.174532 Oct 12 09:33:11.080724 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3071/6570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:10 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:11.104242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:11.104894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:11.112208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:11.112647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:11.113100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:11.113884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:11.114390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:11.114830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:11.258955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:11.267415 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a9db519d-010b-487e-a204-785fcb7e6963 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1563 microversion: 2.1 time: 0.168300 Oct 12 09:33:11.268010 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3500/6571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:11 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:11.353158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:11.353707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:11.360269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:11.360762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:11.361200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:11.361930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:11.362467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:11.362839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:11.389331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:33:11.473546 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-305a28d7-12c5-4b1c-9cb6-f4531db55125 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 204 len: 0 microversion: 2.1 time: 0.124149 Oct 12 09:33:11.474310 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3072/6572] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:33:11 2022] DELETE /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:33:11.482870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:11.483506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:11.489677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:11.490173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:11.490626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:11.491338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:11.491812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:11.492257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:11.633077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:11.642128 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5bd92b6f-49e1-4d32-8941-ed7f5cc194ff tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1569 microversion: 2.1 time: 0.163140 Oct 12 09:33:11.642758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3501/6573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:11 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:12.669578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:12.670364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:12.679378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:12.679987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:12.680533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:12.681426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:12.682010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:12.682568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:12.836990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:12.845911 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94de1f36-bb91-42bf-95a9-bb61950fd701 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1569 microversion: 2.1 time: 0.181946 Oct 12 09:33:12.846512 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3073/6574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:12 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:13.568350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-214b1a01-9994-45f8-b247-f703609ec2bf req-cabdb919-990f-4419-b683-5eaa6fceaeff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532459ed-9efa-4d82-9ebc-ac2a4bac376f", "name": "network-vif-deleted", "tag": "5dc2ba09-42e4-43e3-a2ed-3dc5575885d7"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:33:13.579678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-214b1a01-9994-45f8-b247-f703609ec2bf req-cabdb919-990f-4419-b683-5eaa6fceaeff service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:13.580233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-214b1a01-9994-45f8-b247-f703609ec2bf req-cabdb919-990f-4419-b683-5eaa6fceaeff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:13.580682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-214b1a01-9994-45f8-b247-f703609ec2bf req-cabdb919-990f-4419-b683-5eaa6fceaeff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:13.601231 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-214b1a01-9994-45f8-b247-f703609ec2bf req-cabdb919-990f-4419-b683-5eaa6fceaeff service nova] Creating event network-vif-deleted:5dc2ba09-42e4-43e3-a2ed-3dc5575885d7 for instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f on n-h1-858383-10 Oct 12 09:33:13.608382 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-214b1a01-9994-45f8-b247-f703609ec2bf req-cabdb919-990f-4419-b683-5eaa6fceaeff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044026 Oct 12 09:33:13.612590 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3502/6575] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:33:13.872912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:13.873591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:13.881379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:13.881938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:13.882365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:13.883065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:13.883512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:13.883962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:13.956336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:13.965230 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9542a8a-7144-4d72-8c1d-2a4d6f5d47cb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1361 microversion: 2.1 time: 0.096555 Oct 12 09:33:13.966038 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3074/6576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:13 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1361 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:14.991476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:14.992309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:14.999630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:15.000172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:15.000706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:15.001555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:15.002092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:15.002623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:15.073478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:15.081778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3b1ece35-1cf7-49c9-b9f0-185314f3f96a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1361 microversion: 2.1 time: 0.095716 Oct 12 09:33:15.082364 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3503/6577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:14 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:16.105849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:16.106484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:16.113739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:16.114217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:16.114651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:16.115344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:16.115785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:16.116202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:16.183852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:16.192207 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3f7d6052-88c9-465d-8447-600076ba29a8 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1361 microversion: 2.1 time: 0.090675 Oct 12 09:33:16.209460 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3075/6578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:16 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:17.218472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:17.219035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:17.226276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:17.226775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:17.227226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:17.227943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:17.228412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:17.228850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:17.293229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:17.301803 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-36e28d41-d3c9-4e0f-b22f-d2ff201ff563 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1361 microversion: 2.1 time: 0.087511 Oct 12 09:33:17.302469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3504/6579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:17 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:18.324986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:18.326568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:18.334709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:18.336579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:18.338554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:18.339504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:18.340024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:18.340472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:18.380547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:18.381150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:18.381830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:18.382462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lazy-loading 'fault' on Instance uuid 532459ed-9efa-4d82-9ebc-ac2a4bac376f {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:33:18.460338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:18.468950 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6b4ff24-8123-446a-9418-e866855b6a9e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 200 len: 1320 microversion: 2.1 time: 0.148061 Oct 12 09:33:18.469576 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3076/6580] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:18 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 1320 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:19.493710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:19.494327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:19.502097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:19.502536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:19.503030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:19.503707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:19.504180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:19.504706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:19.519954 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f HTTP/1.1 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '532459ed-9efa-4d82-9ebc-ac2a4bac376f'} Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:19.521676 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e9664e52-866d-4e1a-83b7-ed84648b6980 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 404 len: 111 microversion: 2.1 time: 0.034034 Oct 12 09:33:19.525651 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3505/6581] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:19 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:33:22.767720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:22.768281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:22.776068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:22.777931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:22.777931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:22.777931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:22.778196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:22.778632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:22.805080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:33:22.830955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:22.887708 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c0c4c450-9284-46f1-941e-bb20124a1147 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 204 len: 0 microversion: 2.1 time: 0.123707 Oct 12 09:33:22.888450 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3077/6582] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:33:22 2022] DELETE /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:33:22.897700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:22.898640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:22.906119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:22.906620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:22.907073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:22.907771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:22.908235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:22.908667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:23.045388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:23.053694 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-34064393-a3b7-4e73-9332-ad2bd94fc7ea tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1409 microversion: 2.1 time: 0.160709 Oct 12 09:33:23.054267 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3506/6583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:22 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:33:24.082103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:24.083262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:24.087655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:24.095053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:24.095513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:24.095961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:24.096648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:24.097143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:24.097605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:24.233662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:24.242204 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf24e2cb-35e6-49bb-8d2e-45d2d65f2eeb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1409 microversion: 2.1 time: 0.167313 Oct 12 09:33:24.242752 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3078/6584] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:24 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1409 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:25.106813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-91f3b075-0402-403d-aca3-821d1b6bc256 req-03a1fb77-adda-4694-a54c-9925e1aaa787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5772cb91-e323-4119-8b7a-89ede8db530a", "name": "network-vif-deleted", "tag": "1f554720-290d-47b8-aced-5ed7350d0232"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:33:25.113821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=30 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:25.120921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-91f3b075-0402-403d-aca3-821d1b6bc256 req-03a1fb77-adda-4694-a54c-9925e1aaa787 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:25.121418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-91f3b075-0402-403d-aca3-821d1b6bc256 req-03a1fb77-adda-4694-a54c-9925e1aaa787 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:25.121887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-91f3b075-0402-403d-aca3-821d1b6bc256 req-03a1fb77-adda-4694-a54c-9925e1aaa787 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:25.125993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=82 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:25.135646 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-91f3b075-0402-403d-aca3-821d1b6bc256 req-03a1fb77-adda-4694-a54c-9925e1aaa787 service nova] Creating event network-vif-deleted:1f554720-290d-47b8-aced-5ed7350d0232 for instance 5772cb91-e323-4119-8b7a-89ede8db530a on n-h2-858383-10 Oct 12 09:33:25.140686 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-91f3b075-0402-403d-aca3-821d1b6bc256 req-03a1fb77-adda-4694-a54c-9925e1aaa787 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037938 Oct 12 09:33:25.141298 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3507/6585] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:33:25.265075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:25.265696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:25.273413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:25.273924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:25.274436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:25.275142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:25.275584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:25.276012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:25.341617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:25.349936 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2714338e-6071-484a-a305-5b7cb3c0eaf4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1201 microversion: 2.1 time: 0.088870 Oct 12 09:33:25.350423 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3079/6586] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:25 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:26.374884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:26.375608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:26.383976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:26.384471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:26.384916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:26.385657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:26.386164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:26.386595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:26.450667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:26.459056 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e763a886-881d-44a2-8bf5-3227ae5808b9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1201 microversion: 2.1 time: 0.088696 Oct 12 09:33:26.459634 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3508/6587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:26 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:27.482564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:27.483193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:27.490630 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:27.491127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:27.491583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:27.492284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:27.492737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:27.493168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:27.557799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:27.565988 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c067828b-18ed-4c9b-b8ba-2b6a2ea74a57 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1201 microversion: 2.1 time: 0.087686 Oct 12 09:33:27.566603 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3080/6588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:27 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:28.588894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:28.589698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:28.596870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:28.597752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:28.598200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:28.598914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:28.599379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:28.599819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:28.667246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:28.675642 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc327da8-2a19-475e-9157-d33e03167ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1201 microversion: 2.1 time: 0.091009 Oct 12 09:33:28.676240 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3509/6589] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:28 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:29.699360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:29.700067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:29.707546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:29.708035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:29.708469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:29.709161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:29.709659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:29.710112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:29.753016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:29.753819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:29.754280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:29.754735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lazy-loading 'fault' on Instance uuid 5772cb91-e323-4119-8b7a-89ede8db530a {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:33:29.803384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:29.810787 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b16520a7-57af-43a3-ac85-649ac88581b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 200 len: 1160 microversion: 2.1 time: 0.115710 Oct 12 09:33:29.811451 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3081/6590] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:29 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 1160 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:30.834108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:30.834661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:30.842227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:30.842997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:30.843456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:30.844152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:30.844649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:30.845096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:30.859616 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a HTTP/1.1 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5772cb91-e323-4119-8b7a-89ede8db530a'} Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:30.861525 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e839d918-2aa7-472b-9128-b1eb9ff71675 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 404 len: 111 microversion: 2.1 time: 0.033008 Oct 12 09:33:30.865295 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3510/6591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:30 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:33:33.007533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:33.008037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:33.015675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:33.016153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:33.016589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:33.017279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:33.017774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:33.018204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:33.032411 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f HTTP/1.1 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '532459ed-9efa-4d82-9ebc-ac2a4bac376f'} Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:33:33.034137 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe2e5eb4-f3f3-47f2-a404-e1c08a2d9375 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 404 len: 111 microversion: 2.1 time: 0.032176 Oct 12 09:33:33.037459 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3082/6592] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:33:33 2022] DELETE /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:33:33.044441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:33.045072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 532459ed-9efa-4d82-9ebc-ac2a4bac376f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:33.052425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:33.052918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:33.053366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:33.054115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:33.054584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:33.055030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:33.069659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f HTTP/1.1 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '532459ed-9efa-4d82-9ebc-ac2a4bac376f'} Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:33.071235 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 532459ed-9efa-4d82-9ebc-ac2a4bac376f could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d47247f7-5eab-43ae-9904-7793d022e8e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f" status: 404 len: 111 microversion: 2.1 time: 0.032184 Oct 12 09:33:33.074607 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3511/6593] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:33 2022] GET /compute/v2.1/servers/532459ed-9efa-4d82-9ebc-ac2a4bac376f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:33:33.456098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:33.456777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:33.463546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:33.464028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:33.464466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:33.465179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:33.465676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:33.466193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:33.480100 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a HTTP/1.1 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5772cb91-e323-4119-8b7a-89ede8db530a'} Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:33:33.481647 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ea3d0fb0-2af3-4baf-8bdc-f3c349394781 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 404 len: 111 microversion: 2.1 time: 0.030915 Oct 12 09:33:33.485302 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3083/6594] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:33:33 2022] DELETE /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:33:33.492054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:33.492765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 5772cb91-e323-4119-8b7a-89ede8db530a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:33.499291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:33.499805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:33.500261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:33.500974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:33.501476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:33.501927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:33.516359 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a HTTP/1.1 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5772cb91-e323-4119-8b7a-89ede8db530a'} Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:33:33.517949 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 5772cb91-e323-4119-8b7a-89ede8db530a could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c7a3a00b-6063-484f-a079-3aeb0a9b56eb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a" status: 404 len: 111 microversion: 2.1 time: 0.031286 Oct 12 09:33:33.522232 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3512/6595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:33 2022] GET /compute/v2.1/servers/5772cb91-e323-4119-8b7a-89ede8db530a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:33:33.596040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83e61671-8871-4878-9a19-34b98fd33ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: .version_select at 0x7f984880eaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2111184942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPlV8lMFABBdgOsUDxPQ+Lqj6k+0GSE9JYnZqGrJ4SCiZy2yq9Snz7mzBTNox8HqNOXvgPprP7z0gzpKtzPXF6TzEA2MtoWSPdNtE6i5FiSQ4FsAk9ywIJiJnnSm+RV+g=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:33:33.612446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-83e61671-8871-4878-9a19-34b98fd33ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:33:33.618021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-83e61671-8871-4878-9a19-34b98fd33ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:33:33.644972 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83e61671-8871-4878-9a19-34b98fd33ccb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052935 Oct 12 09:33:33.645604 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3084/6596] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:33:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:33:49.914012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-465757359", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111184942", "security_groups": [{"name": "tempest-secgroup-smoke-1162388439"}], "block_device_mapping_v2": [{"uuid": "7c7aa39e-cb3b-4987-851d-43fb1e92a7d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3ccd3c8-b0a9-48d0-b379-e64e890e1919"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:33:49.925659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=11 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:49.926332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=19 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:50.034854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] validate_networks() for [('d3ccd3c8-b0a9-48d0-b379-e64e890e1919', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:33:50.416690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:33:50.417314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:33:50.418048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:33:50.418669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:33:50.419275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:33:50.430763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:50.431274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:50.431730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:50.432481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:50.432954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:50.433400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:50.451013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:33:50.456419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:33:50.516550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:33:50.518745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c7aa39e-cb3b-4987-851d-43fb1e92a7d3',volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:33:50.668054 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f2f20509-18b9-4ca0-9643-9873c07cbaa3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758066 Oct 12 09:33:50.668692 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3513/6597] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:33:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:33:50.680802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-095d1f99-d386-4279-a858-889e1fe8c304 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:50.681392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-095d1f99-d386-4279-a858-889e1fe8c304 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:50.684490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:50.685256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:50.685844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:33:50.743649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-095d1f99-d386-4279-a858-889e1fe8c304 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:50.750695 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-095d1f99-d386-4279-a858-889e1fe8c304 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1094 microversion: 2.1 time: 0.074370 Oct 12 09:33:50.751273 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3085/6598] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:50 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:51.781553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:51.782482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:51.794994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:51.795857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:51.796618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:51.797892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:51.799982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:51.801217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:51.878877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:51.887804 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c58d4d16-46d7-4e39-aa8d-4db988e1bf66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1192 microversion: 2.1 time: 0.114631 Oct 12 09:33:51.888396 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3514/6599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:51 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:52.912733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:52.914079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:52.921458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:52.922031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:52.922712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:52.923505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:52.924020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:52.924666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:53.069750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:53.084695 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-561f4cae-01be-40b9-8c79-23ca358b8da3 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1278 microversion: 2.1 time: 0.176208 Oct 12 09:33:53.085653 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3086/6600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:52 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:53.314084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-14a6754b-c8c8-45bb-8c9b-5d3d409c318b req-f7e58648-2423-4c31-af67-8a07088e6f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc", "tag": "23e16179-7be8-4cb7-86b9-40888f2fe307"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:33:53.329354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14a6754b-c8c8-45bb-8c9b-5d3d409c318b req-f7e58648-2423-4c31-af67-8a07088e6f8f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:53.330027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14a6754b-c8c8-45bb-8c9b-5d3d409c318b req-f7e58648-2423-4c31-af67-8a07088e6f8f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:53.330724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14a6754b-c8c8-45bb-8c9b-5d3d409c318b req-f7e58648-2423-4c31-af67-8a07088e6f8f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:53.346835 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-14a6754b-c8c8-45bb-8c9b-5d3d409c318b req-f7e58648-2423-4c31-af67-8a07088e6f8f service nova] Creating event network-changed:23e16179-7be8-4cb7-86b9-40888f2fe307 for instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc on n-h2-858383-10 Oct 12 09:33:53.352751 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-14a6754b-c8c8-45bb-8c9b-5d3d409c318b req-f7e58648-2423-4c31-af67-8a07088e6f8f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043578 Oct 12 09:33:53.353875 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3515/6601] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:33:54.108422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:54.109390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:54.117059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:54.117578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:54.118028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:54.118868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:54.119545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:54.119975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:54.262422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:54.271760 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82639f3d-d0d8-47d4-93ae-721ac680eaaf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1278 microversion: 2.1 time: 0.166891 Oct 12 09:33:54.272880 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3087/6602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:54 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:55.297124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:55.297983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:55.305179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:55.305727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:55.306175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:55.306881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:55.307486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:55.307927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:55.447886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:55.456120 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-917a5ea9-46b8-4eb7-bfeb-248ad58d5323 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1278 microversion: 2.1 time: 0.163625 Oct 12 09:33:55.456715 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3516/6603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:55 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:56.480004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:56.480606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:56.487741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:56.488342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:56.488788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:56.489493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:56.489977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:56.490404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:56.640402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:56.649846 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a4101e10-226c-492d-a0f1-7bbebaf2ff0e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1278 microversion: 2.1 time: 0.174012 Oct 12 09:33:56.650445 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3088/6604] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:56 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:57.675647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:57.676422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:57.685342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:57.685998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:57.686560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:57.687435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:57.688017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:57.688565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:57.828606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:57.836645 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb9ca82f-ceda-4847-8908-fa266e2e84d6 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.165941 Oct 12 09:33:57.837150 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3517/6605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:57 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:33:58.867534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:33:58.868178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:33:58.875664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:58.876158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:58.876603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:58.877306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:33:58.877798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:33:58.878233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:33:59.012640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:33:59.025499 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b700e91e-115a-43dc-8de3-66138e041e48 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.161692 Oct 12 09:33:59.026406 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3089/6606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:33:58 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:00.052267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:00.052898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:00.060262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:00.060768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:00.061233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:00.061967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:00.062438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:00.062954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:00.199826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:00.208318 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0affee17-6b47-4515-92bf-60beb2d5dd89 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.160317 Oct 12 09:34:00.208867 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3518/6607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:00 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:01.235518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:01.236541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:01.240898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:34:01.250133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:01.250953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:01.251684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:01.252797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:01.253906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:01.254339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:01.391715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:01.400356 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3cc6de86-ac11-4e14-a5d5-fa174434bc46 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.171549 Oct 12 09:34:01.400936 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3090/6608] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:01 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:02.427292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:02.427920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:02.429968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:34:02.430649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:34:02.437749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:02.438268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:02.438734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:02.439455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:02.439927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:02.440368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:02.576803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:02.588107 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85d68a2b-8a02-4a4e-b496-4e322d19df8e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.167445 Oct 12 09:34:02.588857 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3519/6609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:02 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:03.615528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:03.616495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:03.628790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:03.629754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:03.630199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:03.630894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:03.631348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:03.631773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:03.778931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:03.787124 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-14ea0467-9eb2-438d-80da-ccb239f232d5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.178133 Oct 12 09:34:03.787677 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3091/6610] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:03 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:04.814859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:04.815891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:04.823659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:04.824163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:04.824650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:04.825352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:04.825852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:04.826288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:04.960080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:04.968425 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac2f0043-c2d0-4038-9f29-bfe7eea2aa19 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.160341 Oct 12 09:34:04.968983 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3520/6611] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:04 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:05.993412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:05.994392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:06.005724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:06.006463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:06.007169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:06.008206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:06.008889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:06.009642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:06.148426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:06.159140 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7cbc9598-ebd7-4774-95c8-874acd5690b7 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.171021 Oct 12 09:34:06.159922 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3092/6612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:05 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:07.182781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:07.183409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:07.190995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:07.191612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:07.192034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:07.192746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:07.193218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:07.193707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:07.264083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0bf8db63-b4e2-4514-8093-567490eea69e req-eb80fdd3-bae8-4e74-849d-8e1d18cf516b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc", "name": "network-vif-plugged", "status": "completed", "tag": "23e16179-7be8-4cb7-86b9-40888f2fe307"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:34:07.275422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0bf8db63-b4e2-4514-8093-567490eea69e req-eb80fdd3-bae8-4e74-849d-8e1d18cf516b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:07.276506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0bf8db63-b4e2-4514-8093-567490eea69e req-eb80fdd3-bae8-4e74-849d-8e1d18cf516b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:07.276612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0bf8db63-b4e2-4514-8093-567490eea69e req-eb80fdd3-bae8-4e74-849d-8e1d18cf516b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:07.293072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0bf8db63-b4e2-4514-8093-567490eea69e req-eb80fdd3-bae8-4e74-849d-8e1d18cf516b service nova] Creating event network-vif-plugged:23e16179-7be8-4cb7-86b9-40888f2fe307 for instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc on n-h2-858383-10 Oct 12 09:34:07.298747 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0bf8db63-b4e2-4514-8093-567490eea69e req-eb80fdd3-bae8-4e74-849d-8e1d18cf516b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038558 Oct 12 09:34:07.299991 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3093/6613] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:34:07.334488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:07.347553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a51982c9-7793-4f90-99bb-602568dd1358 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.168648 Oct 12 09:34:07.348151 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3521/6614] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:07 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:08.376937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:08.378119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:08.388413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:08.388900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:08.389339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:08.390076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:08.390530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:08.390951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:08.545920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:08.554987 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e9be4ca-9197-40ee-bbe0-b2c78d931f2b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1266 microversion: 2.1 time: 0.186562 Oct 12 09:34:08.555814 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3094/6615] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:08 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:09.582957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:09.584021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:09.595593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:09.596412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:09.597175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:09.598405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:09.599176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:09.599900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:09.739160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:09.748451 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51d25cff-d95a-443f-97db-812ef00d2396 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1453 microversion: 2.1 time: 0.172059 Oct 12 09:34:09.749060 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3522/6616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:09 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:09.771279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:34:09.772203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:34:09.779213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:09.779699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:09.780161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:09.780844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:09.781292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:09.781740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:09.916096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:34:09.924181 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0f2fa93a-4571-4a86-b3b9-c1806c6dfe3d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1453 microversion: 2.1 time: 0.156887 Oct 12 09:34:09.924779 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3095/6617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:34:09 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:34:11.542183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4ff44359-1c3f-44d5-bf20-6f520f4811d9 req-5479665d-0812-45fa-ae9a-985b0eb43d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc", "tag": "23e16179-7be8-4cb7-86b9-40888f2fe307"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:34:11.552518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4ff44359-1c3f-44d5-bf20-6f520f4811d9 req-5479665d-0812-45fa-ae9a-985b0eb43d41 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:34:11.553012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4ff44359-1c3f-44d5-bf20-6f520f4811d9 req-5479665d-0812-45fa-ae9a-985b0eb43d41 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:34:11.553484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4ff44359-1c3f-44d5-bf20-6f520f4811d9 req-5479665d-0812-45fa-ae9a-985b0eb43d41 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:34:11.564997 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4ff44359-1c3f-44d5-bf20-6f520f4811d9 req-5479665d-0812-45fa-ae9a-985b0eb43d41 service nova] Creating event network-changed:23e16179-7be8-4cb7-86b9-40888f2fe307 for instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc on n-h2-858383-10 Oct 12 09:34:11.570240 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4ff44359-1c3f-44d5-bf20-6f520f4811d9 req-5479665d-0812-45fa-ae9a-985b0eb43d41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031779 Oct 12 09:34:11.571043 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3523/6618] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:36:08.694172 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 09:36:08.695049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=24 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:36:08.695788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=56 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:36:08.697843 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 12 09:36:08.699643 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:36:08.699800 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc (ip 10.222.0.40) !!! Oct 12 09:36:08.769584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:08.770093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:08.776435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:08.776927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:08.777366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:08.778094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:08.778551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:08.778980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:08.804532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:36:08.884664 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c59917a4-49f2-4d18-b9ee-dc98e5f57663 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 204 len: 0 microversion: 2.1 time: 0.196311 Oct 12 09:36:08.885277 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3096/6619] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:36:08 2022] DELETE /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:36:08.892523 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:36:08.896740 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 09:36:08.897267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:36:08.898068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=54 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:36:08.899417 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:36:08.899586 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc (ip 10.222.0.40) !!! Oct 12 09:36:08.901322 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 09:36:08.901522 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc (ip 10.222.0.40) !!! Oct 12 09:36:08.918036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:08.918770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:08.930425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:08.931040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:08.931474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:08.932197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:08.932672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:08.933121 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:09.081518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:09.090113 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-520b6d4a-6e09-49f1-a214-8a834bf6031d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1576 microversion: 2.1 time: 0.200102 Oct 12 09:36:09.090713 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3524/6620] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:08 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:10.118792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:10.119943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:10.133946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:10.134838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:10.135576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:10.136609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:10.137062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:10.137480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:10.144064 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46638. Oct 12 09:36:10.276660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:10.284714 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-16622357-01c1-4ea5-b1d9-6e15d3f7c42a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1576 microversion: 2.1 time: 0.173217 Oct 12 09:36:10.285269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3097/6621] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:10 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:11.309283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:11.309892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:11.320890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:11.321492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:11.321950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:11.322684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:11.323183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:11.323623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:11.333807 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46644. Oct 12 09:36:11.356217 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46646. Oct 12 09:36:11.426861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:11.435211 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dbfd34d5-cf3b-428f-9cba-03ed5893271d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1508 microversion: 2.1 time: 0.130520 Oct 12 09:36:11.435820 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3525/6622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:11 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1508 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:11.615650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5f8f7eb8-2b5e-4e4d-9216-6dbc91b0945c req-8dd0e96a-e630-4778-bd08-682ca494c91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc", "name": "network-vif-deleted", "tag": "23e16179-7be8-4cb7-86b9-40888f2fe307"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:36:11.641229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5f8f7eb8-2b5e-4e4d-9216-6dbc91b0945c req-8dd0e96a-e630-4778-bd08-682ca494c91a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:11.641963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5f8f7eb8-2b5e-4e4d-9216-6dbc91b0945c req-8dd0e96a-e630-4778-bd08-682ca494c91a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:11.642425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5f8f7eb8-2b5e-4e4d-9216-6dbc91b0945c req-8dd0e96a-e630-4778-bd08-682ca494c91a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:11.662620 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5f8f7eb8-2b5e-4e4d-9216-6dbc91b0945c req-8dd0e96a-e630-4778-bd08-682ca494c91a service nova] Creating event network-vif-deleted:23e16179-7be8-4cb7-86b9-40888f2fe307 for instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc on n-h2-858383-10 Oct 12 09:36:11.669696 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5f8f7eb8-2b5e-4e4d-9216-6dbc91b0945c req-8dd0e96a-e630-4778-bd08-682ca494c91a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057445 Oct 12 09:36:11.671209 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3098/6623] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:36:12.459324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:12.460104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:12.467993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:12.468506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:12.468958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:12.469790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:12.470267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:12.470712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:12.543164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:12.552015 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-19782588-a240-46fc-9f40-45481ac7b014 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1225 microversion: 2.1 time: 0.096688 Oct 12 09:36:12.552606 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3526/6624] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:12 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:13.576040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:13.576609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:13.584352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:13.584870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:13.585311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:13.586058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:13.586512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:13.586936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:13.654151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:13.662414 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8b974a60-b609-4238-bffd-51fe0877e7e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1225 microversion: 2.1 time: 0.090873 Oct 12 09:36:13.677469 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3099/6625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:13 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:14.685290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:14.685953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:14.693479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:14.694016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:14.694489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:14.695200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:14.695672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:14.696123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:14.766188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:14.774862 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1e2ec19-f7d7-4ab2-9980-dac9ed38acc9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1225 microversion: 2.1 time: 0.093709 Oct 12 09:36:14.775438 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3527/6626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:14 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:15.798244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:15.798953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:15.806221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:15.806709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:15.807138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:15.807829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:15.808273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:15.808700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:15.876492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:15.884539 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a451f21-4298-4681-ba0c-a3bbdeb31326 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 200 len: 1225 microversion: 2.1 time: 0.090280 Oct 12 09:36:15.885133 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3100/6627] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:15 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:16.908200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:16.908832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:16.916225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:16.916869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:16.917327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:16.918097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:16.918569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:16.919007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:16.933323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc HTTP/1.1 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc'} Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:36:16.935011 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-803c476e-bc04-4416-95bd-5fea0be469c2 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 404 len: 111 microversion: 2.1 time: 0.032264 Oct 12 09:36:16.938988 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3528/6628] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:16 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:36:16.990915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1181649082", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111184942", "security_groups": [{"name": "tempest-secgroup-smoke-1162388439"}], "block_device_mapping_v2": [{"uuid": "7c7aa39e-cb3b-4987-851d-43fb1e92a7d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3ccd3c8-b0a9-48d0-b379-e64e890e1919"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:36:17.110024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] validate_networks() for [('d3ccd3c8-b0a9-48d0-b379-e64e890e1919', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:36:17.488399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:36:17.489001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:36:17.489679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:36:17.490276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:36:17.490816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:36:17.504238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:17.504722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:17.505254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:17.506337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:17.506967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:17.507566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:17.527105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:36:17.532622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:36:17.599387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:36:17.602873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c7aa39e-cb3b-4987-851d-43fb1e92a7d3',volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:36:17.743935 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-596c8c86-df59-4bcd-80e7-e7a27ee7bde4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756975 Oct 12 09:36:17.744594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3101/6629] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:36:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:36:17.755934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ef188cd3-3658-4a8e-9b59-9cf5d09306e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:17.756588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ef188cd3-3658-4a8e-9b59-9cf5d09306e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:17.811352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ef188cd3-3658-4a8e-9b59-9cf5d09306e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:17.818560 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ef188cd3-3658-4a8e-9b59-9cf5d09306e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1095 microversion: 2.1 time: 0.066593 Oct 12 09:36:17.819130 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3529/6630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:17 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:18.844122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:18.845482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:18.851825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:18.852278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:18.852884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:18.853776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:18.854392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:18.854961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:18.926084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:18.934305 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f3027ae2-6203-4996-8d38-ca133daca0db tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1193 microversion: 2.1 time: 0.095932 Oct 12 09:36:18.935020 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3102/6631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:18 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:19.960033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:19.961388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:19.969341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:19.969872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:19.970410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:19.971207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:19.971733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:19.972254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:20.210878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:20.220758 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d18a5cb9-2691-4ec7-b29b-e5ca9caaea09 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1279 microversion: 2.1 time: 0.266409 Oct 12 09:36:20.221254 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3530/6632] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:19 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:20.410496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-929115a8-0789-472d-a328-f8c57b1ee159 req-4402581f-2e36-4d97-bcad-24c2e6ceb3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eea4d4c-0813-4283-818c-0166e3d58c3d", "tag": "e4c3de8c-a922-48a9-a284-2df3faccae98"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:36:20.427093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-929115a8-0789-472d-a328-f8c57b1ee159 req-4402581f-2e36-4d97-bcad-24c2e6ceb3fc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:20.427580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-929115a8-0789-472d-a328-f8c57b1ee159 req-4402581f-2e36-4d97-bcad-24c2e6ceb3fc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:20.428018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-929115a8-0789-472d-a328-f8c57b1ee159 req-4402581f-2e36-4d97-bcad-24c2e6ceb3fc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:20.440507 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-929115a8-0789-472d-a328-f8c57b1ee159 req-4402581f-2e36-4d97-bcad-24c2e6ceb3fc service nova] Creating event network-changed:e4c3de8c-a922-48a9-a284-2df3faccae98 for instance 3eea4d4c-0813-4283-818c-0166e3d58c3d on n-h2-858383-10 Oct 12 09:36:20.446095 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-929115a8-0789-472d-a328-f8c57b1ee159 req-4402581f-2e36-4d97-bcad-24c2e6ceb3fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044929 Oct 12 09:36:20.447802 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3103/6633] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:36:21.246443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:21.247055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:21.255025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:21.255514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:21.256197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:21.256899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:21.257609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:21.258052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:21.474606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:21.483021 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4fcdbd80-15fc-4f9d-b517-ea7834aadc22 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1279 microversion: 2.1 time: 0.242598 Oct 12 09:36:21.483725 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3531/6634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:21 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:22.507747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:22.508298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:22.515315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:22.515785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:22.516220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:22.516915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:22.517365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:22.517828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:22.654670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:22.662853 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8f21f670-51b4-4d3c-a70f-6ef4cd0f7b24 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1279 microversion: 2.1 time: 0.160445 Oct 12 09:36:22.663812 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3104/6635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:22 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:23.688035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:23.688822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:23.699703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:23.700238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:23.700690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:23.701400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:23.701935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:23.702410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:23.856894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:23.865077 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4ea8af3b-9403-42f1-9995-d6e6aa730635 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1279 microversion: 2.1 time: 0.182602 Oct 12 09:36:23.865922 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3532/6636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:23 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:24.888642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:24.889252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:24.896948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:24.897427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:24.897961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:24.898652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:24.899102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:24.899527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:25.030782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:25.038961 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-68823ce6-c4d3-46cd-97e5-7f6cd1fa755b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.154395 Oct 12 09:36:25.039533 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3105/6637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:24 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:26.066673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:26.067755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:26.079424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:26.080255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:26.081012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:26.082223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:26.083008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:26.083737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:26.217010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:26.224989 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-494dfe50-abf1-4547-a0eb-41c7aedaea66 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.165140 Oct 12 09:36:26.225598 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3533/6638] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:26 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:27.251639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:27.252701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:27.262741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:27.263223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:27.263655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:27.264343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:27.264791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:27.265217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:27.398192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:27.406759 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-946b153b-1398-448d-8f5e-ec17340aa200 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.162045 Oct 12 09:36:27.407348 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3106/6639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:27 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:28.434229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:28.435052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:28.438423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:36:28.445647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:28.446177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:28.446737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:28.447618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:28.448196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:28.448739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:28.588871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:28.596955 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-088fc1c5-5c2e-41c8-9925-a235b63215f5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.169139 Oct 12 09:36:28.597559 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3534/6640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:28 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:29.623949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:29.624932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:29.628041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:36:29.629165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:36:29.639596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:29.640080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:29.640515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:29.641211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:29.641700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:29.642128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:29.790371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:29.798771 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf07b651-c23d-4990-90d6-852901737603 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.181350 Oct 12 09:36:29.799343 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3107/6641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:29 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:30.825623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:30.826250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:30.833717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:30.834220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:30.834671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:30.835373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:30.835848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:30.836285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:30.974222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:30.982294 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-672ece14-c724-44c1-b04d-2e0f2126e4ef tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.162790 Oct 12 09:36:30.982925 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3535/6642] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:30 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:32.013696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:32.014278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:32.021637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:32.022125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:32.022593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:32.023285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:32.023733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:32.024159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:32.157837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:32.165800 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-427478b8-e5b7-4775-8bcb-01db3565f1b4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.156137 Oct 12 09:36:32.166415 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3108/6643] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:32 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:33.193777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:33.194829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:33.204018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:33.204523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:33.204977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:33.205733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:33.206209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:33.206652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:33.353352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:33.362532 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9baf2c7d-030c-4951-9390-620ba8ab128a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.175801 Oct 12 09:36:33.363093 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3536/6644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:33 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:34.045925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0b6ac616-9c26-4a81-aced-999e47652a1d req-92e3507c-b6e9-4f0d-99d0-688f5d981484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eea4d4c-0813-4283-818c-0166e3d58c3d", "name": "network-vif-plugged", "status": "completed", "tag": "e4c3de8c-a922-48a9-a284-2df3faccae98"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:36:34.056940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0b6ac616-9c26-4a81-aced-999e47652a1d req-92e3507c-b6e9-4f0d-99d0-688f5d981484 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:34.057458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0b6ac616-9c26-4a81-aced-999e47652a1d req-92e3507c-b6e9-4f0d-99d0-688f5d981484 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:34.057894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0b6ac616-9c26-4a81-aced-999e47652a1d req-92e3507c-b6e9-4f0d-99d0-688f5d981484 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:34.069056 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0b6ac616-9c26-4a81-aced-999e47652a1d req-92e3507c-b6e9-4f0d-99d0-688f5d981484 service nova] Creating event network-vif-plugged:e4c3de8c-a922-48a9-a284-2df3faccae98 for instance 3eea4d4c-0813-4283-818c-0166e3d58c3d on n-h2-858383-10 Oct 12 09:36:34.074142 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0b6ac616-9c26-4a81-aced-999e47652a1d req-92e3507c-b6e9-4f0d-99d0-688f5d981484 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032196 Oct 12 09:36:34.074827 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3109/6645] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:36:34.389389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:34.390466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:34.402952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:34.403483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:34.403953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:34.404713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:34.405182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:34.405647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:34.540863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:34.552263 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1edcef6b-2d03-4ce2-b1d7-6b478ae27e6d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1267 microversion: 2.1 time: 0.169336 Oct 12 09:36:34.553040 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3537/6646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:34 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:35.580024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:35.580796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:35.588552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:35.589108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:35.589690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:35.590494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:35.591043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:35.591534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:35.733464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:35.741719 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ea589c2-607e-48cd-b417-72a7a0ca6236 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1455 microversion: 2.1 time: 0.168285 Oct 12 09:36:35.742313 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3110/6647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:35 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:35.764556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:36:35.765719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:36:35.773297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:35.773837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:35.774307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:35.775023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:35.775503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:35.775950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:35.927520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:36:35.935621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-689a6940-3960-4bf7-a5c6-7f33c55c03d1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1455 microversion: 2.1 time: 0.175023 Oct 12 09:36:35.936196 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3538/6648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:36:35 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:36:37.919615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1d8586d9-6196-45f0-af11-4d9034d7025f req-edff137b-6739-48d9-a8c7-42a641504a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eea4d4c-0813-4283-818c-0166e3d58c3d", "tag": "e4c3de8c-a922-48a9-a284-2df3faccae98"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:36:37.930102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1d8586d9-6196-45f0-af11-4d9034d7025f req-edff137b-6739-48d9-a8c7-42a641504a37 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:36:37.930584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1d8586d9-6196-45f0-af11-4d9034d7025f req-edff137b-6739-48d9-a8c7-42a641504a37 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:36:37.931028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1d8586d9-6196-45f0-af11-4d9034d7025f req-edff137b-6739-48d9-a8c7-42a641504a37 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:36:37.942424 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1d8586d9-6196-45f0-af11-4d9034d7025f req-edff137b-6739-48d9-a8c7-42a641504a37 service nova] Creating event network-changed:e4c3de8c-a922-48a9-a284-2df3faccae98 for instance 3eea4d4c-0813-4283-818c-0166e3d58c3d on n-h2-858383-10 Oct 12 09:36:37.947653 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1d8586d9-6196-45f0-af11-4d9034d7025f req-edff137b-6739-48d9-a8c7-42a641504a37 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031832 Oct 12 09:36:37.948283 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3111/6649] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:38:28.491516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=32 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:38:28.492338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=80 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:38:28.493330 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:38:28.493520 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:38:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 12 09:38:28.501407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1836796282", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2111184942", "security_groups": [{"name": "tempest-secgroup-smoke-1162388439"}], "block_device_mapping_v2": [{"uuid": "f1c7bf61-3072-481e-a6f5-5507b8b93d1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3ccd3c8-b0a9-48d0-b379-e64e890e1919"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:38:28.764999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] validate_networks() for [('d3ccd3c8-b0a9-48d0-b379-e64e890e1919', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:38:29.203997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:38:29.204437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:38:29.204930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:38:29.205358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:38:29.205808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:38:29.215579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:29.216059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:29.216533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:29.217288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:29.217872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:29.218318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:29.235839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:38:29.241370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Getting quotas for user cbf0ce336e124cfe9765524801fe71e2 and project 60fa6111ea194d80b05e5dccdbcf3aa3. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:38:29.303804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:38:29.307256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1c7bf61-3072-481e-a6f5-5507b8b93d1b',volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:38:29.448797 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6169ad4-f0c1-41b5-9227-f52015527c4e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960807 Oct 12 09:38:29.449568 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3539/6650] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:38:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:38:29.459470 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [69519c9e-db2a-456c-87f5-913be80c5911] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:38:29.461895 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 09:38:29.462507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:38:29.463727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:38:29.466441 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 09:38:29.466791 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 (ip 10.222.0.40) !!! Oct 12 09:38:29.479638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8260334b-3df9-4ac6-b13e-59571520a7c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:29.480324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8260334b-3df9-4ac6-b13e-59571520a7c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:29.597181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8260334b-3df9-4ac6-b13e-59571520a7c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:29.604323 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8260334b-3df9-4ac6-b13e-59571520a7c1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1095 microversion: 2.1 time: 0.146742 Oct 12 09:38:29.604967 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3112/6651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:29 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1095 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:30.631725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:30.632317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:30.640062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:30.640566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:30.641015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:30.641768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:30.642237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:30.642677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:30.714677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:30.723553 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0614a1d1-8c95-405e-871b-b027fcacd4fe tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1211 microversion: 2.1 time: 0.097130 Oct 12 09:38:30.724121 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3540/6652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:30 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:31.747660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:31.748315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:31.758213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:31.758707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:31.759285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:31.760006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:31.760465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:31.760893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:31.769664 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [69519c9e-db2a-456c-87f5-913be80c5911] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46856. Oct 12 09:38:31.782212 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46858. Oct 12 09:38:32.009666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:32.018724 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b8569302-0bad-4421-8f40-66f06b755f1b tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1279 microversion: 2.1 time: 0.275206 Oct 12 09:38:32.034408 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3113/6653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:31 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1279 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:32.495080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-35365087-86fb-4aca-b5e4-959aeeb3ad0d req-b13f7a4d-0983-43ae-85e0-0f8407fd022c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1303547-e533-4ffd-be97-786987326111", "tag": "a67c57b8-6d0d-410c-b13b-19b008befb6e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:38:32.505091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-35365087-86fb-4aca-b5e4-959aeeb3ad0d req-b13f7a4d-0983-43ae-85e0-0f8407fd022c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:32.505569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-35365087-86fb-4aca-b5e4-959aeeb3ad0d req-b13f7a4d-0983-43ae-85e0-0f8407fd022c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:32.506018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-35365087-86fb-4aca-b5e4-959aeeb3ad0d req-b13f7a4d-0983-43ae-85e0-0f8407fd022c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:32.517946 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-35365087-86fb-4aca-b5e4-959aeeb3ad0d req-b13f7a4d-0983-43ae-85e0-0f8407fd022c service nova] Creating event network-changed:a67c57b8-6d0d-410c-b13b-19b008befb6e for instance a1303547-e533-4ffd-be97-786987326111 on n-h1-858383-10 Oct 12 09:38:32.524203 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-35365087-86fb-4aca-b5e4-959aeeb3ad0d req-b13f7a4d-0983-43ae-85e0-0f8407fd022c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131186 Oct 12 09:38:32.524847 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3541/6654] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:38:33.045619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:33.046314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:33.053594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:33.054166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:33.054813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:33.055524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:33.055946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:33.056573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:33.262894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:33.271909 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6b1e3d06-aa2f-4658-9621-d9934b28bbfb tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1279 microversion: 2.1 time: 0.233302 Oct 12 09:38:33.272773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3114/6655] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:33 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1279 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:34.297079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:34.297809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:34.304360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:34.304861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:34.305280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:34.306458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:34.306943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:34.307384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:34.444826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:34.453246 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e9802ebe-d999-43ac-9403-acdbf3584c02 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1279 microversion: 2.1 time: 0.161685 Oct 12 09:38:34.454165 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3542/6656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:34 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:35.476550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:35.477112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:35.484272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:35.484881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:35.485312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:35.486159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:35.486486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:35.486905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:35.626295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:35.635285 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ead22dd8-cf84-454a-9500-21e77e04480e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1279 microversion: 2.1 time: 0.162452 Oct 12 09:38:35.635906 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3115/6657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:35 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:36.662787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:36.663524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:36.674468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:36.675018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:36.675517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:36.676290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:36.676827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:36.677319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:36.821458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:36.830211 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c5f25684-0f2a-4a51-acc5-850bc1c09c53 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.173819 Oct 12 09:38:36.830783 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3543/6658] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:36 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:37.857545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:37.858724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:37.870303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:37.871105 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:37.871904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:37.873041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:37.873839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:37.874544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:38.013047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:38.021495 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a24f9e1-f216-4496-932a-10f4b659e34a tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.170520 Oct 12 09:38:38.022076 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3116/6659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:37 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:39.048604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:39.049376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:39.057892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:39.058486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:39.059058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:39.059893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:39.060443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:39.060960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:39.203189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:39.211618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e8c04891-5f47-4ec5-a530-fe95e487d0f9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.169479 Oct 12 09:38:39.212212 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3544/6660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:39 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:40.235928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:40.236490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:40.239498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:38:40.245721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:40.246250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:40.246692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:40.247408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:40.247895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:40.248324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:40.386785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:40.395921 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf944bbe-837f-4cd9-b3bc-5e167cd9bc56 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.164362 Oct 12 09:38:40.396694 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3117/6661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:40 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:41.423559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:41.424498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:41.427337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:38:41.428046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:38:41.434366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:41.434865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:41.435319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:41.436029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:41.436501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:41.436937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:41.572320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:41.581582 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-044b1d95-1efd-4e69-878a-572e0f6046e9 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.164140 Oct 12 09:38:41.582157 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3545/6662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:41 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:42.607925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:42.608700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:42.617472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:42.617977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:42.618417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:42.619125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:42.619578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:42.620010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:42.778185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:42.786400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efe93043-08f7-43d7-97b2-9674f67cdd05 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.183734 Oct 12 09:38:42.786972 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3118/6663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:42 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:43.813516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:43.814593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:43.822945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:43.823446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:43.823893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:43.824642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:43.825112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:43.825585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:43.962794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:43.970962 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-761f2e7c-5829-4076-9f7d-77cea9619032 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.164096 Oct 12 09:38:43.971519 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3546/6664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:43 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:44.999026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:44.999921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:45.012036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:45.012835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:45.013603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:45.015130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:45.015878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:45.016584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:45.158885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:45.166816 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a36f06da-6325-45f7-8770-57836c82d374 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.174514 Oct 12 09:38:45.167364 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3119/6665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:44 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:46.059823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e803a411-d649-4bf6-b64e-afce51d86479 req-9f969452-d38c-43f8-9ce5-c1835fc0761e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1303547-e533-4ffd-be97-786987326111", "name": "network-vif-plugged", "status": "completed", "tag": "a67c57b8-6d0d-410c-b13b-19b008befb6e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:38:46.069798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e803a411-d649-4bf6-b64e-afce51d86479 req-9f969452-d38c-43f8-9ce5-c1835fc0761e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:46.070238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e803a411-d649-4bf6-b64e-afce51d86479 req-9f969452-d38c-43f8-9ce5-c1835fc0761e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:46.070692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e803a411-d649-4bf6-b64e-afce51d86479 req-9f969452-d38c-43f8-9ce5-c1835fc0761e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:46.081825 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e803a411-d649-4bf6-b64e-afce51d86479 req-9f969452-d38c-43f8-9ce5-c1835fc0761e service nova] Creating event network-vif-plugged:a67c57b8-6d0d-410c-b13b-19b008befb6e for instance a1303547-e533-4ffd-be97-786987326111 on n-h1-858383-10 Oct 12 09:38:46.087047 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e803a411-d649-4bf6-b64e-afce51d86479 req-9f969452-d38c-43f8-9ce5-c1835fc0761e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090811 Oct 12 09:38:46.087657 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3547/6666] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:38:46.190151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:46.190784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:46.197922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:46.198430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:46.198862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:46.199538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:46.199988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:46.200423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:46.348431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:46.356702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-311045dc-000c-447e-b0f6-f9ca1077be2c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.170565 Oct 12 09:38:46.357290 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3120/6667] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:46 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:47.382589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:47.383313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:47.390451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:47.390964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:47.391424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:47.392138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:47.392615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:47.393404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:47.531093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:47.539249 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f68b183e-4b8e-4e9c-ad8d-830e2bfeeab0 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1267 microversion: 2.1 time: 0.162003 Oct 12 09:38:47.539861 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3548/6668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:47 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:48.562641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:48.563320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:48.570929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:48.571408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:48.571854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:48.572563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:48.573028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:48.573463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:48.708872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:48.716933 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5d9057b1-6d74-4249-8083-607b136219e4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1455 microversion: 2.1 time: 0.158276 Oct 12 09:38:48.717512 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3121/6669] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:48 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:48.740178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:38:48.741360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:38:48.754522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:48.755026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:48.755476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:48.756193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:48.756699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:48.757126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:48.900683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:38:48.908859 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-140fd82f-826d-4dfc-8bfb-6a63ad86f6cf tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1455 microversion: 2.1 time: 0.173007 Oct 12 09:38:48.909401 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3549/6670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:38:48 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:38:50.914173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9d8df2e2-d4e5-4075-bb39-2ffbe2e0689b req-1e6ca9da-b94e-489e-b3ea-9b2f1b8f8cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1303547-e533-4ffd-be97-786987326111", "tag": "a67c57b8-6d0d-410c-b13b-19b008befb6e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:38:50.924060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9d8df2e2-d4e5-4075-bb39-2ffbe2e0689b req-1e6ca9da-b94e-489e-b3ea-9b2f1b8f8cb9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:38:50.924539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9d8df2e2-d4e5-4075-bb39-2ffbe2e0689b req-1e6ca9da-b94e-489e-b3ea-9b2f1b8f8cb9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:38:50.925129 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9d8df2e2-d4e5-4075-bb39-2ffbe2e0689b req-1e6ca9da-b94e-489e-b3ea-9b2f1b8f8cb9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:38:50.936573 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9d8df2e2-d4e5-4075-bb39-2ffbe2e0689b req-1e6ca9da-b94e-489e-b3ea-9b2f1b8f8cb9 service nova] Creating event network-changed:a67c57b8-6d0d-410c-b13b-19b008befb6e for instance a1303547-e533-4ffd-be97-786987326111 on n-h1-858383-10 Oct 12 09:38:50.941871 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9d8df2e2-d4e5-4075-bb39-2ffbe2e0689b req-1e6ca9da-b94e-489e-b3ea-9b2f1b8f8cb9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090705 Oct 12 09:38:50.942827 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3122/6671] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:40:31.645808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=24 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:40:31.646644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=56 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:40:31.647977 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:40:31.648094 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 12 09:40:31.653071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:31.653588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:31.655838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:40:31.656514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=54 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:40:31.657324 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:40:31.657497 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 (ip 10.222.0.40) !!! Oct 12 09:40:31.663347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-13c883e3-675e-4e03-b3cd-6e89fefe1e10 req-cd87d4f3-17cd-4a9e-826e-de14ad9c55f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1303547-e533-4ffd-be97-786987326111", "tag": "a67c57b8-6d0d-410c-b13b-19b008befb6e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:40:31.670435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:31.671175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:31.671846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:31.672579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:31.673048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:31.673511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:31.676107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-13c883e3-675e-4e03-b3cd-6e89fefe1e10 req-cd87d4f3-17cd-4a9e-826e-de14ad9c55f1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:31.676573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-13c883e3-675e-4e03-b3cd-6e89fefe1e10 req-cd87d4f3-17cd-4a9e-826e-de14ad9c55f1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:31.677001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-13c883e3-675e-4e03-b3cd-6e89fefe1e10 req-cd87d4f3-17cd-4a9e-826e-de14ad9c55f1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:31.689841 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-13c883e3-675e-4e03-b3cd-6e89fefe1e10 req-cd87d4f3-17cd-4a9e-826e-de14ad9c55f1 service nova] Creating event network-changed:a67c57b8-6d0d-410c-b13b-19b008befb6e for instance a1303547-e533-4ffd-be97-786987326111 on n-h1-858383-10 Oct 12 09:40:31.695257 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-13c883e3-675e-4e03-b3cd-6e89fefe1e10 req-cd87d4f3-17cd-4a9e-826e-de14ad9c55f1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052121 Oct 12 09:40:31.696046 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3123/6672] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:40:31.702548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:40:31.788658 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0d1832ed-5b66-44f2-a159-15881d09b03c tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 204 len: 0 microversion: 2.1 time: 0.147783 Oct 12 09:40:31.790095 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3550/6673] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:40:31 2022] DELETE /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:40:31.799635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:31.800533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:31.807679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:31.808366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:31.808812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:31.809559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:31.810019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:31.810443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:32.302090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:32.310158 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a400ad0d-fbf0-40da-b5b4-30eb48172ff5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1580 microversion: 2.1 time: 0.515701 Oct 12 09:40:32.310754 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3124/6674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:31 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1580 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:33.335367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:33.336006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:33.343501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:33.344002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:33.344450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:33.345151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:33.345666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:33.346103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:33.486858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:33.495082 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a15240b3-9306-4b62-92e5-8a94f04a4db1 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1580 microversion: 2.1 time: 0.164313 Oct 12 09:40:33.495857 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3551/6675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:33 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1580 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:34.013172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-14449ee8-cf96-4bb4-b4be-8d4912758d25 req-02035606-c63a-4437-82f4-5c678b5ef01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1303547-e533-4ffd-be97-786987326111", "name": "network-vif-deleted", "tag": "a67c57b8-6d0d-410c-b13b-19b008befb6e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:40:34.025752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-14449ee8-cf96-4bb4-b4be-8d4912758d25 req-02035606-c63a-4437-82f4-5c678b5ef01d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:34.026236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-14449ee8-cf96-4bb4-b4be-8d4912758d25 req-02035606-c63a-4437-82f4-5c678b5ef01d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:34.026663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-14449ee8-cf96-4bb4-b4be-8d4912758d25 req-02035606-c63a-4437-82f4-5c678b5ef01d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:34.038600 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-14449ee8-cf96-4bb4-b4be-8d4912758d25 req-02035606-c63a-4437-82f4-5c678b5ef01d service nova] Creating event network-vif-deleted:a67c57b8-6d0d-410c-b13b-19b008befb6e for instance a1303547-e533-4ffd-be97-786987326111 on n-h1-858383-10 Oct 12 09:40:34.043685 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-14449ee8-cf96-4bb4-b4be-8d4912758d25 req-02035606-c63a-4437-82f4-5c678b5ef01d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034617 Oct 12 09:40:34.047337 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3125/6676] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:40:34.519562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:34.520094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:34.527735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:34.528245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:34.528699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:34.529416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:34.529948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:34.530437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:34.597802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:34.606395 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-311bf845-3fde-4eb7-abe4-858eb2008836 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1226 microversion: 2.1 time: 0.091036 Oct 12 09:40:34.606987 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3552/6677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:34 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:35.632708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:35.633523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:35.640751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:35.641320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:35.641756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:35.642729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:35.643470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:35.644018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:35.711977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:35.720485 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4e2ba33c-dc4f-40ae-8cab-01c16128b051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1226 microversion: 2.1 time: 0.093190 Oct 12 09:40:35.721074 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3126/6678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:35 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:36.744910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:36.745496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:36.752907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:36.753413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:36.753897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:36.754624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:36.755098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:36.755629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:36.819806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:36.828000 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73f09cbc-61a1-417b-9772-1c462fafea20 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1226 microversion: 2.1 time: 0.087228 Oct 12 09:40:36.828588 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3553/6679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:36 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:37.851297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:37.851891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:37.859355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:37.859832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:37.860237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:37.860966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:37.861676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:37.861929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:37.927596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:37.935815 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d21d49d2-72c2-4532-a7a3-2b42d917f2d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 200 len: 1226 microversion: 2.1 time: 0.088460 Oct 12 09:40:37.936401 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3127/6680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:37 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:38.960125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:38.960856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: a1303547-e533-4ffd-be97-786987326111] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:38.968201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:38.968699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:38.969147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:38.969893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:38.970358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:38.970793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:38.984517 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance a1303547-e533-4ffd-be97-786987326111 could not be found. Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 HTTP/1.1 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance a1303547-e533-4ffd-be97-786987326111 could not be found. Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'a1303547-e533-4ffd-be97-786987326111'} Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1303547-e533-4ffd-be97-786987326111 could not be found. Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1303547-e533-4ffd-be97-786987326111 could not be found. Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:40:38.986226 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1303547-e533-4ffd-be97-786987326111 could not be found. Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance a1303547-e533-4ffd-be97-786987326111 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9eff3b50-3e99-4833-b734-d8f372da7c1e tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111" status: 404 len: 111 microversion: 2.1 time: 0.031613 Oct 12 09:40:38.990105 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3554/6681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:38 2022] GET /compute/v2.1/servers/a1303547-e533-4ffd-be97-786987326111 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:40:45.260227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:45.261226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:45.262171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7491ed9f-9d5a-4794-9826-814d44b7fc80 req-01fed370-87a0-44dd-8824-96e24b437956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eea4d4c-0813-4283-818c-0166e3d58c3d", "tag": "e4c3de8c-a922-48a9-a284-2df3faccae98"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:40:45.268591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:45.269061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:45.269711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:45.270489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:45.270974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:45.271593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:45.272616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7491ed9f-9d5a-4794-9826-814d44b7fc80 req-01fed370-87a0-44dd-8824-96e24b437956 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:45.273277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7491ed9f-9d5a-4794-9826-814d44b7fc80 req-01fed370-87a0-44dd-8824-96e24b437956 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:45.273759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7491ed9f-9d5a-4794-9826-814d44b7fc80 req-01fed370-87a0-44dd-8824-96e24b437956 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:45.285632 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7491ed9f-9d5a-4794-9826-814d44b7fc80 req-01fed370-87a0-44dd-8824-96e24b437956 service nova] Creating event network-changed:e4c3de8c-a922-48a9-a284-2df3faccae98 for instance 3eea4d4c-0813-4283-818c-0166e3d58c3d on n-h2-858383-10 Oct 12 09:40:45.291705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7491ed9f-9d5a-4794-9826-814d44b7fc80 req-01fed370-87a0-44dd-8824-96e24b437956 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034157 Oct 12 09:40:45.292556 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3555/6682] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:40:45.298467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:40:45.389030 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-617393f8-7e95-4fff-82d2-ff3f3bd3fc59 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 204 len: 0 microversion: 2.1 time: 0.133294 Oct 12 09:40:45.393047 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3128/6683] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:40:45 2022] DELETE /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:40:45.401958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:45.403809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:45.410718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:45.411584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:45.412217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:45.413110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:45.413864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:45.414459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:45.571172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:45.579326 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2441698a-302e-4bf3-be68-98e0d3fd8654 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1579 microversion: 2.1 time: 0.184578 Oct 12 09:40:45.579888 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3556/6684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:45 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1579 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:46.606056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:46.606782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:46.614220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:46.614714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:46.615157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:46.615839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:46.616296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:46.616726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:46.770612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:46.778783 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3ea4d34-5300-48ca-975c-ac8174ccd051 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1579 microversion: 2.1 time: 0.177171 Oct 12 09:40:46.779364 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3129/6685] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:46 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:47.637728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-8ce262f6-4ec2-4253-87bb-3e471767ecd8 req-18270e62-1440-4e6b-864a-fff76c5aff09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eea4d4c-0813-4283-818c-0166e3d58c3d", "name": "network-vif-deleted", "tag": "e4c3de8c-a922-48a9-a284-2df3faccae98"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:40:47.651571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8ce262f6-4ec2-4253-87bb-3e471767ecd8 req-18270e62-1440-4e6b-864a-fff76c5aff09 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:47.652090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8ce262f6-4ec2-4253-87bb-3e471767ecd8 req-18270e62-1440-4e6b-864a-fff76c5aff09 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:47.652514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-8ce262f6-4ec2-4253-87bb-3e471767ecd8 req-18270e62-1440-4e6b-864a-fff76c5aff09 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:47.665461 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-8ce262f6-4ec2-4253-87bb-3e471767ecd8 req-18270e62-1440-4e6b-864a-fff76c5aff09 service nova] Creating event network-vif-deleted:e4c3de8c-a922-48a9-a284-2df3faccae98 for instance 3eea4d4c-0813-4283-818c-0166e3d58c3d on n-h2-858383-10 Oct 12 09:40:47.672015 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-8ce262f6-4ec2-4253-87bb-3e471767ecd8 req-18270e62-1440-4e6b-864a-fff76c5aff09 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038695 Oct 12 09:40:47.672625 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3557/6686] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:40:47.802502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:47.803041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:47.810428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:47.810915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:47.811373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:47.812048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:47.812497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:47.812919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:47.880385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:47.889420 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-20290930-54ff-4d98-933a-8873bd4557d4 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1226 microversion: 2.1 time: 0.090943 Oct 12 09:40:47.890279 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3130/6687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:47 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:48.913489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:48.914184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:48.922409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:48.922926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:48.923363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:48.924369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:48.925024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:48.925479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:48.995465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:49.003556 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-af7b9ff3-d9ac-45e6-b3be-5fe6f8a0f948 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1226 microversion: 2.1 time: 0.094626 Oct 12 09:40:49.005800 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3558/6688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:48 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:50.028648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:50.029258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:50.037487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:50.038041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:50.038481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:50.039213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:50.039768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:50.040204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:50.105205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:50.113505 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6911717-e747-474c-bac9-f3a4fe3a7cb5 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1226 microversion: 2.1 time: 0.088765 Oct 12 09:40:50.114010 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3131/6689] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:50 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:51.137333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:51.137917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:51.145072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:51.145623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:51.146073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:51.146778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:51.147297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:51.147681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:51.214723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:51.223212 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e3c815d-d5bb-4939-9c77-05ebd34c5824 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1226 microversion: 2.1 time: 0.090358 Oct 12 09:40:51.230687 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3559/6690] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:51 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:52.247611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:52.248240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:52.255437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:52.255923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:52.256757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:52.257641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:52.258170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:52.258605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:52.291751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:52.292229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:52.292659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:52.293104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lazy-loading 'fault' on Instance uuid 3eea4d4c-0813-4283-818c-0166e3d58c3d {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:40:52.338719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbf0ce336e124cfe9765524801fe71e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fa6111ea194d80b05e5dccdbcf3aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:40:52.345879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-008c27ae-8a62-4ffb-b6bf-d1a5293e5008 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 200 len: 1185 microversion: 2.1 time: 0.102725 Oct 12 09:40:52.346446 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3132/6691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:52 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 1185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:40:53.374118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:53.375117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 3eea4d4c-0813-4283-818c-0166e3d58c3d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:53.387230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:53.388047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:53.388790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:53.389991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:53.390771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:53.391504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:53.408708 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 3eea4d4c-0813-4283-818c-0166e3d58c3d could not be found. Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d HTTP/1.1 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3eea4d4c-0813-4283-818c-0166e3d58c3d could not be found. Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3eea4d4c-0813-4283-818c-0166e3d58c3d'} Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eea4d4c-0813-4283-818c-0166e3d58c3d could not be found. Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eea4d4c-0813-4283-818c-0166e3d58c3d could not be found. Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:40:53.410434 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eea4d4c-0813-4283-818c-0166e3d58c3d could not be found. Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 3eea4d4c-0813-4283-818c-0166e3d58c3d could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9fb392fc-bdc5-4ad1-8c9c-8b1916e09676 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d" status: 404 len: 111 microversion: 2.1 time: 0.044574 Oct 12 09:40:53.414891 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3560/6692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:53 2022] GET /compute/v2.1/servers/3eea4d4c-0813-4283-818c-0166e3d58c3d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:40:53.882530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:53.883034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:53.890395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:53.890875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:53.891310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:53.891990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:53.892434 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:53.892857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:53.909179 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc HTTP/1.1 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc'} Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:40:53.910877 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e184628-f742-4a08-accc-800df201f767 tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 404 len: 111 microversion: 2.1 time: 0.033804 Oct 12 09:40:53.914656 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3133/6693] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:40:53 2022] DELETE /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:40:53.920962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:53.921617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] [instance: 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:40:53.927955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:53.928443 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:53.928890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:53.929658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:40:53.930124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:40:53.930555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:40:53.944233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] HTTP exception thrown: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Request method failure captured: Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc HTTP/1.1 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRokUKo5S6sc7mwAB7GLQ6NW7lH4XQBWrGkfzH4C0uVER3SXKLWKK9fYpx9YBVzd0A1GQOFRm8JL5X33R68GopE1BxAsytjKrzNkme9VfL3UeV1l8trUUaZdbepf2PJpARQel57rYBmd-93_nbqhZ7uRTJSvHH6DNwYtuImWnxKALJ6Y Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_60fa6111ea194d80b05e5dccdbcf3aa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/60fa6111ea194d80b05e5dccdbcf3aa3"}]}] Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 60fa6111ea194d80b05e5dccdbcf3aa3 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestVolumeBootPattern-1255724874 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: cbf0ce336e124cfe9765524801fe71e2 Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestVolumeBootPattern-1255724874-project Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc'} Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:40:53.945789 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Returning 404 to user: Instance 2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2d1734f-e20d-4f58-b525-df6b848ecfac tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc" status: 404 len: 111 microversion: 2.1 time: 0.030181 Oct 12 09:40:53.950454 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3561/6694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:40:53 2022] GET /compute/v2.1/servers/2418bd92-b6ba-4ee9-9fb3-7b79b27b2acc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:40:57.379322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e7f84920-140b-48fc-ac72-a198cc43446d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] Calling method '.version_select at 0x7f9843a76790>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:40:57.411424 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e7f84920-140b-48fc-ac72-a198cc43446d tempest-TestVolumeBootPattern-1255724874 tempest-TestVolumeBootPattern-1255724874-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2111184942" status: 202 len: 0 microversion: 2.1 time: 0.036749 Oct 12 09:40:57.412337 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3134/6695] 10.222.0.40 () {58 vars in 1263 bytes} [Wed Oct 12 09:40:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2111184942 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:41:16.053675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:16.054431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:16.165036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1896765696", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:16.221089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] validate_networks() for None {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:41:16.498374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:41:16.498815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:41:16.499305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:41:16.499731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:41:16.500131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:41:16.509368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:16.510261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:16.510718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:16.511467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:16.512022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:16.512453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:16.529965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Getting quotas for project d635f3119f9e49cf9e1ee1d2b21614ea. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:41:16.535361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Getting quotas for user 3366d2083ff947b2ad427bfa8f6093e1 and project d635f3119f9e49cf9e1ee1d2b21614ea. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:41:16.548714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:41:16.551104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:41:16.595510 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [6e307c03-0648-4d0b-ac74-3318c402c00f] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:41:17.607020 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [6e307c03-0648-4d0b-ac74-3318c402c00f] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 47138. Oct 12 09:41:17.611955 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0192d3c1-784e-405f-85b3-425a1ed3387e tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563467 Oct 12 09:41:17.612621 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3562/6696] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:41:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:41:17.625921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32ba130a-fd03-4fba-acec-320d94e3d825 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:17.628561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-32ba130a-fd03-4fba-acec-320d94e3d825 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:17.631001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:17.631857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:17.689952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-32ba130a-fd03-4fba-acec-320d94e3d825 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:17.696855 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32ba130a-fd03-4fba-acec-320d94e3d825 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1222 microversion: 2.1 time: 0.075283 Oct 12 09:41:17.697471 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3135/6697] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:17 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:18.725981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:18.728021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:18.738688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:18.739549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:18.740310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:18.741607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:18.742415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:18.743318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:18.812178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:18.820226 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e67b23c4-f6c8-44dd-bb8e-e42901877738 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1274 microversion: 2.1 time: 0.102631 Oct 12 09:41:18.820848 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3563/6698] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:18 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:19.850482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:19.851088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:19.859007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:19.859878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:19.860315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:19.861586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:19.861586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:19.861933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:20.084602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:20.092969 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e790f14-6147-4d8a-9aee-1cfe0d4931dc tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1322 microversion: 2.1 time: 0.252617 Oct 12 09:41:20.094047 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3136/6699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:19 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:20.484227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ce91d8af-fde8-4d6b-b79e-49e148c34c17 req-ad98bc83-2753-4c08-9c0b-addee9a8495f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aafe7be-8f22-4c5c-b694-7f49af50733f", "tag": "1df451e0-41d2-4187-ad37-c06b2e377719"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:20.497401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce91d8af-fde8-4d6b-b79e-49e148c34c17 req-ad98bc83-2753-4c08-9c0b-addee9a8495f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:20.497928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce91d8af-fde8-4d6b-b79e-49e148c34c17 req-ad98bc83-2753-4c08-9c0b-addee9a8495f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:20.498379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce91d8af-fde8-4d6b-b79e-49e148c34c17 req-ad98bc83-2753-4c08-9c0b-addee9a8495f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:20.510880 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ce91d8af-fde8-4d6b-b79e-49e148c34c17 req-ad98bc83-2753-4c08-9c0b-addee9a8495f service nova] Creating event network-changed:1df451e0-41d2-4187-ad37-c06b2e377719 for instance 4aafe7be-8f22-4c5c-b694-7f49af50733f on n-h2-858383-10 Oct 12 09:41:20.516593 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ce91d8af-fde8-4d6b-b79e-49e148c34c17 req-ad98bc83-2753-4c08-9c0b-addee9a8495f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036786 Oct 12 09:41:20.517574 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3564/6700] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:21.120375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:21.121402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:21.129425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:21.129970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:21.130403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:21.131127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:21.131594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:21.132014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:21.266694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:21.278517 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-795424f1-2caa-4de3-90e6-c02db75c220d tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1322 microversion: 2.1 time: 0.164556 Oct 12 09:41:21.279275 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3137/6701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:21 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:22.308802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:22.309537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:22.316237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:22.316736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:22.317186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:22.318078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:22.318375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:22.318844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:22.452830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:22.460842 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5876b192-98ea-4422-b80c-a911bc4743ec tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1322 microversion: 2.1 time: 0.157276 Oct 12 09:41:22.461454 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3565/6702] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:22 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:23.484030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:23.484638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:23.491660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:23.492149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:23.492585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:23.493293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:23.493786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:23.494211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:23.626550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:23.635265 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad11c8f9-b3b1-4a70-b27f-7fe6d1b2de69 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1322 microversion: 2.1 time: 0.155177 Oct 12 09:41:23.635856 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3138/6703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:23 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:24.662882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:24.664448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:24.676116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:24.676960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:24.677782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:24.679006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:24.679762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:24.680479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:24.827290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:24.835523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-61f59b0b-30c9-4c02-93f2-89d18528f644 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1322 microversion: 2.1 time: 0.179372 Oct 12 09:41:24.836124 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3566/6704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:24 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:25.509665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-51602e36-4fb3-4051-b564-46bfdd777690 req-98dc790d-56b3-43c4-aed5-6dc163927414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aafe7be-8f22-4c5c-b694-7f49af50733f", "name": "network-vif-plugged", "status": "completed", "tag": "1df451e0-41d2-4187-ad37-c06b2e377719"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:25.520854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-51602e36-4fb3-4051-b564-46bfdd777690 req-98dc790d-56b3-43c4-aed5-6dc163927414 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:25.521415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-51602e36-4fb3-4051-b564-46bfdd777690 req-98dc790d-56b3-43c4-aed5-6dc163927414 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:25.521880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-51602e36-4fb3-4051-b564-46bfdd777690 req-98dc790d-56b3-43c4-aed5-6dc163927414 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:25.534631 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-51602e36-4fb3-4051-b564-46bfdd777690 req-98dc790d-56b3-43c4-aed5-6dc163927414 service nova] Creating event network-vif-plugged:1df451e0-41d2-4187-ad37-c06b2e377719 for instance 4aafe7be-8f22-4c5c-b694-7f49af50733f on n-h2-858383-10 Oct 12 09:41:25.539867 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-51602e36-4fb3-4051-b564-46bfdd777690 req-98dc790d-56b3-43c4-aed5-6dc163927414 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034359 Oct 12 09:41:25.541009 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3139/6705] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:25.860329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:25.860933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:25.868260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:25.868758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:25.869211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:25.869957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:25.870459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:25.870893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:26.004472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:26.012782 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-283e3ea8-c6b8-4609-acbc-349b7a4e0205 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1322 microversion: 2.1 time: 0.156735 Oct 12 09:41:26.013351 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3567/6706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:25 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:27.040992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:27.042209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:27.054220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:27.055029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:27.055765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:27.056935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:27.057765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:27.058497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:27.191158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:27.202170 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f89f832c-3b8f-4d02-8688-582f4e3c8f00 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1471 microversion: 2.1 time: 0.168038 Oct 12 09:41:27.202766 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3140/6707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:27 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:27.234048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:27.234779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:27.288926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-09d28487-41c5-4937-a813-76697bbab115 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Calling method '.version_select at 0x7f98437a68b0>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:27.357775 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-09d28487-41c5-4937-a813-76697bbab115 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/5dcbba5cdf4542799b4fb23ae9eb4f16" status: 200 len: 371 microversion: 2.1 time: 0.128295 Oct 12 09:41:27.358353 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3568/6708] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 09:41:27 2022] GET /compute/v2.1/os-quota-sets/5dcbba5cdf4542799b4fb23ae9eb4f16 => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:27.370937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c3b5733-5b39-44c1-8fe8-62dedc24841f tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-445731690", "id": 1317149059, "os-flavor-access:is_public": "True"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:27.391740 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c3b5733-5b39-44c1-8fe8-62dedc24841f tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.024583 Oct 12 09:41:27.392246 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3141/6709] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:41:27 2022] POST /compute/v2.1/flavors => generated 437 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:27.408597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1317149059"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:27.410941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:27.417280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:27.417810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:27.418262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:27.419079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:27.419549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:27.419986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:27.506171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2df473f159394610816b34437f962578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcbba5cdf4542799b4fb23ae9eb4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:27.513144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-445731690 {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:41:27.520329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:27.520831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:27.521284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:27.522070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:27.522545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:27.522990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:27.544183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Getting quotas for project d635f3119f9e49cf9e1ee1d2b21614ea. Resources: {'ram', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:41:27.549782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Getting quotas for user 3366d2083ff947b2ad427bfa8f6093e1 and project d635f3119f9e49cf9e1ee1d2b21614ea. Resources: {'ram', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:41:27.563016 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.compute.api [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] ram quota exceeded for 5dcbba5cdf4542799b4fb23ae9eb4f16, tried to resize instance. Oct 12 09:41:27.563577 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Request method failure captured: Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f/action HTTP/1.1 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 39 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRou7iXfAh0q5jjFXOMhrMv-xsBxXECOjypXy-2l_Jgoj1mJxLVNDojHDADXdpodpqgmj7DSQ-u3Ec9h8LwNSlebWQ9GbwqnJ217VmNn-cLJS1LTH35L-Scayd1-k57gHr-dcyhbYzh8VccQXU_DolagQTYplfU2MgdLrK5X13UmGmY8 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 5dcbba5cdf4542799b4fb23ae9eb4f16 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1650451828 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Role: member,reader,admin Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: member,reader,admin Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5dcbba5cdf4542799b4fb23ae9eb4f16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5dcbba5cdf4542799b4fb23ae9eb4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5dcbba5cdf4542799b4fb23ae9eb4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5dcbba5cdf4542799b4fb23ae9eb4f16"}]}] Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1650451828 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 5dcbba5cdf4542799b4fb23ae9eb4f16 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1650451828 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersAdminNegativeTestJSON-1650451828-project-admin Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 2df473f159394610816b34437f962578 Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1650451828-project-admin Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: {"resize": {"flavorRef": "1317149059"}} Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '4aafe7be-8f22-4c5c-b694-7f49af50733f', 'body': {'resize': {'flavorRef': '1317149059'}}} Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:41:27.565740 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b101f844-faba-49d3-b361-a116ec62f526 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f/action" status: 403 len: 118 microversion: 2.1 time: 0.162592 Oct 12 09:41:27.570185 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3569/6710] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:41:27 2022] POST /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f/action => generated 118 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 12 09:41:27.577242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-be46ef37-001d-4185-9b38-98e62f283e87 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:27.596186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-be46ef37-001d-4185-9b38-98e62f283e87 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1317149059" status: 202 len: 0 microversion: 2.1 time: 0.023184 Oct 12 09:41:27.596828 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3142/6711] 10.222.0.40 () {58 vars in 1161 bytes} [Wed Oct 12 09:41:27 2022] DELETE /compute/v2.1/flavors/1317149059 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:41:27.606957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-390656fb-6283-4046-ace2-bbb9d0a2ee92 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:27.628142 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-390656fb-6283-4046-ace2-bbb9d0a2ee92 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026696 Oct 12 09:41:27.628706 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3570/6712] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:41:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:27.652341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4598ccb-0e53-480a-88e5-caa32cc56eba tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Calling method '.version_select at 0x7f984367b040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:27.694753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:27.729242 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4598ccb-0e53-480a-88e5-caa32cc56eba tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/5dcbba5cdf4542799b4fb23ae9eb4f16" status: 200 len: 371 microversion: 2.1 time: 0.083338 Oct 12 09:41:27.729856 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3143/6713] 10.222.0.40 () {58 vars in 1242 bytes} [Wed Oct 12 09:41:27 2022] GET /compute/v2.1/os-quota-sets/5dcbba5cdf4542799b4fb23ae9eb4f16 => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:27.741945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64833d4e-c158-41b6-af48-3448ee44c553 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1928439016", "id": 8387895, "os-flavor-access:is_public": "True"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:27.763764 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-64833d4e-c158-41b6-af48-3448ee44c553 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.025666 Oct 12 09:41:27.764355 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3571/6714] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:41:27 2022] POST /compute/v2.1/flavors => generated 428 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:27.776366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "8387895"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:27.778902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:27.785113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:27.785642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:27.786083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:27.786781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:27.787254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:27.787674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:27.992322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2df473f159394610816b34437f962578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcbba5cdf4542799b4fb23ae9eb4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:28.000412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1928439016 {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:41:28.011312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:28.011963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:28.012478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:28.013232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:28.013714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:28.014134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:28.039268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Getting quotas for project d635f3119f9e49cf9e1ee1d2b21614ea. Resources: {'ram', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:41:28.044558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Getting quotas for user 3366d2083ff947b2ad427bfa8f6093e1 and project d635f3119f9e49cf9e1ee1d2b21614ea. Resources: {'ram', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:41:28.057863 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.compute.api [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] cores quota exceeded for 5dcbba5cdf4542799b4fb23ae9eb4f16, tried to resize instance. Oct 12 09:41:28.058388 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Request method failure captured: Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f/action HTTP/1.1 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 36 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRou7iXfAh0q5jjFXOMhrMv-xsBxXECOjypXy-2l_Jgoj1mJxLVNDojHDADXdpodpqgmj7DSQ-u3Ec9h8LwNSlebWQ9GbwqnJ217VmNn-cLJS1LTH35L-Scayd1-k57gHr-dcyhbYzh8VccQXU_DolagQTYplfU2MgdLrK5X13UmGmY8 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 5dcbba5cdf4542799b4fb23ae9eb4f16 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1650451828 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Role: member,reader,admin Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: member,reader,admin Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5dcbba5cdf4542799b4fb23ae9eb4f16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5dcbba5cdf4542799b4fb23ae9eb4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5dcbba5cdf4542799b4fb23ae9eb4f16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5dcbba5cdf4542799b4fb23ae9eb4f16"}]}] Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1650451828 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 5dcbba5cdf4542799b4fb23ae9eb4f16 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1650451828 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersAdminNegativeTestJSON-1650451828-project-admin Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 2df473f159394610816b34437f962578 Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1650451828-project-admin Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: {"resize": {"flavorRef": "8387895"}} Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '4aafe7be-8f22-4c5c-b694-7f49af50733f', 'body': {'resize': {'flavorRef': '8387895'}}} Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:41:28.060473 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e29be5bc-820c-4664-9e63-919e6f05f7e8 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f/action" status: 403 len: 113 microversion: 2.1 time: 0.289375 Oct 12 09:41:28.064642 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3144/6715] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:41:27 2022] POST /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f/action => generated 113 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:41:28.070696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7efea22a-84cc-49d3-b315-2d01adba5e58 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:28.089975 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7efea22a-84cc-49d3-b315-2d01adba5e58 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/8387895" status: 202 len: 0 microversion: 2.1 time: 0.022899 Oct 12 09:41:28.090530 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3572/6716] 10.222.0.40 () {58 vars in 1152 bytes} [Wed Oct 12 09:41:28 2022] DELETE /compute/v2.1/flavors/8387895 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:41:28.100952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-56f8f207-1729-4886-ba2f-6d6f50f928a1 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:28.122209 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-56f8f207-1729-4886-ba2f-6d6f50f928a1 tempest-ServersAdminNegativeTestJSON-1650451828 tempest-ServersAdminNegativeTestJSON-1650451828-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027313 Oct 12 09:41:28.122789 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3145/6717] 10.222.0.40 () {58 vars in 1146 bytes} [Wed Oct 12 09:41:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:28.146245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:28.146910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:28.154772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:28.155283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:28.155993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:28.157196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:28.157724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:28.158132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:28.186347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:41:28.266386 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1b5b821f-2f55-4b61-9a2d-5f66e02e2d73 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 204 len: 0 microversion: 2.1 time: 0.125702 Oct 12 09:41:28.267339 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3573/6718] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:41:28 2022] DELETE /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:41:28.275203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:28.275814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:28.282355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:28.282845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:28.283285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:28.283979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:28.284436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:28.284864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:28.412171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:28.420596 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1622e7e-3ed1-4a71-8348-b8b1d80e1d86 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1477 microversion: 2.1 time: 0.149328 Oct 12 09:41:28.421167 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3146/6719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:28 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1477 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:29.451508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:29.452559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:29.467376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:29.467880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:29.468333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:29.469046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:29.469543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:29.469984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:29.615442 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:29.623608 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0c23866c-a43a-402c-b314-585917b22fe0 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1477 microversion: 2.1 time: 0.178622 Oct 12 09:41:29.624215 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3574/6720] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:29 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1477 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:30.133876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-3cc3fea2-8138-4296-91f4-ba46b50bbcc1 req-b71db1ce-6982-43b1-98b2-b1f7bc6ce90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aafe7be-8f22-4c5c-b694-7f49af50733f", "name": "network-vif-deleted", "tag": "1df451e0-41d2-4187-ad37-c06b2e377719"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:30.146361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3cc3fea2-8138-4296-91f4-ba46b50bbcc1 req-b71db1ce-6982-43b1-98b2-b1f7bc6ce90c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:30.146813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3cc3fea2-8138-4296-91f4-ba46b50bbcc1 req-b71db1ce-6982-43b1-98b2-b1f7bc6ce90c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:30.147527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-3cc3fea2-8138-4296-91f4-ba46b50bbcc1 req-b71db1ce-6982-43b1-98b2-b1f7bc6ce90c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:30.159788 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-3cc3fea2-8138-4296-91f4-ba46b50bbcc1 req-b71db1ce-6982-43b1-98b2-b1f7bc6ce90c service nova] Creating event network-vif-deleted:1df451e0-41d2-4187-ad37-c06b2e377719 for instance 4aafe7be-8f22-4c5c-b694-7f49af50733f on n-h2-858383-10 Oct 12 09:41:30.165120 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-3cc3fea2-8138-4296-91f4-ba46b50bbcc1 req-b71db1ce-6982-43b1-98b2-b1f7bc6ce90c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034856 Oct 12 09:41:30.165882 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3147/6721] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:30.647633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:30.648226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:30.656968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:30.657547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:30.657942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:30.658654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:30.659128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:30.659596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:30.693383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:30.693912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:30.694409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:30.694825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lazy-loading 'fault' on Instance uuid 4aafe7be-8f22-4c5c-b694-7f49af50733f {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:41:30.736242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3366d2083ff947b2ad427bfa8f6093e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd635f3119f9e49cf9e1ee1d2b21614ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:30.744304 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6448e1ad-3f5e-4694-ab0f-a060764e4fe5 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 200 len: 1312 microversion: 2.1 time: 0.101124 Oct 12 09:41:30.744882 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3575/6722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:30 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:31.774916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:31.776053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] [instance: 4aafe7be-8f22-4c5c-b694-7f49af50733f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:31.786687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:31.787468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:31.788200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:31.789333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:31.790122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:31.790775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:31.806104 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] HTTP exception thrown: Instance 4aafe7be-8f22-4c5c-b694-7f49af50733f could not be found. Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Request method failure captured: Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f HTTP/1.1 Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRou71jxJXib72NIjB1YMBg6VOtsmLds5SbxNaN5g_rF-tbLe9czJlAibpFk9yewp2Mzxz4VMdrF6ONJseQrDcTf1kVXyyGSOMns0NqD-3udgV0inPHr14DR0fv-VStlYGyKDN7NxuxYROYj72PxL1ziUt-gt0fBzsDAzrKKWWZ7u8tU Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: d635f3119f9e49cf9e1ee1d2b21614ea Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-677214786 Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d635f3119f9e49cf9e1ee1d2b21614ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d635f3119f9e49cf9e1ee1d2b21614ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d635f3119f9e49cf9e1ee1d2b21614ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d635f3119f9e49cf9e1ee1d2b21614ea"}]}] Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersAdminNegativeTestJSON-677214786 Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: d635f3119f9e49cf9e1ee1d2b21614ea Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-677214786 Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersAdminNegativeTestJSON-677214786-project Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 3366d2083ff947b2ad427bfa8f6093e1 Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersAdminNegativeTestJSON-677214786-project Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 4aafe7be-8f22-4c5c-b694-7f49af50733f could not be found. Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '4aafe7be-8f22-4c5c-b694-7f49af50733f'} Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aafe7be-8f22-4c5c-b694-7f49af50733f could not be found. Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aafe7be-8f22-4c5c-b694-7f49af50733f could not be found. Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:31.807697 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aafe7be-8f22-4c5c-b694-7f49af50733f could not be found. Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] Returning 404 to user: Instance 4aafe7be-8f22-4c5c-b694-7f49af50733f could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3c14026a-c29e-4336-9390-8665ed9813d9 tempest-ServersAdminNegativeTestJSON-677214786 tempest-ServersAdminNegativeTestJSON-677214786-project] 10.222.0.40 "GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f" status: 404 len: 111 microversion: 2.1 time: 0.042892 Oct 12 09:41:31.811845 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3148/6723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:31 2022] GET /compute/v2.1/servers/4aafe7be-8f22-4c5c-b694-7f49af50733f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:41:37.898356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:37.899164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:38.020670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1216893305", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "9452fc32-0f2d-4a8d-bc93-e49d023d0d97"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:38.076200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] validate_networks() for [('9452fc32-0f2d-4a8d-bc93-e49d023d0d97', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:41:38.486217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:41:38.486649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:41:38.487143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:41:38.487566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:41:38.488000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:41:38.498293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:38.498720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:38.499597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:38.500369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:38.500843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:38.501284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:38.519662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Getting quotas for project a943b43e268440c2afa3af27dcca2ff2. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:41:38.525234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Getting quotas for user e6e20f9c7d0845bcb4a03e82c479ba98 and project a943b43e268440c2afa3af27dcca2ff2. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:41:38.538069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:41:38.540544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:41:38.589984 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-97133bf4-08e2-459f-9a05-528a0e47f920 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697475 Oct 12 09:41:38.590948 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3576/6724] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:41:38.602446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d36776ea-ace0-4145-85a4-5be6768bfd51 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:38.603320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d36776ea-ace0-4145-85a4-5be6768bfd51 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:38.606666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:38.607557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:38.676077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d36776ea-ace0-4145-85a4-5be6768bfd51 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:38.684047 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d36776ea-ace0-4145-85a4-5be6768bfd51 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1215 microversion: 2.1 time: 0.085408 Oct 12 09:41:38.699431 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3149/6725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:38 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:39.707823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:39.708593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:39.717025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:39.717677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:39.718138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:39.718860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:39.719333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:39.719776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:39.782721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:39.790451 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cfbc1d2e-9fae-4b61-b308-86e2dcf51d93 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1267 microversion: 2.1 time: 0.086749 Oct 12 09:41:39.791031 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3577/6726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:39 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:40.814851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:40.815453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:40.823599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:40.824409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:40.825019 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:40.826007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:40.826528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:40.827194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:40.932006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:40.940245 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef6055a7-1b64-4072-89f9-c77c61211284 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1273 microversion: 2.1 time: 0.130140 Oct 12 09:41:40.941421 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3150/6727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:40 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:41.883061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5fd0747d-c68d-4887-b502-5c90357f223e req-91635156-da70-41aa-bd21-4b1d8a3d5062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10a2591-65ba-483b-820d-acbded3af961", "tag": "b0632d0f-d111-4421-9a56-bca5fad3bf2c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:41.903946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5fd0747d-c68d-4887-b502-5c90357f223e req-91635156-da70-41aa-bd21-4b1d8a3d5062 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:41.906163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5fd0747d-c68d-4887-b502-5c90357f223e req-91635156-da70-41aa-bd21-4b1d8a3d5062 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:41.906673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5fd0747d-c68d-4887-b502-5c90357f223e req-91635156-da70-41aa-bd21-4b1d8a3d5062 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:41.919514 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5fd0747d-c68d-4887-b502-5c90357f223e req-91635156-da70-41aa-bd21-4b1d8a3d5062 service nova] Creating event network-changed:b0632d0f-d111-4421-9a56-bca5fad3bf2c for instance e10a2591-65ba-483b-820d-acbded3af961 on n-h2-858383-10 Oct 12 09:41:41.924593 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5fd0747d-c68d-4887-b502-5c90357f223e req-91635156-da70-41aa-bd21-4b1d8a3d5062 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045814 Oct 12 09:41:41.925219 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3578/6728] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:41.965370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:41.966020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:41.972985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:41.973496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:41.973938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:41.974632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:41.975090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:41.975516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:42.170783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:42.179264 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3710b4b9-d4cd-473e-af03-1cc12b29dfc8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1315 microversion: 2.1 time: 0.217938 Oct 12 09:41:42.179844 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3151/6729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:41 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:43.208861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:43.210083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:43.222141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:43.222987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:43.223754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:43.224968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:43.225802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:43.226548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:43.367435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:43.375934 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-da0fd2d0-2255-4dc1-ab4d-8a370d4ef9b2 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1315 microversion: 2.1 time: 0.175600 Oct 12 09:41:43.376494 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3579/6730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:43 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:44.403218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:44.403904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:44.410895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:44.411392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:44.411851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:44.412576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:44.413018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:44.413445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:44.543131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:44.551261 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc3239ff-d9e8-4c5b-95c3-519d574d94d8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1315 microversion: 2.1 time: 0.154231 Oct 12 09:41:44.551772 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3152/6731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:44 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:45.575170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:45.575786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:45.582988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:45.583641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:45.584101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:45.584851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:45.585284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:45.585817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:45.719809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:45.730522 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2074e473-ed9f-4dbb-b0db-4f2e5d41bece tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1315 microversion: 2.1 time: 0.159514 Oct 12 09:41:45.731509 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3580/6732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:45 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:46.763515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:46.764231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:46.772860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:46.773454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:46.773996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:46.774818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:46.775365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:46.775874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:46.914885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:46.923364 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5d9cfce-d622-42a2-ae8b-08f2d301a622 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1315 microversion: 2.1 time: 0.166817 Oct 12 09:41:46.924049 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3153/6733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:46 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:47.721568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-658356a1-5411-4d31-8a70-461190fc13b4 req-8f6b1a1a-145a-423e-b2d7-837fc310fccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10a2591-65ba-483b-820d-acbded3af961", "name": "network-vif-plugged", "status": "completed", "tag": "b0632d0f-d111-4421-9a56-bca5fad3bf2c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:47.727596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:47.734555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-658356a1-5411-4d31-8a70-461190fc13b4 req-8f6b1a1a-145a-423e-b2d7-837fc310fccb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:47.735064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-658356a1-5411-4d31-8a70-461190fc13b4 req-8f6b1a1a-145a-423e-b2d7-837fc310fccb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:47.735516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-658356a1-5411-4d31-8a70-461190fc13b4 req-8f6b1a1a-145a-423e-b2d7-837fc310fccb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:47.743360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:47.751822 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-658356a1-5411-4d31-8a70-461190fc13b4 req-8f6b1a1a-145a-423e-b2d7-837fc310fccb service nova] Creating event network-vif-plugged:b0632d0f-d111-4421-9a56-bca5fad3bf2c for instance e10a2591-65ba-483b-820d-acbded3af961 on n-h2-858383-10 Oct 12 09:41:47.757465 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-658356a1-5411-4d31-8a70-461190fc13b4 req-8f6b1a1a-145a-423e-b2d7-837fc310fccb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039746 Oct 12 09:41:47.758185 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3581/6734] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:41:47.947009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:47.947631 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:47.950381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:47.955979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:47.956468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:47.956903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:47.957637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:47.958099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:47.958525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:47.962142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=74 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:48.095277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:48.103403 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6492154-5f74-44f1-9d8d-66038ccfe89d tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1315 microversion: 2.1 time: 0.160389 Oct 12 09:41:48.104190 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3154/6735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:47 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:49.124679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:49.125871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:49.132493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:49.133216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:49.142659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:49.143267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:49.143754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:49.144463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:49.144964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:49.145902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:49.284945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:49.296052 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9268fb04-83d1-44a4-92b2-51e629728dfe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1502 microversion: 2.1 time: 0.173568 Oct 12 09:41:49.296631 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3582/6736] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:49 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:49.318992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:41:49.321194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:49.323159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:41:49.329809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:49.330300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:49.330738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:49.331426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:49.331878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:49.332357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:49.411708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:49.417669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Old instance type m1.heat2, new instance type m1.heat {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:41:49.424646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:41:49.425048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:41:49.425555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:41:49.425965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:41:49.426375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:41:49.546073 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-003d9e2e-f2bb-4995-9d6f-f945eaafadcb tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "POST /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961/action" status: 202 len: 0 microversion: 2.1 time: 0.231170 Oct 12 09:41:49.546777 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3155/6737] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:41:49 2022] POST /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:41:49.555165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:49.555918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:49.562458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:49.562960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:49.563419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:49.564111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:49.564576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:49.565009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:49.729822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:49.739165 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-46e30581-3b5f-4e99-b445-a5de1ba006a5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1511 microversion: 2.1 time: 0.188010 Oct 12 09:41:49.739895 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3583/6738] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:49 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:50.764101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:50.764695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:50.771818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:50.772301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:50.772738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:50.773426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:50.773903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:50.774324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:50.906381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:50.914936 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a868bc9e-7b41-4b2d-bdae-4e412bae408f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1511 microversion: 2.1 time: 0.155951 Oct 12 09:41:50.915719 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3156/6739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:50 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:51.940899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:51.941690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:51.950810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:51.951672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:51.952447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:51.953157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:51.953668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:51.955519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:52.111200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:52.124251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f3a07d0f-8929-4b97-8a22-62b134ccb5a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.188005 Oct 12 09:41:52.124959 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3584/6740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:51 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:53.157113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:53.157912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:53.168052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:53.168714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:53.169298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:53.170258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:53.170852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:53.171420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:53.316483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:53.328144 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-63d2dbcc-5f44-4b2a-a3c9-fa526f309b6e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.177276 Oct 12 09:41:53.328884 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3157/6741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:53 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:54.359217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:54.359985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:54.369207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:54.369866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:54.370474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:54.371800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:54.372456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:54.373382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:54.515573 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:54.523532 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6811264-55d4-4ef4-99d2-db489e75af3e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.170322 Oct 12 09:41:54.524140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3585/6742] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:54 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:55.551674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:55.552644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:55.562652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:55.563136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:55.563571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:55.564267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:55.564710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:55.565132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:55.700819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:55.709029 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-77093cf9-adbc-4d1f-b193-98063c936d2a tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.163835 Oct 12 09:41:55.709639 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3158/6743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:55 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:56.736599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:56.737906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:56.749464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:56.750304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:56.751068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:56.752237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:56.753011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:56.753801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:56.889105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:56.897263 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-131d794a-dd40-46ab-a2d0-d5581fb3f490 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.167447 Oct 12 09:41:56.897876 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3586/6744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:56 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:57.924965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:57.926092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:57.936588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:57.937074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:57.937543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:57.938234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:57.938687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:57.939115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:58.084721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:58.092591 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-06eb251d-c1c2-43c7-9c41-b17511663bca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.174303 Oct 12 09:41:58.093210 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3159/6745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:57 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:41:59.120661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:41:59.121546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:41:59.129294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:59.129832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:59.130290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:59.131009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:41:59.131493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:41:59.131943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:41:59.272821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:41:59.281265 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f6a9a5a2-c2a3-4795-825d-bf4523ee752f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.167412 Oct 12 09:41:59.281886 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3587/6746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:41:59 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:00.305582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:00.306308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:00.314966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:00.315539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:00.316053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:00.316865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:00.317451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:00.317953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:00.454306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:00.462535 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2f692b0a-1f8c-44c9-b625-97b815182582 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.161673 Oct 12 09:42:00.463112 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3160/6747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:00 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:01.492252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:01.493291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:01.505075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:01.505619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:01.506077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:01.506792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:01.507273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:01.507706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:01.643531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:01.652415 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5b6640c4-acbd-4dd8-aa44-64d9d12f6ab5 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.168941 Oct 12 09:42:01.653051 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3588/6748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:01 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:02.680628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:02.681644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:02.691939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:02.692682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:02.693122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:02.693853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:02.694306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:02.694733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:02.836883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:02.844815 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-568861e0-6d7d-4e4a-8de5-d9684e1f8f8b tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.171214 Oct 12 09:42:02.845393 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3161/6749] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:02 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:03.872090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:03.873247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:03.884528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:03.885134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:03.885816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:03.886877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:03.887538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:03.888163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:04.026809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:04.035211 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39fd9397-7d08-465a-8e2b-bc78c0c546a6 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.168344 Oct 12 09:42:04.035788 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3589/6750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:03 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:05.066061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:05.066627 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:05.074520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:05.075148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:05.075589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:05.076289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:05.076737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:05.077160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:05.281064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:05.289367 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15ea4631-a5c8-496a-9fab-25a53bd317aa tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.227606 Oct 12 09:42:05.290004 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3162/6751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:05 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:06.317361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:06.318447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:06.330298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:06.331126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:06.331885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:06.333020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:06.333519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:06.333968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:06.476445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:06.484886 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec8dfeed-57cf-4809-93b9-fe28fe4d43a8 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.174261 Oct 12 09:42:06.485479 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3590/6752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:06 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:07.512592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:07.513775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:07.523332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:07.523788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:07.524223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:07.524917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:07.525367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:07.525804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:07.672283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:07.680498 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f430f628-c9b5-40fe-9528-371ab7692bff tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.174766 Oct 12 09:42:07.681070 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3163/6753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:07 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:08.708056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:08.709094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:08.720864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:08.721800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:08.722561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:08.723873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:08.724343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:08.724787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:08.871568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:08.880057 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95d31eb2-49cf-42f6-8f6b-c276084a5eca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.178432 Oct 12 09:42:08.880601 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3591/6754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:08 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:09.907818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:09.908868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:09.920204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:09.921002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:09.921833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:09.922929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:09.923674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:09.924372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:10.055334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:10.063687 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-62bda4d0-29d7-4824-84a3-3a26fec9dc9e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.162520 Oct 12 09:42:10.064294 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3164/6755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:09 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:11.091532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:11.092568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:11.102422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:11.102926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:11.103376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:11.104113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:11.104588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:11.105036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:11.239327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:11.248036 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f1f695a4-352f-4157-9045-c895fe2b9b86 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.163121 Oct 12 09:42:11.248587 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3592/6756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:11 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:12.283493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:12.284479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:12.297643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:12.298456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:12.299192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:12.300353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:12.301103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:12.301872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:12.442582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:12.450730 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-52de0ab1-660f-45f0-9799-5ca5b922f732 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.174028 Oct 12 09:42:12.451369 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3165/6757] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:12 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:13.479194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:13.480323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:13.491304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:13.491810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:13.492260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:13.492965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:13.493453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:13.493892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:13.630450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:13.639087 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b488670f-f629-42eb-b8c0-4664707b6280 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.167104 Oct 12 09:42:13.639665 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3593/6758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:13 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:14.667687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:14.668676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:14.680903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:14.681768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:14.682506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:14.683647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:14.684525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:14.685248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:14.849403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:14.859670 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8d186248-5195-459b-9e13-826da313cbe9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.199461 Oct 12 09:42:14.860240 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3166/6759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:14 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:15.883572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:15.884196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:15.891691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:15.892197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:15.892675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:15.893393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:15.893897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:15.894352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:16.036892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:16.049420 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e4abf1dd-ca73-485a-b096-b84daaa21fbf tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.169878 Oct 12 09:42:16.050241 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3594/6760] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:15 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:17.078218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:17.079222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:17.090773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:17.091564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:17.092277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:17.093408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:17.094191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:17.094894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:17.229465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:17.237661 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a4cd126-27cc-4d55-8ce9-a20ac60480fe tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.166134 Oct 12 09:42:17.238218 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3167/6761] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:17 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:18.266402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:18.267311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:18.279282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:18.280133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:18.280879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:18.282123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:18.282865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:18.283590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:18.420338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:18.428502 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eec703bb-399a-4964-9cfe-632941243ff9 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1516 microversion: 2.1 time: 0.168954 Oct 12 09:42:18.429074 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3595/6762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:18 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:19.346466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-7ff94b8c-aaee-4599-b35f-5070ed08bc5f req-fb2e7015-1bdb-4a80-9254-c271b091b1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10a2591-65ba-483b-820d-acbded3af961", "name": "network-vif-unplugged", "status": "completed", "tag": "b0632d0f-d111-4421-9a56-bca5fad3bf2c"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:19.352093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=32 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:19.358234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ff94b8c-aaee-4599-b35f-5070ed08bc5f req-fb2e7015-1bdb-4a80-9254-c271b091b1fc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:19.358726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ff94b8c-aaee-4599-b35f-5070ed08bc5f req-fb2e7015-1bdb-4a80-9254-c271b091b1fc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:19.359151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ff94b8c-aaee-4599-b35f-5070ed08bc5f req-fb2e7015-1bdb-4a80-9254-c271b091b1fc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:19.363151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:19.371877 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7ff94b8c-aaee-4599-b35f-5070ed08bc5f req-fb2e7015-1bdb-4a80-9254-c271b091b1fc service nova] Creating event network-vif-unplugged:b0632d0f-d111-4421-9a56-bca5fad3bf2c for instance e10a2591-65ba-483b-820d-acbded3af961 on n-h1-858383-10 Oct 12 09:42:19.377790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-7ff94b8c-aaee-4599-b35f-5070ed08bc5f req-fb2e7015-1bdb-4a80-9254-c271b091b1fc service nova] Instance e10a2591-65ba-483b-820d-acbded3af961 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:42:19.389460 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-7ff94b8c-aaee-4599-b35f-5070ed08bc5f req-fb2e7015-1bdb-4a80-9254-c271b091b1fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046768 Oct 12 09:42:19.390073 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3168/6763] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:42:19.452420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:19.453042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:19.455807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=30 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:19.460892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:19.461397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:19.461864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:19.462646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:19.463160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:19.463599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:19.469289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=86 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:19.599187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:19.607192 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88cd4306-7e8b-4804-8ab5-54c7f6a53168 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1515 microversion: 2.1 time: 0.158788 Oct 12 09:42:19.607763 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3596/6764] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:19 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:20.637504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:20.638457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:20.647209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:20.647849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:20.648426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:20.649336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:20.649967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:20.650529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:20.799498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:20.811321 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1a5a5d99-6578-4b45-a41e-7609f0f8243e tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1513 microversion: 2.1 time: 0.182061 Oct 12 09:42:20.812139 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3169/6765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:20 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:21.414604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a165e235-8693-467d-bd6e-ddc1a5710e53 req-410476b4-1f0a-44e2-b3ec-9ac8ace170c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10a2591-65ba-483b-820d-acbded3af961", "tag": "b0632d0f-d111-4421-9a56-bca5fad3bf2c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:21.425908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a165e235-8693-467d-bd6e-ddc1a5710e53 req-410476b4-1f0a-44e2-b3ec-9ac8ace170c7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:21.426402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a165e235-8693-467d-bd6e-ddc1a5710e53 req-410476b4-1f0a-44e2-b3ec-9ac8ace170c7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:21.426849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a165e235-8693-467d-bd6e-ddc1a5710e53 req-410476b4-1f0a-44e2-b3ec-9ac8ace170c7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:21.439565 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a165e235-8693-467d-bd6e-ddc1a5710e53 req-410476b4-1f0a-44e2-b3ec-9ac8ace170c7 service nova] Creating event network-changed:b0632d0f-d111-4421-9a56-bca5fad3bf2c for instance e10a2591-65ba-483b-820d-acbded3af961 on n-h1-858383-10 Oct 12 09:42:21.446312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-a165e235-8693-467d-bd6e-ddc1a5710e53 req-410476b4-1f0a-44e2-b3ec-9ac8ace170c7 service nova] Instance e10a2591-65ba-483b-820d-acbded3af961 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:42:21.457468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a165e235-8693-467d-bd6e-ddc1a5710e53 req-410476b4-1f0a-44e2-b3ec-9ac8ace170c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049177 Oct 12 09:42:21.458109 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3597/6766] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:42:21.834971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:21.835489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:21.843026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:21.843528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:21.844000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:21.844707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:21.845130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:21.845888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:22.546047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:22.554117 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b3668d04-61bc-4a29-a846-0cd28e04964f tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1513 microversion: 2.1 time: 0.723418 Oct 12 09:42:22.554948 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3170/6767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:21 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1513 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:23.579405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:23.580108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:23.586675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:23.587177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:23.587621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:23.588329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:23.588798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:23.589271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:23.819174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:23.827178 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b6d8c072-b1f9-49b5-88b3-357dbc72cfcd tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1510 microversion: 2.1 time: 0.252972 Oct 12 09:42:23.827761 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3598/6768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:23 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:23.849979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:23.850537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:23.857891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:23.858542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:23.858866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:23.859677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:23.860126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:23.860543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:23.887273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:42:23.937989 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.compute.api [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Found an unconfirmed migration during delete, id: 16, status: finished Oct 12 09:42:25.106425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-97c9785a-629e-4612-a672-915cede745e2 req-e665666e-89ba-4bf5-8599-20c4203c78ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10a2591-65ba-483b-820d-acbded3af961", "name": "network-vif-plugged", "status": "completed", "tag": "b0632d0f-d111-4421-9a56-bca5fad3bf2c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:25.117420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-97c9785a-629e-4612-a672-915cede745e2 req-e665666e-89ba-4bf5-8599-20c4203c78ac service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:25.118077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-97c9785a-629e-4612-a672-915cede745e2 req-e665666e-89ba-4bf5-8599-20c4203c78ac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:25.118810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-97c9785a-629e-4612-a672-915cede745e2 req-e665666e-89ba-4bf5-8599-20c4203c78ac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:25.131266 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-97c9785a-629e-4612-a672-915cede745e2 req-e665666e-89ba-4bf5-8599-20c4203c78ac service nova] Creating event network-vif-plugged:b0632d0f-d111-4421-9a56-bca5fad3bf2c for instance e10a2591-65ba-483b-820d-acbded3af961 on n-h1-858383-10 Oct 12 09:42:25.136829 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-97c9785a-629e-4612-a672-915cede745e2 req-e665666e-89ba-4bf5-8599-20c4203c78ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034376 Oct 12 09:42:25.137671 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3599/6769] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:42:25.448381 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4210b573-f45c-482f-849a-0cb62ac759ca tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 204 len: 0 microversion: 2.1 time: 1.601883 Oct 12 09:42:25.449066 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3171/6770] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:42:23 2022] DELETE /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 0 bytes in 1604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:42:25.458454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:25.459178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:25.465738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:25.466258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:25.466715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:25.467532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:25.468004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:25.468449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:25.601658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:25.609880 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d49af8f-fa73-46cb-aa50-c0e83b22c1a3 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1502 microversion: 2.1 time: 0.155800 Oct 12 09:42:25.610440 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3600/6771] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:25 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:26.634267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:26.634970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:26.642304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:26.642790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:26.643235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:26.643932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:26.644389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:26.644818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:26.791912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e20f9c7d0845bcb4a03e82c479ba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a943b43e268440c2afa3af27dcca2ff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:26.799984 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3347fd41-8e79-42ee-ac2c-b033e010ad28 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 200 len: 1502 microversion: 2.1 time: 0.170494 Oct 12 09:42:26.800567 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3172/6772] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:26 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:27.314337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f0d044c6-c0a5-44fc-a0eb-813893bb1277 req-d5225900-920f-4175-a2bd-1bdff66f0a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10a2591-65ba-483b-820d-acbded3af961", "name": "network-vif-deleted", "tag": "b0632d0f-d111-4421-9a56-bca5fad3bf2c"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:27.327953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f0d044c6-c0a5-44fc-a0eb-813893bb1277 req-d5225900-920f-4175-a2bd-1bdff66f0a5c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:27.328449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f0d044c6-c0a5-44fc-a0eb-813893bb1277 req-d5225900-920f-4175-a2bd-1bdff66f0a5c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:27.328892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f0d044c6-c0a5-44fc-a0eb-813893bb1277 req-d5225900-920f-4175-a2bd-1bdff66f0a5c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:27.341182 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f0d044c6-c0a5-44fc-a0eb-813893bb1277 req-d5225900-920f-4175-a2bd-1bdff66f0a5c service nova] Creating event network-vif-deleted:b0632d0f-d111-4421-9a56-bca5fad3bf2c for instance e10a2591-65ba-483b-820d-acbded3af961 on n-h1-858383-10 Oct 12 09:42:27.347696 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f0d044c6-c0a5-44fc-a0eb-813893bb1277 req-d5225900-920f-4175-a2bd-1bdff66f0a5c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037567 Oct 12 09:42:27.348662 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3601/6773] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:42:27.827168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:27.828185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:27.839492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:27.839978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:27.840443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:27.841195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:27.841685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:27.842115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:27.856019 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] HTTP exception thrown: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Request method failure captured: Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 HTTP/1.1 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRovRv5vRc66xfqVfeTeltUGXQ4fCoAdG3CZ4_pVHWb9DFX9TFeIecosfpVleepyMDQJ93na98-Sm0F57A7DqEwE44Q_54FadXZ-AnX1cxegZssSeX92fCs7eptnuBPEqAlSJ5xA-QAhKoCBD-JvszzM2JkWMwioczCe7VG1ToR8n8O4 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a943b43e268440c2afa3af27dcca2ff2 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a943b43e268440c2afa3af27dcca2ff2"}]}] Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a943b43e268440c2afa3af27dcca2ff2 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1006535702-project Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: e6e20f9c7d0845bcb4a03e82c479ba98 Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1006535702-project Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e10a2591-65ba-483b-820d-acbded3af961'} Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:42:27.857705 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Returning 404 to user: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe011db4-f2a3-4b75-89b5-08f9b10fe306 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 404 len: 111 microversion: 2.1 time: 0.038579 Oct 12 09:42:27.861758 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3173/6774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:27 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:42:27.876777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:27.877373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:27.884246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:27.884738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:27.885182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:27.885929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:27.886393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:27.886826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:27.900430 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] HTTP exception thrown: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Request method failure captured: Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 HTTP/1.1 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRovRv5vRc66xfqVfeTeltUGXQ4fCoAdG3CZ4_pVHWb9DFX9TFeIecosfpVleepyMDQJ93na98-Sm0F57A7DqEwE44Q_54FadXZ-AnX1cxegZssSeX92fCs7eptnuBPEqAlSJ5xA-QAhKoCBD-JvszzM2JkWMwioczCe7VG1ToR8n8O4 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a943b43e268440c2afa3af27dcca2ff2 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a943b43e268440c2afa3af27dcca2ff2"}]}] Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a943b43e268440c2afa3af27dcca2ff2 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-DeleteServersTestJSON-1006535702-project Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: e6e20f9c7d0845bcb4a03e82c479ba98 Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-DeleteServersTestJSON-1006535702-project Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'e10a2591-65ba-483b-820d-acbded3af961'} Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:42:27.902153 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Returning 404 to user: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0bec7b4b-11d2-4fad-8ffb-a4093df95200 tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 404 len: 111 microversion: 2.1 time: 0.031283 Oct 12 09:42:27.906412 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3602/6775] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:42:27 2022] DELETE /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:42:27.912459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:27.913069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] [instance: e10a2591-65ba-483b-820d-acbded3af961] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:27.919234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:27.919714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:27.920145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:27.920814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:27.921250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:27.921712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:27.935596 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] HTTP exception thrown: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Request method failure captured: Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 HTTP/1.1 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRovRv5vRc66xfqVfeTeltUGXQ4fCoAdG3CZ4_pVHWb9DFX9TFeIecosfpVleepyMDQJ93na98-Sm0F57A7DqEwE44Q_54FadXZ-AnX1cxegZssSeX92fCs7eptnuBPEqAlSJ5xA-QAhKoCBD-JvszzM2JkWMwioczCe7VG1ToR8n8O4 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a943b43e268440c2afa3af27dcca2ff2 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a943b43e268440c2afa3af27dcca2ff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a943b43e268440c2afa3af27dcca2ff2"}]}] Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a943b43e268440c2afa3af27dcca2ff2 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1006535702 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-DeleteServersTestJSON-1006535702-project Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: e6e20f9c7d0845bcb4a03e82c479ba98 Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-DeleteServersTestJSON-1006535702-project Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'e10a2591-65ba-483b-820d-acbded3af961'} Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:42:27.937144 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] Returning 404 to user: Instance e10a2591-65ba-483b-820d-acbded3af961 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e131f3b0-4a92-44a4-9700-79af5c5a44ad tempest-DeleteServersTestJSON-1006535702 tempest-DeleteServersTestJSON-1006535702-project] 10.222.0.40 "GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961" status: 404 len: 111 microversion: 2.1 time: 0.030123 Oct 12 09:42:27.941401 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3174/6776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:27 2022] GET /compute/v2.1/servers/e10a2591-65ba-483b-820d-acbded3af961 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:42:36.438548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-898816867", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "1df1a611-0e06-4e37-a81f-779265e73991"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:36.718739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] validate_networks() for [('1df1a611-0e06-4e37-a81f-779265e73991', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:42:37.099279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:42:37.099811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:42:37.100325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:42:37.100748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:42:37.101177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:42:37.110796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:37.111295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:37.111753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:37.112806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:37.113267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:37.113895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:37.135028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Getting quotas for project 3548d3847dd54937abea4a91a69543ba. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:42:37.140419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Getting quotas for user ac6ed91a455a4f7a83f7387116c1231a and project 3548d3847dd54937abea4a91a69543ba. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:42:37.154203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:42:37.157299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:42:37.203236 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c6f2881f-b023-4c4f-952b-c4ade8c6b927 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884473 Oct 12 09:42:37.203897 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3603/6777] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 09:42:37.215276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d62eb2ba-9716-4fea-8e1c-02f422424753 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:37.215893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d62eb2ba-9716-4fea-8e1c-02f422424753 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:37.375858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d62eb2ba-9716-4fea-8e1c-02f422424753 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:37.384383 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d62eb2ba-9716-4fea-8e1c-02f422424753 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1217 microversion: 2.1 time: 0.173194 Oct 12 09:42:37.385133 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3175/6778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:37 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:38.408972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:38.409711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:38.418759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:38.419541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:38.420200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:38.421091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:38.421768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:38.423266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:38.491116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:38.499181 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ec0fced-c212-4cac-994f-17956c533ee7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1275 microversion: 2.1 time: 0.095321 Oct 12 09:42:38.500398 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3604/6779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:38 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:39.523704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:39.525149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:39.531647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:39.534838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:39.535574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:39.536226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:39.537190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:39.537907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:39.538570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:39.802101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:39.814919 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-de78c9c0-e8e8-4c19-9f89-1d8e5fa7bc9b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1317 microversion: 2.1 time: 0.295084 Oct 12 09:42:39.815519 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3176/6780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:39 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:40.018597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e741add7-0326-4d6f-b211-85f3d63a8338 req-6b00858f-c72e-4b9c-b495-b52ad7a28ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36ba1d95-6661-48ff-b5bc-ddfa852d176b", "tag": "cc547904-6e75-46c9-9dc1-bbcc30a0ce5d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:40.029191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e741add7-0326-4d6f-b211-85f3d63a8338 req-6b00858f-c72e-4b9c-b495-b52ad7a28ec4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:40.029704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e741add7-0326-4d6f-b211-85f3d63a8338 req-6b00858f-c72e-4b9c-b495-b52ad7a28ec4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:40.030152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e741add7-0326-4d6f-b211-85f3d63a8338 req-6b00858f-c72e-4b9c-b495-b52ad7a28ec4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:40.042298 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e741add7-0326-4d6f-b211-85f3d63a8338 req-6b00858f-c72e-4b9c-b495-b52ad7a28ec4 service nova] Creating event network-changed:cc547904-6e75-46c9-9dc1-bbcc30a0ce5d for instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b on n-h1-858383-10 Oct 12 09:42:40.047517 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e741add7-0326-4d6f-b211-85f3d63a8338 req-6b00858f-c72e-4b9c-b495-b52ad7a28ec4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032531 Oct 12 09:42:40.048103 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3605/6781] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:42:40.839222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:40.839841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:40.848231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:40.848793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:40.849251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:40.850012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:40.850497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:40.851090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:40.982944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:40.991186 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1b888392-1234-42b1-8cee-780353b67359 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1317 microversion: 2.1 time: 0.156394 Oct 12 09:42:40.991759 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3177/6782] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:40 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:42.017317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:42.018186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:42.025016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:42.025634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:42.026083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:42.026831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:42.027288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:42.027752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:42.159245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:42.167369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1a5e6e58-4dc8-4264-9075-2de8ce5fae56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1317 microversion: 2.1 time: 0.155732 Oct 12 09:42:42.167943 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3606/6783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:42 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:43.194247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:43.195233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:43.203769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:43.204259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:43.204695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:43.205568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:43.206013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:43.206435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:43.338300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:43.346383 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d0af8e63-0292-4b5e-b0e8-0fe5b7e64870 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1317 microversion: 2.1 time: 0.158624 Oct 12 09:42:43.346962 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3178/6784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:43 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:44.370713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:44.371519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:44.381217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:44.382292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:44.382935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:44.383891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:44.384526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:44.385119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:44.530552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:44.539140 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3a2d3c0-92bb-465b-98a2-9d706a595340 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1317 microversion: 2.1 time: 0.173861 Oct 12 09:42:44.539669 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3607/6785] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:44 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:45.562664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:45.563241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:45.570560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:45.571050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:45.571471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:45.572165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:45.572617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:45.573035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:45.706668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:45.715062 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ccafa14e-4d69-4d57-9797-e7552ee4e9a2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1317 microversion: 2.1 time: 0.156523 Oct 12 09:42:45.715638 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3179/6786] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:45 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:46.742130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:46.743160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:46.754707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:46.755539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:46.756288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:46.757897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:46.758683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:46.759415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:46.898209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:46.906296 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb85083e-4146-4272-9959-94502f7db464 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1317 microversion: 2.1 time: 0.170771 Oct 12 09:42:46.906903 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3608/6787] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:46 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:47.227147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-1b9b478a-dd1e-4c2f-bc71-e91f1f03faf9 req-0ba78c93-a887-4aa3-b7fe-d0dbf9c0a8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ba1d95-6661-48ff-b5bc-ddfa852d176b", "name": "network-vif-plugged", "status": "completed", "tag": "cc547904-6e75-46c9-9dc1-bbcc30a0ce5d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:47.239229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1b9b478a-dd1e-4c2f-bc71-e91f1f03faf9 req-0ba78c93-a887-4aa3-b7fe-d0dbf9c0a8c5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:47.239709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1b9b478a-dd1e-4c2f-bc71-e91f1f03faf9 req-0ba78c93-a887-4aa3-b7fe-d0dbf9c0a8c5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:47.240216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-1b9b478a-dd1e-4c2f-bc71-e91f1f03faf9 req-0ba78c93-a887-4aa3-b7fe-d0dbf9c0a8c5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:47.252588 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-1b9b478a-dd1e-4c2f-bc71-e91f1f03faf9 req-0ba78c93-a887-4aa3-b7fe-d0dbf9c0a8c5 service nova] Creating event network-vif-plugged:cc547904-6e75-46c9-9dc1-bbcc30a0ce5d for instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b on n-h1-858383-10 Oct 12 09:42:47.258239 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-1b9b478a-dd1e-4c2f-bc71-e91f1f03faf9 req-0ba78c93-a887-4aa3-b7fe-d0dbf9c0a8c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035060 Oct 12 09:42:47.259156 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3180/6788] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:42:47.930041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:47.931304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:47.933350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:47.934196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:47.940986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:47.941517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:47.941972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:47.942696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:47.943168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:47.943612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:48.079625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:48.087852 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b463d67e-a019-44ad-a6f2-658e4409e6b2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1317 microversion: 2.1 time: 0.161920 Oct 12 09:42:48.088412 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3609/6789] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:47 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:49.111130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:49.119467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:49.120646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:49.133513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.134362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.135095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.136171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.136622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.137057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.268289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:49.276496 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8d9bcf6-1669-41a0-943e-355733242ae6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1506 microversion: 2.1 time: 0.167247 Oct 12 09:42:49.277001 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3181/6790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:49 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:49.298710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:49.299339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:49.306637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.307160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.307680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.308386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.308849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.309288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.446001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:49.454164 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7338af92-6e2f-4025-bcd8-bae31532c7b0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1506 microversion: 2.1 time: 0.159380 Oct 12 09:42:49.454772 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3610/6791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:49 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:49.476375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:49.479010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:49.480876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:49.486504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.486984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.487418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.488112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.488562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.488972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.554232 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-01664ea9-f776-41dd-a814-ec1499e7c28d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "PUT /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1078 microversion: 2.1 time: 0.081798 Oct 12 09:42:49.554868 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3182/6792] 10.222.0.40 () {60 vars in 1256 bytes} [Wed Oct 12 09:42:49 2022] PUT /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1078 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:49.576388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:49.577330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:49.580231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:49.588317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.589146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.589798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.590937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.591410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.591854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.594966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=68 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:42:49.727375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:49.737343 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a6a7e194-3b80-4fd4-8a40-03922e811d13 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1504 microversion: 2.1 time: 0.167538 Oct 12 09:42:49.737966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3611/6793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:49 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:49.762849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:49.763590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:49.770198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.770695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.771137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.771835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.772291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.772721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.908926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:49.920284 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5dd834d-397c-439f-b733-c9ac352d96cc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1504 microversion: 2.1 time: 0.164206 Oct 12 09:42:49.920861 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3183/6794] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:49 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:49.942498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:42:49.944843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:49.951372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.951866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.952308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.953044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:49.953537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:49.953991 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:49.982292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:49.987862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Old instance type m1.heat2, new instance type m1.heat {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:42:49.994510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:42:49.994950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:42:49.995432 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:42:49.995851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:42:49.996260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:42:50.069917 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa3641e2-71b0-4445-b06c-ecedac46feb9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "POST /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b/action" status: 202 len: 0 microversion: 2.1 time: 0.131341 Oct 12 09:42:50.070539 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3612/6795] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:42:49 2022] POST /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:42:50.078969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:50.079563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:50.085658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:50.086145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:50.086575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:50.087258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:50.088290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:50.088290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:50.220346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:50.228349 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dc8336e2-39bd-4ccd-b9fb-aec0f873f97a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1515 microversion: 2.1 time: 0.153309 Oct 12 09:42:50.228887 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3184/6796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:50 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:51.256409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:51.257854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:51.268133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:51.268637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:51.269090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:51.269847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:51.270314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:51.270758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:51.406658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:51.414651 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-828a172f-c802-4ba4-bb55-7eee65022ea1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1515 microversion: 2.1 time: 0.165112 Oct 12 09:42:51.415861 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3613/6797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:51 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:52.440484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:52.441305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:52.451228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:52.452094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:52.452703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:52.453671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:52.454280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:52.454860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:52.601366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:52.614061 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e39210c-d167-4d59-ba2f-d64a604c6fc2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.178699 Oct 12 09:42:52.614896 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3185/6798] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:52 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:53.645494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:53.646437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:53.658232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:53.659076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:53.659831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:53.661005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:53.661850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:53.662582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:53.803741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:53.811920 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c037e14-eaa6-4709-948b-2aee4524be71 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.173081 Oct 12 09:42:53.812479 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3614/6799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:53 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:54.840448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:54.841380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:54.853146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:54.854003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:54.854724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:54.855873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:54.856618 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:54.857349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:54.990339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:54.999143 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b21702bc-7ab9-4083-9ee8-bdf257db278c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.165324 Oct 12 09:42:54.999720 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3186/6800] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:54 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:56.028257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:56.028880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:56.036418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:56.036922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:56.037375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:56.038123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:56.038600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:56.039043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:56.172880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:56.181072 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c601813c-381f-4b0c-9a2a-4b712ab0be93 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.156859 Oct 12 09:42:56.181686 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3615/6801] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:56 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:57.208664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:57.209845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:57.221542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:57.222365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:57.223127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:57.224225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:57.224972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:57.225719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:57.363719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:57.375933 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d889ee22-74d6-4fc1-837c-491a69540df7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.173870 Oct 12 09:42:57.376765 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3187/6802] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:57 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:58.408635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:58.409331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:58.417903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:58.418488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:58.419015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:58.419838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:58.420397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:58.420951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:58.558735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:58.567159 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f1b08fde-9721-4a4f-84be-a25df6772ad1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.164507 Oct 12 09:42:58.567736 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3616/6803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:58 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:42:59.597995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:42:59.598964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:42:59.610244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:59.610724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:59.611160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:59.611839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:42:59.612293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:42:59.612709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:42:59.753108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:42:59.761703 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2d51edd-f876-4655-82dc-87b0932b73a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.170338 Oct 12 09:42:59.762309 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3188/6804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:42:59 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:00.786709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:00.787601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:00.798376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:00.798873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:00.799321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:00.800026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:00.800495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:00.800931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:00.937864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:00.946400 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2c733051-89b1-4e41-a83b-d3012bb94bc8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.165534 Oct 12 09:43:00.946984 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3617/6805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:00 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:01.973044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:01.973719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:01.980589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:01.981099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:01.981590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:01.982312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:01.982756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:01.983232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:02.120915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:02.129291 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-86da64e7-4ce6-44ab-addc-d8729b9d1885 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.162584 Oct 12 09:43:02.129898 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3189/6806] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:01 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:03.156770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:03.157766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:03.169536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:03.170407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:03.171170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:03.172358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:03.173153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:03.173982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:03.317072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:03.325306 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3bdf8a14-ef1c-49ac-a200-b81349569ea0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.175435 Oct 12 09:43:03.325926 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3618/6807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:03 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:04.352872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:04.354036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:04.365495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:04.366323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:04.367039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:04.368168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:04.368913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:04.369660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:04.511671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:04.522975 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c809b95-55ad-484d-8980-6b3ab51f5ded tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.176790 Oct 12 09:43:04.523584 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3190/6808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:04 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:05.549690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:05.550841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:05.558672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:05.559171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:05.559616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:05.560333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:05.560795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:05.561233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:05.693975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:05.702119 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-37e0d6b4-61ee-416f-b09e-dfaa88c98882 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.159182 Oct 12 09:43:05.702689 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3619/6809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:05 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:06.730052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:06.730987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:06.741602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:06.742099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:06.742543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:06.743276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:06.743739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:06.744170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:06.876445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:06.884725 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b61618a-b1fa-4c0e-834e-07b85bb21223 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.161288 Oct 12 09:43:06.885645 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3191/6810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:06 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:07.909910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:07.910695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:07.919780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:07.920397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:07.920962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:07.921892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:07.922470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:07.923046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:08.068968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:08.077481 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f60b0766-0408-48e3-9b02-ce9f4e06fb04 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.172480 Oct 12 09:43:08.078075 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3620/6811] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:07 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:09.113106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:09.114127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:09.122751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:09.123287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:09.123749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:09.124515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:09.125032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:09.125498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:09.148457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:09.263636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:09.271854 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d85a538e-f55e-43ae-b437-cc02e7761421 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.165571 Oct 12 09:43:09.272478 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3192/6812] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:09 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:10.299188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:10.300170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:10.312016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:10.312841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:10.313644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:10.314948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:10.315677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:10.316406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:10.446987 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:10.455044 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d24ef04a-6533-490e-8845-fb7cb029c4d4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.162602 Oct 12 09:43:10.455637 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3621/6813] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:10 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:11.480064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:11.480980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:11.490210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:11.490736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:11.491172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:11.491870 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:11.492320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:11.492749 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:11.629831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:11.639012 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-88362c6e-6de0-481e-bafd-76ebdab25fa7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.163862 Oct 12 09:43:11.639657 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3193/6814] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:11 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:12.665923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:12.666992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:12.677010 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:12.677860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:12.678312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:12.679022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:12.679517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:12.679961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:12.825242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:12.833311 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bfbf52ff-eae8-4c15-8761-29f9c56580ad tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.173506 Oct 12 09:43:12.834073 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3622/6815] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:12 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:13.858050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:13.858707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:13.867862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:13.868407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:13.868894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:13.870402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:13.870402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:13.870676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:14.006828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:14.014940 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2f09f0bc-6100-4091-9642-b264ce83c383 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.161543 Oct 12 09:43:14.015510 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3194/6816] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:13 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:15.038895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:15.039506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:15.046808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:15.047313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:15.047767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:15.048477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:15.048974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:15.049418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:15.179301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:15.187615 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c167fa63-df3b-4df9-bd67-809846649a1e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.152789 Oct 12 09:43:15.188186 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3623/6817] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:15 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:16.210999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:16.211579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:16.218871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:16.219360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:16.219789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:16.220663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:16.221025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:16.221471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:16.362774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:16.373590 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0569f236-3f4e-4100-84d7-550e94cf77ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.166506 Oct 12 09:43:16.374182 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3195/6818] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:16 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:17.402134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:17.402949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:17.412581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:17.413245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:17.413900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:17.414837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:17.415474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:17.416050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:17.558409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:17.566735 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-470beda7-1b2a-4660-b50d-ebe0040df238 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.169945 Oct 12 09:43:17.567343 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3624/6819] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:17 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:18.592016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:18.592846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:18.602576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:18.603073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:18.603513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:18.604223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:18.604684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:18.605119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:18.752165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:18.760991 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-728a7a8b-87fb-405b-9618-baa3f93ef97d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1520 microversion: 2.1 time: 0.173900 Oct 12 09:43:18.761651 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3196/6820] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:18 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:19.784991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:19.785657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:19.789857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=30 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:19.793611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:19.794131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:19.794456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:19.795166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:19.795613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:19.796040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:19.825509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ce77c8d6-d50e-47c2-ab11-3ac415b528e7 req-0c5bba7a-3a23-4794-ab82-47d887240c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ba1d95-6661-48ff-b5bc-ddfa852d176b", "name": "network-vif-unplugged", "status": "completed", "tag": "cc547904-6e75-46c9-9dc1-bbcc30a0ce5d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:19.833665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=32 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:19.836149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce77c8d6-d50e-47c2-ab11-3ac415b528e7 req-0c5bba7a-3a23-4794-ab82-47d887240c5d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:19.836875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce77c8d6-d50e-47c2-ab11-3ac415b528e7 req-0c5bba7a-3a23-4794-ab82-47d887240c5d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:19.837597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ce77c8d6-d50e-47c2-ab11-3ac415b528e7 req-0c5bba7a-3a23-4794-ab82-47d887240c5d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:19.841175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:19.853506 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ce77c8d6-d50e-47c2-ab11-3ac415b528e7 req-0c5bba7a-3a23-4794-ab82-47d887240c5d service nova] Creating event network-vif-unplugged:cc547904-6e75-46c9-9dc1-bbcc30a0ce5d for instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b on n-h2-858383-10 Oct 12 09:43:19.860383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-ce77c8d6-d50e-47c2-ab11-3ac415b528e7 req-0c5bba7a-3a23-4794-ab82-47d887240c5d service nova] Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:43:19.873081 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ce77c8d6-d50e-47c2-ab11-3ac415b528e7 req-0c5bba7a-3a23-4794-ab82-47d887240c5d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108859 Oct 12 09:43:19.874296 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3625/6821] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:43:20.021472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:20.029892 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-676a7489-e027-4e37-be53-fc8224470912 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1519 microversion: 2.1 time: 0.249419 Oct 12 09:43:20.030471 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3197/6822] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:19 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:21.060823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:21.062039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:21.072674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:21.073522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:21.074300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:21.075452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:21.076269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:21.076996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:21.228935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:21.240633 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-feb93ec4-fbbc-40cb-b879-7b06876d612e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1517 microversion: 2.1 time: 0.188868 Oct 12 09:43:21.241465 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3626/6823] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:21 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:21.890981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f62f69ad-730a-4813-9595-693b9152af24 req-636d3510-7ee9-40ca-9197-a0b883641095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36ba1d95-6661-48ff-b5bc-ddfa852d176b", "tag": "cc547904-6e75-46c9-9dc1-bbcc30a0ce5d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:21.904167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f62f69ad-730a-4813-9595-693b9152af24 req-636d3510-7ee9-40ca-9197-a0b883641095 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:21.904676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f62f69ad-730a-4813-9595-693b9152af24 req-636d3510-7ee9-40ca-9197-a0b883641095 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:21.905113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f62f69ad-730a-4813-9595-693b9152af24 req-636d3510-7ee9-40ca-9197-a0b883641095 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:21.919587 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f62f69ad-730a-4813-9595-693b9152af24 req-636d3510-7ee9-40ca-9197-a0b883641095 service nova] Creating event network-changed:cc547904-6e75-46c9-9dc1-bbcc30a0ce5d for instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b on n-h2-858383-10 Oct 12 09:43:21.925477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-f62f69ad-730a-4813-9595-693b9152af24 req-636d3510-7ee9-40ca-9197-a0b883641095 service nova] Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:43:21.936522 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f62f69ad-730a-4813-9595-693b9152af24 req-636d3510-7ee9-40ca-9197-a0b883641095 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051572 Oct 12 09:43:21.937115 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3198/6824] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:43:22.270290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:22.271841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:22.280054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:22.280572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:22.281021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:22.281786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:22.282240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:22.282677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:22.432988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:22.440919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c137518f-9124-47e3-b004-e0d3c950c1cb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1517 microversion: 2.1 time: 0.175280 Oct 12 09:43:22.441776 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3627/6825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:22 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:23.469138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:23.470006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:23.478182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:23.478601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:23.479031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:23.479725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:23.480169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:23.480589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:23.612891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:23.625027 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33ae8baa-4351-4e51-823b-c5583a4d0410 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1514 microversion: 2.1 time: 0.162090 Oct 12 09:43:23.625937 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3199/6826] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:23 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:23.648317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:23.648858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:23.656179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:23.656722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:23.657199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:23.657958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:23.658422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:23.658869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:23.720244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d87046f8-111d-4537-971a-832e6a05fd20 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "POST /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b/action" status: 204 len: 0 microversion: 2.1 time: 0.075689 Oct 12 09:43:23.720894 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3628/6827] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:43:23 2022] POST /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:43:23.729590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:23.730192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:23.736492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:23.736984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:23.737426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:23.738159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:23.738614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:23.739049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:24.244670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:24.253001 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6951ef7-1d7d-4ea2-b147-d4c21052c298 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1514 microversion: 2.1 time: 0.527467 Oct 12 09:43:24.253592 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3200/6828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:23 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:25.277960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:25.278550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:25.284973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:25.285498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:25.286137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:25.287026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:25.287488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:25.287926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:25.423725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:25.432425 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7fd5aabb-ff54-47e6-aa4a-3d75ee9e2a56 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1514 microversion: 2.1 time: 0.159819 Oct 12 09:43:25.432985 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3629/6829] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:25 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:26.145915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4785064c-bcb2-404a-8397-a7d9a4865a7a req-ea968c09-d8fd-4d74-9aeb-f143669cd551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ba1d95-6661-48ff-b5bc-ddfa852d176b", "name": "network-vif-plugged", "status": "completed", "tag": "cc547904-6e75-46c9-9dc1-bbcc30a0ce5d"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:26.155491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4785064c-bcb2-404a-8397-a7d9a4865a7a req-ea968c09-d8fd-4d74-9aeb-f143669cd551 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:26.155963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4785064c-bcb2-404a-8397-a7d9a4865a7a req-ea968c09-d8fd-4d74-9aeb-f143669cd551 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:26.156390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4785064c-bcb2-404a-8397-a7d9a4865a7a req-ea968c09-d8fd-4d74-9aeb-f143669cd551 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:26.167490 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4785064c-bcb2-404a-8397-a7d9a4865a7a req-ea968c09-d8fd-4d74-9aeb-f143669cd551 service nova] Creating event network-vif-plugged:cc547904-6e75-46c9-9dc1-bbcc30a0ce5d for instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b on n-h2-858383-10 Oct 12 09:43:26.173082 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4785064c-bcb2-404a-8397-a7d9a4865a7a req-ea968c09-d8fd-4d74-9aeb-f143669cd551 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084068 Oct 12 09:43:26.173681 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3201/6830] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:43:26.460437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:26.461430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:26.468808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:26.469313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:26.469820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:26.470537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:26.471007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:26.471454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:26.602714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:26.611565 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a1ab64d-713d-43da-8b01-eccd7d9f62b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1506 microversion: 2.1 time: 0.157821 Oct 12 09:43:26.612240 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3630/6831] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:26 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:26.635344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:26.636078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:26.642818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:26.643336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:26.643770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:26.644476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:26.644927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:26.645353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:26.777184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:26.785363 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e6a03bbc-96f7-4673-8109-77a673c07a02 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1506 microversion: 2.1 time: 0.154847 Oct 12 09:43:26.785996 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3202/6832] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:26 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:26.810832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0682cc2-effe-45ce-9419-195edabd1ee1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Action: 'create', calling method: .version_select at 0x7f984880c160>, body: {"keypair": {"name": "tempest-keypair-1525661782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpHxqalpZSEJmEfr1S2AihNRUwMaPreMSlSQNxmmRbRUNFRgaSkmzCGSGauxW0RMv9EYklM8ORCC/nw5lZEMU6lWjX7JJhW3WT5+pUPGnW8PoUVI2UJDA7HKL4HtUYEmQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:26.827402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e0682cc2-effe-45ce-9419-195edabd1ee1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Getting quotas for project 3548d3847dd54937abea4a91a69543ba. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:43:26.832973 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e0682cc2-effe-45ce-9419-195edabd1ee1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Getting quotas for user ac6ed91a455a4f7a83f7387116c1231a and project 3548d3847dd54937abea4a91a69543ba. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:43:26.865231 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0682cc2-effe-45ce-9419-195edabd1ee1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058212 Oct 12 09:43:26.865940 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3631/6833] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:43:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:43:28.097468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:28.098190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:28.105911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:28.106417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:28.106862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:28.107583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:28.108041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:28.108464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:28.244024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:28.252252 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-59c1e3b9-2ef9-4835-9a90-93f9e27c382c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 200 len: 1506 microversion: 2.1 time: 0.159065 Oct 12 09:43:28.252882 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3203/6834] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:28 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:28.275741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:28.276307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:28.284282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:28.284789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:28.285273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:28.286029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:28.286510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:28.286955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:28.313837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:43:28.396446 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66afb30b-094d-4049-a86f-88fa392af0b1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "DELETE /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 204 len: 0 microversion: 2.1 time: 0.124882 Oct 12 09:43:28.396993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3632/6835] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:43:28 2022] DELETE /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:43:28.456899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2068152847", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "1df1a611-0e06-4e37-a81f-779265e73991"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:28.510935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] validate_networks() for [('1df1a611-0e06-4e37-a81f-779265e73991', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:43:28.916563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:43:28.916706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:43:28.917211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:43:28.917646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:43:28.918062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:43:28.930780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:28.931281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:28.931932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:28.933018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:28.933750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:28.934413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:28.956394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Getting quotas for project 3548d3847dd54937abea4a91a69543ba. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:43:28.962043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Getting quotas for user ac6ed91a455a4f7a83f7387116c1231a and project 3548d3847dd54937abea4a91a69543ba. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:43:28.975456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:43:28.977916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:43:29.026719 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1213795e-9318-4036-b621-780da7837372 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573557 Oct 12 09:43:29.027510 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3204/6836] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:43:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:43:29.039455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9aaa73d8-e834-4a96-b7fe-6ca1a390cb66 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:29.040187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9aaa73d8-e834-4a96-b7fe-6ca1a390cb66 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:29.095631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9aaa73d8-e834-4a96-b7fe-6ca1a390cb66 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:29.102723 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9aaa73d8-e834-4a96-b7fe-6ca1a390cb66 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1218 microversion: 2.1 time: 0.067669 Oct 12 09:43:29.103295 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3633/6837] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:29 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:30.126705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:30.127293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:30.134997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:30.135493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:30.135934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:30.136643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:30.137101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:30.137548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:30.207873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:30.217397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c25e92f-fac0-434a-9f87-b2873620c32d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1270 microversion: 2.1 time: 0.095598 Oct 12 09:43:30.218016 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3205/6838] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:30 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:30.375115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b4d263fc-1fae-4d67-92c5-14a33ccce057 req-d11ec12e-2b18-418e-80bc-64b971294761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ba1d95-6661-48ff-b5bc-ddfa852d176b", "name": "network-vif-deleted", "tag": "cc547904-6e75-46c9-9dc1-bbcc30a0ce5d"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:30.395578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b4d263fc-1fae-4d67-92c5-14a33ccce057 req-d11ec12e-2b18-418e-80bc-64b971294761 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:30.401961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b4d263fc-1fae-4d67-92c5-14a33ccce057 req-d11ec12e-2b18-418e-80bc-64b971294761 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:30.402805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b4d263fc-1fae-4d67-92c5-14a33ccce057 req-d11ec12e-2b18-418e-80bc-64b971294761 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:30.415928 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b4d263fc-1fae-4d67-92c5-14a33ccce057 req-d11ec12e-2b18-418e-80bc-64b971294761 service nova] Creating event network-vif-deleted:cc547904-6e75-46c9-9dc1-bbcc30a0ce5d for instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b on n-h2-858383-10 Oct 12 09:43:30.426152 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b4d263fc-1fae-4d67-92c5-14a33ccce057 req-d11ec12e-2b18-418e-80bc-64b971294761 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056030 Oct 12 09:43:30.432182 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3634/6839] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:43:31.240650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:31.241422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:31.248798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:31.249284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:31.249741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:31.250449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:31.250929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:31.251355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:31.387837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:31.396243 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c286667-5b35-4286-98ca-ac7fc4fd8af2 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1318 microversion: 2.1 time: 0.159592 Oct 12 09:43:31.396797 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3206/6840] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:31 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:32.178254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0332547a-1993-407a-90ae-f3518fbeb984 req-f3c42297-133b-4c2e-976a-789470aeeade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692b12aa-93d5-4a98-8170-55d96f6348f1", "tag": "51bdaf1a-1bad-4bf3-8824-a20479df62fd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:32.188195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0332547a-1993-407a-90ae-f3518fbeb984 req-f3c42297-133b-4c2e-976a-789470aeeade service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:32.188617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0332547a-1993-407a-90ae-f3518fbeb984 req-f3c42297-133b-4c2e-976a-789470aeeade service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:32.189065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0332547a-1993-407a-90ae-f3518fbeb984 req-f3c42297-133b-4c2e-976a-789470aeeade service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:32.200829 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0332547a-1993-407a-90ae-f3518fbeb984 req-f3c42297-133b-4c2e-976a-789470aeeade service nova] Creating event network-changed:51bdaf1a-1bad-4bf3-8824-a20479df62fd for instance 692b12aa-93d5-4a98-8170-55d96f6348f1 on n-h2-858383-10 Oct 12 09:43:32.205844 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0332547a-1993-407a-90ae-f3518fbeb984 req-f3c42297-133b-4c2e-976a-789470aeeade service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083391 Oct 12 09:43:32.206460 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3635/6841] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:43:32.420218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:32.420904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:32.427442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:32.427919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:32.428383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:32.429076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:32.429494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:32.430023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:32.565531 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:32.575180 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-84f67b1a-ed3a-48e4-a130-0621ea504cc1 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1318 microversion: 2.1 time: 0.159181 Oct 12 09:43:32.575758 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3207/6842] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:32 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:33.599182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:33.599869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:33.607234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:33.607769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:33.608217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:33.608929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:33.609425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:33.609869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:33.818507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:33.826709 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0730f674-b026-4d14-9fd2-9b3a4aa110f6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1318 microversion: 2.1 time: 0.231834 Oct 12 09:43:33.827292 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3636/6843] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:33 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:34.853267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:34.853869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:34.861854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:34.862349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:34.862791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:34.863492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:34.863961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:34.864394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:34.998989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:35.007510 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-81acd7c2-9bea-4828-b725-d16ed3155a52 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1318 microversion: 2.1 time: 0.160507 Oct 12 09:43:35.008094 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3208/6844] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:34 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:36.030119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:36.030705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:36.038144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:36.038645 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:36.039091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:36.039805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:36.040268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:36.040706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:36.171649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:36.179836 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-88608276-8211-415d-ae1a-9e671b6f38fc tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1318 microversion: 2.1 time: 0.153828 Oct 12 09:43:36.180567 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3637/6845] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:36 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:37.207911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:37.208783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:37.220402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:37.221209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:37.221979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:37.223123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:37.223883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:37.224549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:37.359299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:37.367955 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4062e3e-fb9c-462a-8d12-dcda74a0a71e tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1318 microversion: 2.1 time: 0.166891 Oct 12 09:43:37.368768 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3209/6846] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:37 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:38.129716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d7bbe7fb-554a-409c-81b9-027c09c5f82a req-913dddf2-ffc7-4b75-9a8a-38cab3566cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692b12aa-93d5-4a98-8170-55d96f6348f1", "name": "network-vif-plugged", "status": "completed", "tag": "51bdaf1a-1bad-4bf3-8824-a20479df62fd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:38.140928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d7bbe7fb-554a-409c-81b9-027c09c5f82a req-913dddf2-ffc7-4b75-9a8a-38cab3566cff service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:38.141477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d7bbe7fb-554a-409c-81b9-027c09c5f82a req-913dddf2-ffc7-4b75-9a8a-38cab3566cff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:38.141944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d7bbe7fb-554a-409c-81b9-027c09c5f82a req-913dddf2-ffc7-4b75-9a8a-38cab3566cff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:38.153236 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d7bbe7fb-554a-409c-81b9-027c09c5f82a req-913dddf2-ffc7-4b75-9a8a-38cab3566cff service nova] Creating event network-vif-plugged:51bdaf1a-1bad-4bf3-8824-a20479df62fd for instance 692b12aa-93d5-4a98-8170-55d96f6348f1 on n-h2-858383-10 Oct 12 09:43:38.158304 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d7bbe7fb-554a-409c-81b9-027c09c5f82a req-913dddf2-ffc7-4b75-9a8a-38cab3566cff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032482 Oct 12 09:43:38.158908 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3638/6847] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:43:38.395605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:38.396489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:38.407897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:38.408692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:38.409411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:38.410598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:38.411349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:38.412053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:38.551378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:38.554971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:38.559948 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97a68af8-79b8-4f85-b7c7-bf87e529ccd0 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1318 microversion: 2.1 time: 0.171043 Oct 12 09:43:38.560519 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3210/6848] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:38 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:39.580183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:39.585658 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:39.586575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:39.593717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:39.594440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:39.594898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:39.595608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:39.596075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:39.596512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:39.726473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:39.734710 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8dff19a7-f206-48b0-998e-fe293dabb7c6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1507 microversion: 2.1 time: 0.155515 Oct 12 09:43:39.735296 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3639/6849] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:39 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:39.758274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:39.758798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:39.760655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:39.761391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:39.769863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:39.770343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:39.770788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:39.771493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:39.771951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:39.772385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:39.900608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:39.908842 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-061e4476-d852-4992-b349-bf315c3a0762 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1507 microversion: 2.1 time: 0.155202 Oct 12 09:43:39.909426 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3211/6850] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:39 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:39.934253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:43:39.937828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:39.946834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:39.947484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:39.948002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:39.948705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:39.949169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:39.949633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:39.977418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:39.983528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Old instance type m1.heat2, new instance type m1.heat {{(pid=127006) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:43:39.990359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:43:39.990792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:43:39.991279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:43:39.991695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:43:39.992115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:43:40.059072 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aeae4e82-329d-44ae-8485-8bb65199c7e3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "POST /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1/action" status: 202 len: 0 microversion: 2.1 time: 0.131401 Oct 12 09:43:40.059689 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3640/6851] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:43:39 2022] POST /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:43:40.068338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:40.069040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:40.076045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:40.076545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:40.076987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:40.077917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:40.078382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:40.078897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:40.221489 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:40.229763 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5464c788-6892-4445-8e47-06ff65aed0a4 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1514 microversion: 2.1 time: 0.165465 Oct 12 09:43:40.238563 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3212/6852] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:40 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:41.257244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:41.258248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:41.268310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:41.269012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:41.269718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:41.270736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:41.271414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:41.272051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:41.403513 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:41.406963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:41.412103 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a15fc574-5f04-46da-9ccc-9c8943f384ca tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1514 microversion: 2.1 time: 0.162151 Oct 12 09:43:41.412684 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3641/6853] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:41 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:42.439931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:42.440973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:42.450901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:42.451390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:42.451822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:42.452516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:42.452961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:42.453381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:42.587001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:42.598105 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b696ec7f-9615-4a0f-8717-47047e3676af tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.164912 Oct 12 09:43:42.598661 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3213/6854] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:42 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:43.623950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:43.624739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:43.633809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:43.634410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:43.635044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:43.635750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:43.636216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:43.636652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:43.779744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:43.787882 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7d3f83c-c0d0-403b-9662-fc2149789894 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.169308 Oct 12 09:43:43.788459 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3642/6855] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:43 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:44.813674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:44.814256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:44.824162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:44.824656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:44.825101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:44.825856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:44.826296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:44.826733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:44.962804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:44.971329 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f21208f9-d31b-48d9-b029-73f0dc1122f3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.162993 Oct 12 09:43:44.971911 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3214/6856] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:44 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:46.006527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:46.007220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:46.015420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:46.015921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:46.016394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:46.017105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:46.017639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:46.018063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:46.157948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:46.166323 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd56562b-ab27-4736-af77-cf30c48c111c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.166392 Oct 12 09:43:46.166888 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3643/6857] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:45 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:47.194089 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:47.195073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:47.206528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:47.207321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:47.208048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:47.209179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:47.209999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:47.210698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:47.346235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:47.358271 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-edeba004-6bbc-497e-a69d-a28240a4d154 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.170436 Oct 12 09:43:47.359012 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3215/6858] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:47 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:48.387560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:48.388818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:48.397789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:48.398360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:48.398819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:48.399622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:48.400100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:48.400555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:48.544473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:48.552523 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe314915-aea1-4526-85ae-e77784cb759c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.170426 Oct 12 09:43:48.553135 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3644/6859] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:48 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:49.577831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:49.578581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:49.586674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:49.587190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:49.587646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:49.588444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:49.588913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:49.589351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:49.720679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:49.728846 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d6ab30da-84e7-4904-ae13-2cb344e9983f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.155372 Oct 12 09:43:49.729404 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3216/6860] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:49 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:50.760853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:50.761679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:50.768320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:50.775116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:50.775723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:50.776171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:50.776885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:50.777354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:50.777822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:50.923548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:50.932054 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c6b8baf-9bb6-4675-8caf-d754aaefc2b8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.177897 Oct 12 09:43:50.932632 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3645/6861] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:50 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:51.959775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:51.960697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:51.965524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:43:51.975415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:51.976227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:51.976983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:51.978143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:51.978769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:51.979193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:52.127458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:52.136667 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-21712914-c7bc-4fd3-aab6-ea05591bb2a7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.183971 Oct 12 09:43:52.137248 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3217/6862] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:51 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:53.164526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:53.165506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:53.178255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:53.179133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:53.179873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:53.181071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:53.181835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:53.182277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:53.333610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:53.341709 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-566d9195-bab5-4c2a-a085-0fc4790bb21a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.184000 Oct 12 09:43:53.342259 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3646/6863] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:53 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:54.368327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:54.369286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:54.372453 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:43:54.372738 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:43:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 (ip 10.222.0.40) !!! Oct 12 09:43:54.385822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:54.386332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:54.386770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:54.387474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:54.387921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:54.388378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:54.523303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:54.531355 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e6cfa64-eaa8-479d-9a73-5d9df42d07bd tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.169548 Oct 12 09:43:54.531942 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3218/6864] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:54 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:55.558490 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:55.559318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:55.568996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:55.569665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:55.570227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:55.571116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:55.571707 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:55.572254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:55.712347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:55.720519 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c47670a-8867-4a53-874c-97b8186fadea tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.168216 Oct 12 09:43:55.721125 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3647/6865] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:55 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:56.746850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:56.747553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:56.755852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:56.756387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:56.756855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:56.757702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:56.758251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:56.758750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:56.902581 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:56.912224 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f2c25018-7673-443c-a928-a0f84c5565f8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.170731 Oct 12 09:43:56.912827 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3219/6866] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:56 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:57.940281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:57.941303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:57.950793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:57.951291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:57.951739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:57.952444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:57.952907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:57.953343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:58.096306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:58.104998 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d7e040a3-4d53-48c4-b969-ebeeadb91a00 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.171357 Oct 12 09:43:58.105625 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3648/6867] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:57 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:43:59.131656 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:43:59.132441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:43:59.143152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:59.143899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:59.144566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:59.145661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:43:59.146358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:43:59.147000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:43:59.281298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:43:59.291707 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a3928c8-c75f-4787-8f1c-32600a0a63b7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.166783 Oct 12 09:43:59.292282 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3220/6868] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:43:59 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:00.323333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:00.324955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:00.333475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:00.334065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:00.334613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:00.335441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:00.335986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:00.336501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:00.474386 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:00.482940 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f6a26344-32f7-49d2-a460-2f40068b54b6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.165863 Oct 12 09:44:00.483520 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3649/6869] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:00 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:01.511580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:01.512650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:01.524505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:01.525226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:01.525700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:01.526415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:01.526878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:01.527291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:01.666338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:01.674351 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-47fb94e0-41fe-452b-8b26-797d246007d8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.169931 Oct 12 09:44:01.674974 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3221/6870] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:01 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:02.702125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:02.703246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:02.714971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:02.715474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:02.715931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:02.716665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:02.717137 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:02.717607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:02.865920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:02.875554 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-434063bc-bf67-4812-ab67-0a293327dcd7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.180082 Oct 12 09:44:02.876132 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3650/6871] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:02 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:03.899928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:03.900539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:03.907458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:03.907955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:03.908409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:03.909092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:03.909592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:03.910010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:04.047944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:04.056413 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f22e1fdc-0e8e-4fe5-b954-00b45494ca78 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.161202 Oct 12 09:44:04.056990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3222/6872] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:03 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:05.083976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:05.085099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:05.094995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:05.095503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:05.095969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:05.096694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:05.097167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:05.097653 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:05.230314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:05.238259 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-27b4a7e9-c294-4e15-a56c-8fe89ea4614f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.160975 Oct 12 09:44:05.238848 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3651/6873] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:05 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:06.269000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:06.270136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:06.280550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:06.281012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:06.281471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:06.282187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:06.282639 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:06.283062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:06.422188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:06.430738 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-53429413-d1cd-4ae0-a167-8f21f8682c4c tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.168607 Oct 12 09:44:06.431309 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3223/6874] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:06 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:07.455698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:07.456343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:07.464510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:07.465016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:07.465474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:07.466230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:07.466704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:07.467149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:07.686200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:07.694516 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de3147b5-657c-4a67-8692-b815fe715e3b tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.243894 Oct 12 09:44:07.695104 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3652/6875] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:07 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:08.721933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:08.722936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:08.733818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:08.734306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:08.734743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:08.735446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:08.735898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:08.736332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:08.871598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:08.879888 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3ef232a8-3159-4011-9485-16f6e86c99f9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1519 microversion: 2.1 time: 0.164253 Oct 12 09:44:08.880478 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3224/6876] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:08 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:09.615781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6761b641-53db-48d2-8cd5-f74b9740a8d4 req-f7de2a33-5997-4584-bb03-0ab06132fbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692b12aa-93d5-4a98-8170-55d96f6348f1", "name": "network-vif-unplugged", "status": "completed", "tag": "51bdaf1a-1bad-4bf3-8824-a20479df62fd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:09.626417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6761b641-53db-48d2-8cd5-f74b9740a8d4 req-f7de2a33-5997-4584-bb03-0ab06132fbc9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:09.626924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6761b641-53db-48d2-8cd5-f74b9740a8d4 req-f7de2a33-5997-4584-bb03-0ab06132fbc9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:09.627353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6761b641-53db-48d2-8cd5-f74b9740a8d4 req-f7de2a33-5997-4584-bb03-0ab06132fbc9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:09.639956 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6761b641-53db-48d2-8cd5-f74b9740a8d4 req-f7de2a33-5997-4584-bb03-0ab06132fbc9 service nova] Creating event network-vif-unplugged:51bdaf1a-1bad-4bf3-8824-a20479df62fd for instance 692b12aa-93d5-4a98-8170-55d96f6348f1 on n-h1-858383-10 Oct 12 09:44:09.645870 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-6761b641-53db-48d2-8cd5-f74b9740a8d4 req-f7de2a33-5997-4584-bb03-0ab06132fbc9 service nova] Instance 692b12aa-93d5-4a98-8170-55d96f6348f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:44:09.657470 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6761b641-53db-48d2-8cd5-f74b9740a8d4 req-f7de2a33-5997-4584-bb03-0ab06132fbc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045517 Oct 12 09:44:09.658347 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3653/6877] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:44:09.903415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:09.904018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:09.911571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:09.912070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:09.912509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:09.913228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:09.913786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:09.914237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:09.919584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=85 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:44:10.141427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:10.149749 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1f7dd515-a44e-49b1-8ed9-145f4981c26d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1518 microversion: 2.1 time: 0.250309 Oct 12 09:44:10.150320 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3225/6878] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:09 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:44:11.179588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:11.180646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:11.191295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:11.192136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:11.192886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:11.194109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:11.194885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:11.195616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:11.335457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:11.343491 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-23e6e632-29a5-4ae5-b1a8-9dca7cdb11d3 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1516 microversion: 2.1 time: 0.172631 Oct 12 09:44:11.344084 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3654/6879] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:11 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:11.676257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2e30557d-b08a-493b-83d0-ca58aedb6bfd req-23816b88-f1bf-4a5e-bd3f-8335407e11a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692b12aa-93d5-4a98-8170-55d96f6348f1", "tag": "51bdaf1a-1bad-4bf3-8824-a20479df62fd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:11.686799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2e30557d-b08a-493b-83d0-ca58aedb6bfd req-23816b88-f1bf-4a5e-bd3f-8335407e11a5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:11.687282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2e30557d-b08a-493b-83d0-ca58aedb6bfd req-23816b88-f1bf-4a5e-bd3f-8335407e11a5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:11.687710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2e30557d-b08a-493b-83d0-ca58aedb6bfd req-23816b88-f1bf-4a5e-bd3f-8335407e11a5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:11.699418 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2e30557d-b08a-493b-83d0-ca58aedb6bfd req-23816b88-f1bf-4a5e-bd3f-8335407e11a5 service nova] Creating event network-changed:51bdaf1a-1bad-4bf3-8824-a20479df62fd for instance 692b12aa-93d5-4a98-8170-55d96f6348f1 on n-h1-858383-10 Oct 12 09:44:11.705950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-2e30557d-b08a-493b-83d0-ca58aedb6bfd req-23816b88-f1bf-4a5e-bd3f-8335407e11a5 service nova] Instance 692b12aa-93d5-4a98-8170-55d96f6348f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:44:11.716892 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2e30557d-b08a-493b-83d0-ca58aedb6bfd req-23816b88-f1bf-4a5e-bd3f-8335407e11a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044433 Oct 12 09:44:11.717506 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3226/6880] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:44:12.368421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:12.369666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:12.376363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:12.376946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:12.377659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:12.378385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:12.378853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:12.379283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:12.511760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:12.521132 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6df1bf92-0552-44df-992e-869be8e9b2b5 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1513 microversion: 2.1 time: 0.157629 Oct 12 09:44:12.521968 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3655/6881] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:12 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:12.544496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:12.545241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:12.551601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:12.552079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:12.552513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:12.553203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:12.553686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:12.554160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:12.613839 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-abffd7c7-2e40-4fed-87e2-5f086dde2616 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "POST /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1/action" status: 204 len: 0 microversion: 2.1 time: 0.073511 Oct 12 09:44:12.617506 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3227/6882] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:44:12 2022] POST /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:44:12.622832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:12.623464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:12.631191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:12.631701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:12.632158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:12.632879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:12.633350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:12.633835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:12.872313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:12.881189 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aba09f07-2490-4f6d-b85b-3b63c70f3b46 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1513 microversion: 2.1 time: 0.262288 Oct 12 09:44:12.881818 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3656/6883] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:12 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:13.906040 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:13.906731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:13.913832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:13.914331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:13.914756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:13.915683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:13.916127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:13.916554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:14.053237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:14.062352 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-34b35bec-9e33-4436-bb43-c3df4e18d141 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1513 microversion: 2.1 time: 0.161648 Oct 12 09:44:14.062945 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3228/6884] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:13 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:15.086566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:15.087188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:15.094967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.095462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.095918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.096641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.097134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.097670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.100530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=89 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:44:15.227897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:15.236489 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5e56c8a7-ea2d-471a-9dde-c9d12384a8ef tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1505 microversion: 2.1 time: 0.154097 Oct 12 09:44:15.237087 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3657/6885] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:15 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:15.259428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:15.259958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:15.267015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.267480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.267945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.268735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.269137 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.269612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.405989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:15.418128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7bc46dee-dec5-4805-a3d0-3983b50bffe9 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1505 microversion: 2.1 time: 0.162372 Oct 12 09:44:15.418917 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3229/6886] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:15 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:15.440999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:15.441655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:15.447803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.448300 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.448748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.449550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.450050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.450588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.583845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:15.592608 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7212358f-9a99-49b4-9afe-df25c88d972d tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1505 microversion: 2.1 time: 0.155466 Oct 12 09:44:15.605478 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3658/6887] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:15 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:15.615185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:15.615719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:15.623925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.624536 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.624985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.625723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.626205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.626638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.653455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:44:15.696665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-82f44d09-d450-4146-9aeb-cf0cdd8c8202 req-157917e2-1757-4e2c-b4e0-a78e0623dd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692b12aa-93d5-4a98-8170-55d96f6348f1", "name": "network-vif-plugged", "status": "completed", "tag": "51bdaf1a-1bad-4bf3-8824-a20479df62fd"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:15.707841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-82f44d09-d450-4146-9aeb-cf0cdd8c8202 req-157917e2-1757-4e2c-b4e0-a78e0623dd31 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.708555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-82f44d09-d450-4146-9aeb-cf0cdd8c8202 req-157917e2-1757-4e2c-b4e0-a78e0623dd31 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.709215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-82f44d09-d450-4146-9aeb-cf0cdd8c8202 req-157917e2-1757-4e2c-b4e0-a78e0623dd31 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.723064 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-82f44d09-d450-4146-9aeb-cf0cdd8c8202 req-157917e2-1757-4e2c-b4e0-a78e0623dd31 service nova] Creating event network-vif-plugged:51bdaf1a-1bad-4bf3-8824-a20479df62fd for instance 692b12aa-93d5-4a98-8170-55d96f6348f1 on n-h1-858383-10 Oct 12 09:44:15.728618 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-82f44d09-d450-4146-9aeb-cf0cdd8c8202 req-157917e2-1757-4e2c-b4e0-a78e0623dd31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035780 Oct 12 09:44:15.729316 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3659/6888] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:44:15.755551 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-23d9c9a8-4b21-40b5-aace-f19fa7b97ab7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "DELETE /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 204 len: 0 microversion: 2.1 time: 0.143996 Oct 12 09:44:15.757538 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3230/6889] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:44:15 2022] DELETE /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:44:15.775295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:15.775977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:15.782527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.782968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.783410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.784118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.784584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.785020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.809823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:44:15.853735 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.compute.api [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Instance is already in deleting state, ignoring this request Oct 12 09:44:15.854605 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c698c88-b2c1-4e29-a443-06ff1b1d769a tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "DELETE /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 204 len: 0 microversion: 2.1 time: 0.083737 Oct 12 09:44:15.855447 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3660/6890] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:44:15 2022] DELETE /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:44:15.864037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:15.864744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:15.870940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.871416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.871863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:15.872548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:15.872996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:15.873560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:16.015563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:16.023457 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d2d4302c-4905-4901-b5cd-b84ca4c629c8 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1511 microversion: 2.1 time: 0.163730 Oct 12 09:44:16.024030 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3231/6891] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:15 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:44:17.048331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:17.048972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:17.056724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:17.057227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:17.057717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:17.058433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:17.058905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:17.059344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:17.209083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:17.217665 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69b31864-5e6d-42be-883e-a5faebc9a018 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1511 microversion: 2.1 time: 0.174079 Oct 12 09:44:17.218334 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3661/6892] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:17 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:17.686657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-211c21a1-0954-4ae2-a8bb-033e2bea2642 req-a28b54df-081a-4b10-9585-fa5823641d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692b12aa-93d5-4a98-8170-55d96f6348f1", "name": "network-vif-deleted", "tag": "51bdaf1a-1bad-4bf3-8824-a20479df62fd"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:17.697454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-211c21a1-0954-4ae2-a8bb-033e2bea2642 req-a28b54df-081a-4b10-9585-fa5823641d05 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:17.698032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-211c21a1-0954-4ae2-a8bb-033e2bea2642 req-a28b54df-081a-4b10-9585-fa5823641d05 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:17.698541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-211c21a1-0954-4ae2-a8bb-033e2bea2642 req-a28b54df-081a-4b10-9585-fa5823641d05 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:17.711589 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-211c21a1-0954-4ae2-a8bb-033e2bea2642 req-a28b54df-081a-4b10-9585-fa5823641d05 service nova] Creating event network-vif-deleted:51bdaf1a-1bad-4bf3-8824-a20479df62fd for instance 692b12aa-93d5-4a98-8170-55d96f6348f1 on n-h1-858383-10 Oct 12 09:44:17.717323 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-211c21a1-0954-4ae2-a8bb-033e2bea2642 req-a28b54df-081a-4b10-9585-fa5823641d05 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Oct 12 09:44:17.721155 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3232/6893] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:44:18.240898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:18.241718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:18.249337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:18.249940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:18.250563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:18.251335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:18.251820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:18.252255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:18.288832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:18.289339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:18.289832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:18.290343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lazy-loading 'fault' on Instance uuid 692b12aa-93d5-4a98-8170-55d96f6348f1 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:44:18.334834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6ed91a455a4f7a83f7387116c1231a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3548d3847dd54937abea4a91a69543ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:18.342243 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b45b941a-74f0-474a-9447-b6abf35d453f tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 200 len: 1306 microversion: 2.1 time: 0.105689 Oct 12 09:44:18.342906 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3662/6894] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:18 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:19.372576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:19.374221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 692b12aa-93d5-4a98-8170-55d96f6348f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:19.385243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:19.386096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:19.386828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:19.387974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:19.388726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:19.389488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:19.403362 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] HTTP exception thrown: Instance 692b12aa-93d5-4a98-8170-55d96f6348f1 could not be found. Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Request method failure captured: Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 HTTP/1.1 Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRowMlzh48Q_VkOinvaBmKT-8fdHtVODl9A0pXhK1U4-B88zepeBv6Hq8ErsuUSjoYv7X2hEYbn7TEE61PNPKCyGHRlEKD9H5ZvyTp0dtW-O5S8C2RFizIdHE53OLwhwvodTcpXLdl3DCzLEfmRsv0Kp-hsnbgJFeShW3Vnfw6UW-gHk Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 3548d3847dd54937abea4a91a69543ba Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3548d3847dd54937abea4a91a69543ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3548d3847dd54937abea4a91a69543ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3548d3847dd54937abea4a91a69543ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3548d3847dd54937abea4a91a69543ba"}]}] Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 3548d3847dd54937abea4a91a69543ba Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiskConfigTestJSON-489206382-project Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: ac6ed91a455a4f7a83f7387116c1231a Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiskConfigTestJSON-489206382-project Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 692b12aa-93d5-4a98-8170-55d96f6348f1 could not be found. Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '692b12aa-93d5-4a98-8170-55d96f6348f1'} Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692b12aa-93d5-4a98-8170-55d96f6348f1 could not be found. Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692b12aa-93d5-4a98-8170-55d96f6348f1 could not be found. Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:44:19.405015 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692b12aa-93d5-4a98-8170-55d96f6348f1 could not be found. Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Returning 404 to user: Instance 692b12aa-93d5-4a98-8170-55d96f6348f1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-24120e8a-9f33-4591-bad0-e266ce6dcbd6 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1" status: 404 len: 111 microversion: 2.1 time: 0.043095 Oct 12 09:44:19.409919 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3233/6895] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:19 2022] GET /compute/v2.1/servers/692b12aa-93d5-4a98-8170-55d96f6348f1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:44:19.415407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12d13fab-2433-42e3-8b25-0e9df592effb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '.version_select at 0x7f9848032b80>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:19.438441 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12d13fab-2433-42e3-8b25-0e9df592effb tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525661782" status: 202 len: 0 microversion: 2.1 time: 0.027002 Oct 12 09:44:19.439018 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3663/6896] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 09:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525661782 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:44:20.043044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:20.043764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:20.050810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:20.051298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:20.051735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:20.052426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:20.052878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:20.053302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:20.066768 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] HTTP exception thrown: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Request method failure captured: Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b HTTP/1.1 Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRowMlzh48Q_VkOinvaBmKT-8fdHtVODl9A0pXhK1U4-B88zepeBv6Hq8ErsuUSjoYv7X2hEYbn7TEE61PNPKCyGHRlEKD9H5ZvyTp0dtW-O5S8C2RFizIdHE53OLwhwvodTcpXLdl3DCzLEfmRsv0Kp-hsnbgJFeShW3Vnfw6UW-gHk Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 3548d3847dd54937abea4a91a69543ba Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3548d3847dd54937abea4a91a69543ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3548d3847dd54937abea4a91a69543ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3548d3847dd54937abea4a91a69543ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3548d3847dd54937abea4a91a69543ba"}]}] Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 3548d3847dd54937abea4a91a69543ba Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerDiskConfigTestJSON-489206382-project Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: ac6ed91a455a4f7a83f7387116c1231a Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerDiskConfigTestJSON-489206382-project Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '36ba1d95-6661-48ff-b5bc-ddfa852d176b'} Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:44:20.068325 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Returning 404 to user: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d69d6105-c24f-4d87-b942-9833c819a1ed tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "DELETE /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 404 len: 111 microversion: 2.1 time: 0.032654 Oct 12 09:44:20.072194 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3234/6897] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:44:20 2022] DELETE /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:44:20.078565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:20.079200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] [instance: 36ba1d95-6661-48ff-b5bc-ddfa852d176b] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:20.086036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:20.086543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:20.086986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:20.087694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:20.088164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:20.088608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:20.102057 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] HTTP exception thrown: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Request method failure captured: Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b HTTP/1.1 Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRowMlzh48Q_VkOinvaBmKT-8fdHtVODl9A0pXhK1U4-B88zepeBv6Hq8ErsuUSjoYv7X2hEYbn7TEE61PNPKCyGHRlEKD9H5ZvyTp0dtW-O5S8C2RFizIdHE53OLwhwvodTcpXLdl3DCzLEfmRsv0Kp-hsnbgJFeShW3Vnfw6UW-gHk Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 3548d3847dd54937abea4a91a69543ba Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3548d3847dd54937abea4a91a69543ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3548d3847dd54937abea4a91a69543ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3548d3847dd54937abea4a91a69543ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3548d3847dd54937abea4a91a69543ba"}]}] Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 3548d3847dd54937abea4a91a69543ba Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-489206382 Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerDiskConfigTestJSON-489206382-project Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: ac6ed91a455a4f7a83f7387116c1231a Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerDiskConfigTestJSON-489206382-project Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '36ba1d95-6661-48ff-b5bc-ddfa852d176b'} Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:44:20.103719 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] Returning 404 to user: Instance 36ba1d95-6661-48ff-b5bc-ddfa852d176b could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0087dbad-a2f8-446f-9679-bc46c4fab1d7 tempest-ServerDiskConfigTestJSON-489206382 tempest-ServerDiskConfigTestJSON-489206382-project] 10.222.0.40 "GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b" status: 404 len: 111 microversion: 2.1 time: 0.030652 Oct 12 09:44:20.108397 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3664/6898] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:20 2022] GET /compute/v2.1/servers/36ba1d95-6661-48ff-b5bc-ddfa852d176b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:44:28.729050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bc076cdf-d9c3-4270-8f4f-9e3d638c0fbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'create', calling method: .version_select at 0x7f98437adca0>, body: {"keypair": {"name": "tempest-keypair-1126700783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnsWAPf7F1vZv7Yr9GTi7sF4h1AHwHrNLaQTmXTL91mLEgmNLT078K3YzHgJx+ZxhoI9bYoxHsYOYmV2Bh1D3OMkboB1+Vu7qXaOkQGV1HwAA6NqWUGtSc9tOe5e8BQtw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:28.737272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:44:28.752519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-bc076cdf-d9c3-4270-8f4f-9e3d638c0fbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for project a2177efa327a4db9be755b2ddb9510e6. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:44:28.759272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-bc076cdf-d9c3-4270-8f4f-9e3d638c0fbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for user f18227827d83493f83795e243ec1e476 and project a2177efa327a4db9be755b2ddb9510e6. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:44:28.788299 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bc076cdf-d9c3-4270-8f4f-9e3d638c0fbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174781 Oct 12 09:44:28.789096 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3235/6899] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:44:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:44:30.118873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1996020263", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "008b7335-c5f1-497c-ab20-664960622707"}], "security_groups": [{"name": "tempest-securitygroup--805998850"}], "key_name": "tempest-keypair-1126700783", "user_data": "}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:30.129151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:44:30.129904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:44:30.229235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] validate_networks() for [('008b7335-c5f1-497c-ab20-664960622707', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:44:31.030395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:44:31.030842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:44:31.031340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:44:31.031770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:44:31.032208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:44:31.047176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:31.047672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:31.048129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:31.048883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:31.049389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:31.049871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:31.074306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:44:31.082661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for user f18227827d83493f83795e243ec1e476 and project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:44:31.095863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:44:31.098593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:44:31.156487 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04ed19e8-a8f0-464b-882c-e0734da1c649 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.041686 Oct 12 09:44:31.158652 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3665/6900] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:44:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:44:31.170486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:44:31.177868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1a522de-3282-45c4-9311-da5d36c57655 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:31.178674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1a522de-3282-45c4-9311-da5d36c57655 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:31.276203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1a522de-3282-45c4-9311-da5d36c57655 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:31.285871 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1a522de-3282-45c4-9311-da5d36c57655 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1239 microversion: 2.1 time: 0.115880 Oct 12 09:44:31.287083 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3236/6901] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:31 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1239 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:32.312003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:32.312640 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:32.321140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:32.321968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:32.322635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:32.323466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:32.324149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:32.324696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:32.408487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:32.417215 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-94df2818-c81f-4a2a-813f-00c6b76db31a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1299 microversion: 2.1 time: 0.112166 Oct 12 09:44:32.433126 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3666/6902] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:32 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:33.444191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:33.451447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:33.458759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:33.459245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:33.459680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:33.460377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:33.460990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:33.461589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:33.594062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:33.602481 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb1aba23-ca7b-4b8f-acf2-6a4381be4098 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1364 microversion: 2.1 time: 0.163698 Oct 12 09:44:33.603385 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3237/6903] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:33 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:33.807957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5b049727-d331-4cc8-a7bb-5aef1b2b0327 req-a741f700-a8e9-4d30-b517-c0dde0912696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d304b54e-794d-488d-a942-14caf97f5b33", "tag": "b7996c53-f642-4725-bd06-4fc5b38a478a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:33.819392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5b049727-d331-4cc8-a7bb-5aef1b2b0327 req-a741f700-a8e9-4d30-b517-c0dde0912696 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:33.819888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5b049727-d331-4cc8-a7bb-5aef1b2b0327 req-a741f700-a8e9-4d30-b517-c0dde0912696 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:33.820332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5b049727-d331-4cc8-a7bb-5aef1b2b0327 req-a741f700-a8e9-4d30-b517-c0dde0912696 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:33.833677 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5b049727-d331-4cc8-a7bb-5aef1b2b0327 req-a741f700-a8e9-4d30-b517-c0dde0912696 service nova] Creating event network-changed:b7996c53-f642-4725-bd06-4fc5b38a478a for instance d304b54e-794d-488d-a942-14caf97f5b33 on n-h2-858383-10 Oct 12 09:44:33.839229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5b049727-d331-4cc8-a7bb-5aef1b2b0327 req-a741f700-a8e9-4d30-b517-c0dde0912696 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035129 Oct 12 09:44:33.840211 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3667/6904] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:44:34.630246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:34.630942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:34.638927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:34.639471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:34.639968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:34.640736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:34.641250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:34.641762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:34.790909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:34.798805 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-99220f80-dda2-412f-b10c-09cc7f424c8d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1364 microversion: 2.1 time: 0.175538 Oct 12 09:44:34.799387 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3238/6905] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:34 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:35.823705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:35.824416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:35.831538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:35.832041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:35.832506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:35.833287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:35.833797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:35.834240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:35.976041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:35.984078 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-71302a5e-5e90-4edf-8631-9a74d6cdc1fb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1364 microversion: 2.1 time: 0.165727 Oct 12 09:44:35.984668 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3668/6906] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:35 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:37.007353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:37.008004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:37.015293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:37.015785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:37.016235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:37.016934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:37.017394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:37.017858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:37.150966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:37.159393 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0db501bd-23e2-4c3e-9664-7840f022612e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1364 microversion: 2.1 time: 0.156416 Oct 12 09:44:37.159977 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3239/6907] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:37 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:38.186029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:38.187085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:38.197570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:38.198076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:38.198530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:38.199245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:38.199718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:38.200274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:38.341731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:38.349700 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca82bebe-815b-4046-b749-a3877118f7ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1364 microversion: 2.1 time: 0.170257 Oct 12 09:44:38.353477 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3669/6908] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:38 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:38.368856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d8bb1c81-e806-49d9-a3c9-81d68beca7e5 req-e9b80828-1dff-4f75-bbc6-61ad1630fe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d304b54e-794d-488d-a942-14caf97f5b33", "name": "network-vif-plugged", "status": "completed", "tag": "b7996c53-f642-4725-bd06-4fc5b38a478a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:38.379405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8bb1c81-e806-49d9-a3c9-81d68beca7e5 req-e9b80828-1dff-4f75-bbc6-61ad1630fe77 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:38.379967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8bb1c81-e806-49d9-a3c9-81d68beca7e5 req-e9b80828-1dff-4f75-bbc6-61ad1630fe77 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:38.380405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8bb1c81-e806-49d9-a3c9-81d68beca7e5 req-e9b80828-1dff-4f75-bbc6-61ad1630fe77 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:38.391614 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d8bb1c81-e806-49d9-a3c9-81d68beca7e5 req-e9b80828-1dff-4f75-bbc6-61ad1630fe77 service nova] Creating event network-vif-plugged:b7996c53-f642-4725-bd06-4fc5b38a478a for instance d304b54e-794d-488d-a942-14caf97f5b33 on n-h2-858383-10 Oct 12 09:44:38.396630 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d8bb1c81-e806-49d9-a3c9-81d68beca7e5 req-e9b80828-1dff-4f75-bbc6-61ad1630fe77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033831 Oct 12 09:44:38.397222 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3240/6909] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:44:39.376675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:39.377767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:39.389585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:39.390448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:39.391195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:39.392358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:39.393140 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:39.393958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:39.530554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:39.540639 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1c568e43-347d-49f1-a12c-6f001817abbf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1364 microversion: 2.1 time: 0.170345 Oct 12 09:44:39.541145 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3670/6910] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:39 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:40.569764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:40.570458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:40.577005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:40.577478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:40.577939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:40.578623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:40.579070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:40.579485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:40.726120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:44:40.734210 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c0e440a-4be3-4a14-85e7-93c3977b13b5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1551 microversion: 2.1 time: 0.173345 Oct 12 09:44:40.734843 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3241/6911] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:44:40 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:44:40.761872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:44:40.762419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:44:40.769695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:40.770198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:40.770660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:40.771373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:40.771855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:40.772299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:40.856103 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c666a941-7ab8-4d2e-8c66-21d42d91efe5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098190 Oct 12 09:44:40.856738 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3671/6912] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:44:40 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:44:42.115144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5e2cd98d-f0ea-4dcd-9f7a-cef08fa16004 req-925cb179-2892-469f-b169-99a8672aad6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d304b54e-794d-488d-a942-14caf97f5b33", "tag": "b7996c53-f642-4725-bd06-4fc5b38a478a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:44:42.120044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:44:42.126875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5e2cd98d-f0ea-4dcd-9f7a-cef08fa16004 req-925cb179-2892-469f-b169-99a8672aad6e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:44:42.127368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5e2cd98d-f0ea-4dcd-9f7a-cef08fa16004 req-925cb179-2892-469f-b169-99a8672aad6e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:44:42.127796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5e2cd98d-f0ea-4dcd-9f7a-cef08fa16004 req-925cb179-2892-469f-b169-99a8672aad6e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:44:42.139698 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5e2cd98d-f0ea-4dcd-9f7a-cef08fa16004 req-925cb179-2892-469f-b169-99a8672aad6e service nova] Creating event network-changed:b7996c53-f642-4725-bd06-4fc5b38a478a for instance d304b54e-794d-488d-a942-14caf97f5b33 on n-h2-858383-10 Oct 12 09:44:42.144883 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5e2cd98d-f0ea-4dcd-9f7a-cef08fa16004 req-925cb179-2892-469f-b169-99a8672aad6e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033549 Oct 12 09:44:42.145507 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3242/6913] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:45:18.000520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:18.001355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:18.004278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:18.004986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=32 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:18.010253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:18.010888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:18.019232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.019734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.020187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.020893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.021361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.021947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.161171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:18.169350 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43447406-c6c1-4daf-9656-4b645a283173 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1670 microversion: 2.1 time: 0.169883 Oct 12 09:45:18.169955 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3672/6914] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:17 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:18.190595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:18.191396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=28 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:18.195818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:18.196580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:18.204551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.205035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.205488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.206197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.206654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.207075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.345162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:18.353033 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7f42f1da-2bad-4e5d-bf22-b101e48e7386 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1670 microversion: 2.1 time: 0.164573 Oct 12 09:45:18.353603 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3243/6915] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:18 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:18.376283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:18.376904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:18.383372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.383885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.384330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.385028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.385488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.385934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.528858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:18.536964 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb5bdf5a-acb0-4343-9e96-8d327e9ba514 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1670 microversion: 2.1 time: 0.164735 Oct 12 09:45:18.537622 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3673/6916] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:18 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:45:18.559764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:18.562110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:18.568393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.568886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.569326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.570043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.570497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.570912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.605200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:18.611378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Old instance type m1.heat2, new instance type m1.heat {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:45:18.618383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:45:18.618809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:45:18.619282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:45:18.619693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:45:18.620102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:45:18.687744 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4ec138ed-45f9-4595-a3c5-dcd58c46d336 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33/action" status: 202 len: 0 microversion: 2.1 time: 0.131888 Oct 12 09:45:18.688342 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3244/6917] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:45:18 2022] POST /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:45:18.696924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:18.697604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:18.704424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.704927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.705392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.706131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:18.706906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:18.707005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:18.876016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:18.888086 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0fe6471f-bf4c-4110-993d-cfac986e241e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1679 microversion: 2.1 time: 0.194128 Oct 12 09:45:18.892131 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3674/6918] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:18 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:19.931547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:19.932589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:19.940580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:19.941096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:19.941568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:19.942266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:19.942724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:19.943154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:20.084021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:20.092356 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-583b23c4-9b86-414a-a95b-1664b33de28f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1679 microversion: 2.1 time: 0.168914 Oct 12 09:45:20.092900 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3245/6919] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:19 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:21.120417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:21.121319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:21.133222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:21.134122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:21.134877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:21.136062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:21.136946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:21.137398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:21.284794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:21.293140 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c0af62c0-6cd5-4ec9-a626-dfaf730c6187 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.179386 Oct 12 09:45:21.293744 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3675/6920] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:21 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:22.321290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:22.322461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:22.334217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:22.335028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:22.335765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:22.336925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:22.337897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:22.338615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:22.482417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:22.494415 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e47bbd58-6a50-4c7a-9733-90992d1186d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.179706 Oct 12 09:45:22.495138 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3246/6921] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:22 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:23.523772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:23.524808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:23.537012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:23.537929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:23.538685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:23.539864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:23.540657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:23.541420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:23.689766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:23.698555 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fb757100-7a6d-4e2a-889c-b11d27236229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.181454 Oct 12 09:45:23.699186 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3676/6922] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:23 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:24.726603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:24.727538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:24.739195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:24.739969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:24.740755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:24.742024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:24.742781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:24.743493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:24.879904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:24.888054 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dd543a0a-d3f1-48eb-809e-5c7e65ee0444 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.168081 Oct 12 09:45:24.888601 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3247/6923] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:24 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:25.915781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:25.916852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:25.928620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:25.929502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:25.930285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:25.931449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:25.932258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:25.932996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:26.069002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:26.077208 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f860e50-fc10-4a6a-be8f-6a28d2713ef1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.168069 Oct 12 09:45:26.077840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3677/6924] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:25 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:27.105081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:27.106078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:27.115623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:27.116179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:27.116756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:27.117727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:27.118334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:27.118888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:27.260882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:27.269249 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-acf5e509-445d-4087-9fdb-f4fdadf01a62 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.170695 Oct 12 09:45:27.269863 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3248/6925] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:27 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:28.296699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:28.297743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:28.309290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:28.309818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:28.310277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:28.311022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:28.311493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:28.311937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:28.448616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:28.457034 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eafcc6a8-60af-4ed5-aa63-debcfb620474 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.166873 Oct 12 09:45:28.457679 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3678/6926] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:28 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:29.481390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:29.481985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:29.489328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:29.489851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:29.490292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:29.490985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:29.491439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:29.491868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:29.629346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:29.640840 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e2b56e99-197e-4d05-9f28-ac26b8e5594d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.163606 Oct 12 09:45:29.641810 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3249/6927] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:29 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:30.665276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:30.665978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:30.673359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:30.673885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:30.674343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:30.675058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:30.675530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:30.675974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:30.809333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:30.817507 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2be7a8ad-9caf-4aec-bbbb-4e44f56330f9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.156493 Oct 12 09:45:30.818085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3679/6928] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:30 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:31.845767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:31.846736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:31.857052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:31.857576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:31.858016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:31.858728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:31.859192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:31.859621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:31.996098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:32.004636 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2dc81de9-7d6c-4672-989d-beb7ad187f89 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.165791 Oct 12 09:45:32.005225 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3250/6929] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:31 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:33.032293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:33.033329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:33.044907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:33.045407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:33.045893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:33.046604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:33.047071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:33.047512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:33.180778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:33.192641 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec9ef3ca-0a2d-41ea-bb82-6196ad215487 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.166585 Oct 12 09:45:33.193389 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3680/6930] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:33 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:34.220760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:34.221690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:34.233584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:34.234413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:34.235133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:34.236255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:34.237021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:34.237775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:34.370786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:34.379434 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cc99d9d6-6063-4f0e-a0f6-a872706865b8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.165529 Oct 12 09:45:34.380013 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3251/6931] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:34 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:35.406930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:35.407966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:35.419634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:35.420470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:35.421322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:35.422075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:35.422548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:35.422990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:35.557342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:35.566551 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d14a63b-e426-4747-8ee9-cf6ffc681230 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.166179 Oct 12 09:45:35.567009 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3681/6932] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:35 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:36.599841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:36.600846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:36.613417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:36.614294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:36.615038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:36.616201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:36.616969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:36.617750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:36.751004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:36.761046 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-32833063-8834-4e61-98c9-8628fa96ddbb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1684 microversion: 2.1 time: 0.167972 Oct 12 09:45:36.761654 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3252/6933] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:36 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:37.784765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:37.785363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:37.792985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:37.793525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:37.793985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:37.794699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:37.795168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:37.795611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:37.928062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:37.936369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0d9e6c84-dc95-438f-a7c0-1fd635e536ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1683 microversion: 2.1 time: 0.155666 Oct 12 09:45:37.936963 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3682/6934] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:37 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:38.199551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a868fdee-4bdb-4d01-b6e0-abf6b2d41df5 req-d825d7ea-fba2-4f37-97ca-02561ee837cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d304b54e-794d-488d-a942-14caf97f5b33", "name": "network-vif-unplugged", "status": "completed", "tag": "b7996c53-f642-4725-bd06-4fc5b38a478a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:38.210356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a868fdee-4bdb-4d01-b6e0-abf6b2d41df5 req-d825d7ea-fba2-4f37-97ca-02561ee837cd service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:38.210830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a868fdee-4bdb-4d01-b6e0-abf6b2d41df5 req-d825d7ea-fba2-4f37-97ca-02561ee837cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:38.211255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a868fdee-4bdb-4d01-b6e0-abf6b2d41df5 req-d825d7ea-fba2-4f37-97ca-02561ee837cd service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:38.223086 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a868fdee-4bdb-4d01-b6e0-abf6b2d41df5 req-d825d7ea-fba2-4f37-97ca-02561ee837cd service nova] Creating event network-vif-unplugged:b7996c53-f642-4725-bd06-4fc5b38a478a for instance d304b54e-794d-488d-a942-14caf97f5b33 on n-h1-858383-10 Oct 12 09:45:38.228659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-a868fdee-4bdb-4d01-b6e0-abf6b2d41df5 req-d825d7ea-fba2-4f37-97ca-02561ee837cd service nova] Instance d304b54e-794d-488d-a942-14caf97f5b33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:45:38.240127 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a868fdee-4bdb-4d01-b6e0-abf6b2d41df5 req-d825d7ea-fba2-4f37-97ca-02561ee837cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044617 Oct 12 09:45:38.241136 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3253/6935] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:45:38.963211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:38.963871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:38.971466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:38.972181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:38.972855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:38.974098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:38.974571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:38.975015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:39.112930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:39.120823 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3aa068ba-0f9e-4df5-8e2d-42ed6a2eebdf tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1683 microversion: 2.1 time: 0.163902 Oct 12 09:45:39.121651 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3683/6936] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:38 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:40.146152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:40.146825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:40.153544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:40.154035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:40.154510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:40.155206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:40.155661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:40.156090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:40.256015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3fa18599-2ea0-4a65-8062-f49e259af47d req-2edc88ac-a4fc-456a-b58f-fe1df719ab39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d304b54e-794d-488d-a942-14caf97f5b33", "tag": "b7996c53-f642-4725-bd06-4fc5b38a478a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:40.267173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3fa18599-2ea0-4a65-8062-f49e259af47d req-2edc88ac-a4fc-456a-b58f-fe1df719ab39 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:40.267696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3fa18599-2ea0-4a65-8062-f49e259af47d req-2edc88ac-a4fc-456a-b58f-fe1df719ab39 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:40.268177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3fa18599-2ea0-4a65-8062-f49e259af47d req-2edc88ac-a4fc-456a-b58f-fe1df719ab39 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:40.280930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3fa18599-2ea0-4a65-8062-f49e259af47d req-2edc88ac-a4fc-456a-b58f-fe1df719ab39 service nova] Creating event network-changed:b7996c53-f642-4725-bd06-4fc5b38a478a for instance d304b54e-794d-488d-a942-14caf97f5b33 on n-h1-858383-10 Oct 12 09:45:40.287160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-3fa18599-2ea0-4a65-8062-f49e259af47d req-2edc88ac-a4fc-456a-b58f-fe1df719ab39 service nova] Instance d304b54e-794d-488d-a942-14caf97f5b33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:45:40.298729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:40.298906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3fa18599-2ea0-4a65-8062-f49e259af47d req-2edc88ac-a4fc-456a-b58f-fe1df719ab39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046993 Oct 12 09:45:40.299449 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3684/6937] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:45:40.307282 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30c39ed5-9af1-40c4-9cd0-f4f299758862 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1681 microversion: 2.1 time: 0.166594 Oct 12 09:45:40.307912 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3254/6938] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:40 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:41.331890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:41.332646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:41.340201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:41.340690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:41.341144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:41.341892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:41.342368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:41.342810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:41.487903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:41.495941 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68a692d5-c951-4b06-b72f-563c2a9023b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1678 microversion: 2.1 time: 0.168464 Oct 12 09:45:41.496533 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3685/6939] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:41 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:41.519855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:41.520364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:41.527702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:41.528214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:41.528650 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:41.529313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:41.529793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:41.530218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:41.598417 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a670b73e-dd3a-427c-a3c1-0877caba28e8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33/action" status: 204 len: 0 microversion: 2.1 time: 0.082536 Oct 12 09:45:41.599072 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3255/6940] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:45:41 2022] POST /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:45:41.607652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:41.608419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:41.614887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:41.615390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:41.615839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:41.617553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:41.618080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:41.618693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:41.826851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:41.835010 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-336da03a-ae3b-4f72-8067-e85f90b65b65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1678 microversion: 2.1 time: 0.231235 Oct 12 09:45:41.835760 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3686/6941] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:41 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:42.860704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:42.862362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:42.868755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:42.869240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:42.869701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:42.870396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:42.870851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:42.871273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:43.007995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:43.016667 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b204ed9-4904-43dd-ad31-ab87aa3a3b46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1678 microversion: 2.1 time: 0.160971 Oct 12 09:45:43.017624 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3256/6942] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:42 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:44.041202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:44.041901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:44.048788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.049284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.049781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.050531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.050994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.051422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.149777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-44b8764b-27ba-4e4d-8670-91cf95e68231 req-9a100fe6-55d1-46fd-97b4-8519c25067e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d304b54e-794d-488d-a942-14caf97f5b33", "name": "network-vif-plugged", "status": "completed", "tag": "b7996c53-f642-4725-bd06-4fc5b38a478a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:44.160312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-44b8764b-27ba-4e4d-8670-91cf95e68231 req-9a100fe6-55d1-46fd-97b4-8519c25067e3 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.161560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-44b8764b-27ba-4e4d-8670-91cf95e68231 req-9a100fe6-55d1-46fd-97b4-8519c25067e3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.162149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-44b8764b-27ba-4e4d-8670-91cf95e68231 req-9a100fe6-55d1-46fd-97b4-8519c25067e3 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.174398 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-44b8764b-27ba-4e4d-8670-91cf95e68231 req-9a100fe6-55d1-46fd-97b4-8519c25067e3 service nova] Creating event network-vif-plugged:b7996c53-f642-4725-bd06-4fc5b38a478a for instance d304b54e-794d-488d-a942-14caf97f5b33 on n-h1-858383-10 Oct 12 09:45:44.179565 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-44b8764b-27ba-4e4d-8670-91cf95e68231 req-9a100fe6-55d1-46fd-97b4-8519c25067e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033623 Oct 12 09:45:44.180473 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3257/6943] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:45:44.184741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:44.192559 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bc641fed-2fbc-4b34-8459-d02e03d4e961 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1670 microversion: 2.1 time: 0.155972 Oct 12 09:45:44.193120 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3687/6944] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:44 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:44.217091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:44.217298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:44.223681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.224153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.224589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.225377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.225857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.226281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.228883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:44.367470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:44.379665 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-29a7a2b9-eea1-443e-b8e6-bb6cf695e750 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1670 microversion: 2.1 time: 0.167256 Oct 12 09:45:44.380308 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3258/6945] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:44 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:44.402301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:44.402955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:44.409268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.409799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.410254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.410966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.411434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.411877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.551893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:44.555566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=100 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:44.560832 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a0bea308-ba9a-4b4a-9bc3-d92f36de86e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1670 microversion: 2.1 time: 0.162512 Oct 12 09:45:44.561419 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3688/6946] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:44 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:44.584901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:44.585403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:44.591796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.592276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.592708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.593400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.593889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.594311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.620152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:45:44.699486 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b7ec6528-42f3-4d90-bc80-acab211fec88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 204 len: 0 microversion: 2.1 time: 0.118140 Oct 12 09:45:44.700121 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3259/6947] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:45:44 2022] DELETE /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:45:44.709155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:44.709842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:44.716114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.716621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.717045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.717794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:44.718273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:44.718716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:44.849835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:44.861491 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca71390e-f84f-445a-bee1-dce97304b0a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1676 microversion: 2.1 time: 0.156525 Oct 12 09:45:44.862077 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3689/6948] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:44 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:45.886230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:45.886967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:45.894308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:45.894801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:45.895243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:45.895952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:45.896410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:45.896837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:46.034577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:46.043174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f697c3d-a372-4180-b489-04aab11cdd71 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1676 microversion: 2.1 time: 0.161326 Oct 12 09:45:46.043723 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3260/6949] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:45 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:46.940472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-92c89548-af5b-436d-b04c-aa877fac0e38 req-dfb246f2-d322-4c3f-a553-1a9821f376ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d304b54e-794d-488d-a942-14caf97f5b33", "name": "network-vif-deleted", "tag": "b7996c53-f642-4725-bd06-4fc5b38a478a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:46.952960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-92c89548-af5b-436d-b04c-aa877fac0e38 req-dfb246f2-d322-4c3f-a553-1a9821f376ac service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:46.953975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-92c89548-af5b-436d-b04c-aa877fac0e38 req-dfb246f2-d322-4c3f-a553-1a9821f376ac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:46.954456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-92c89548-af5b-436d-b04c-aa877fac0e38 req-dfb246f2-d322-4c3f-a553-1a9821f376ac service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:46.967104 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-92c89548-af5b-436d-b04c-aa877fac0e38 req-dfb246f2-d322-4c3f-a553-1a9821f376ac service nova] Creating event network-vif-deleted:b7996c53-f642-4725-bd06-4fc5b38a478a for instance d304b54e-794d-488d-a942-14caf97f5b33 on n-h1-858383-10 Oct 12 09:45:46.973052 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-92c89548-af5b-436d-b04c-aa877fac0e38 req-dfb246f2-d322-4c3f-a553-1a9821f376ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036362 Oct 12 09:45:46.974030 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3690/6950] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:45:47.067083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:47.068313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:47.075284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:47.075763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:47.076202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:47.076960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:47.077411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:47.077867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:47.112294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:47.113208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:47.113893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:47.114728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lazy-loading 'fault' on Instance uuid d304b54e-794d-488d-a942-14caf97f5b33 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:45:47.159810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:47.168509 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-512dbb78-6765-4d05-951d-029cba99d31d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 200 len: 1329 microversion: 2.1 time: 0.105507 Oct 12 09:45:47.184621 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3261/6951] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:47 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:48.192809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:48.193407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:48.196634 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=39 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:48.201883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:48.202393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:48.202857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:48.203582 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:48.204060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:48.204512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:48.218933 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 HTTP/1.1 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'd304b54e-794d-488d-a942-14caf97f5b33'} Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:45:48.220590 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95ef8132-b707-4724-9aaa-54c305e9f569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 404 len: 111 microversion: 2.1 time: 0.033951 Oct 12 09:45:48.224935 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3691/6952] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:48 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:45:48.237336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:48.237983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:48.240834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:48.246228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:48.246711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:48.247155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:48.248400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:48.249048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:48.249548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:48.265608 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 HTTP/1.1 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'd304b54e-794d-488d-a942-14caf97f5b33'} Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:45:48.267285 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83f7be32-28ba-4b58-9f0e-3b0a05a94ebe tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 404 len: 111 microversion: 2.1 time: 0.035375 Oct 12 09:45:48.271621 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3262/6953] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:48 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:45:48.319738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1225012803", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "008b7335-c5f1-497c-ab20-664960622707"}], "security_groups": [{"name": "tempest-securitygroup--805998850"}], "key_name": "tempest-keypair-1126700783", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:48.432242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] validate_networks() for [('008b7335-c5f1-497c-ab20-664960622707', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:45:48.815088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:45:48.815531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:45:48.816167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:45:48.816597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:45:48.817050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:45:48.826691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:48.827195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:48.827652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:48.828396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:48.828864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:48.829301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:48.847107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:45:48.852290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for user f18227827d83493f83795e243ec1e476 and project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:45:48.867200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:45:48.869673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:45:48.918379 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-41d85a8c-79ce-41de-b959-93447b97f8ab tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.602577 Oct 12 09:45:48.919044 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3692/6954] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:45:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:45:48.931059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bfe7551f-eaa2-4b3d-b72c-73d4ac24eca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:48.931739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bfe7551f-eaa2-4b3d-b72c-73d4ac24eca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:48.984751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bfe7551f-eaa2-4b3d-b72c-73d4ac24eca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:48.994754 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bfe7551f-eaa2-4b3d-b72c-73d4ac24eca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1239 microversion: 2.1 time: 0.067675 Oct 12 09:45:48.995345 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3263/6955] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:48 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:50.022631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:50.023172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:50.034096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:50.034887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:50.035614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:50.036627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:50.037291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:50.038074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:50.138237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:50.147594 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-51c28ec5-6a52-4066-8ad3-57c0fe87eda8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1299 microversion: 2.1 time: 0.132474 Oct 12 09:45:50.149481 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3693/6956] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:50 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:51.171736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:51.172350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:51.180807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:51.181375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:51.181925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:51.182700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:51.183231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:51.183741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:51.320968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:51.329097 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1b68ba23-f971-4d06-8c8b-5fa7e5122b60 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1364 microversion: 2.1 time: 0.161467 Oct 12 09:45:51.329905 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3264/6957] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:51 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:51.506578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ad62deb6-cf76-43d4-8ff3-70e42b56b789 req-7989a333-4243-4ab2-aa55-fcf25fc9b8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19aeda84-9246-4cf1-95c3-6ca691e9c9e1", "tag": "d26df73c-5c26-440a-b157-fbd4772185e6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:51.517367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad62deb6-cf76-43d4-8ff3-70e42b56b789 req-7989a333-4243-4ab2-aa55-fcf25fc9b8e9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:51.517901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad62deb6-cf76-43d4-8ff3-70e42b56b789 req-7989a333-4243-4ab2-aa55-fcf25fc9b8e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:51.518362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ad62deb6-cf76-43d4-8ff3-70e42b56b789 req-7989a333-4243-4ab2-aa55-fcf25fc9b8e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:51.530342 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ad62deb6-cf76-43d4-8ff3-70e42b56b789 req-7989a333-4243-4ab2-aa55-fcf25fc9b8e9 service nova] Creating event network-changed:d26df73c-5c26-440a-b157-fbd4772185e6 for instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 on n-h2-858383-10 Oct 12 09:45:51.535716 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ad62deb6-cf76-43d4-8ff3-70e42b56b789 req-7989a333-4243-4ab2-aa55-fcf25fc9b8e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033059 Oct 12 09:45:51.536678 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3694/6958] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:45:52.356552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:52.357924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:52.367365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:52.367994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:52.368437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:52.369160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:52.369651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:52.370076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:52.499579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:52.507715 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-41d480a0-0c0a-4791-8e1f-a400b6e6abf0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1364 microversion: 2.1 time: 0.157723 Oct 12 09:45:52.508286 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3265/6959] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:52 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:53.535458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:53.536148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:53.542822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:53.543318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:53.543774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:53.544480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:53.544949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:53.545390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:53.696865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:53.705494 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a079909-da49-46a7-a2b1-3bbfbdb4fe86 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1364 microversion: 2.1 time: 0.177562 Oct 12 09:45:53.706092 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3695/6960] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:53 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:54.738579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:54.739253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:54.746446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:54.746932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:54.747363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:54.748030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:54.748499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:54.748951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:54.891106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:54.899041 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c07f8f93-018c-4b51-b66d-e07163ea8063 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1364 microversion: 2.1 time: 0.167010 Oct 12 09:45:54.899634 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3266/6961] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:54 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:55.926705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:55.927722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:55.939394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:55.940255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:55.940998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:55.942307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:55.942775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:55.943210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:56.078743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:56.086793 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79026ff2-4e80-4829-854f-ea49332c37d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1364 microversion: 2.1 time: 0.166831 Oct 12 09:45:56.087377 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3696/6962] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:55 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:56.776454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f67cb024-d728-43a4-a27e-efd3c655cbb8 req-94a3a5dc-3370-4a72-aa30-aaebcd0bf965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeda84-9246-4cf1-95c3-6ca691e9c9e1", "name": "network-vif-plugged", "status": "completed", "tag": "d26df73c-5c26-440a-b157-fbd4772185e6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:56.787661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f67cb024-d728-43a4-a27e-efd3c655cbb8 req-94a3a5dc-3370-4a72-aa30-aaebcd0bf965 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:56.788144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f67cb024-d728-43a4-a27e-efd3c655cbb8 req-94a3a5dc-3370-4a72-aa30-aaebcd0bf965 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:56.788574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f67cb024-d728-43a4-a27e-efd3c655cbb8 req-94a3a5dc-3370-4a72-aa30-aaebcd0bf965 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:56.800114 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f67cb024-d728-43a4-a27e-efd3c655cbb8 req-94a3a5dc-3370-4a72-aa30-aaebcd0bf965 service nova] Creating event network-vif-plugged:d26df73c-5c26-440a-b157-fbd4772185e6 for instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 on n-h2-858383-10 Oct 12 09:45:56.805339 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f67cb024-d728-43a4-a27e-efd3c655cbb8 req-94a3a5dc-3370-4a72-aa30-aaebcd0bf965 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Oct 12 09:45:56.806037 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3267/6963] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:45:57.114751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:57.115343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:57.122916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:57.123446 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:57.123928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:57.124674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:57.125168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:57.125667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:57.267907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:57.279271 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd7c03f0-07d0-42bb-bd46-8798d01d4369 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1364 microversion: 2.1 time: 0.170699 Oct 12 09:45:57.280041 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3697/6964] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:57 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:58.306597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:58.307301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:58.313933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:58.314420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:58.314864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:58.315557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:58.316013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:58.316449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:58.449276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:45:58.457518 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d310f759-feba-4cbd-8bee-4ab042f71ff1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1550 microversion: 2.1 time: 0.156688 Oct 12 09:45:58.458194 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3268/6965] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:45:58 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:45:58.482374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:45:58.482934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:45:58.490087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:58.490576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:58.491024 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:58.491732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:58.492200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:58.492641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:58.573415 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0efdedc7-a839-4aea-9a0c-93b6e3e9a758 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094778 Oct 12 09:45:58.574362 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3698/6966] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:45:58 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:45:59.529861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-94c38bb3-4024-488e-812a-68c534ca8e83 req-78a91ecc-c36a-4c27-a722-089aa9857cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19aeda84-9246-4cf1-95c3-6ca691e9c9e1", "tag": "d26df73c-5c26-440a-b157-fbd4772185e6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:45:59.534723 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:45:59.542058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-94c38bb3-4024-488e-812a-68c534ca8e83 req-78a91ecc-c36a-4c27-a722-089aa9857cb6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:45:59.542544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-94c38bb3-4024-488e-812a-68c534ca8e83 req-78a91ecc-c36a-4c27-a722-089aa9857cb6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:45:59.543021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-94c38bb3-4024-488e-812a-68c534ca8e83 req-78a91ecc-c36a-4c27-a722-089aa9857cb6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:45:59.554613 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-94c38bb3-4024-488e-812a-68c534ca8e83 req-78a91ecc-c36a-4c27-a722-089aa9857cb6 service nova] Creating event network-changed:d26df73c-5c26-440a-b157-fbd4772185e6 for instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 on n-h2-858383-10 Oct 12 09:45:59.559688 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-94c38bb3-4024-488e-812a-68c534ca8e83 req-78a91ecc-c36a-4c27-a722-089aa9857cb6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033530 Oct 12 09:45:59.560314 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3269/6967] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:46:40.424526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:46:40.425825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:46:40.429022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:46:40.430237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=42 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:46:40.437503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-358d72ec-9f47-4497-b5d1-a48298b54f85 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:46:40.446684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-358d72ec-9f47-4497-b5d1-a48298b54f85 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:40.447180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-358d72ec-9f47-4497-b5d1-a48298b54f85 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:40.447631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-358d72ec-9f47-4497-b5d1-a48298b54f85 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:40.474259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-358d72ec-9f47-4497-b5d1-a48298b54f85 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Going to try to stop instance {{(pid=127006) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 09:46:40.519700 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-358d72ec-9f47-4497-b5d1-a48298b54f85 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/action" status: 202 len: 0 microversion: 2.1 time: 0.096585 Oct 12 09:46:40.520512 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3699/6968] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:46:40 2022] POST /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:46:40.527445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=17 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:46:40.528785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:46:40.533076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:40.533957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:40.545327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:40.545932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:40.546355 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:40.547058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:40.547514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:40.547943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:40.680528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:40.688538 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9e781df4-10a0-415f-895d-491e0e683ba8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.163342 Oct 12 09:46:40.689124 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3270/6969] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:40 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:41.715888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:41.716692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:41.726673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:41.727326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:41.727903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:41.729007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:41.729616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:41.730148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:41.868058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:41.876561 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8db30f7c-4d44-4e0f-a5f9-cb7a5613cca2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.167763 Oct 12 09:46:41.877138 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3700/6970] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:41 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:42.905272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:42.906344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:42.914517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:42.915004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:42.915439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:42.916138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:42.916596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:42.917025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:43.051686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:43.059687 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e85614ba-4989-43de-bbe4-1a5ca960c409 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.160905 Oct 12 09:46:43.060265 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3271/6971] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:42 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:44.089034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:44.090046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:44.100219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:44.100733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:44.101190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:44.101954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:44.102425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:44.102871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:44.244210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:44.252606 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-970d8651-a548-4f4f-a454-a0ede2586720 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.170731 Oct 12 09:46:44.253206 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3701/6972] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:44 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:45.280596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:45.281411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:45.297847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:45.298700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:45.299415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:45.300529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:45.300981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:45.301403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:45.431029 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:45.439494 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-29c3c866-7475-46f7-96f8-dbbdd4f9075e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.165560 Oct 12 09:46:45.440105 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3272/6973] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:45 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:46.467435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:46.468406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:46.477800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:46.478306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:46.478757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:46.479473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:46.479943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:46.480382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:46.610305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:46.618713 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3f90f19-d8c2-473a-a95b-0e4c668b49f6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.157718 Oct 12 09:46:46.619326 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3702/6974] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:46 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:47.646513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:47.647124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:47.655044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:47.655582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:47.656063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:47.656838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:47.657340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:47.657825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:47.797815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:47.807398 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-114db96a-e4cd-410d-8f76-68515747aaba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.167189 Oct 12 09:46:47.808026 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3273/6975] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:47 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:48.831051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:48.831647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:48.839090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:48.839597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:48.840018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:48.840764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:48.841200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:48.841689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:48.976038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:48.984530 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fdd75cad-fd33-487b-895c-e014d6d8412b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.157495 Oct 12 09:46:48.985149 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3703/6976] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:48 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:50.013877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:50.014734 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:50.024257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:50.024740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:50.025156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:50.025915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:50.026363 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:50.026779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:50.170721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:50.180868 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9372d9cf-ca08-4fd7-ad2a-1c139fb41de2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.173646 Oct 12 09:46:50.181491 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3274/6977] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:50 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:51.208312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:51.208925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:51.217604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:51.218195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:51.218723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:51.219551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:51.220099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:51.220616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:51.354418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:51.362248 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b1918f86-cc50-4c93-b7c0-e30c60adf0ac tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.160627 Oct 12 09:46:51.362826 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3704/6978] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:51 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:52.390872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:52.391838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:52.403533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:52.404330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:52.405054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:52.406246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:52.406995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:52.407715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:52.826288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:52.834693 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0dc5ca62-5113-4672-bd40-59151658bc52 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.450407 Oct 12 09:46:52.835269 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3275/6979] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:52 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:53.859930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:53.860793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:53.870545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:53.871172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:53.871742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:53.872629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:53.873221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:53.873807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:54.022585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:54.035505 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f2de187-7130-4917-a85a-078b7982f702 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.180407 Oct 12 09:46:54.036321 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3705/6980] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:53 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:55.063467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:55.064482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:55.076073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:55.076891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:55.077709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:55.078858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:55.079615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:55.080389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:55.217873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:55.230810 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9f787408-f8c0-44ee-9f0d-efce242acaeb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.173758 Oct 12 09:46:55.231648 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3276/6981] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:55 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:56.261863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:56.262848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:56.274559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:56.275385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:56.276130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:56.277287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:56.278108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:56.278836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:56.414741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:56.422775 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-442a7ae9-8103-4126-ab63-e192e0b2556e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1656 microversion: 2.1 time: 0.167813 Oct 12 09:46:56.423336 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3706/6982] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:56 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:56.447116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:46:56.449378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:56.456401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:56.456873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:56.457299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:56.458086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:56.458457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:56.458877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:56.495332 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:56.501777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Old instance type m1.heat2, new instance type m1.heat {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:46:56.508668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:46:56.509119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:46:56.509632 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:46:56.510048 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:46:56.510459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:46:56.582481 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b9b55945-0ef0-4053-bf2c-0d8d893d77c6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/action" status: 202 len: 0 microversion: 2.1 time: 0.139298 Oct 12 09:46:56.583073 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3277/6983] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:46:56 2022] POST /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:46:56.591842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:56.592562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:56.599004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:56.599540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:56.600049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:56.600773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:56.601253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:56.601718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:56.763989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:56.772163 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a3a3f7c-9b59-467c-8b2d-3cfbe53061ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.184628 Oct 12 09:46:56.772750 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3707/6984] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:56 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:46:57.801100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:57.802172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:57.813273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:57.814141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:57.814878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:57.816035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:57.816794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:57.817520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:57.960817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:57.969592 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-27a622eb-c3ba-488d-aaf9-229ad822d276 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1679 microversion: 2.1 time: 0.176476 Oct 12 09:46:57.970432 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3278/6985] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:57 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:46:58.997732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:46:58.998770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:46:59.010015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:59.010550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:59.010996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:59.011721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:46:59.012204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:46:59.012650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:46:59.158786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:46:59.168739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fef334cb-5d77-4579-86cf-3f0b7d57e234 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1684 microversion: 2.1 time: 0.177943 Oct 12 09:46:59.169350 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3708/6986] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:46:58 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:00.197054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:00.197804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:00.208770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:00.209607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:00.210311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:00.211447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:00.212227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:00.212664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:00.354886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:00.363315 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-49ec44ee-8eb2-4d4f-bf3a-3cc9d36d207d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1684 microversion: 2.1 time: 0.173143 Oct 12 09:47:00.363889 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3279/6987] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:00 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:01.193703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5fc98be8-1a32-4b51-a7da-022a086b91c7 req-3ff15744-1353-4ee2-b83b-86783c9fdc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeda84-9246-4cf1-95c3-6ca691e9c9e1", "name": "network-vif-unplugged", "status": "completed", "tag": "d26df73c-5c26-440a-b157-fbd4772185e6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:01.204864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5fc98be8-1a32-4b51-a7da-022a086b91c7 req-3ff15744-1353-4ee2-b83b-86783c9fdc25 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:01.205836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5fc98be8-1a32-4b51-a7da-022a086b91c7 req-3ff15744-1353-4ee2-b83b-86783c9fdc25 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:01.206350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5fc98be8-1a32-4b51-a7da-022a086b91c7 req-3ff15744-1353-4ee2-b83b-86783c9fdc25 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:01.219239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5fc98be8-1a32-4b51-a7da-022a086b91c7 req-3ff15744-1353-4ee2-b83b-86783c9fdc25 service nova] Creating event network-vif-unplugged:d26df73c-5c26-440a-b157-fbd4772185e6 for instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 on n-h1-858383-10 Oct 12 09:47:01.224791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-5fc98be8-1a32-4b51-a7da-022a086b91c7 req-3ff15744-1353-4ee2-b83b-86783c9fdc25 service nova] Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:47:01.235839 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5fc98be8-1a32-4b51-a7da-022a086b91c7 req-3ff15744-1353-4ee2-b83b-86783c9fdc25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046154 Oct 12 09:47:01.236467 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3709/6988] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:47:01.387192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:01.387746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:01.395150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:01.395659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:01.396102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:01.396818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:01.397273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:01.397733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:01.883872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:01.892217 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a463aca2-1645-40eb-84c5-cb168933527b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1683 microversion: 2.1 time: 0.509246 Oct 12 09:47:01.892773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3280/6989] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:01 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1683 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:02.917729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:02.918472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:02.926071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:02.926567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:02.927013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:02.927717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:02.928179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:02.928613 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:03.069541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:03.077980 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a385126-a91c-47a7-8a4f-6c90be4fc4a9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1681 microversion: 2.1 time: 0.164805 Oct 12 09:47:03.078582 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3710/6990] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:02 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:03.258613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c9efb6d5-1933-43d0-b855-3a4b70eef487 req-7df2aed2-bae4-4d18-8c3e-7a33bddbccaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19aeda84-9246-4cf1-95c3-6ca691e9c9e1", "tag": "d26df73c-5c26-440a-b157-fbd4772185e6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:03.276169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c9efb6d5-1933-43d0-b855-3a4b70eef487 req-7df2aed2-bae4-4d18-8c3e-7a33bddbccaf service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:03.276591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c9efb6d5-1933-43d0-b855-3a4b70eef487 req-7df2aed2-bae4-4d18-8c3e-7a33bddbccaf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:03.277022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c9efb6d5-1933-43d0-b855-3a4b70eef487 req-7df2aed2-bae4-4d18-8c3e-7a33bddbccaf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:03.289145 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c9efb6d5-1933-43d0-b855-3a4b70eef487 req-7df2aed2-bae4-4d18-8c3e-7a33bddbccaf service nova] Creating event network-changed:d26df73c-5c26-440a-b157-fbd4772185e6 for instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 on n-h1-858383-10 Oct 12 09:47:03.294877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-c9efb6d5-1933-43d0-b855-3a4b70eef487 req-7df2aed2-bae4-4d18-8c3e-7a33bddbccaf service nova] Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:47:03.307221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c9efb6d5-1933-43d0-b855-3a4b70eef487 req-7df2aed2-bae4-4d18-8c3e-7a33bddbccaf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054588 Oct 12 09:47:03.307840 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3281/6991] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:47:04.102115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:04.102710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:04.109861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:04.110382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:04.110845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:04.111607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:04.112067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:04.112507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:04.248476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:04.257078 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fe9ccec1-0a57-4ce0-8758-ca59dc03ee88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1677 microversion: 2.1 time: 0.159069 Oct 12 09:47:04.257705 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3711/6992] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:04 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:04.281318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:04.281934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:04.288217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:04.288699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:04.289134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:04.289854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:04.290302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:04.290739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:04.353686 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5e0a64f-ea76-44e2-9eea-4a172403208b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/action" status: 204 len: 0 microversion: 2.1 time: 0.077157 Oct 12 09:47:04.354478 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3282/6993] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:47:04 2022] POST /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:47:04.363731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:04.364504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:04.370768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:04.371588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:04.372156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:04.372917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:04.373390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:04.373874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:04.599617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:04.608495 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8cd3c38a-b898-4c48-8f0a-2b71ea8be36d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1677 microversion: 2.1 time: 0.249687 Oct 12 09:47:04.609321 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3712/6994] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:04 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:05.637776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:05.638479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:05.645154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:05.645668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:05.646114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:05.646807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:05.647266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:05.647694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:05.781537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:05.790146 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-128577a4-7e5f-420b-9016-261fa49a8939 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1677 microversion: 2.1 time: 0.159605 Oct 12 09:47:05.790867 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3283/6995] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:05 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:06.631869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a7a10ad5-4c30-492a-8a36-2ade2ed6e5c7 req-206a96a1-fab4-4769-87c0-6066c624d026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeda84-9246-4cf1-95c3-6ca691e9c9e1", "name": "network-vif-plugged", "status": "completed", "tag": "d26df73c-5c26-440a-b157-fbd4772185e6"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:06.643940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a7a10ad5-4c30-492a-8a36-2ade2ed6e5c7 req-206a96a1-fab4-4769-87c0-6066c624d026 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:06.644797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a7a10ad5-4c30-492a-8a36-2ade2ed6e5c7 req-206a96a1-fab4-4769-87c0-6066c624d026 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:06.645248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a7a10ad5-4c30-492a-8a36-2ade2ed6e5c7 req-206a96a1-fab4-4769-87c0-6066c624d026 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:06.656920 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a7a10ad5-4c30-492a-8a36-2ade2ed6e5c7 req-206a96a1-fab4-4769-87c0-6066c624d026 service nova] Creating event network-vif-plugged:d26df73c-5c26-440a-b157-fbd4772185e6 for instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 on n-h1-858383-10 Oct 12 09:47:06.662104 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a7a10ad5-4c30-492a-8a36-2ade2ed6e5c7 req-206a96a1-fab4-4769-87c0-6066c624d026 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 Oct 12 09:47:06.662673 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3713/6996] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:47:06.814771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:06.815413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:06.822644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:06.823128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:06.823572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:06.824270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:06.824725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:06.825154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:06.840793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:47:06.965348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:06.973814 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-964a22da-ee1e-4d56-a821-a673fdd7d96a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1656 microversion: 2.1 time: 0.163035 Oct 12 09:47:06.974388 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3284/6997] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:06 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:07.004780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:07.005527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:07.012258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:07.012774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:07.013211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:07.013982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:07.014452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:07.014900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:07.153336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:07.161584 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-82e20c2d-1529-4756-a6e3-d5b098bbcdd4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1656 microversion: 2.1 time: 0.161048 Oct 12 09:47:07.162140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3714/6998] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:06 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:07.184459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5c7227fc-01a3-4c3d-8ab9-04a29cd72ac0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:07.190634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c7227fc-01a3-4c3d-8ab9-04a29cd72ac0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:07.191126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c7227fc-01a3-4c3d-8ab9-04a29cd72ac0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:07.191569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5c7227fc-01a3-4c3d-8ab9-04a29cd72ac0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:07.214501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5c7227fc-01a3-4c3d-8ab9-04a29cd72ac0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Going to try to start instance {{(pid=127007) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 09:47:07.268524 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5c7227fc-01a3-4c3d-8ab9-04a29cd72ac0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/action" status: 202 len: 0 microversion: 2.1 time: 0.087883 Oct 12 09:47:07.269308 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3285/6999] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:47:07 2022] POST /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:47:07.278078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:07.278835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:07.285960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:07.286583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:07.287091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:07.288155 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:07.288631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:07.289379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:07.310119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:47:07.429923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:07.438174 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad88a560-4c69-4be2-b88c-035ce5ffa453 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1665 microversion: 2.1 time: 0.164144 Oct 12 09:47:07.438884 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3715/7000] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:07 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:08.463985 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:08.464715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:08.471285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:08.471770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:08.472211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:08.472918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:08.473378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:08.473834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:08.615401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:08.623474 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c2dcefab-736e-4463-9e74-4f988a85099f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1669 microversion: 2.1 time: 0.164785 Oct 12 09:47:08.624090 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3286/7001] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:08 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:08.648961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:08.649533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:08.659585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:08.660183 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:08.660795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:08.661880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:08.662530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:08.663097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:08.690246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:47:08.782224 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cc463b23-862c-43d4-8f83-9311647e7dbc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 204 len: 0 microversion: 2.1 time: 0.138884 Oct 12 09:47:08.782738 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3716/7002] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:47:08 2022] DELETE /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:47:08.791667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:08.792306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:08.798577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:08.799077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:08.799521 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:08.800413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:08.800883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:08.801358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:08.938160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:08.950139 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-286690f9-aaab-4212-8164-26a6caa358e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1675 microversion: 2.1 time: 0.162874 Oct 12 09:47:08.950722 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3287/7003] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:08 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:09.974746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:09.975508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:09.982641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:09.983143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:09.983592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:09.984304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:09.984771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:09.985210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:10.125695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:10.133930 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0115b51-8c0a-4e8e-b690-4ab02feaea7a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1675 microversion: 2.1 time: 0.163593 Oct 12 09:47:10.134534 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3717/7004] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:09 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:11.041863 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-016dd6f5-8ae6-406c-a268-64f4cb0341da req-d1a2c9df-a0d1-4251-b61c-574e0c03a236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeda84-9246-4cf1-95c3-6ca691e9c9e1", "name": "network-vif-deleted", "tag": "d26df73c-5c26-440a-b157-fbd4772185e6"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:11.049467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=41 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:47:11.054007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-016dd6f5-8ae6-406c-a268-64f4cb0341da req-d1a2c9df-a0d1-4251-b61c-574e0c03a236 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:11.054494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-016dd6f5-8ae6-406c-a268-64f4cb0341da req-d1a2c9df-a0d1-4251-b61c-574e0c03a236 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:11.054924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-016dd6f5-8ae6-406c-a268-64f4cb0341da req-d1a2c9df-a0d1-4251-b61c-574e0c03a236 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:11.068430 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-016dd6f5-8ae6-406c-a268-64f4cb0341da req-d1a2c9df-a0d1-4251-b61c-574e0c03a236 service nova] Creating event network-vif-deleted:d26df73c-5c26-440a-b157-fbd4772185e6 for instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 on n-h1-858383-10 Oct 12 09:47:11.074022 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-016dd6f5-8ae6-406c-a268-64f4cb0341da req-d1a2c9df-a0d1-4251-b61c-574e0c03a236 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035945 Oct 12 09:47:11.074647 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3288/7005] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:47:11.157359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:11.158689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:11.162077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:47:11.167868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:11.168383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:11.168838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:11.169591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:11.170056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:11.170493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:11.208471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:11.208972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:11.209426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:11.209920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lazy-loading 'fault' on Instance uuid 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:47:11.256387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:11.265124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47f1c11b-8f3a-4f38-8dbe-f3e2f3201af3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 200 len: 1329 microversion: 2.1 time: 0.111868 Oct 12 09:47:11.265959 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3718/7006] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:11 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:12.295196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:12.295993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:12.306614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:12.307306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:12.308050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:12.309035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:12.309491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:12.309953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:12.323705 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 HTTP/1.1 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '19aeda84-9246-4cf1-95c3-6ca691e9c9e1'} Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:47:12.325368 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e346c302-12e6-4da0-9fed-c4866412d01b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 404 len: 111 microversion: 2.1 time: 0.040256 Oct 12 09:47:12.330162 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3289/7007] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:12 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:47:12.343907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:12.344523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:12.350989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:12.351492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:12.351946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:12.352659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:12.353135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:12.353628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:12.367729 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 HTTP/1.1 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '19aeda84-9246-4cf1-95c3-6ca691e9c9e1'} Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:47:12.369369 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1cf54033-6d8d-4191-8bda-d99b77fed9cc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 404 len: 111 microversion: 2.1 time: 0.031307 Oct 12 09:47:12.373929 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3719/7008] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:12 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:47:12.425001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-139405623", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "008b7335-c5f1-497c-ab20-664960622707"}], "security_groups": [{"name": "tempest-securitygroup--805998850"}], "key_name": "tempest-keypair-1126700783", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:12.538121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] validate_networks() for [('008b7335-c5f1-497c-ab20-664960622707', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:47:13.038686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:47:13.039145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:47:13.039669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:47:13.040079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:47:13.040541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:47:13.050205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:13.050697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:13.051143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:13.051909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:13.052367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:13.052805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:13.073969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:47:13.079634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for user f18227827d83493f83795e243ec1e476 and project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:47:13.094069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:47:13.096444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:47:13.147090 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e156fb0-cb3f-4a7b-8eb2-5e5e439efc54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.725851 Oct 12 09:47:13.147759 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3290/7009] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:47:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:47:13.159657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a411a7f7-4300-4b06-8e62-da2c910766d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:13.160277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a411a7f7-4300-4b06-8e62-da2c910766d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:13.212910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a411a7f7-4300-4b06-8e62-da2c910766d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:13.220379 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a411a7f7-4300-4b06-8e62-da2c910766d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1238 microversion: 2.1 time: 0.064632 Oct 12 09:47:13.220946 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3720/7010] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:13 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:14.248321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:14.250403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:14.257773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:14.258271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:14.258694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:14.259387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:14.259835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:14.260260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:14.350876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:14.361702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba65194b-7db8-40d4-a1cf-86c41599b95d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1290 microversion: 2.1 time: 0.119831 Oct 12 09:47:14.373519 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3291/7011] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:14 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:15.387127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:15.387749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:15.395878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:15.396388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:15.396844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:15.397586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:15.398045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:15.398492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:15.622400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:15.630900 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6fc7c625-d6af-4c8b-92ec-391c955e488b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1363 microversion: 2.1 time: 0.247834 Oct 12 09:47:15.631499 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3721/7012] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:15 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:15.827573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b4c3de6b-f308-4e9b-b8ce-4bac020e9f57 req-0fb45e68-7876-405e-8087-8cde1ed32b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:15.838156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b4c3de6b-f308-4e9b-b8ce-4bac020e9f57 req-0fb45e68-7876-405e-8087-8cde1ed32b42 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:15.838644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b4c3de6b-f308-4e9b-b8ce-4bac020e9f57 req-0fb45e68-7876-405e-8087-8cde1ed32b42 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:15.839074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b4c3de6b-f308-4e9b-b8ce-4bac020e9f57 req-0fb45e68-7876-405e-8087-8cde1ed32b42 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:15.858167 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b4c3de6b-f308-4e9b-b8ce-4bac020e9f57 req-0fb45e68-7876-405e-8087-8cde1ed32b42 service nova] Creating event network-changed:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h2-858383-10 Oct 12 09:47:15.863276 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b4c3de6b-f308-4e9b-b8ce-4bac020e9f57 req-0fb45e68-7876-405e-8087-8cde1ed32b42 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039558 Oct 12 09:47:15.863905 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3292/7013] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:47:16.659084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:16.660115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:16.672067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:16.672902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:16.673815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:16.674996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:16.675830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:16.676523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:16.814076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:16.823761 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-083e3f51-7aed-4362-87b2-3abcfed5df24 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1363 microversion: 2.1 time: 0.171185 Oct 12 09:47:16.824331 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3722/7014] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:16 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:17.846039 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:47:17.846804 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 (ip 10.222.0.40) !!! Oct 12 09:47:17.853714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:17.854704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:17.865067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:17.865807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:17.866454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:17.867422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:17.868043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:17.868633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:18.005838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:18.015465 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-520212a7-25a9-489f-8bf5-70c35c5c788f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1363 microversion: 2.1 time: 0.171288 Oct 12 09:47:18.016034 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3293/7015] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:17 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:19.039150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:19.039780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:19.043077 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:47:19.043228 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 (ip 10.222.0.40) !!! Oct 12 09:47:19.049563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:19.050070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:19.050534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:19.051488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:19.051980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:19.052423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:19.189983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:19.198124 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8aef2b16-c89a-4021-b37c-b89e8ab3f229 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1363 microversion: 2.1 time: 0.162927 Oct 12 09:47:19.198705 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3723/7016] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:19 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:20.226366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:20.227242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:20.236638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:20.237163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:20.237642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:20.238346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:20.238806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:20.239234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:20.391349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:20.399596 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d7d989f-9751-42c8-9164-43f512ca26c2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1363 microversion: 2.1 time: 0.180224 Oct 12 09:47:20.400192 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3294/7017] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:20 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:21.042134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-01b8d02e-bb9c-49ac-9b00-702dcccffd43 req-61cbfbb8-8880-4f5a-a7ff-206acace3c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "name": "network-vif-plugged", "status": "completed", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:21.053766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-01b8d02e-bb9c-49ac-9b00-702dcccffd43 req-61cbfbb8-8880-4f5a-a7ff-206acace3c6a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:21.054382 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-01b8d02e-bb9c-49ac-9b00-702dcccffd43 req-61cbfbb8-8880-4f5a-a7ff-206acace3c6a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:21.055805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-01b8d02e-bb9c-49ac-9b00-702dcccffd43 req-61cbfbb8-8880-4f5a-a7ff-206acace3c6a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:21.068152 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-01b8d02e-bb9c-49ac-9b00-702dcccffd43 req-61cbfbb8-8880-4f5a-a7ff-206acace3c6a service nova] Creating event network-vif-plugged:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h2-858383-10 Oct 12 09:47:21.073586 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-01b8d02e-bb9c-49ac-9b00-702dcccffd43 req-61cbfbb8-8880-4f5a-a7ff-206acace3c6a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035715 Oct 12 09:47:21.074729 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3724/7018] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:47:21.428509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:21.429579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:21.439218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:21.439646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:21.440088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:21.440786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:21.441245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:21.441717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:21.569425 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:21.577400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b99cef7-32f5-4cae-ade5-736454b641da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1363 microversion: 2.1 time: 0.155505 Oct 12 09:47:21.577981 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3295/7019] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:21 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:22.606777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:22.607564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:22.615133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:22.615632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:22.616093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:22.616788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:22.617259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:22.617751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:22.751094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:47:22.759139 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb316961-cd3e-4dfa-b2d0-db74d00cd5cb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1549 microversion: 2.1 time: 0.156750 Oct 12 09:47:22.759708 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3725/7020] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:47:22 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:47:22.782459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:47:22.783004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:47:22.790093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:22.790576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:22.791009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:22.791700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:22.792150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:22.792571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:22.876909 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a81306fc-9bd8-45ac-837c-e4cd0030368b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098035 Oct 12 09:47:22.877761 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3296/7021] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:47:22 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:47:23.833840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cad3ebc2-adee-4e64-adec-5a0ad9789d4d req-28d45367-3891-4c12-9d8a-0f574a01726c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:47:23.838864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:47:23.846969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cad3ebc2-adee-4e64-adec-5a0ad9789d4d req-28d45367-3891-4c12-9d8a-0f574a01726c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:47:23.847471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cad3ebc2-adee-4e64-adec-5a0ad9789d4d req-28d45367-3891-4c12-9d8a-0f574a01726c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:47:23.847943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cad3ebc2-adee-4e64-adec-5a0ad9789d4d req-28d45367-3891-4c12-9d8a-0f574a01726c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:47:23.859598 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cad3ebc2-adee-4e64-adec-5a0ad9789d4d req-28d45367-3891-4c12-9d8a-0f574a01726c service nova] Creating event network-changed:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h2-858383-10 Oct 12 09:47:23.864630 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cad3ebc2-adee-4e64-adec-5a0ad9789d4d req-28d45367-3891-4c12-9d8a-0f574a01726c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034575 Oct 12 09:47:23.865429 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3726/7022] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:01.973621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:01.974804 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:01.978494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:01.979741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:01.987054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:01.990279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:01.999464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:02.000145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:02.000717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:02.001419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:02.001923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:02.002347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:02.032059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:02.038225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Old instance type m1.heat2, new instance type m1.heat {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:48:02.045315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:48:02.045777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:48:02.046259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:48:02.046672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:48:02.047092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:48:02.112904 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-08fedfe8-0ad4-4482-9e99-e85b21d3d8ee tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415/action" status: 202 len: 0 microversion: 2.1 time: 0.140734 Oct 12 09:48:02.113530 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3297/7023] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:48:01 2022] POST /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:48:02.120506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=21 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:02.121694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:02.126328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:02.127047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:02.134540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:02.135033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:02.135509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:02.136214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:02.136670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:02.137110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:02.341926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:02.351839 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d2ffc59-dcd5-49ee-b9cd-76209d3380b1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1677 microversion: 2.1 time: 0.233646 Oct 12 09:48:02.352434 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3727/7024] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:02 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:03.376347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:03.376936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:03.384133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:03.384612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:03.385052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:03.385766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:03.386221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:03.386646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:03.579263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:03.587575 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-14112954-17be-4f4d-b706-d1e2e9fc20ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1677 microversion: 2.1 time: 0.216524 Oct 12 09:48:03.588167 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3298/7025] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:03 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:04.614296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:04.615111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:04.625498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:04.626174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:04.626769 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:04.627706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:04.628334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:04.628927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:04.791072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:04.802348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1dbc870a-6653-4087-890c-1c6c34507965 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.193306 Oct 12 09:48:04.802915 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3728/7026] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:04 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:05.826455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:05.827148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:05.834202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:05.834744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:05.835194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:05.835901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:05.836360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:05.836776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:05.975593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:05.983565 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a391318-36f3-4434-b97f-c9d61008e757 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.161420 Oct 12 09:48:05.984173 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3299/7027] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:05 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:07.009097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:07.009906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:07.019466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:07.020066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:07.020576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:07.021384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:07.021936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:07.022419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:07.156829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:07.165021 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e0e1aa9b-754a-4bf8-b995-bd9fb5261461 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.161223 Oct 12 09:48:07.165624 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3729/7028] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:07 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:08.198186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:08.199043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:08.210670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:08.211490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:08.212225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:08.213383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:08.214187 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:08.214915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:08.351182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:08.362804 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4e997c0b-6f57-4ae6-9047-bfb281ebc48b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.171500 Oct 12 09:48:08.363559 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3300/7029] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:08 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:09.392045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:09.392960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:09.402445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:09.402952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:09.403399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:09.404110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:09.404576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:09.405016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:09.538822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:09.546845 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8b43ba1a-714a-4dbc-b0e7-4e42bc570a98 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.161542 Oct 12 09:48:09.547399 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3730/7030] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:09 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:10.573257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:10.574007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:10.582430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:10.583006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:10.583556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:10.584340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:10.584903 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:10.585467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:10.732664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:10.741041 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-de460bbb-012d-4eb2-96ce-3f1a756236ec tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.173231 Oct 12 09:48:10.741729 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3301/7031] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:10 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:11.769094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:11.770016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:11.780452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:11.781334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:11.782129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:11.783306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:11.784097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:11.784808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:11.918922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:11.927253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0c3087cc-2b40-4f62-b2c9-5917f646c1b6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.165175 Oct 12 09:48:11.927833 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3731/7032] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:11 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:12.955271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:12.956282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:12.965421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:12.965953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:12.966408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:12.967104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:12.967574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:12.968003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:13.103587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:13.111962 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9d5eebd-6a1e-4012-9973-6234c4417100 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.163690 Oct 12 09:48:13.112524 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3302/7033] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:12 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:14.140489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:14.141334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:14.153165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:14.154004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:14.154823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:14.155983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:14.156751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:14.157529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:14.303107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:14.315177 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8ff54b07-4132-4512-aa6b-b2c38adb8842 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.181042 Oct 12 09:48:14.315959 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3732/7034] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:14 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:15.344277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:15.345308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:15.357200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:15.358027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:15.358763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:15.359915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:15.360699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:15.361411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:15.503750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:15.513376 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d60a2c55-14d7-423f-b7e8-22bd556e6a8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.175735 Oct 12 09:48:15.514019 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3303/7035] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:15 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:16.537334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:16.538009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:16.545471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:16.546033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:16.546491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:16.547201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:16.547676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:16.548120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:16.681807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:16.689904 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1ae65b66-b154-4bbf-8c7c-e37202a77c2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.156554 Oct 12 09:48:16.690489 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3733/7036] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:16 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:17.712915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:17.714206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:17.721890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:17.722384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:17.722816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:17.723509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:17.723959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:17.724392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:17.857846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:17.866702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d066eff-b750-4cc6-8941-970343249ceb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.158160 Oct 12 09:48:17.867279 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3304/7037] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:17 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:18.891021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:18.891647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:18.901342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:18.901915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:18.902372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:18.903100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:18.903572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:18.904015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:19.040897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:19.057587 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3293de00-1682-427b-baf9-23fd557ee618 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.170637 Oct 12 09:48:19.058191 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3734/7038] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:18 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:20.085833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:20.086812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:20.098676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:20.099476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:20.100201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:20.101344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:20.102150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:20.102852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:20.243411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:20.252160 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-22204617-9129-45b4-b28a-b8ae9f7546ca tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.173033 Oct 12 09:48:20.252757 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3305/7039] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:20 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:21.275926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:21.276304 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:21.283271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:21.283770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:21.284215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:21.284918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:21.285487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:21.285910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:21.431410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:21.439925 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-86baae74-8806-4862-88ed-32da77bb630a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1682 microversion: 2.1 time: 0.168133 Oct 12 09:48:21.440349 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3735/7040] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:21 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:22.283514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-567193b9-10e2-4a0f-8959-43b72e1819f5 req-9f5eb957-20f1-4b64-b302-18404e643047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "name": "network-vif-unplugged", "status": "completed", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:22.293855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-567193b9-10e2-4a0f-8959-43b72e1819f5 req-9f5eb957-20f1-4b64-b302-18404e643047 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:22.294330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-567193b9-10e2-4a0f-8959-43b72e1819f5 req-9f5eb957-20f1-4b64-b302-18404e643047 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:22.294765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-567193b9-10e2-4a0f-8959-43b72e1819f5 req-9f5eb957-20f1-4b64-b302-18404e643047 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:22.307284 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-567193b9-10e2-4a0f-8959-43b72e1819f5 req-9f5eb957-20f1-4b64-b302-18404e643047 service nova] Creating event network-vif-unplugged:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h1-858383-10 Oct 12 09:48:22.312820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-567193b9-10e2-4a0f-8959-43b72e1819f5 req-9f5eb957-20f1-4b64-b302-18404e643047 service nova] Instance 4f988057-e591-4e0d-a037-4632ee978415 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:48:22.324413 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-567193b9-10e2-4a0f-8959-43b72e1819f5 req-9f5eb957-20f1-4b64-b302-18404e643047 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104692 Oct 12 09:48:22.325127 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3306/7041] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:22.464317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:22.464965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:22.472125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:22.472631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:22.473087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:22.473830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:22.474393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:22.474836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:22.609088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:22.617294 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b69d996b-d095-44fe-a84b-266d9fec546c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1681 microversion: 2.1 time: 0.157065 Oct 12 09:48:22.617903 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3736/7042] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:22 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:23.649272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:23.650633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:23.666945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:23.667919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:23.668633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:23.669776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:23.670478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:23.671124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:23.818065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:23.828193 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7bb3e13d-5c02-4418-b1b7-a9bddced8b8a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1679 microversion: 2.1 time: 0.187904 Oct 12 09:48:23.828729 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3307/7043] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:23 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:24.344222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-25230581-b73a-4ade-a443-4365eef09065 req-e08c99a3-3367-4344-8583-7fe60f8486cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:24.355009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-25230581-b73a-4ade-a443-4365eef09065 req-e08c99a3-3367-4344-8583-7fe60f8486cb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:24.355503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-25230581-b73a-4ade-a443-4365eef09065 req-e08c99a3-3367-4344-8583-7fe60f8486cb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:24.355952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-25230581-b73a-4ade-a443-4365eef09065 req-e08c99a3-3367-4344-8583-7fe60f8486cb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:24.367852 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-25230581-b73a-4ade-a443-4365eef09065 req-e08c99a3-3367-4344-8583-7fe60f8486cb service nova] Creating event network-changed:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h1-858383-10 Oct 12 09:48:24.374794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-25230581-b73a-4ade-a443-4365eef09065 req-e08c99a3-3367-4344-8583-7fe60f8486cb service nova] Instance 4f988057-e591-4e0d-a037-4632ee978415 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:48:24.387584 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-25230581-b73a-4ade-a443-4365eef09065 req-e08c99a3-3367-4344-8583-7fe60f8486cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047136 Oct 12 09:48:24.388156 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3737/7044] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:24.852671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:24.853283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:24.865276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:24.870852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:24.871353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:24.872948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:24.873415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:24.874087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:25.105000 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:25.113797 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94a25ba6-3556-4e5b-a895-e509ef6e2ed0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1679 microversion: 2.1 time: 0.265501 Oct 12 09:48:25.114480 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3308/7045] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:24 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1679 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:26.144134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:26.145152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:26.155684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:26.156501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:26.157243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:26.158439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:26.159220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:26.159943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:26.296635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:26.305094 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec040bbf-eb63-4c8c-bcd9-bd63dcda93f5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1676 microversion: 2.1 time: 0.169708 Oct 12 09:48:26.305712 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3738/7046] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:26 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:26.327951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:26.328526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:26.335833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:26.336320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:26.336737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:26.337490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:26.337949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:26.338385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:26.376710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:26.377167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:26.377684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:26.378412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:26.378867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:26.379297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:26.400134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:48:26.405772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for user f18227827d83493f83795e243ec1e476 and project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:48:26.490220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:26.518120 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-880fa731-651a-4d1c-9094-d5263c1f9539 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415/action" status: 202 len: 0 microversion: 2.1 time: 0.193142 Oct 12 09:48:26.518919 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3309/7047] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:48:26 2022] POST /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:48:26.527342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:26.528022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:26.535709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:26.536388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:26.536861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:26.537715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:26.538285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:26.538794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:26.677699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:26.686502 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7ee0b1c2-ae10-4e40-95b0-ebf86320ec73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1675 microversion: 2.1 time: 0.163131 Oct 12 09:48:26.687085 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3739/7048] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:26 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:27.043782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-7e1ef7b6-8a7f-4362-9183-91251793568a req-90634361-57a5-438d-a417-109d171fd6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "name": "network-vif-plugged", "status": "completed", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:27.053759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7e1ef7b6-8a7f-4362-9183-91251793568a req-90634361-57a5-438d-a417-109d171fd6a2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:27.054251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7e1ef7b6-8a7f-4362-9183-91251793568a req-90634361-57a5-438d-a417-109d171fd6a2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:27.054698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7e1ef7b6-8a7f-4362-9183-91251793568a req-90634361-57a5-438d-a417-109d171fd6a2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:27.067659 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7e1ef7b6-8a7f-4362-9183-91251793568a req-90634361-57a5-438d-a417-109d171fd6a2 service nova] Creating event network-vif-plugged:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h1-858383-10 Oct 12 09:48:27.073054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-7e1ef7b6-8a7f-4362-9183-91251793568a req-90634361-57a5-438d-a417-109d171fd6a2 service nova] Instance 4f988057-e591-4e0d-a037-4632ee978415 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:48:27.083986 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-7e1ef7b6-8a7f-4362-9183-91251793568a req-90634361-57a5-438d-a417-109d171fd6a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114002 Oct 12 09:48:27.084608 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3310/7049] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:27.713351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:27.714479 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:27.725981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:27.726802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:27.727557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:27.728715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:27.729535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:27.730379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:27.863649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:27.872235 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06acb66a-455e-4b8f-a846-0be567c3188f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1675 microversion: 2.1 time: 0.165242 Oct 12 09:48:27.872809 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3740/7050] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:27 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:28.899965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:28.901018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:28.911561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:28.912327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:28.912888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:28.913973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:28.914539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:28.915101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:29.053461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:29.061568 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8b2a0eae-f526-4035-a4f9-9394034559df tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1675 microversion: 2.1 time: 0.168286 Oct 12 09:48:29.062154 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3311/7051] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:28 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:29.862996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6999b40f-d953-4d06-a0a6-b35f323a008c req-ff4aca7e-b51e-41d7-939d-4ee3c0448b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "name": "network-vif-unplugged", "status": "completed", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:29.874558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6999b40f-d953-4d06-a0a6-b35f323a008c req-ff4aca7e-b51e-41d7-939d-4ee3c0448b59 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:29.875108 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6999b40f-d953-4d06-a0a6-b35f323a008c req-ff4aca7e-b51e-41d7-939d-4ee3c0448b59 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:29.875525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6999b40f-d953-4d06-a0a6-b35f323a008c req-ff4aca7e-b51e-41d7-939d-4ee3c0448b59 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:29.887849 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6999b40f-d953-4d06-a0a6-b35f323a008c req-ff4aca7e-b51e-41d7-939d-4ee3c0448b59 service nova] Creating event network-vif-unplugged:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h2-858383-10 Oct 12 09:48:29.893335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-6999b40f-d953-4d06-a0a6-b35f323a008c req-ff4aca7e-b51e-41d7-939d-4ee3c0448b59 service nova] Instance 4f988057-e591-4e0d-a037-4632ee978415 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:48:29.904762 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6999b40f-d953-4d06-a0a6-b35f323a008c req-ff4aca7e-b51e-41d7-939d-4ee3c0448b59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045522 Oct 12 09:48:29.905555 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3741/7052] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:30.085854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:30.086586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:30.094033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:30.094501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:30.094956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:30.095660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:30.096134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:30.096560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:30.230550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:30.238169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a09c4675-190a-47d9-88e6-ba7487f896d2 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1675 microversion: 2.1 time: 0.156366 Oct 12 09:48:30.238769 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3312/7053] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:30 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:31.268271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:31.269414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:31.280104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:31.280946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:31.281780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:31.282961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:31.283743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:31.284514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:31.431648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:31.439990 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6065cd0d-f2fe-4d4f-bdc3-45aab0483265 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1675 microversion: 2.1 time: 0.180322 Oct 12 09:48:31.440554 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3742/7054] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:31 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:31.920779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d8aa490e-fa3c-46c1-b2c9-e2ba066558ce req-9b7e1316-b2cf-4ea3-b3ed-82fa84b4b720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:31.931087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8aa490e-fa3c-46c1-b2c9-e2ba066558ce req-9b7e1316-b2cf-4ea3-b3ed-82fa84b4b720 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:31.931569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8aa490e-fa3c-46c1-b2c9-e2ba066558ce req-9b7e1316-b2cf-4ea3-b3ed-82fa84b4b720 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:31.932003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d8aa490e-fa3c-46c1-b2c9-e2ba066558ce req-9b7e1316-b2cf-4ea3-b3ed-82fa84b4b720 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:31.944106 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d8aa490e-fa3c-46c1-b2c9-e2ba066558ce req-9b7e1316-b2cf-4ea3-b3ed-82fa84b4b720 service nova] Creating event network-changed:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h2-858383-10 Oct 12 09:48:31.950134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-d8aa490e-fa3c-46c1-b2c9-e2ba066558ce req-9b7e1316-b2cf-4ea3-b3ed-82fa84b4b720 service nova] Instance 4f988057-e591-4e0d-a037-4632ee978415 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:48:31.961423 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d8aa490e-fa3c-46c1-b2c9-e2ba066558ce req-9b7e1316-b2cf-4ea3-b3ed-82fa84b4b720 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044513 Oct 12 09:48:31.962056 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3313/7055] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:32.464204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:32.465596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:32.468536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=33 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:32.473904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:32.474473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:32.477383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:32.478239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:32.478771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:32.479557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:32.483866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=93 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:32.677522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:32.686581 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d3d45604-e613-4b2f-89bf-f60e41fd7895 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1675 microversion: 2.1 time: 0.226203 Oct 12 09:48:32.687251 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3743/7056] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:32 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:33.717018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:33.717836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:33.720997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:33.725097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:33.725694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:33.726138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:33.726846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:33.727305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:33.727780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:33.859494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:33.867738 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bf88cbb6-521c-4cfb-b54a-7761b68196cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1668 microversion: 2.1 time: 0.159483 Oct 12 09:48:33.868319 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3314/7057] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:33 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:33.890647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:33.891275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:33.898579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:33.899079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:33.899537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:33.900247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:33.900718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:33.901160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:34.039948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:34.051177 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1d42051f-d7f1-4a42-aaa8-31d0fd953b8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1668 microversion: 2.1 time: 0.164095 Oct 12 09:48:34.051840 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3744/7058] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:33 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:34.076041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:34.076658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:34.083182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:34.083672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:34.084114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:34.084811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:34.085268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:34.085740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:34.226872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:34.235096 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3f58af73-ccdc-4fd0-bd4d-6d3058d2f0f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1668 microversion: 2.1 time: 0.163056 Oct 12 09:48:34.235719 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3315/7059] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:34 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:34.257925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:34.258460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:34.264611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:34.265113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:34.265601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:34.266314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:34.266744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:34.267181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:34.291977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:48:34.375303 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f622f219-2eeb-4efc-a318-5ae442c4e6f8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 204 len: 0 microversion: 2.1 time: 0.120920 Oct 12 09:48:34.375916 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3745/7060] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:48:34 2022] DELETE /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:48:34.384543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:34.385197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:34.391310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:34.391789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:34.392228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:34.392928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:34.393383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:34.393837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:34.539470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:34.548178 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-09d361f6-cf4c-453e-b1a4-6541bcdadf09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1674 microversion: 2.1 time: 0.167581 Oct 12 09:48:34.548794 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3316/7061] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:34 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:35.469355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0c2115e9-5f52-494d-b09e-155683394caf req-bc652fe1-e5e3-442c-96df-9bd8af5a6cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "name": "network-vif-plugged", "status": "completed", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:35.483903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0c2115e9-5f52-494d-b09e-155683394caf req-bc652fe1-e5e3-442c-96df-9bd8af5a6cf8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:35.484421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0c2115e9-5f52-494d-b09e-155683394caf req-bc652fe1-e5e3-442c-96df-9bd8af5a6cf8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:35.484856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0c2115e9-5f52-494d-b09e-155683394caf req-bc652fe1-e5e3-442c-96df-9bd8af5a6cf8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:35.495964 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0c2115e9-5f52-494d-b09e-155683394caf req-bc652fe1-e5e3-442c-96df-9bd8af5a6cf8 service nova] Creating event network-vif-plugged:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h2-858383-10 Oct 12 09:48:35.501298 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0c2115e9-5f52-494d-b09e-155683394caf req-bc652fe1-e5e3-442c-96df-9bd8af5a6cf8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036246 Oct 12 09:48:35.501962 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3746/7062] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:35.572360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:35.573097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:35.580103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:35.580592 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:35.581054 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:35.581778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:35.582253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:35.582810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:35.726670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:35.734801 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-41dd5694-29a6-48d4-8a48-f1c6a7dfce8f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1674 microversion: 2.1 time: 0.166546 Oct 12 09:48:35.735391 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3317/7063] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:35 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:36.759154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:36.759880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:36.761744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:36.768012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:36.768483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:36.769202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:36.770527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:36.774786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:36.775306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:36.852201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-3d4e6a5a-55b0-4152-8533-489b6376bb76 req-67687ee1-89e4-4910-91f8-b32405be5281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f988057-e591-4e0d-a037-4632ee978415", "name": "network-vif-deleted", "tag": "72aa6bb0-82f7-4c84-93a4-f19bedefe6f4"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:36.870075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d4e6a5a-55b0-4152-8533-489b6376bb76 req-67687ee1-89e4-4910-91f8-b32405be5281 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:36.870583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d4e6a5a-55b0-4152-8533-489b6376bb76 req-67687ee1-89e4-4910-91f8-b32405be5281 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:36.871037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-3d4e6a5a-55b0-4152-8533-489b6376bb76 req-67687ee1-89e4-4910-91f8-b32405be5281 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:36.888680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:36.899355 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-769d955d-8472-47d3-9381-c610641a0e1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 200 len: 1323 microversion: 2.1 time: 0.144254 Oct 12 09:48:36.900562 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3318/7064] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:36 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 1323 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:37.169973 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-3d4e6a5a-55b0-4152-8533-489b6376bb76 req-67687ee1-89e4-4910-91f8-b32405be5281 service nova] Creating event network-vif-deleted:72aa6bb0-82f7-4c84-93a4-f19bedefe6f4 for instance 4f988057-e591-4e0d-a037-4632ee978415 on n-h2-858383-10 Oct 12 09:48:37.174891 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-3d4e6a5a-55b0-4152-8533-489b6376bb76 req-67687ee1-89e4-4910-91f8-b32405be5281 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.465321 Oct 12 09:48:37.175766 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3747/7065] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:37.923654 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:37.924274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:37.931651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:37.932100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:37.932575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:37.933280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:37.933774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:37.934206 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:37.947970 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 HTTP/1.1 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '4f988057-e591-4e0d-a037-4632ee978415'} Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:48:37.949727 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c502ee2-5f80-415c-8840-3e2fb78d2197 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 404 len: 111 microversion: 2.1 time: 0.031623 Oct 12 09:48:37.954748 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3319/7066] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:37 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:48:37.970534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:37.971277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:37.977685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:37.978189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:37.978622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:37.979327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:37.979791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:37.980550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:37.993985 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 HTTP/1.1 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '4f988057-e591-4e0d-a037-4632ee978415'} Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:48:37.995619 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3880040a-a937-449f-a6bf-0128a9e6b16c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 404 len: 111 microversion: 2.1 time: 0.032031 Oct 12 09:48:38.005702 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3748/7067] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:37 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:48:38.047921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-526271653", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "008b7335-c5f1-497c-ab20-664960622707"}], "security_groups": [{"name": "tempest-securitygroup--805998850"}], "key_name": "tempest-keypair-1126700783", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:38.159746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] validate_networks() for [('008b7335-c5f1-497c-ab20-664960622707', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:48:38.545865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:48:38.546468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:48:38.546969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:48:38.547471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:48:38.548015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:48:38.558642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:38.559139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:38.559623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:38.560359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:38.560822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:38.561257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:38.578546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:48:38.584287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for user f18227827d83493f83795e243ec1e476 and project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:48:38.597529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:48:38.599888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:48:38.650176 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ceda6791-8a5d-4779-837f-9c2588a844d7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.606187 Oct 12 09:48:38.651054 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3320/7068] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:48:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:48:38.662502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eabb0ae6-fdd0-4574-b2a9-09d7d5851d31 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:38.663484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eabb0ae6-fdd0-4574-b2a9-09d7d5851d31 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:38.723385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eabb0ae6-fdd0-4574-b2a9-09d7d5851d31 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:38.731511 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eabb0ae6-fdd0-4574-b2a9-09d7d5851d31 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1238 microversion: 2.1 time: 0.073002 Oct 12 09:48:38.732132 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3749/7069] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:38 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:39.756391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:39.757013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:39.764306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:39.764810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:39.765249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:39.766006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:39.766439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:39.766864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:39.831580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:39.845400 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45ec4ce4-dff1-4a64-b6da-07f68d6a8569 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1290 microversion: 2.1 time: 0.093736 Oct 12 09:48:39.846358 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3321/7070] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:39 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:40.870735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:40.871836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:40.878976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:40.880372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:40.880837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:40.881600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:40.882045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:40.882666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:41.101090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:41.109430 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9b9d23da-db70-46b6-b4c9-89baf4f87841 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1363 microversion: 2.1 time: 0.242771 Oct 12 09:48:41.110226 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3750/7071] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:40 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:41.660253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9c2c02b3-d0b4-43d6-b741-067a6e31974a req-e77beaa5-8fd0-4510-93b6-ca3ea8d44fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:41.672961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9c2c02b3-d0b4-43d6-b741-067a6e31974a req-e77beaa5-8fd0-4510-93b6-ca3ea8d44fb5 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:41.673315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9c2c02b3-d0b4-43d6-b741-067a6e31974a req-e77beaa5-8fd0-4510-93b6-ca3ea8d44fb5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:41.673798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9c2c02b3-d0b4-43d6-b741-067a6e31974a req-e77beaa5-8fd0-4510-93b6-ca3ea8d44fb5 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:41.686058 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9c2c02b3-d0b4-43d6-b741-067a6e31974a req-e77beaa5-8fd0-4510-93b6-ca3ea8d44fb5 service nova] Creating event network-changed:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h2-858383-10 Oct 12 09:48:41.691629 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9c2c02b3-d0b4-43d6-b741-067a6e31974a req-e77beaa5-8fd0-4510-93b6-ca3ea8d44fb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035007 Oct 12 09:48:41.692612 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3322/7072] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:42.134786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:42.135409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:42.142342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:42.142837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:42.143286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:42.143995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:42.144495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:42.144928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:42.276301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:42.284502 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c8b150e-f8d9-43bb-8b00-b9e4d92202d8 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1363 microversion: 2.1 time: 0.154341 Oct 12 09:48:42.285064 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3751/7073] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:42 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:43.309840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:43.310564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:43.317237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:43.317816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:43.318252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:43.318949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:43.319403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:43.320475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:43.459002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:43.467766 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b755e9b7-33ba-4312-be23-713d1e9f9958 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1363 microversion: 2.1 time: 0.163227 Oct 12 09:48:43.468691 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3323/7074] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:43 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:44.498280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:44.499298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:44.506839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:44.507352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:44.507809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:44.508535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:44.509008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:44.509475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:44.643182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:44.655017 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a3786b9-3bd9-441c-a3e3-0ca7bc0b672b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1363 microversion: 2.1 time: 0.163770 Oct 12 09:48:44.655828 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3752/7075] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:44 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:45.553033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-dc93c5bb-b6dd-4386-a313-e1993c49d991 req-58031762-4e12-4bc9-a165-f1fb03df2457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "name": "network-vif-plugged", "status": "completed", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:45.564139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dc93c5bb-b6dd-4386-a313-e1993c49d991 req-58031762-4e12-4bc9-a165-f1fb03df2457 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:45.564642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dc93c5bb-b6dd-4386-a313-e1993c49d991 req-58031762-4e12-4bc9-a165-f1fb03df2457 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:45.565295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-dc93c5bb-b6dd-4386-a313-e1993c49d991 req-58031762-4e12-4bc9-a165-f1fb03df2457 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:45.578519 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-dc93c5bb-b6dd-4386-a313-e1993c49d991 req-58031762-4e12-4bc9-a165-f1fb03df2457 service nova] Creating event network-vif-plugged:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h2-858383-10 Oct 12 09:48:45.583334 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-dc93c5bb-b6dd-4386-a313-e1993c49d991 req-58031762-4e12-4bc9-a165-f1fb03df2457 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034203 Oct 12 09:48:45.583946 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3324/7076] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:45.678287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:45.678859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:45.686285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:45.686796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:45.687283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:45.688006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:45.688460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:45.688922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:45.841525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:45.849777 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-83fa6605-0618-41fd-8cc1-4dd44c94ae6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1363 microversion: 2.1 time: 0.175544 Oct 12 09:48:45.850354 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3753/7077] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:45 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:46.874293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:46.874991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:46.881666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:46.882163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:46.882580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:46.883334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:46.883882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:46.884317 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:47.021193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:47.029097 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dfbace56-99b6-4dcc-b779-a768ccb84e30 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1363 microversion: 2.1 time: 0.160402 Oct 12 09:48:47.029711 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3325/7078] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:46 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:48.054554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:48.055095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:48.062751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:48.063260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:48.063718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:48.064433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:48.064905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:48.065328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:48.201315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:48:48.209634 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-724f9b77-0629-4e9e-84a6-db6b0320d2e6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1550 microversion: 2.1 time: 0.159198 Oct 12 09:48:48.210204 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3754/7079] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:48:48 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:48:48.233369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:48:48.233925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:48:48.241027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:48.241543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:48.241979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:48.242678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:48.243132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:48.243554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:48.322578 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dffd32ba-3d5e-485c-b1de-63620a90a072 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093384 Oct 12 09:48:48.323199 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3326/7080] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:48:48 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:48:49.582198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-fd2bf410-99c7-4e9b-8671-abeb815a1798 req-ff936cac-f46c-4dc8-9b05-9ae6accaa9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:48:49.587269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:48:49.594254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fd2bf410-99c7-4e9b-8671-abeb815a1798 req-ff936cac-f46c-4dc8-9b05-9ae6accaa9da service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:48:49.594756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fd2bf410-99c7-4e9b-8671-abeb815a1798 req-ff936cac-f46c-4dc8-9b05-9ae6accaa9da service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:48:49.595205 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-fd2bf410-99c7-4e9b-8671-abeb815a1798 req-ff936cac-f46c-4dc8-9b05-9ae6accaa9da service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:48:49.606978 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-fd2bf410-99c7-4e9b-8671-abeb815a1798 req-ff936cac-f46c-4dc8-9b05-9ae6accaa9da service nova] Creating event network-changed:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h2-858383-10 Oct 12 09:48:49.612444 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-fd2bf410-99c7-4e9b-8671-abeb815a1798 req-ff936cac-f46c-4dc8-9b05-9ae6accaa9da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033969 Oct 12 09:48:49.613094 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3755/7081] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:49:24.094893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:24.095699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:24.099447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:24.100190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:24.104942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:24.105625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:24.114444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:24.114960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:24.115421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:24.116198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:24.116649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:24.117067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:24.256198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:24.264239 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-acbe6851-08f3-4798-84ea-fb5c4d328a09 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1669 microversion: 2.1 time: 0.170233 Oct 12 09:49:24.265018 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3327/7082] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:24 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:24.285270 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:49:24.285818 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/os-volume_attachments (ip 10.222.0.40) !!! Oct 12 09:49:24.286930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:24.287929 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:24.292385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "486e2e48-daf1-4a19-a46e-aef5644b1683"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:49:24.294900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:24.304047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:24.304681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:24.305147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:24.305887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:24.306360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:24.306800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:24.559318 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fab8d782-786d-46c1-8732-9e18e176005f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275681 Oct 12 09:49:24.560142 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3756/7083] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:49:24 2022] POST /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:49:35.529161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:49:35.531490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:35.533912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:35.534564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:35.540854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:35.541356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:35.541830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:35.542524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:35.542980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:35.543411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:35.572604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:35.578156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Old instance type m1.heat2, new instance type m1.heat {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 09:49:35.585577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:49:35.586026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:49:35.586501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:49:35.586908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:49:35.587319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:49:35.655158 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aef1a522-1a94-4040-b204-7092f14a89e1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/action" status: 202 len: 0 microversion: 2.1 time: 0.130017 Oct 12 09:49:35.655781 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3328/7084] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:49:35 2022] POST /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:49:35.662351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:35.663263 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:49:35.667447 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:35.668689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:35.675833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:35.676269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:35.676723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:35.677464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:35.677946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:35.678376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:35.850107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:35.859335 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad735ed9-6558-4fb1-8594-0d2fe53532d0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1724 microversion: 2.1 time: 0.198848 Oct 12 09:49:35.872250 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3757/7085] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:35 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:36.884415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:36.885025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:36.892773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:36.893267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:36.893747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:36.894448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:36.894906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:36.895709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:37.038070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:37.047572 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-88924ac3-1723-4a00-92d1-d849c1821f1f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1724 microversion: 2.1 time: 0.168069 Oct 12 09:49:37.048625 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3329/7086] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:36 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:38.076406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:38.077504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:38.089194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:38.090087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:38.090842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:38.092019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:38.092807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:38.093596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:38.236412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:38.249246 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-22b141e9-098a-4149-b81b-0e6446245df9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.179244 Oct 12 09:49:38.249957 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3758/7087] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:38 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:39.278082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:39.279148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:39.290967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:39.291772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:39.292508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:39.293706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:39.294458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:39.295168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:39.437171 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:39.446206 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1bdfa141-2f14-43c0-9085-42396e98b1ba tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.174958 Oct 12 09:49:39.446756 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3330/7088] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:39 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:40.474286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:40.475257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:40.487529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:40.488491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:40.489308 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:40.490537 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:40.491410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:40.492159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:40.633886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:40.646945 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9061ed7c-3627-4cfc-a0f5-6125209b1ecd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.179304 Oct 12 09:49:40.647717 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3759/7089] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:40 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:41.676981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:41.679276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:41.688341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:41.688878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:41.689403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:41.690202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:41.690704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:41.691197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:41.830490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:41.838962 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-51517c9c-ad2c-4803-b08e-c43a0e71bd2b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.167225 Oct 12 09:49:41.839573 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3331/7090] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:41 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:42.866938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:42.867975 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:42.878378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:42.878854 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:42.879326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:42.880035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:42.880501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:42.880943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:43.021027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:43.033537 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-afda1ca3-852a-4489-a9ae-a330747c85db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.173314 Oct 12 09:49:43.034351 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3760/7091] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:42 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:44.066267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:44.067027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:44.076004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:44.076609 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:44.077164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:44.078090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:44.078672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:44.079215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:44.225183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:44.237818 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-99311993-593c-4ea8-9fdd-58023f9f0736 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.177330 Oct 12 09:49:44.238617 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3332/7092] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:44 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:45.271001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:45.272041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:45.283571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:45.284418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:45.285223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:45.286440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:45.287251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:45.287974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:45.429830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:45.441344 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ac5b6d3b-553c-4895-a2b1-974b7ac2fd54 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.176856 Oct 12 09:49:45.442247 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3761/7093] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:45 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:46.476414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:46.477354 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:46.488245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:46.488983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:46.489681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:46.491014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:46.491502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:46.492154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:46.632658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:46.644502 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c002e218-837c-473c-b789-a069ddab6c26 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.173936 Oct 12 09:49:46.645063 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3333/7094] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:46 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:47.669015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:47.669781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:47.677807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:47.678319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:47.678777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:47.679494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:47.679964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:47.680414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:47.825114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:47.837805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1ed6b545-9922-47d9-b9c5-1a4cab9999e3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.173410 Oct 12 09:49:47.838391 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3762/7095] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:47 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:48.866787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:48.867850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:48.879057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:48.879546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:48.879995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:48.880701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:48.881159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:48.881626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:49.024005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:49.032759 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9e524be-f87f-4190-856b-8bd169af1b88 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.172841 Oct 12 09:49:49.033348 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3334/7096] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:48 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:50.060624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:50.061743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:50.070672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:50.071199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:50.071657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:50.072385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:50.072852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:50.073298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:50.210548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:50.219429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68534e97-d1df-47af-9cf1-e7de2f5a8313 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.165571 Oct 12 09:49:50.219997 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3763/7097] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:50 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:51.248284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:51.249305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:51.261003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:51.261925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:51.262624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:51.263780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:51.264537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:51.265258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:51.410777 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:51.419357 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b9660536-9e31-4cd3-9bcf-febc2accf4bb tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.178336 Oct 12 09:49:51.419877 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3335/7098] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:51 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:52.448966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:52.449995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:52.461671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:52.462506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:52.463276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:52.464441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:52.465221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:52.465999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:52.597593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:52.606259 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c2cf34d6-7010-426c-9573-5eef97b00223 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.163877 Oct 12 09:49:52.606817 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3764/7099] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:52 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:53.635220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:53.636228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:53.646075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:53.646566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:53.647007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:53.647709 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:53.648170 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:53.648593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:53.780094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:53.789817 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9372d43e-2b29-4c60-a692-c8e1d0c9feed tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.161633 Oct 12 09:49:53.790399 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3336/7100] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:53 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:54.817816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:54.818592 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:54.828166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:54.828840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:54.829491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:54.830472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:54.831110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:54.831704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:54.971105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:54.983575 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-25b6eef0-332e-404e-a903-0040cfe0174f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.172130 Oct 12 09:49:54.984391 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3765/7101] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:54 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:56.010800 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:56.011658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:56.021806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:56.022413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:56.023045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:56.024046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:56.024753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:56.025379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:56.164547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:56.177858 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e11ad37c-886f-4bca-91d1-15de13368e73 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.172496 Oct 12 09:49:56.178679 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3337/7102] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:56 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:57.209467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:57.210370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:57.219879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:57.220558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:57.221163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:57.222150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:57.222788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:57.223388 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:57.375701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:57.384217 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3748e613-a4d4-4717-9fa4-4ab210dc05a0 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.180669 Oct 12 09:49:57.384921 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3766/7103] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:57 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:58.412122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:58.412825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:58.421460 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:58.422051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:58.422577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:58.423414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:58.423963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:58.424446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:58.572208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:58.584899 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2cc5aeae-f4d1-438f-81ca-8f1206a7b2a1 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.179268 Oct 12 09:49:58.585529 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3338/7104] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:58 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:49:59.612612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:49:59.613696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:49:59.621744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:59.622252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:59.622712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:59.623434 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:49:59.623907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:49:59.624350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:49:59.769395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:49:59.778520 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-be40afdf-608d-4f00-b422-7bd2ed475405 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.172443 Oct 12 09:49:59.779112 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3767/7105] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:49:59 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:00.802558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:00.803184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:00.810678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:00.811182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:00.811635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:00.812347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:00.812808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:00.813242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:00.949838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:00.958791 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6f74f2b6-b326-4793-a8ea-ef85b409cfa4 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.160354 Oct 12 09:50:00.959594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3339/7106] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:00 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:01.880287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4bfa9f21-e385-42d7-be3e-9ba3b4caabeb req-6e614cf0-45fc-4b26-a369-406ca0f1e89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "name": "network-vif-unplugged", "status": "completed", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:50:01.891539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4bfa9f21-e385-42d7-be3e-9ba3b4caabeb req-6e614cf0-45fc-4b26-a369-406ca0f1e89c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:01.892307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4bfa9f21-e385-42d7-be3e-9ba3b4caabeb req-6e614cf0-45fc-4b26-a369-406ca0f1e89c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:01.892805 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4bfa9f21-e385-42d7-be3e-9ba3b4caabeb req-6e614cf0-45fc-4b26-a369-406ca0f1e89c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:01.905661 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4bfa9f21-e385-42d7-be3e-9ba3b4caabeb req-6e614cf0-45fc-4b26-a369-406ca0f1e89c service nova] Creating event network-vif-unplugged:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h2-858383-10 Oct 12 09:50:01.911368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-4bfa9f21-e385-42d7-be3e-9ba3b4caabeb req-6e614cf0-45fc-4b26-a369-406ca0f1e89c service nova] Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:50:01.922811 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4bfa9f21-e385-42d7-be3e-9ba3b4caabeb req-6e614cf0-45fc-4b26-a369-406ca0f1e89c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046616 Oct 12 09:50:01.923463 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3768/7107] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:50:01.983695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:01.984422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:01.991110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:01.991684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:01.992233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:01.993110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:01.993607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:01.994385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:02.130830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:02.140511 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e3e1f44-265f-4ce9-883b-dca653b9ee1c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1729 microversion: 2.1 time: 0.161243 Oct 12 09:50:02.141099 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3340/7108] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:01 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:03.028161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-393d81a6-9ce7-4e19-b4a1-ef6929400191 req-8300828a-ff2e-4c26-9805-8c133e5cd065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:50:03.038354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-393d81a6-9ce7-4e19-b4a1-ef6929400191 req-8300828a-ff2e-4c26-9805-8c133e5cd065 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:03.038853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-393d81a6-9ce7-4e19-b4a1-ef6929400191 req-8300828a-ff2e-4c26-9805-8c133e5cd065 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:03.039312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-393d81a6-9ce7-4e19-b4a1-ef6929400191 req-8300828a-ff2e-4c26-9805-8c133e5cd065 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:03.051262 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-393d81a6-9ce7-4e19-b4a1-ef6929400191 req-8300828a-ff2e-4c26-9805-8c133e5cd065 service nova] Creating event network-changed:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h1-858383-10 Oct 12 09:50:03.056938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-393d81a6-9ce7-4e19-b4a1-ef6929400191 req-8300828a-ff2e-4c26-9805-8c133e5cd065 service nova] Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:50:03.068283 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-393d81a6-9ce7-4e19-b4a1-ef6929400191 req-8300828a-ff2e-4c26-9805-8c133e5cd065 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045161 Oct 12 09:50:03.068913 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3769/7109] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:50:03.164832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:03.165431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:03.173899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:03.174880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:03.175038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:03.175645 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:03.176597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:03.177192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:03.394195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:03.403687 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bf397343-c3c1-4b2d-9db9-1a912d8bc0b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1728 microversion: 2.1 time: 0.242249 Oct 12 09:50:03.404382 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3341/7110] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:03 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:04.430060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:04.430779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:04.437738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:04.438239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:04.438713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:04.439467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:04.439936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:04.440367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:04.576731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:04.585897 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e9e2dfa-c4ae-41ad-90ff-f67bd27edefa tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.161559 Oct 12 09:50:04.586525 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3770/7111] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:04 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:05.610646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:05.611216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:05.614046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=33 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:05.621480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:05.626892 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:05.628088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:05.628829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:05.629294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:05.629750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:05.632622 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:05.774427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:05.783805 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-af5bad22-6bd0-42a5-a737-daafa16fd69c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.177158 Oct 12 09:50:05.784399 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3342/7112] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:05 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:06.808460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:06.809090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:06.812044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=29 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:06.818322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:06.818832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:06.819289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:06.820018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:06.820487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:06.820931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:06.823620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=81 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:06.958811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:06.967778 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7e4441ae-5010-4eeb-86a8-73ae2f70c9dc tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.163429 Oct 12 09:50:06.981615 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3771/7113] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:06 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:07.992589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:07.994925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:08.002693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:08.003292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:08.003818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:08.004751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:08.005215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:08.005689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:08.138133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:08.147110 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-76d85a55-067b-420f-a20f-74caebef1d20 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.158742 Oct 12 09:50:08.155437 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3343/7114] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:07 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:09.175379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:09.176313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:09.184302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:09.184860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:09.185346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:09.186374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:09.186899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:09.187398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:09.321789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:09.330273 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c2292a78-1a24-41d6-b249-e7c7a2c2256c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.161892 Oct 12 09:50:09.330848 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3772/7115] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:09 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:10.358638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:10.359713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:10.371785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:10.372591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:10.373314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:10.374511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:10.375267 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:10.375987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:10.522110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:10.530823 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-36698996-cc5a-4172-ba47-feb400c11533 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.178855 Oct 12 09:50:10.531385 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3344/7116] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:10 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:11.558595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:11.559721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:11.570795 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:11.571636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:11.572389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:11.573611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:11.574395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:11.575130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:11.725269 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:11.734647 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7d74f2ca-36c0-4928-b153-73faa6ee65da tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.182722 Oct 12 09:50:11.735261 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3773/7117] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:11 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:12.763188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:12.764130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:12.774225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:12.774713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:12.775182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:12.775883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:12.776348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:12.776775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:12.914024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:12.926779 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c9edb3b-bca4-453e-b639-5f15b4e88324 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.169975 Oct 12 09:50:12.927553 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3345/7118] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:12 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:13.955344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:13.956009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:13.966700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:13.967243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:13.967887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:13.968966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:13.969618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:13.970224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:14.105365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:14.114408 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-940275cb-e4e7-4976-8e0c-0d987ae573d6 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.165534 Oct 12 09:50:14.115053 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3774/7119] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:13 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:15.142617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:15.143511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:15.152403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:15.152896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:15.153333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:15.154064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:15.154523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:15.154955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:15.287940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:15.296740 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-424ac00c-526f-45d5-876a-eab184267d46 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1726 microversion: 2.1 time: 0.160848 Oct 12 09:50:15.297372 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3346/7120] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:15 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:16.325997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:16.326998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:16.338654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:16.339476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:16.340230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:16.341404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:16.342242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:16.342979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:16.481309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:16.490255 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ad8fe12-f47c-4515-b427-8359a9abef3d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1723 microversion: 2.1 time: 0.171005 Oct 12 09:50:16.490848 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3775/7121] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:16 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:16.517638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:50:16.518253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:16.527492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:16.527975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:16.528417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:16.529111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:16.529602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:16.530037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:16.568670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:16.569180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:16.569696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:16.570427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:16.570914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:16.571340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:16.592382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:50:16.598080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Getting quotas for user f18227827d83493f83795e243ec1e476 and project a2177efa327a4db9be755b2ddb9510e6. Resources: {'ram', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:50:16.706541 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7ae6aac8-9de6-4d5f-a566-1927c59199db tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "POST /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/action" status: 202 len: 0 microversion: 2.1 time: 0.195248 Oct 12 09:50:16.707179 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3347/7122] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:50:16 2022] POST /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 09:50:16.716647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:16.717281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:16.723715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:16.724222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:16.724659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:16.725377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:16.725914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:16.726321 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:16.863771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:16.878081 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bab3e63f-846b-4111-8d50-1419586899d5 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.165883 Oct 12 09:50:16.878910 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3776/7123] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:16 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:50:17.415641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9358bcfb-72b9-488d-8fe0-c4954f0545ae req-707d7c42-8b93-44c4-af68-b525395d29a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "name": "network-vif-plugged", "status": "completed", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:50:17.428004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9358bcfb-72b9-488d-8fe0-c4954f0545ae req-707d7c42-8b93-44c4-af68-b525395d29a6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:17.428487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9358bcfb-72b9-488d-8fe0-c4954f0545ae req-707d7c42-8b93-44c4-af68-b525395d29a6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:17.428940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9358bcfb-72b9-488d-8fe0-c4954f0545ae req-707d7c42-8b93-44c4-af68-b525395d29a6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:17.441458 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9358bcfb-72b9-488d-8fe0-c4954f0545ae req-707d7c42-8b93-44c4-af68-b525395d29a6 service nova] Creating event network-vif-plugged:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h1-858383-10 Oct 12 09:50:17.446961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-9358bcfb-72b9-488d-8fe0-c4954f0545ae req-707d7c42-8b93-44c4-af68-b525395d29a6 service nova] Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:50:17.457935 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9358bcfb-72b9-488d-8fe0-c4954f0545ae req-707d7c42-8b93-44c4-af68-b525395d29a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054121 Oct 12 09:50:17.458546 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3348/7124] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:50:17.902302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:17.902914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:17.910393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:17.910906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:17.911366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:17.912083 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:17.912559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:17.913007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:18.053569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:18.062455 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-62efe6cc-e6bd-4e93-8e6a-286a24fa37cd tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.164157 Oct 12 09:50:18.063047 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3777/7125] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:17 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:19.088951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:19.090010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:19.097148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:19.097667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:19.098103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:19.098802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:19.099246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:19.099671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:19.237914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:19.246665 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aeb181ae-77c7-4572-8d1e-1448748ea146 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.163579 Oct 12 09:50:19.247261 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3349/7126] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:19 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:20.270296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:20.270934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:20.278127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:20.278661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:20.279103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:20.279848 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:20.280311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:20.280752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:20.416905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:20.425764 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-492493b1-63fa-435d-9311-83bb5102d6d3 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.159368 Oct 12 09:50:20.426334 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3778/7127] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:20 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:21.450342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:21.451116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:21.458365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:21.458852 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:21.459291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:21.459993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:21.460446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:21.460876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:21.604666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:21.613055 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2f06bf64-f2de-4b7a-9cae-ab2be77049b7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.166932 Oct 12 09:50:21.613648 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3350/7128] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:21 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:22.638958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:22.639786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:22.648779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:22.649405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:22.650034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:22.650890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:22.651477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:22.652027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:22.841368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:22.851233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3f82209-0117-45b5-b027-4df50c410016 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.217262 Oct 12 09:50:22.851835 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3779/7129] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:22 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:23.188823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2f924977-dc9f-4999-b41e-faa191dadb4d req-da59f6ac-c621-47ce-9a8c-e87d1bd338cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "name": "network-vif-unplugged", "status": "completed", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:50:23.200391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2f924977-dc9f-4999-b41e-faa191dadb4d req-da59f6ac-c621-47ce-9a8c-e87d1bd338cb service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:23.200950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2f924977-dc9f-4999-b41e-faa191dadb4d req-da59f6ac-c621-47ce-9a8c-e87d1bd338cb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:23.201390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2f924977-dc9f-4999-b41e-faa191dadb4d req-da59f6ac-c621-47ce-9a8c-e87d1bd338cb service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:23.214521 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2f924977-dc9f-4999-b41e-faa191dadb4d req-da59f6ac-c621-47ce-9a8c-e87d1bd338cb service nova] Creating event network-vif-unplugged:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h2-858383-10 Oct 12 09:50:23.220084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-2f924977-dc9f-4999-b41e-faa191dadb4d req-da59f6ac-c621-47ce-9a8c-e87d1bd338cb service nova] Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:50:23.231342 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2f924977-dc9f-4999-b41e-faa191dadb4d req-da59f6ac-c621-47ce-9a8c-e87d1bd338cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046554 Oct 12 09:50:23.231985 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3351/7130] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:50:23.876199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:23.876817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:23.884493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:23.885006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:23.885474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:23.886243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:23.886722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:23.887166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:24.353601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:24.362527 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43d64f83-f1e9-4324-921d-f84203fdba0c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.490585 Oct 12 09:50:24.363149 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3780/7131] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:23 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:25.269465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b133b9df-67a5-475e-adf7-7eee3dc57b77 req-e3ae93a5-f338-406c-b25b-cda093d85384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:50:25.280095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b133b9df-67a5-475e-adf7-7eee3dc57b77 req-e3ae93a5-f338-406c-b25b-cda093d85384 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:25.280487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b133b9df-67a5-475e-adf7-7eee3dc57b77 req-e3ae93a5-f338-406c-b25b-cda093d85384 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:25.280906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b133b9df-67a5-475e-adf7-7eee3dc57b77 req-e3ae93a5-f338-406c-b25b-cda093d85384 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:25.293267 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b133b9df-67a5-475e-adf7-7eee3dc57b77 req-e3ae93a5-f338-406c-b25b-cda093d85384 service nova] Creating event network-changed:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h2-858383-10 Oct 12 09:50:25.299340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-b133b9df-67a5-475e-adf7-7eee3dc57b77 req-e3ae93a5-f338-406c-b25b-cda093d85384 service nova] Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 09:50:25.310391 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b133b9df-67a5-475e-adf7-7eee3dc57b77 req-e3ae93a5-f338-406c-b25b-cda093d85384 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045074 Oct 12 09:50:25.311326 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3352/7132] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:50:25.449104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:25.450941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:25.463881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:25.465927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:25.467562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:25.468695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:25.469402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:25.470158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:25.699666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:25.727106 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-05099a18-10d0-4d63-baec-9eb6d9284b81 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.283846 Oct 12 09:50:25.740627 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3781/7133] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:25 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:26.765110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:26.769875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:26.770602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:26.777775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:26.778313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:26.778773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:26.779496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:26.779940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:26.780370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:26.916189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:26.925131 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3cd08906-bc0e-48c9-978e-447ce9c19522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.161932 Oct 12 09:50:26.926013 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3353/7134] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:26 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:27.948638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:27.949257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:27.956806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:27.957309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:27.957802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:27.958521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:27.958992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:27.959438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:28.093159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:28.101725 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b3a929f0-a7ae-402c-ac25-9334b668868a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.157092 Oct 12 09:50:28.102317 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3782/7135] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:27 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:29.125684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:29.126256 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:29.133836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:29.134328 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:29.134769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:29.135485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:29.135943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:29.136405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:29.272116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:29.280755 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-305b2b8c-a9ba-43e5-968d-0655d266f371 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.159557 Oct 12 09:50:29.281348 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3354/7136] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:29 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:30.307631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:30.308743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:30.320504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:30.321359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:30.322187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:30.323421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:30.324212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:30.325127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:30.456233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:30.464739 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9d75c69e-0e65-4bdd-ad47-a8521de25e7e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.163864 Oct 12 09:50:30.465302 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3783/7137] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:30 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:31.492613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:31.494011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:31.503856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:31.504343 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:31.504765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:31.505492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:31.505945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:31.506366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:31.652825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:31.661779 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-af9767d4-e30d-4db1-bf58-9aa8b65931e9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.175952 Oct 12 09:50:31.662359 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3355/7138] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:31 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:32.690030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:32.690878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:32.702577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:32.703070 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:32.703524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:32.704237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:32.704717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:32.705151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:32.843113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:32.851990 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a93e7556-b20e-45c4-97cb-467baedce0ae tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.168849 Oct 12 09:50:32.852584 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3784/7139] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:32 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:33.878201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:33.878827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:33.885323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:33.885849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:33.886304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:33.887006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:33.887467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:33.887898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:34.016280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:34.018678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:34.027107 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-589d5bd5-2793-472f-9ac5-3c4b431b80c7 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.153822 Oct 12 09:50:34.027695 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3356/7140] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:33 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:35.055074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:35.056130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:35.065734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:35.066244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:35.066705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:35.067486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:35.067958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:35.068399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:35.205423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:35.214168 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9cdbe659-a038-441c-a167-a8d108916c61 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.165800 Oct 12 09:50:35.214889 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3785/7141] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:35 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:36.242220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:36.243416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:36.248226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:36.257887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:36.258688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:36.259419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:36.260561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:36.261320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:36.262063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:36.398828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:36.407467 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-31a677d9-898f-4d7e-b8c2-595742a5ab65 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1722 microversion: 2.1 time: 0.172051 Oct 12 09:50:36.408037 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3357/7142] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:36 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:37.430652 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:37.431282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:37.434157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=30 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:37.439684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:37.440181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:37.440628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:37.441337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:37.441843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:37.442283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:37.445011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=90 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:50:37.574917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:37.583441 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aecbb269-fbe3-45c7-93b5-51ba7a886377 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1715 microversion: 2.1 time: 0.157089 Oct 12 09:50:37.584046 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3786/7143] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:37 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:37.606123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:37.606699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:37.614078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:37.614560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:37.614992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:37.615678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:37.616119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:37.616539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:37.749113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:37.757819 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e0db795-b073-4878-9fff-ffa469c4888c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1715 microversion: 2.1 time: 0.155582 Oct 12 09:50:37.758415 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3358/7144] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:37 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:37.780988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:37.781542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:37.788576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:37.789458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:37.790275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:37.791559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:37.792465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:37.793261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:37.937745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:37.946451 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a4395b4-d9fb-4497-b58d-234ea616423b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1715 microversion: 2.1 time: 0.169477 Oct 12 09:50:37.947025 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3787/7145] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:37 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1715 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:37.968707 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:37.969219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:37.975282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:37.975781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:37.976220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:37.976921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:37.977376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:37.977831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:38.003541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:50:38.085743 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f6e01da3-09fd-47f8-a567-ac5934c0196a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 204 len: 0 microversion: 2.1 time: 0.120606 Oct 12 09:50:38.086389 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3359/7146] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:50:37 2022] DELETE /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:50:38.096037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:38.096721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:38.103060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:38.103580 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:38.104040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:38.104767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:38.105246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:38.105730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:38.235898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:38.248921 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-224745cf-e0de-4b00-9ad1-fc89edff8f6a tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1721 microversion: 2.1 time: 0.156743 Oct 12 09:50:38.249966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3788/7147] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:38 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:39.278190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:39.279390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:39.290764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:39.291577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:39.292448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:39.293772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:39.294537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:39.295243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:39.432529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:39.440992 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5be15673-0bef-4fc4-832f-b43a7cdd450f tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1721 microversion: 2.1 time: 0.170113 Oct 12 09:50:39.441590 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3360/7148] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:39 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:40.083030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e7bc22be-b7ac-44a8-925f-3c42904c3b74 req-1e5824e7-eb1b-4480-acf3-16f027a8cc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "name": "network-vif-plugged", "status": "completed", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:50:40.094939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7bc22be-b7ac-44a8-925f-3c42904c3b74 req-1e5824e7-eb1b-4480-acf3-16f027a8cc98 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:40.095578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7bc22be-b7ac-44a8-925f-3c42904c3b74 req-1e5824e7-eb1b-4480-acf3-16f027a8cc98 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:40.096125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7bc22be-b7ac-44a8-925f-3c42904c3b74 req-1e5824e7-eb1b-4480-acf3-16f027a8cc98 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:40.110143 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e7bc22be-b7ac-44a8-925f-3c42904c3b74 req-1e5824e7-eb1b-4480-acf3-16f027a8cc98 service nova] Creating event network-vif-plugged:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h2-858383-10 Oct 12 09:50:40.116253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e7bc22be-b7ac-44a8-925f-3c42904c3b74 req-1e5824e7-eb1b-4480-acf3-16f027a8cc98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037451 Oct 12 09:50:40.117747 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3789/7149] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:50:40.464713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:40.465642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:40.472982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:40.473490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:40.473959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:40.474669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:40.475127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:40.475879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:40.547740 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:40.556740 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3f1f24e9-c3a4-41e4-860a-f418fbabd175 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1654 microversion: 2.1 time: 0.096186 Oct 12 09:50:40.557341 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3361/7150] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:40 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:40.697671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-90e7125b-1e1c-42b4-91d0-c4b0a9988150 req-fa9b8365-545a-4342-9bb6-be06506b9e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47624d41-d73d-4d03-be5e-fdd8a4c203a7", "name": "network-vif-deleted", "tag": "6d734cd1-165b-4eef-9778-8bf3d864bde3"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:50:40.709414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-90e7125b-1e1c-42b4-91d0-c4b0a9988150 req-fa9b8365-545a-4342-9bb6-be06506b9e61 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:40.710039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-90e7125b-1e1c-42b4-91d0-c4b0a9988150 req-fa9b8365-545a-4342-9bb6-be06506b9e61 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:40.710557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-90e7125b-1e1c-42b4-91d0-c4b0a9988150 req-fa9b8365-545a-4342-9bb6-be06506b9e61 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:40.723302 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-90e7125b-1e1c-42b4-91d0-c4b0a9988150 req-fa9b8365-545a-4342-9bb6-be06506b9e61 service nova] Creating event network-vif-deleted:6d734cd1-165b-4eef-9778-8bf3d864bde3 for instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 on n-h2-858383-10 Oct 12 09:50:40.728589 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-90e7125b-1e1c-42b4-91d0-c4b0a9988150 req-fa9b8365-545a-4342-9bb6-be06506b9e61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035406 Oct 12 09:50:40.729614 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3790/7151] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:50:41.579965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:41.580590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:41.588233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:41.588758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:41.589204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:41.590109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:41.590569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:41.591001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:41.658265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:41.667329 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e70ca5da-b318-40a3-a96e-0684a116107e tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1369 microversion: 2.1 time: 0.091423 Oct 12 09:50:41.667924 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3362/7152] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:41 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:42.692244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:42.692906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:42.699763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:42.700260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:42.700714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:42.701475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:42.701959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:42.702401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:42.767090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:42.776286 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3dff8f3a-9808-493e-b013-0871124f5228 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1369 microversion: 2.1 time: 0.089417 Oct 12 09:50:42.776892 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3791/7153] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:42 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:43.799409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:43.800037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:43.810011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:43.810775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:43.811487 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:43.812602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:43.813538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:43.813989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:43.882265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:43.890961 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-19ee1207-3981-468e-b05c-7da76d48ddc9 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1369 microversion: 2.1 time: 0.095618 Oct 12 09:50:43.891543 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3363/7154] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:43 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:44.914923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:44.915554 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:44.924237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:44.924852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:44.925334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:44.926204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:44.926915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:44.927107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:44.959643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:44.960212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:44.960670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:44.961128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lazy-loading 'fault' on Instance uuid 47624d41-d73d-4d03-be5e-fdd8a4c203a7 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:50:45.002928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18227827d83493f83795e243ec1e476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2177efa327a4db9be755b2ddb9510e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:50:45.012356 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9da86053-081e-43ec-90b1-557b22f5617b tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 200 len: 1374 microversion: 2.1 time: 0.101917 Oct 12 09:50:45.012922 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3792/7155] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:44 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 1374 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:50:46.037189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:46.037788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:46.044966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:46.045477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:46.045937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:46.046681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:46.047140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:46.047571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:46.064326 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 HTTP/1.1 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '47624d41-d73d-4d03-be5e-fdd8a4c203a7'} Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:46.066061 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ae4bf0a6-0217-421a-b83c-eb80883bc522 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 404 len: 111 microversion: 2.1 time: 0.034332 Oct 12 09:50:46.071305 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3364/7156] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:46 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:46.130154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:46.132336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:46.139473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:46.139974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:46.140426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:46.141136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:46.141678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:46.142096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:46.157599 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/os-volume_attachments HTTP/1.1 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': '47624d41-d73d-4d03-be5e-fdd8a4c203a7'} Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:46.159302 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d931912c-e3bd-4e56-9582-4618fd56ee3c tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034916 Oct 12 09:50:46.163182 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3793/7157] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:50:46 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.503927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.504456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:49.511981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.512471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.512973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.513704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.514154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.514580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.528560 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 HTTP/1.1 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '47624d41-d73d-4d03-be5e-fdd8a4c203a7'} Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:49.530139 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-dfba51fd-4dc7-4491-a661-8cfcc6df8253 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 404 len: 111 microversion: 2.1 time: 0.031803 Oct 12 09:50:49.534229 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3365/7158] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:50:49 2022] DELETE /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.540425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.541127 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 47624d41-d73d-4d03-be5e-fdd8a4c203a7] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:49.548260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.548758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.549210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.549927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.550404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.550846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.566182 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 HTTP/1.1 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '47624d41-d73d-4d03-be5e-fdd8a4c203a7'} Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.567793 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 47624d41-d73d-4d03-be5e-fdd8a4c203a7 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6b5dbe8-11d4-49b0-8546-068ce137c285 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7" status: 404 len: 111 microversion: 2.1 time: 0.032895 Oct 12 09:50:49.571695 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3794/7159] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:49 2022] GET /compute/v2.1/servers/47624d41-d73d-4d03-be5e-fdd8a4c203a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.578848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.579433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:49.586109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.586608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.587050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.587776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.588235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.588660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.604125 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 HTTP/1.1 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '4f988057-e591-4e0d-a037-4632ee978415'} Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:49.605836 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:49.610253 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-db037395-2f49-4ccb-a2a7-7cbb15ec6d39 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 404 len: 111 microversion: 2.1 time: 0.032594 Oct 12 09:50:49.611212 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3366/7160] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:50:49 2022] DELETE /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.617027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.618079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 4f988057-e591-4e0d-a037-4632ee978415] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:49.624752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.625279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.625831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.626585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.627056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.627494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.642111 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 HTTP/1.1 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '4f988057-e591-4e0d-a037-4632ee978415'} Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.643689 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 4f988057-e591-4e0d-a037-4632ee978415 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-72079e71-9399-466b-b4f7-a440cd129373 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415" status: 404 len: 111 microversion: 2.1 time: 0.032174 Oct 12 09:50:49.648146 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3795/7161] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:49 2022] GET /compute/v2.1/servers/4f988057-e591-4e0d-a037-4632ee978415 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.654039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.654541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:49.660647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.661119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.661579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.662252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.662702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.663120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.678003 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 HTTP/1.1 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '19aeda84-9246-4cf1-95c3-6ca691e9c9e1'} Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:49.679570 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:49.684096 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9cc2e20-af24-4f49-929a-95b664efbe7d tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 404 len: 111 microversion: 2.1 time: 0.030874 Oct 12 09:50:49.685360 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3367/7162] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:50:49 2022] DELETE /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.691505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.692139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: 19aeda84-9246-4cf1-95c3-6ca691e9c9e1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:49.698287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.699430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.699890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.700604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.701076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.701549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.715823 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 HTTP/1.1 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '19aeda84-9246-4cf1-95c3-6ca691e9c9e1'} Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.717464 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance 19aeda84-9246-4cf1-95c3-6ca691e9c9e1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b3b0eec5-a510-493b-997d-33546bab5555 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1" status: 404 len: 111 microversion: 2.1 time: 0.031514 Oct 12 09:50:49.721621 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3796/7163] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:49 2022] GET /compute/v2.1/servers/19aeda84-9246-4cf1-95c3-6ca691e9c9e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.727963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.728401 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:49.735006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.735989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.736543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.737589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.738149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.738918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.754088 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 HTTP/1.1 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'd304b54e-794d-488d-a942-14caf97f5b33'} Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:49.755780 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:49.760118 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-39422986-6a2f-4f45-99e4-714227749839 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 404 len: 111 microversion: 2.1 time: 0.035071 Oct 12 09:50:49.761008 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3368/7164] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:50:49 2022] DELETE /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.769391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.770178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [instance: d304b54e-794d-488d-a942-14caf97f5b33] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:50:49.776327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.776823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.777313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.778065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:50:49.778539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:50:49.778982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:50:49.793030 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] HTTP exception thrown: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Request method failure captured: Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 HTTP/1.1 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRox8VEwxtH5dMxRQkADJK9wKFfHb3z5bA-fHlar528ENm1N2Rn8ms3i-unpPj9wjKQ19LD7yydzMWaa8QRWbaTCsLI7N1bFihhLyoVGTQW3lJ_KWyA-2-u7Ag7XUriz2VxFstCOhA8pHzZuyQmgzTBPBIxStzNAT-XaxI1IlqeFOzAU Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2177efa327a4db9be755b2ddb9510e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2177efa327a4db9be755b2ddb9510e6"}]}] Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: a2177efa327a4db9be755b2ddb9510e6 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210893452 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f18227827d83493f83795e243ec1e476 Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServerActionsTestJSON-1210893452-project Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'd304b54e-794d-488d-a942-14caf97f5b33'} Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:50:49.794716 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Returning 404 to user: Instance d304b54e-794d-488d-a942-14caf97f5b33 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cab3a4b2-8e2e-4e86-84c4-71ceaa66ee57 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33" status: 404 len: 111 microversion: 2.1 time: 0.031086 Oct 12 09:50:49.799331 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3797/7165] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:50:49 2022] GET /compute/v2.1/servers/d304b54e-794d-488d-a942-14caf97f5b33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:50:49.805281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f22f74da-2c29-4cd4-89de-f1629cec4497 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] Calling method '.version_select at 0x7f98434db040>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:50:49.809969 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f22f74da-2c29-4cd4-89de-f1629cec4497 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [48eb267c-766f-4d56-8a7b-e1a0ecc4f1b6] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:50:50.822299 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [None req-f22f74da-2c29-4cd4-89de-f1629cec4497 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] [48eb267c-766f-4d56-8a7b-e1a0ecc4f1b6] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48856. Oct 12 09:50:50.849954 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f22f74da-2c29-4cd4-89de-f1629cec4497 tempest-ServerActionsTestJSON-1210893452 tempest-ServerActionsTestJSON-1210893452-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126700783" status: 202 len: 0 microversion: 2.1 time: 1.048445 Oct 12 09:50:50.850545 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3369/7166] 10.222.0.40 () {58 vars in 1221 bytes} [Wed Oct 12 09:50:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126700783 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:51:00.235976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=25 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:00.236850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=45 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:00.350201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748319811", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "6ca3926a-31dc-4f65-a65f-64fcb9d61174"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:00.407385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] validate_networks() for [('6ca3926a-31dc-4f65-a65f-64fcb9d61174', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:51:00.844734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:51:00.845193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:51:00.845758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:51:00.846330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:51:00.846933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:51:00.858246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:00.858756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:00.859249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:00.859997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:00.860504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:00.861204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:00.879872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Getting quotas for project 071f9d6e8abe41b38d07446c07181a83. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:51:00.885639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Getting quotas for user c155a138eaf045a9893ac90b0793d697 and project 071f9d6e8abe41b38d07446c07181a83. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:51:00.899768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:51:00.902189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:51:00.951846 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6a8bfdc-0952-4adb-b951-f72c21d973ba tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721485 Oct 12 09:51:00.952518 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3798/7167] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:51:00.961930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:00.963205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:00.967380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9c2cdeb-8653-4786-bfb6-a3a8b640d5ec tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:00.967999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9c2cdeb-8653-4786-bfb6-a3a8b640d5ec tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:01.039616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9c2cdeb-8653-4786-bfb6-a3a8b640d5ec tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:01.046834 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9c2cdeb-8653-4786-bfb6-a3a8b640d5ec tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1216 microversion: 2.1 time: 0.086824 Oct 12 09:51:01.047930 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3370/7168] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:00 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:02.072890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:02.073827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:02.081871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:02.082473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:02.083017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:02.084153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:02.084696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:02.085203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:02.198814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:02.208263 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14473783-6f88-4885-9a7d-d44de5bbb7eb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1276 microversion: 2.1 time: 0.141048 Oct 12 09:51:02.209285 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3799/7169] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:02 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:03.233651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:03.234353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:03.241109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:03.241648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:03.242910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:03.244069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:03.245122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:03.246015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:03.437626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:03.447221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-25f4e948-3a3a-409c-9f13-9a80cbc8648e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1316 microversion: 2.1 time: 0.217832 Oct 12 09:51:03.448243 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3371/7170] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:03 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:03.608500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5d07a4c6-49a3-40e9-bf0b-82ecd00c725e req-ab5de551-2466-415b-b065-75efd12309a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ea0b68-dd40-4462-89ba-21c396ae8be4", "tag": "8c3fc01e-5b39-452b-b04e-3caf46df7433"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:03.626266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5d07a4c6-49a3-40e9-bf0b-82ecd00c725e req-ab5de551-2466-415b-b065-75efd12309a1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:03.627071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5d07a4c6-49a3-40e9-bf0b-82ecd00c725e req-ab5de551-2466-415b-b065-75efd12309a1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:03.627776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5d07a4c6-49a3-40e9-bf0b-82ecd00c725e req-ab5de551-2466-415b-b065-75efd12309a1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:03.658098 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5d07a4c6-49a3-40e9-bf0b-82ecd00c725e req-ab5de551-2466-415b-b065-75efd12309a1 service nova] Creating event network-changed:8c3fc01e-5b39-452b-b04e-3caf46df7433 for instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 on n-h2-858383-10 Oct 12 09:51:03.666742 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5d07a4c6-49a3-40e9-bf0b-82ecd00c725e req-ab5de551-2466-415b-b065-75efd12309a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063637 Oct 12 09:51:03.668018 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3800/7171] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:51:04.474931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:04.475781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:04.486140 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:04.486805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:04.487386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:04.488302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:04.488912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:04.489491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:04.631224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:04.643605 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf54c0a4-eeb6-4b9e-9ec9-68ebcb0c5e20 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1316 microversion: 2.1 time: 0.174654 Oct 12 09:51:04.644547 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3372/7172] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:04 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:05.664753 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:51:05.665312 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:51:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 (ip 10.222.0.40) !!! Oct 12 09:51:05.670428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:05.671151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:05.679498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:05.680013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:05.680507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:05.681232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:05.681751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:05.682190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:05.816807 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:05.825063 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e35ef372-70c6-4835-b423-ce4f668ebd6d tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1316 microversion: 2.1 time: 0.161543 Oct 12 09:51:05.825758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3801/7173] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:05 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:06.851465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:06.852532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:06.864205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:06.865165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:06.865165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:06.865876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:06.866340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:06.866776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:07.006326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:07.018929 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9f6208e3-09d7-4c4d-b374-abdacad60f5b tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1316 microversion: 2.1 time: 0.173948 Oct 12 09:51:07.019776 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3373/7174] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:06 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:08.046869 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:08.047878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:08.059586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:08.060441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:08.061282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:08.062674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:08.063461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:08.064251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:08.204715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:08.212578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-35b43a9d-26f0-4c55-909a-4e4d799bf3ca tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1316 microversion: 2.1 time: 0.172588 Oct 12 09:51:08.213463 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3802/7175] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:08 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:09.239517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:09.240136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:09.247884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:09.248378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:09.248825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:09.249555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:09.250017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:09.250449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:09.380397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:09.391075 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3675a38c-b83b-4a65-9487-6c8ed4d46451 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1316 microversion: 2.1 time: 0.157675 Oct 12 09:51:09.391918 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3374/7176] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:09 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:10.241579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-89b74129-c6b5-43be-97ef-4ad661170835 req-ad34f6fd-740d-464f-9116-1fc28192927b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ea0b68-dd40-4462-89ba-21c396ae8be4", "name": "network-vif-plugged", "status": "completed", "tag": "8c3fc01e-5b39-452b-b04e-3caf46df7433"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:10.252752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89b74129-c6b5-43be-97ef-4ad661170835 req-ad34f6fd-740d-464f-9116-1fc28192927b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:10.253253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89b74129-c6b5-43be-97ef-4ad661170835 req-ad34f6fd-740d-464f-9116-1fc28192927b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:10.253729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-89b74129-c6b5-43be-97ef-4ad661170835 req-ad34f6fd-740d-464f-9116-1fc28192927b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:10.265525 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-89b74129-c6b5-43be-97ef-4ad661170835 req-ad34f6fd-740d-464f-9116-1fc28192927b service nova] Creating event network-vif-plugged:8c3fc01e-5b39-452b-b04e-3caf46df7433 for instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 on n-h2-858383-10 Oct 12 09:51:10.270615 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-89b74129-c6b5-43be-97ef-4ad661170835 req-ad34f6fd-740d-464f-9116-1fc28192927b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033135 Oct 12 09:51:10.271230 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3803/7177] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:51:10.415550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:10.416136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:10.423526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:10.424008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:10.424446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:10.425362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:10.425835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:10.426264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:10.559196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:10.567479 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-663fa150-81f3-4463-9e91-bfefd59864dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1316 microversion: 2.1 time: 0.156083 Oct 12 09:51:10.568057 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3375/7178] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:10 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:11.592620 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:11.593512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:11.599114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:11.599928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:11.607208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:11.607710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:11.608157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:11.608893 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:11.609358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:11.609815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:11.743084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:11.754321 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bc48d367-9a22-49c4-a2a7-ac6310fc26a8 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1316 microversion: 2.1 time: 0.162719 Oct 12 09:51:11.754916 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3804/7179] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:11 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:12.781862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:12.782696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:12.785817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:12.795855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:12.796665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:12.797422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:12.798611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:12.799373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:12.800082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:12.942360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:12.950520 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8623c8fb-e367-47ff-b629-58f86ea908f2 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1504 microversion: 2.1 time: 0.175488 Oct 12 09:51:12.951113 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3376/7180] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:12 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:13.012792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1057022237", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "6ca3926a-31dc-4f65-a65f-64fcb9d61174"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:13.066697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] validate_networks() for [('6ca3926a-31dc-4f65-a65f-64fcb9d61174', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:51:13.460543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:51:13.461116 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:51:13.461850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:51:13.462412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:51:13.462954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:51:13.476288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:13.476787 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:13.477237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:13.478029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:13.478491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:13.478926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:13.497090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Getting quotas for project 071f9d6e8abe41b38d07446c07181a83. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:51:13.503068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Getting quotas for user c155a138eaf045a9893ac90b0793d697 and project 071f9d6e8abe41b38d07446c07181a83. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:51:13.515475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:51:13.517835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:51:13.566329 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55a8929b-9b5b-477e-a706-e259de3abcda tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557388 Oct 12 09:51:13.567378 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3805/7181] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:51:13.578205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-748aee1d-c7d7-4619-8a9e-fc9073a205bf tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:13.578739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-748aee1d-c7d7-4619-8a9e-fc9073a205bf tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:13.636253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-748aee1d-c7d7-4619-8a9e-fc9073a205bf tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:13.643647 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-748aee1d-c7d7-4619-8a9e-fc9073a205bf tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1217 microversion: 2.1 time: 0.069386 Oct 12 09:51:13.644240 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3377/7182] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:13 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:14.668124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:14.668676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:14.675745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:14.676255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:14.676714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:14.677453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:14.677945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:14.678400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:14.760668 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:14.770376 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f2c22513-075f-4786-ba39-1a6d21737d78 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1277 microversion: 2.1 time: 0.107278 Oct 12 09:51:14.770978 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3806/7183] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:14 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:15.793646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:15.794263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:15.802052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:15.802537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:15.803110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:15.803720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:15.804195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:15.804628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:16.128753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:16.136820 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-94b0c9ef-6491-4a71-ac55-07e447340ec4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1317 microversion: 2.1 time: 0.347269 Oct 12 09:51:16.137398 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3378/7184] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:15 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:16.473771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4855742b-91a1-4b9c-91d9-1fd869da0120 req-345b7406-38fd-45de-8da3-1b85dda50c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b071192c-85a8-4d9f-bc02-ade1f1b7c972", "tag": "06bc6d4f-7c68-494a-b312-11b37317f0df"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:16.484536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4855742b-91a1-4b9c-91d9-1fd869da0120 req-345b7406-38fd-45de-8da3-1b85dda50c85 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:16.485036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4855742b-91a1-4b9c-91d9-1fd869da0120 req-345b7406-38fd-45de-8da3-1b85dda50c85 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:16.485516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4855742b-91a1-4b9c-91d9-1fd869da0120 req-345b7406-38fd-45de-8da3-1b85dda50c85 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:16.497711 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4855742b-91a1-4b9c-91d9-1fd869da0120 req-345b7406-38fd-45de-8da3-1b85dda50c85 service nova] Creating event network-changed:06bc6d4f-7c68-494a-b312-11b37317f0df for instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 on n-h1-858383-10 Oct 12 09:51:16.502868 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4855742b-91a1-4b9c-91d9-1fd869da0120 req-345b7406-38fd-45de-8da3-1b85dda50c85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033061 Oct 12 09:51:16.503699 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3807/7185] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:51:17.163827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:17.164497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:17.173480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:17.174138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:17.174677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:17.175564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:17.176125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:17.176660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:17.317599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:17.329478 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0c2b476e-4b22-40ec-b1a5-faabc46ffdfd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1317 microversion: 2.1 time: 0.171751 Oct 12 09:51:17.330301 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3379/7186] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:17 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:18.354094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:18.354830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:18.361145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:18.361692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:18.362144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:18.362856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:18.363326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:18.363765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:18.497610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:18.506787 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd180b7f-fa5d-40ce-bec8-843cbc96da64 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1317 microversion: 2.1 time: 0.158010 Oct 12 09:51:18.507378 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3808/7187] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:18 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:19.532047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:19.532755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:19.542246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:19.542884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:19.543466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:19.544390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:19.544986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:19.545598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:19.679649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:19.688603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b44d2dd5-0862-466e-a49d-f1e8ed1bf1d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1317 microversion: 2.1 time: 0.161885 Oct 12 09:51:19.689182 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3380/7188] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:19 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:20.717231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:20.718343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:20.728915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:20.728915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:20.729244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:20.729981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:20.730450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:20.730887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:20.898921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:20.908072 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5fd52db5-9f23-4ece-9c22-c3d875e30afb tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1317 microversion: 2.1 time: 0.198609 Oct 12 09:51:20.908640 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3809/7189] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:20 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:21.934773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:21.935381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:21.942908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:21.943403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:21.943849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:21.944561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:21.945023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:21.945491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:22.085065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:22.093600 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee13dbe7-118d-4ee6-b3e0-f77a79c11f24 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1317 microversion: 2.1 time: 0.163033 Oct 12 09:51:22.094210 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3381/7190] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:21 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:23.120702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:23.121261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:23.128812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:23.129312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:23.129798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:23.130510 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:23.130984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:23.131430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:23.276688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:23.284827 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0c74948a-5889-42c6-a2dc-ba081ff0a39c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1317 microversion: 2.1 time: 0.171121 Oct 12 09:51:23.285384 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3810/7191] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:23 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:23.694575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-7ecad0ac-647d-4ce7-a889-9dc25fba84c2 req-f914e250-407a-4671-a372-8dd0cf2905c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b071192c-85a8-4d9f-bc02-ade1f1b7c972", "name": "network-vif-plugged", "status": "completed", "tag": "06bc6d4f-7c68-494a-b312-11b37317f0df"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:23.700692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:23.707168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ecad0ac-647d-4ce7-a889-9dc25fba84c2 req-f914e250-407a-4671-a372-8dd0cf2905c9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:23.707661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ecad0ac-647d-4ce7-a889-9dc25fba84c2 req-f914e250-407a-4671-a372-8dd0cf2905c9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:23.708100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7ecad0ac-647d-4ce7-a889-9dc25fba84c2 req-f914e250-407a-4671-a372-8dd0cf2905c9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:23.719955 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7ecad0ac-647d-4ce7-a889-9dc25fba84c2 req-f914e250-407a-4671-a372-8dd0cf2905c9 service nova] Creating event network-vif-plugged:06bc6d4f-7c68-494a-b312-11b37317f0df for instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 on n-h1-858383-10 Oct 12 09:51:23.725366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-7ecad0ac-647d-4ce7-a889-9dc25fba84c2 req-f914e250-407a-4671-a372-8dd0cf2905c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034690 Oct 12 09:51:23.725998 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3382/7192] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:51:24.312396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:24.313486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:24.316585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:24.317939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:24.326493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:24.327003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:24.327464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:24.328179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:24.328661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:24.329110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:24.473459 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:24.482250 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29f90cb2-65a3-42bb-a360-fd98faaf81d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1317 microversion: 2.1 time: 0.176534 Oct 12 09:51:24.482828 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3811/7193] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:24 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:25.514118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:25.515161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:25.526152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:25.526823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:25.527255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:25.527954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:25.528413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:25.528843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:25.668445 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:25.680479 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8a17447c-3334-4fe5-b39c-a338256defb4 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1505 microversion: 2.1 time: 0.176224 Oct 12 09:51:25.681277 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3383/7194] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:25 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:25.703563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:25.704110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:25.711579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:25.712085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:25.712540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:25.713259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:25.713864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:25.714309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:25.741211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:51:25.824024 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8bb5c7b8-984c-4945-a6a8-5ab867267f84 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 204 len: 0 microversion: 2.1 time: 0.124156 Oct 12 09:51:25.824668 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3812/7195] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:51:25 2022] DELETE /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:51:25.833274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:25.833936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:25.840478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:25.840973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:25.841420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:25.842158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:25.842620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:25.843047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:25.989246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:25.997577 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e686594c-aeb4-4b78-8717-ee182738bc6f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1511 microversion: 2.1 time: 0.168280 Oct 12 09:51:25.998161 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3384/7196] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:25 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:27.026029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:27.026995 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:27.034318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:27.034825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:27.035306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:27.036034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:27.036508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:27.036953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:27.174532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:27.182667 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-391e1745-7f2a-4738-b869-166d2612602f tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1511 microversion: 2.1 time: 0.163914 Oct 12 09:51:27.183257 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3813/7197] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:27 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:27.673008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-040e09a5-2312-4d26-a13e-7491c0d30883 req-6ac34994-a1b7-4d8b-b01b-4bafd599ecbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b071192c-85a8-4d9f-bc02-ade1f1b7c972", "name": "network-vif-deleted", "tag": "06bc6d4f-7c68-494a-b312-11b37317f0df"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:27.684274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-040e09a5-2312-4d26-a13e-7491c0d30883 req-6ac34994-a1b7-4d8b-b01b-4bafd599ecbc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:27.684840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-040e09a5-2312-4d26-a13e-7491c0d30883 req-6ac34994-a1b7-4d8b-b01b-4bafd599ecbc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:27.685265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-040e09a5-2312-4d26-a13e-7491c0d30883 req-6ac34994-a1b7-4d8b-b01b-4bafd599ecbc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:27.701208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-040e09a5-2312-4d26-a13e-7491c0d30883 req-6ac34994-a1b7-4d8b-b01b-4bafd599ecbc service nova] Creating event network-vif-deleted:06bc6d4f-7c68-494a-b312-11b37317f0df for instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 on n-h1-858383-10 Oct 12 09:51:27.706805 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-040e09a5-2312-4d26-a13e-7491c0d30883 req-6ac34994-a1b7-4d8b-b01b-4bafd599ecbc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037490 Oct 12 09:51:27.710967 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3385/7198] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:51:28.205765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:28.206519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:28.213908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:28.214405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:28.214871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:28.215603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:28.216080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:28.216523 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:28.249153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:28.249738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:28.250200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:28.250638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lazy-loading 'fault' on Instance uuid b071192c-85a8-4d9f-bc02-ade1f1b7c972 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:51:28.295623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:28.302800 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3da96b8e-6b0c-4575-b4bb-eb7f8e3b5d83 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 200 len: 1307 microversion: 2.1 time: 0.101272 Oct 12 09:51:28.303477 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3814/7199] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:28 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:29.333500 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:29.334687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:29.343022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.343513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.343957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.344672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.345131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.345599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.359355 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] HTTP exception thrown: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Request method failure captured: Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 HTTP/1.1 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo4Ek84nXhcIoqumhlVsvCWS8Y-QO9oB1jQ55YcLlFESG4EjJ5c0YLUzSHzngIduEahoNq1zRomja8NnC9gNszVKdDEUKM_eGrOa17PgwQm3DzTM3C3K4G0zyF35zHuHglo4idpcoNEU8_u37DZx9BXK72-odSJVO1wyaJ9yCrIGCzk Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}] Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c155a138eaf045a9893ac90b0793d697 Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'b071192c-85a8-4d9f-bc02-ade1f1b7c972'} Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:29.361041 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Returning 404 to user: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3d61aeb6-2cdd-4081-9b8d-4001dcccd36c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 404 len: 111 microversion: 2.1 time: 0.037708 Oct 12 09:51:29.368929 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3386/7200] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:29 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:51:29.372351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:29.373023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:29.380533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.381042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.381542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.382302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.382772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.383216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.521916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:29.525685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:29.530804 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-078baedc-8de2-4a9e-836c-2637f944e17c tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1504 microversion: 2.1 time: 0.162543 Oct 12 09:51:29.531371 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3815/7201] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:29 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:29.553705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b8beb5b-de9e-4ea8-a3fe-41ff3d2b81dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:29.556245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b8beb5b-de9e-4ea8-a3fe-41ff3d2b81dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 650acd74-3726-4547-adff-aa0485fa18f1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:29.562641 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-2b8beb5b-de9e-4ea8-a3fe-41ff3d2b81dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] HTTP exception thrown: Instance 650acd74-3726-4547-adff-aa0485fa18f1 could not be found. Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b8beb5b-de9e-4ea8-a3fe-41ff3d2b81dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Request method failure captured: Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/650acd74-3726-4547-adff-aa0485fa18f1/action HTTP/1.1 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 32 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo4Ek84nXhcIoqumhlVsvCWS8Y-QO9oB1jQ55YcLlFESG4EjJ5c0YLUzSHzngIduEahoNq1zRomja8NnC9gNszVKdDEUKM_eGrOa17PgwQm3DzTM3C3K4G0zyF35zHuHglo4idpcoNEU8_u37DZx9BXK72-odSJVO1wyaJ9yCrIGCzk Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}] Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c155a138eaf045a9893ac90b0793d697 Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: {"resize": {"flavorRef": "452"}} Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 650acd74-3726-4547-adff-aa0485fa18f1 could not be found. Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '650acd74-3726-4547-adff-aa0485fa18f1', 'body': {'resize': {'flavorRef': '452'}}} Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650acd74-3726-4547-adff-aa0485fa18f1 could not be found. Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:51:29.564303 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650acd74-3726-4547-adff-aa0485fa18f1 could not be found. Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650acd74-3726-4547-adff-aa0485fa18f1 could not be found. Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b8beb5b-de9e-4ea8-a3fe-41ff3d2b81dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Returning 404 to user: Instance 650acd74-3726-4547-adff-aa0485fa18f1 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b8beb5b-de9e-4ea8-a3fe-41ff3d2b81dd tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "POST /compute/v2.1/servers/650acd74-3726-4547-adff-aa0485fa18f1/action" status: 404 len: 111 microversion: 2.1 time: 0.016250 Oct 12 09:51:29.569395 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3387/7202] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:51:29 2022] POST /compute/v2.1/servers/650acd74-3726-4547-adff-aa0485fa18f1/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:51:29.575798 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:29.576428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:29.583772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.584274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.584726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.585498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.585934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.586373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.723498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:29.732158 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-855aa1fa-2362-4ff5-a4d4-209fb7436467 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1504 microversion: 2.1 time: 0.160944 Oct 12 09:51:29.732723 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3816/7203] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:29 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:29.756158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:29.756792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:29.764405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.764885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.765324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.766073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.766526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.766949 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.912459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:29.920761 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-285b1c9a-b0df-43e1-9b00-cf6064461146 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1504 microversion: 2.1 time: 0.168963 Oct 12 09:51:29.921340 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3388/7204] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:29 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:29.943891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ad522e6b-a4a1-420c-adec-1791912d844d"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:29.946352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:29.952913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.953413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.953965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.954676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:29.955149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:29.955587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:29.998189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:30.003462 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] HTTP exception thrown: Flavor ad522e6b-a4a1-420c-adec-1791912d844d could not be found. Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Request method failure captured: Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: request: POST /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4/action HTTP/1.1 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 65 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRo4Ek84nXhcIoqumhlVsvCWS8Y-QO9oB1jQ55YcLlFESG4EjJ5c0YLUzSHzngIduEahoNq1zRomja8NnC9gNszVKdDEUKM_eGrOa17PgwQm3DzTM3C3K4G0zyF35zHuHglo4idpcoNEU8_u37DZx9BXK72-odSJVO1wyaJ9yCrIGCzk Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}] Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c155a138eaf045a9893ac90b0793d697 Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: {"resize": {"flavorRef": "ad522e6b-a4a1-420c-adec-1791912d844d"}} Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: exception: Flavor ad522e6b-a4a1-420c-adec-1791912d844d could not be found. Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '77ea0b68-dd40-4462-89ba-21c396ae8be4', 'body': {'resize': {'flavorRef': 'ad522e6b-a4a1-420c-adec-1791912d844d'}}} Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4202, in resize Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:51:30.005469 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ad522e6b-a4a1-420c-adec-1791912d844d could not be found. Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ad522e6b-a4a1-420c-adec-1791912d844d could not be found. Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ad522e6b-a4a1-420c-adec-1791912d844d could not be found. Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Returning 400 to user: Flavor ad522e6b-a4a1-420c-adec-1791912d844d could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-382726e4-cc7a-4c5a-be6f-ad4bf95ec8d7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "POST /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4/action" status: 400 len: 107 microversion: 2.1 time: 0.067117 Oct 12 09:51:30.010462 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3817/7205] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:51:29 2022] POST /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4/action => generated 107 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:51:30.017254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:30.017901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:30.024796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.025289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.025762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.026466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.027072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.027510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.161284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:30.173791 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3733cc85-a848-4f61-9ab8-9305143fe59a tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1504 microversion: 2.1 time: 0.160177 Oct 12 09:51:30.174561 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3389/7206] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:30 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:30.200635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:30.201265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:30.207606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.208119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.208615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.209333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.209837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.210284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.346201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:30.354558 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f95780f4-326a-4d32-85c1-aae3a1654eb7 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1504 microversion: 2.1 time: 0.157876 Oct 12 09:51:30.355267 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3818/7207] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:30 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:30.377833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6c65678-736f-437d-b944-2149c97fb33e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6c65678-736f-437d-b944-2149c97fb33e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Request method failure captured: Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: request: POST /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4/action HTTP/1.1 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 29 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo4Ek84nXhcIoqumhlVsvCWS8Y-QO9oB1jQ55YcLlFESG4EjJ5c0YLUzSHzngIduEahoNq1zRomja8NnC9gNszVKdDEUKM_eGrOa17PgwQm3DzTM3C3K4G0zyF35zHuHglo4idpcoNEU8_u37DZx9BXK72-odSJVO1wyaJ9yCrIGCzk Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}] Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c155a138eaf045a9893ac90b0793d697 Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: {"resize": {"flavorRef": ""}} Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '77ea0b68-dd40-4462-89ba-21c396ae8be4', 'body': {'resize': {'flavorRef': ''}}} Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise error Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi '' Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.381389 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6c65678-736f-437d-b944-2149c97fb33e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6c65678-736f-437d-b944-2149c97fb33e tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "POST /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4/action" status: 400 len: 113 microversion: 2.1 time: 0.009263 Oct 12 09:51:30.385782 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3390/7208] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:51:30 2022] POST /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 09:51:30.391264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:30.391898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:30.394588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:30.400574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.401100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.401599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.402314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.402800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.403243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.538980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:30.547627 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85b1ad2b-a35b-4163-b245-cd00d6a2a000 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1504 microversion: 2.1 time: 0.160212 Oct 12 09:51:30.548231 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3819/7209] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:30 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:30.576300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:30.576808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:30.584396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.584889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.585329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.586090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.586550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.586983 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.603559 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] HTTP exception thrown: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Request method failure captured: Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 HTTP/1.1 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo4Ek84nXhcIoqumhlVsvCWS8Y-QO9oB1jQ55YcLlFESG4EjJ5c0YLUzSHzngIduEahoNq1zRomja8NnC9gNszVKdDEUKM_eGrOa17PgwQm3DzTM3C3K4G0zyF35zHuHglo4idpcoNEU8_u37DZx9BXK72-odSJVO1wyaJ9yCrIGCzk Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}] Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: c155a138eaf045a9893ac90b0793d697 Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'b071192c-85a8-4d9f-bc02-ade1f1b7c972'} Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:51:30.605147 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Returning 404 to user: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6918b4f1-8e5c-442c-8012-52c43c550b04 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 404 len: 111 microversion: 2.1 time: 0.036921 Oct 12 09:51:30.609530 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3391/7210] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:51:30 2022] DELETE /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:51:30.615450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:30.616086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: b071192c-85a8-4d9f-bc02-ade1f1b7c972] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:30.622714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.623223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.623683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.624403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.624959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.625414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.639400 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] HTTP exception thrown: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Request method failure captured: Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 HTTP/1.1 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRo4Ek84nXhcIoqumhlVsvCWS8Y-QO9oB1jQ55YcLlFESG4EjJ5c0YLUzSHzngIduEahoNq1zRomja8NnC9gNszVKdDEUKM_eGrOa17PgwQm3DzTM3C3K4G0zyF35zHuHglo4idpcoNEU8_u37DZx9BXK72-odSJVO1wyaJ9yCrIGCzk Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}] Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c155a138eaf045a9893ac90b0793d697 Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'b071192c-85a8-4d9f-bc02-ade1f1b7c972'} Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:30.640912 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Returning 404 to user: Instance b071192c-85a8-4d9f-bc02-ade1f1b7c972 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-50d698ff-1529-4911-be76-fbe9afca27d3 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972" status: 404 len: 111 microversion: 2.1 time: 0.030927 Oct 12 09:51:30.644981 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3820/7211] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:30 2022] GET /compute/v2.1/servers/b071192c-85a8-4d9f-bc02-ade1f1b7c972 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:51:30.651218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:30.651711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:30.657986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.658468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.658905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.659593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.660045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.660469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.685914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:51:30.699641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=100 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:30.760269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eb1b2418-e409-46b2-bcc5-8821b7b96772 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 204 len: 0 microversion: 2.1 time: 0.112634 Oct 12 09:51:30.760902 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3392/7212] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:51:30 2022] DELETE /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:51:30.769301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:30.769970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:30.776229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.776743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.777239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.777981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:30.778456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:30.778899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:30.916196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:30.924578 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-944eec6d-9ad3-476a-8c19-dffee4a9cf02 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1510 microversion: 2.1 time: 0.159273 Oct 12 09:51:30.925157 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3821/7213] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:30 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:31.949624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:31.950284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:31.952335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:51:31.957953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:31.958441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:31.958888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:31.959584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:31.960039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:31.960470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:32.108513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:32.116947 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-05cb444a-0728-4598-8738-78ab3b088052 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1510 microversion: 2.1 time: 0.171954 Oct 12 09:51:32.117459 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3393/7214] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:31 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:51:32.703694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e6d60ea5-cdcd-43ea-bda2-d7f00e53c64e req-5f821320-0510-480a-8966-b5acad515c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ea0b68-dd40-4462-89ba-21c396ae8be4", "name": "network-vif-deleted", "tag": "8c3fc01e-5b39-452b-b04e-3caf46df7433"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:51:32.716687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e6d60ea5-cdcd-43ea-bda2-d7f00e53c64e req-5f821320-0510-480a-8966-b5acad515c42 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:32.717198 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e6d60ea5-cdcd-43ea-bda2-d7f00e53c64e req-5f821320-0510-480a-8966-b5acad515c42 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:32.717655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e6d60ea5-cdcd-43ea-bda2-d7f00e53c64e req-5f821320-0510-480a-8966-b5acad515c42 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:32.730540 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e6d60ea5-cdcd-43ea-bda2-d7f00e53c64e req-5f821320-0510-480a-8966-b5acad515c42 service nova] Creating event network-vif-deleted:8c3fc01e-5b39-452b-b04e-3caf46df7433 for instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 on n-h2-858383-10 Oct 12 09:51:32.736938 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e6d60ea5-cdcd-43ea-bda2-d7f00e53c64e req-5f821320-0510-480a-8966-b5acad515c42 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037077 Oct 12 09:51:32.737919 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3822/7215] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:51:33.144398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:33.145501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:33.155377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:33.155867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:33.156301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:33.157003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:33.157522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:33.157914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:33.191412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:33.191992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:33.192478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:33.193122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lazy-loading 'fault' on Instance uuid 77ea0b68-dd40-4462-89ba-21c396ae8be4 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:51:33.236604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c155a138eaf045a9893ac90b0793d697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f9d6e8abe41b38d07446c07181a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:51:33.245077 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-143a2c1b-a39d-43c8-9cf6-576127c14f55 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 200 len: 1306 microversion: 2.1 time: 0.107395 Oct 12 09:51:33.253487 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3394/7216] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:33 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:51:34.273366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:51:34.274572 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] [instance: 77ea0b68-dd40-4462-89ba-21c396ae8be4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:51:34.286674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:34.287502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:34.288265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:34.289468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:51:34.290259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:51:34.291034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:51:34.308218 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] HTTP exception thrown: Instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 could not be found. Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Request method failure captured: Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 HTTP/1.1 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRo4Ek84nXhcIoqumhlVsvCWS8Y-QO9oB1jQ55YcLlFESG4EjJ5c0YLUzSHzngIduEahoNq1zRomja8NnC9gNszVKdDEUKM_eGrOa17PgwQm3DzTM3C3K4G0zyF35zHuHglo4idpcoNEU8_u37DZx9BXK72-odSJVO1wyaJ9yCrIGCzk Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_071f9d6e8abe41b38d07446c07181a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/071f9d6e8abe41b38d07446c07181a83"}]}] Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 071f9d6e8abe41b38d07446c07181a83 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-ServersNegativeTestJSON-28286390 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: c155a138eaf045a9893ac90b0793d697 Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-ServersNegativeTestJSON-28286390-project Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 could not be found. Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '77ea0b68-dd40-4462-89ba-21c396ae8be4'} Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 could not be found. Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 could not be found. Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:51:34.309962 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 could not be found. Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] Returning 404 to user: Instance 77ea0b68-dd40-4462-89ba-21c396ae8be4 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-98f3728e-3a3b-4631-8c2b-d5c7350c3a86 tempest-ServersNegativeTestJSON-28286390 tempest-ServersNegativeTestJSON-28286390-project] 10.222.0.40 "GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4" status: 404 len: 111 microversion: 2.1 time: 0.045567 Oct 12 09:51:34.314026 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3823/7217] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:51:34 2022] GET /compute/v2.1/servers/77ea0b68-dd40-4462-89ba-21c396ae8be4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:52:05.174201 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=5 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:05.174952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:05.358209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1c234fde-7b0e-4dad-9560-595a02f00922 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: .version_select at 0x7f984cbe19d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-8849604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE16M9vZ/hlQQpx5uS9K75n33cCMwzGd9x3huqVUer1uFb5wJzeud4jvEd1hHIkyM7BoZrlMzRrQE5d6EQ41DTPXaayyrWVuT9lJTSMVrO5G8YO0z1wbNe1typJXgLxVjw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:05.375367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1c234fde-7b0e-4dad-9560-595a02f00922 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for project c07038af8a5249469d5cb828df3a643b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:52:05.380562 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-1c234fde-7b0e-4dad-9560-595a02f00922 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for user 5e7bd92e366740c897a13339241517cf and project c07038af8a5249469d5cb828df3a643b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:52:05.406137 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1c234fde-7b0e-4dad-9560-595a02f00922 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.237040 Oct 12 09:52:05.407053 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3395/7218] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:52:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:05.458187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1251494981", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-8849604", "networks": [{"uuid": "d54f67d2-3af3-438c-b090-519c97077050"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:05.468202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=9 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:05.468866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=34 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:05.523396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] validate_networks() for [('d54f67d2-3af3-438c-b090-519c97077050', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:52:05.958299 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:52:05.958749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:52:05.959239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:52:05.959671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:52:05.960104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:52:05.969649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:05.970162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:05.970619 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:05.971574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:05.972048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:05.972657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:05.994794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for project c07038af8a5249469d5cb828df3a643b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:52:06.000274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for user 5e7bd92e366740c897a13339241517cf and project c07038af8a5249469d5cb828df3a643b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:52:06.013665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:52:06.016073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:52:06.064911 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bf698b3c-a52a-47aa-98b9-cd0b720d6c02 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610739 Oct 12 09:52:06.066128 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3824/7219] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:52:06.077323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5960d771-7cd9-449e-8481-4bd006ad1eab tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:06.077981 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5960d771-7cd9-449e-8481-4bd006ad1eab tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:06.132284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5960d771-7cd9-449e-8481-4bd006ad1eab tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:06.139406 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5960d771-7cd9-449e-8481-4bd006ad1eab tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1260 microversion: 2.1 time: 0.066211 Oct 12 09:52:06.140176 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3396/7220] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:06 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1260 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:07.163716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:07.164566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:07.171713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:07.172356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:07.172925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:07.173982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:07.174502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:07.175053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:07.290424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:07.303805 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-89a5189f-b936-4537-8246-12250a539cb0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1320 microversion: 2.1 time: 0.145111 Oct 12 09:52:07.304808 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3825/7221] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:07 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1320 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:08.328883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:08.329643 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:08.337540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:08.338097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:08.338533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:08.339506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:08.340093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:08.340539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:08.501334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:08.510964 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-353af81e-2120-4d65-b760-fa0736f45e83 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1360 microversion: 2.1 time: 0.185815 Oct 12 09:52:08.512025 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3397/7222] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:08 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1360 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:08.687838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-31873c86-fa63-416c-a8e7-6b96f90c6041 req-f0d445d3-ce9d-448b-a2f8-afb2cdb177d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2676a142-a094-44f2-b43f-4e409928af14", "tag": "71411af0-c240-4ec0-9c5a-9837712ebceb"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:08.699410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-31873c86-fa63-416c-a8e7-6b96f90c6041 req-f0d445d3-ce9d-448b-a2f8-afb2cdb177d8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:08.700162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-31873c86-fa63-416c-a8e7-6b96f90c6041 req-f0d445d3-ce9d-448b-a2f8-afb2cdb177d8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:08.700804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-31873c86-fa63-416c-a8e7-6b96f90c6041 req-f0d445d3-ce9d-448b-a2f8-afb2cdb177d8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:08.714012 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-31873c86-fa63-416c-a8e7-6b96f90c6041 req-f0d445d3-ce9d-448b-a2f8-afb2cdb177d8 service nova] Creating event network-changed:71411af0-c240-4ec0-9c5a-9837712ebceb for instance 2676a142-a094-44f2-b43f-4e409928af14 on n-h2-858383-10 Oct 12 09:52:08.719581 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-31873c86-fa63-416c-a8e7-6b96f90c6041 req-f0d445d3-ce9d-448b-a2f8-afb2cdb177d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035672 Oct 12 09:52:08.720481 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3826/7223] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:09.535367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:09.536086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:09.543419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:09.544009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:09.544540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:09.545621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:09.546298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:09.551381 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:09.703227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:09.711941 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-16d3b6ca-7f49-4759-808a-5fb0d1b66345 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1360 microversion: 2.1 time: 0.180405 Oct 12 09:52:09.712661 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3398/7224] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:09 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:10.736778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:10.737542 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:10.744561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:10.745073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:10.745597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:10.746369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:10.746842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:10.747298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:10.953252 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:10.962270 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-844ff5f7-a03b-4a74-99a2-33f3c94dcb7a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1360 microversion: 2.1 time: 0.230729 Oct 12 09:52:10.962886 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3827/7225] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:10 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:11.984771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:11.985388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:11.992849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:11.993347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:11.993824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:11.994525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:11.994978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:11.995403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:12.144889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:12.153237 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1b0f3217-1e8a-4f32-9b8d-525a65af39bc tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1360 microversion: 2.1 time: 0.172415 Oct 12 09:52:12.153824 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3399/7226] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:11 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:13.176776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:13.177450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:13.184077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:13.184597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:13.185037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:13.185786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:13.186259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:13.186705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:13.318606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:13.326901 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-84646271-5b24-4bb4-bbb6-98c69f1fb18b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1360 microversion: 2.1 time: 0.154346 Oct 12 09:52:13.327747 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3828/7227] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:13 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:14.355591 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:14.356613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:14.368998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:14.369891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:14.370647 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:14.371950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:14.372760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:14.373352 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:14.511600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:14.520507 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-28f9a768-e72c-4f5a-a3fb-438dfb6526a7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1360 microversion: 2.1 time: 0.171736 Oct 12 09:52:14.521096 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3400/7228] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:14 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:14.624875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-aef488b3-2d66-4b42-83c1-6d16c633e9cd req-25a81a1b-3072-4d02-81da-c8f42a7a04f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2676a142-a094-44f2-b43f-4e409928af14", "name": "network-vif-plugged", "status": "completed", "tag": "71411af0-c240-4ec0-9c5a-9837712ebceb"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:14.635607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-aef488b3-2d66-4b42-83c1-6d16c633e9cd req-25a81a1b-3072-4d02-81da-c8f42a7a04f7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:14.636105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-aef488b3-2d66-4b42-83c1-6d16c633e9cd req-25a81a1b-3072-4d02-81da-c8f42a7a04f7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:14.636563 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-aef488b3-2d66-4b42-83c1-6d16c633e9cd req-25a81a1b-3072-4d02-81da-c8f42a7a04f7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:14.648423 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-aef488b3-2d66-4b42-83c1-6d16c633e9cd req-25a81a1b-3072-4d02-81da-c8f42a7a04f7 service nova] Creating event network-vif-plugged:71411af0-c240-4ec0-9c5a-9837712ebceb for instance 2676a142-a094-44f2-b43f-4e409928af14 on n-h2-858383-10 Oct 12 09:52:14.653590 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-aef488b3-2d66-4b42-83c1-6d16c633e9cd req-25a81a1b-3072-4d02-81da-c8f42a7a04f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032721 Oct 12 09:52:14.654207 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3829/7229] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:15.544737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:15.545348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:15.552943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:15.553452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:15.553918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:15.554610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:15.555070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:15.555493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:15.693181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:15.704954 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-09820ca2-5d4e-4d00-825c-2cdedf0197f8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1360 microversion: 2.1 time: 0.164024 Oct 12 09:52:15.705795 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3401/7230] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:15 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:16.729882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:16.731119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:16.735944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:16.736615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:16.744351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:16.744866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:16.745327 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:16.746086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:16.746562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:16.747009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:16.878546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:16.886595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-209f9312-8a2c-4f00-b3ec-93eb14fd5934 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1551 microversion: 2.1 time: 0.159893 Oct 12 09:52:16.887202 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3830/7231] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:16 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:16.909606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:16.910216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:16.912100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:16.918228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:16.918705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:16.919143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:16.919876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:16.920327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:16.920769 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:17.064016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:17.072508 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5aa0f5eb-397c-41d7-b01e-f2a68fe2045c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1551 microversion: 2.1 time: 0.167078 Oct 12 09:52:17.073060 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3402/7232] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:16 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:18.707200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16f7c5a1-d953-43a8-98f2-b847a6d32be0"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:18.709627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:18.716796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:18.717293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:18.717774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:18.718475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:18.718936 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:18.719373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:18.975905 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f78bda2-eab0-45f0-9e5f-6b7004b40cc1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272666 Oct 12 09:52:18.976566 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3831/7233] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:52:18 2022] POST /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:29.759953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:29.760573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:29.764919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:29.765722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=36 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:29.773506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:29.774113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:29.774705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:29.775731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:29.776393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:29.776956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:29.862411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lazy-loading 'services' on Instance uuid 2676a142-a094-44f2-b43f-4e409928af14 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:52:29.941180 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d8815371-ed71-4ee0-8326-b7e9f487a365 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments/16f7c5a1-d953-43a8-98f2-b847a6d32be0" status: 202 len: 0 microversion: 2.1 time: 0.187400 Oct 12 09:52:29.941835 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3403/7234] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:52:29 2022] DELETE /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments/16f7c5a1-d953-43a8-98f2-b847a6d32be0 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:52:29.948612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:29.949874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:29.954536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:29.957047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:29.965583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:29.966113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:29.966599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:29.967296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:29.967785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:29.968216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:30.001756 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-478b4ed2-4eaa-4dd4-8669-fd988410d26a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055127 Oct 12 09:52:30.002359 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3832/7235] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:52:29 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:52:31.017376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:31.019717 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:31.026350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:31.026839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:31.027281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:31.027990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:31.028446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:31.028877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:31.059651 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-27bd0fd5-2392-442a-ba58-fe58f955475a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047703 Oct 12 09:52:31.060218 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3404/7236] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:52:31 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:32.072742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:32.075073 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:32.082684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:32.083218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:32.083670 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:32.084400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:32.084874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:32.085313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:32.119374 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c7e6ebe-c8b9-4783-ad2b-8eedd5e262bd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050613 Oct 12 09:52:32.119874 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3833/7237] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:52:32 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:33.131833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:33.134039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:33.140960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:33.141463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:33.141912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:33.142612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:33.143063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:33.143484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:33.177036 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a98f2913-f9d9-419e-b722-b7944c6237fb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049354 Oct 12 09:52:33.177662 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3405/7238] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:52:33 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:34.190385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:34.192587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:34.200069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:34.200570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:34.201019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:34.201761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:34.202247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:34.202690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:34.234889 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5214e0d0-7df1-4b7a-a275-672163ff4f4f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048780 Oct 12 09:52:34.235686 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3834/7239] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:52:34 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:35.252010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:35.254387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:35.262370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:35.262911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:35.263400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:35.264176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:35.264689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:35.265166 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:35.297275 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02d6c603-5b3d-470e-85b5-96b20e02f0c7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051659 Oct 12 09:52:35.297854 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3406/7240] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:52:35 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:52:35.311912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:35.312437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:35.322002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:35.322679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:35.323277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:35.324344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:35.325021 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:35.325647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:35.408646 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] HTTP exception thrown: Instance 2676a142-a094-44f2-b43f-4e409928af14 is not attached to volume 16f7c5a1-d953-43a8-98f2-b847a6d32be0 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Request method failure captured: Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments/16f7c5a1-d953-43a8-98f2-b847a6d32be0 HTTP/1.1 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRo5AwLRlygbQ8SBLvuyYXaCcxHxAmBQ1GFfHoUYitbpJPhIm2Ayu5pQ3VV0NAhXEmjy5dua9TcCTar0GYdbZ8XD_qVMAToX_YkwcyGxs3edNI5XbHwubdYEntXm4UKFI2AKLJhcdz4KqItMCKgTj5lgmLuoJYww_LtHuEw3VrEgDwhs Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c07038af8a5249469d5cb828df3a643b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}] Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 5e7bd92e366740c897a13339241517cf Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2676a142-a094-44f2-b43f-4e409928af14 is not attached to volume 16f7c5a1-d953-43a8-98f2-b847a6d32be0 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': '2676a142-a094-44f2-b43f-4e409928af14', 'id': '16f7c5a1-d953-43a8-98f2-b847a6d32be0'} Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16f7c5a1-d953-43a8-98f2-b847a6d32be0. Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2676a142-a094-44f2-b43f-4e409928af14 is not attached to volume 16f7c5a1-d953-43a8-98f2-b847a6d32be0 Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:52:35.425493 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:52:35.430025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:52:35.430025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:52:35.430025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2676a142-a094-44f2-b43f-4e409928af14 is not attached to volume 16f7c5a1-d953-43a8-98f2-b847a6d32be0 Oct 12 09:52:35.430025 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:35.430025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Returning 404 to user: Instance 2676a142-a094-44f2-b43f-4e409928af14 is not attached to volume 16f7c5a1-d953-43a8-98f2-b847a6d32be0 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:52:35.430025 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d73bb61d-96c1-464d-8004-fbce2f02a00b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments/16f7c5a1-d953-43a8-98f2-b847a6d32be0" status: 404 len: 154 microversion: 2.1 time: 0.121406 Oct 12 09:52:35.430025 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3835/7241] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:52:35 2022] DELETE /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14/os-volume_attachments/16f7c5a1-d953-43a8-98f2-b847a6d32be0 => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:52:38.793546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:38.794113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:38.801289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:38.801888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:38.802400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:38.803179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:38.803698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:38.804211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:38.832036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:52:38.916331 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f7d7d13d-0a2e-4991-953d-f9980d9ef81f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 204 len: 0 microversion: 2.1 time: 0.126145 Oct 12 09:52:38.917123 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3407/7242] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:52:38 2022] DELETE /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:52:38.925749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:38.926375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:38.934004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:38.934499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:38.934948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:38.935654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:38.936118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:38.936557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:39.075176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:39.083547 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b7b4c33-5dce-4e4f-919b-4e8c6866a925 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1557 microversion: 2.1 time: 0.161695 Oct 12 09:52:39.084148 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3836/7243] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:38 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:40.111860 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:40.112602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:40.120805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:40.121219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:40.121721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:40.122463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:40.122946 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:40.123394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:40.257469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:40.265661 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9b1fe726-7b4d-4b69-ac4e-85d883ad2263 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1557 microversion: 2.1 time: 0.160909 Oct 12 09:52:40.266244 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3408/7244] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:40 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:41.109615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ec186c1b-e4b9-4cbc-bc25-3cad8ce1f3d4 req-54499531-7ab2-4dc4-a9ac-3213eef3d005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2676a142-a094-44f2-b43f-4e409928af14", "name": "network-vif-deleted", "tag": "71411af0-c240-4ec0-9c5a-9837712ebceb"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:41.122413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ec186c1b-e4b9-4cbc-bc25-3cad8ce1f3d4 req-54499531-7ab2-4dc4-a9ac-3213eef3d005 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:41.122912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ec186c1b-e4b9-4cbc-bc25-3cad8ce1f3d4 req-54499531-7ab2-4dc4-a9ac-3213eef3d005 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:41.123361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ec186c1b-e4b9-4cbc-bc25-3cad8ce1f3d4 req-54499531-7ab2-4dc4-a9ac-3213eef3d005 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:41.135440 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ec186c1b-e4b9-4cbc-bc25-3cad8ce1f3d4 req-54499531-7ab2-4dc4-a9ac-3213eef3d005 service nova] Creating event network-vif-deleted:71411af0-c240-4ec0-9c5a-9837712ebceb for instance 2676a142-a094-44f2-b43f-4e409928af14 on n-h2-858383-10 Oct 12 09:52:41.140919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ec186c1b-e4b9-4cbc-bc25-3cad8ce1f3d4 req-54499531-7ab2-4dc4-a9ac-3213eef3d005 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035618 Oct 12 09:52:41.141549 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3837/7245] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:41.288421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:41.289047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:41.296290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:41.296797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:41.297241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:41.297974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:41.298456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:41.298997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:41.331436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:41.331882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:41.332346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:41.332819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lazy-loading 'fault' on Instance uuid 2676a142-a094-44f2-b43f-4e409928af14 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:52:41.378258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:41.386423 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0f00224a-3a82-4069-aa9f-6e2edf1e719d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 200 len: 1350 microversion: 2.1 time: 0.102103 Oct 12 09:52:41.387002 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3409/7246] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:41 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:42.416579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:42.417824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2676a142-a094-44f2-b43f-4e409928af14] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:42.428450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:42.429527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:42.430287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:42.431482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:42.432293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:42.433042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:42.452437 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] HTTP exception thrown: Instance 2676a142-a094-44f2-b43f-4e409928af14 could not be found. Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Request method failure captured: Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 HTTP/1.1 Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRo5AwLRlygbQ8SBLvuyYXaCcxHxAmBQ1GFfHoUYitbpJPhIm2Ayu5pQ3VV0NAhXEmjy5dua9TcCTar0GYdbZ8XD_qVMAToX_YkwcyGxs3edNI5XbHwubdYEntXm4UKFI2AKLJhcdz4KqItMCKgTj5lgmLuoJYww_LtHuEw3VrEgDwhs Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c07038af8a5249469d5cb828df3a643b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}] Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 5e7bd92e366740c897a13339241517cf Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2676a142-a094-44f2-b43f-4e409928af14 could not be found. Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2676a142-a094-44f2-b43f-4e409928af14'} Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2676a142-a094-44f2-b43f-4e409928af14 could not be found. Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2676a142-a094-44f2-b43f-4e409928af14 could not be found. Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:52:42.454253 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2676a142-a094-44f2-b43f-4e409928af14 could not be found. Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Returning 404 to user: Instance 2676a142-a094-44f2-b43f-4e409928af14 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-36802568-050f-4d11-9eb8-9de96caa465a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14" status: 404 len: 111 microversion: 2.1 time: 0.048108 Oct 12 09:52:42.458767 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3838/7247] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:42 2022] GET /compute/v2.1/servers/2676a142-a094-44f2-b43f-4e409928af14 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:52:42.464853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b5b9abc9-7e6b-4d22-a43c-7e2b630da7e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '.version_select at 0x7f984cbfd160>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:42.487613 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b5b9abc9-7e6b-4d22-a43c-7e2b630da7e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-8849604" status: 202 len: 0 microversion: 2.1 time: 0.026619 Oct 12 09:52:42.488206 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3410/7248] 10.222.0.40 () {58 vars in 1269 bytes} [Wed Oct 12 09:52:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-8849604 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:52:42.506481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-24496597-a140-4ebb-b2a0-8c077cdd67a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: .version_select at 0x7f9848b98940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-11697553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDfh4R09XAWJfZ7B2njTNGTw8C9/JwwMrijmPCgy12xlvkKUK5hXNmfqKoBB4DyJc1hl+iyWCf343izpREp/IbTnCwG+Ui+hUvmNw0rrljM9U5yueLtSDirnPOuMuAthQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:42.523511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-24496597-a140-4ebb-b2a0-8c077cdd67a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for project c07038af8a5249469d5cb828df3a643b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:52:42.528728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-24496597-a140-4ebb-b2a0-8c077cdd67a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for user 5e7bd92e366740c897a13339241517cf and project c07038af8a5249469d5cb828df3a643b. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:52:42.561672 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-24496597-a140-4ebb-b2a0-8c077cdd67a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058896 Oct 12 09:52:42.562523 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3839/7249] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:52:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:42.640982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-156570219", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-11697553", "networks": [{"uuid": "d54f67d2-3af3-438c-b090-519c97077050"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:42.696411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] validate_networks() for [('d54f67d2-3af3-438c-b090-519c97077050', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:52:43.199419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:52:43.199851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:52:43.200465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:52:43.200886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:52:43.201327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:52:43.210624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:43.211114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:43.211560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:43.212295 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:43.212755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:43.213184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:43.230702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for project c07038af8a5249469d5cb828df3a643b. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:52:43.236219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for user 5e7bd92e366740c897a13339241517cf and project c07038af8a5249469d5cb828df3a643b. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:52:43.249283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:52:43.251753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:52:43.296514 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [cfa2cd62-3aaf-48ff-b652-d79bef6fd6f6] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:52:44.310520 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [cfa2cd62-3aaf-48ff-b652-d79bef6fd6f6] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49486. Oct 12 09:52:44.318158 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-da13f6e9-5352-48c8-ba59-379bcdee374c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.680763 Oct 12 09:52:44.319226 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3411/7250] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:52:44.335972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf93b0ce-ff48-4067-ac21-d3239dfd4db9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:44.336575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cf93b0ce-ff48-4067-ac21-d3239dfd4db9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:44.392838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cf93b0ce-ff48-4067-ac21-d3239dfd4db9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:44.399983 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf93b0ce-ff48-4067-ac21-d3239dfd4db9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1260 microversion: 2.1 time: 0.068905 Oct 12 09:52:44.400542 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3840/7251] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:44 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1260 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:45.437909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:45.438862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:45.446485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:45.446972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:45.447410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:45.448109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:45.448561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:45.449063 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:45.518515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:45.527157 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-72ff61cf-0cd5-470e-bb34-0d7a84d24068 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1312 microversion: 2.1 time: 0.106703 Oct 12 09:52:45.528143 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3412/7252] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:45 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:46.551963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:46.553158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:46.561012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:46.561483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:46.561948 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:46.562674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:46.563153 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:46.563674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:46.814740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:46.822689 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b12f99c7-d607-4a97-aa0d-c6e4b7b8059a tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1360 microversion: 2.1 time: 0.274942 Oct 12 09:52:46.823706 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3841/7253] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:46 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1360 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:46.964595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-a2a4a87c-3698-4f9d-ab83-2960e94f93d6 req-5705cfb0-d897-4972-83e2-440aa68c2b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe6a106-9b51-4165-9fbf-47998c2fdd6e", "tag": "1a2b74ee-5c53-4f02-b1e0-689ca512f331"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:46.975700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2a4a87c-3698-4f9d-ab83-2960e94f93d6 req-5705cfb0-d897-4972-83e2-440aa68c2b5b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:46.976275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2a4a87c-3698-4f9d-ab83-2960e94f93d6 req-5705cfb0-d897-4972-83e2-440aa68c2b5b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:46.976901 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-a2a4a87c-3698-4f9d-ab83-2960e94f93d6 req-5705cfb0-d897-4972-83e2-440aa68c2b5b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:46.988881 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-a2a4a87c-3698-4f9d-ab83-2960e94f93d6 req-5705cfb0-d897-4972-83e2-440aa68c2b5b service nova] Creating event network-changed:1a2b74ee-5c53-4f02-b1e0-689ca512f331 for instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e on n-h2-858383-10 Oct 12 09:52:46.994221 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-a2a4a87c-3698-4f9d-ab83-2960e94f93d6 req-5705cfb0-d897-4972-83e2-440aa68c2b5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033704 Oct 12 09:52:46.994928 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3413/7254] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:47.846730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:47.847466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:47.855849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:47.856502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:47.857087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:47.857947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:47.858483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:47.859204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:47.994391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:48.002650 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f440b4e7-1803-4129-9c50-ae71ef1a97e9 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1360 microversion: 2.1 time: 0.159919 Oct 12 09:52:48.003213 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3842/7255] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:47 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:49.028421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:49.028993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:49.036488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:49.036982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:49.037555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:49.038296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:49.038761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:49.039188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:49.170774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:49.183130 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02041538-e31a-4dab-8503-c66fab96e318 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1360 microversion: 2.1 time: 0.160181 Oct 12 09:52:49.183878 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3414/7256] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:49 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:50.209600 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:50.210199 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:50.217545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:50.218047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:50.218498 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:50.219220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:50.219681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:50.220107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:50.357826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:50.366181 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9f452824-e159-472c-88d6-b64c7a621f01 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1360 microversion: 2.1 time: 0.160842 Oct 12 09:52:50.366748 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3843/7257] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:50 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:51.392678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:51.393564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:51.405371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:51.406235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:51.406974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:51.408134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:51.408896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:51.409665 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:51.545912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:51.554206 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5a031527-0143-4eda-b327-e5359307e22d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1360 microversion: 2.1 time: 0.168324 Oct 12 09:52:51.554787 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3415/7258] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:51 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:52.580477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:52.581536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:52.591047 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:52.591556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:52.592015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:52.592744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:52.593228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:52.593701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:52.726985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:52.735134 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-178e4f9d-f22a-49ac-804c-d48ac7788728 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1360 microversion: 2.1 time: 0.161294 Oct 12 09:52:52.735738 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3844/7259] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:52 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:52.795268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2c23e019-4d1a-45c1-81ff-82f5c6991e0d req-ee82df11-d12e-4f47-99b9-95c1615df556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe6a106-9b51-4165-9fbf-47998c2fdd6e", "name": "network-vif-plugged", "status": "completed", "tag": "1a2b74ee-5c53-4f02-b1e0-689ca512f331"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:52.806023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2c23e019-4d1a-45c1-81ff-82f5c6991e0d req-ee82df11-d12e-4f47-99b9-95c1615df556 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:52.806691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2c23e019-4d1a-45c1-81ff-82f5c6991e0d req-ee82df11-d12e-4f47-99b9-95c1615df556 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:52.807124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2c23e019-4d1a-45c1-81ff-82f5c6991e0d req-ee82df11-d12e-4f47-99b9-95c1615df556 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:52.819874 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2c23e019-4d1a-45c1-81ff-82f5c6991e0d req-ee82df11-d12e-4f47-99b9-95c1615df556 service nova] Creating event network-vif-plugged:1a2b74ee-5c53-4f02-b1e0-689ca512f331 for instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e on n-h2-858383-10 Oct 12 09:52:52.825135 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2c23e019-4d1a-45c1-81ff-82f5c6991e0d req-ee82df11-d12e-4f47-99b9-95c1615df556 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033508 Oct 12 09:52:52.825967 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3416/7260] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:52:53.763280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:53.764272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:53.775856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:53.776352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:53.776804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:53.777540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:53.778016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:53.778455 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:53.922393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:53.930592 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a70023bd-09a5-46e9-9b7d-adf69cf9eac3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1360 microversion: 2.1 time: 0.174119 Oct 12 09:52:53.931170 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3845/7261] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:53 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:54.954053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:54.955302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:54.963486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:54.964635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:54.976249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:54.977053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:54.977947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:54.978894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:54.979349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:54.979774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:55.124065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:55.132539 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-57d5f6fb-8e03-4d1f-b65e-59bbaffa96c3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1551 microversion: 2.1 time: 0.180353 Oct 12 09:52:55.133083 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3417/7262] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:54 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1551 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:55.156371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:52:55.156998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:55.159049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:55.166265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:55.166856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:55.167366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:55.168079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:55.168547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:55.169017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:55.317867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:52:55.326705 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-520e8685-6540-4678-83fe-da0e2ecd67ed tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1551 microversion: 2.1 time: 0.174511 Oct 12 09:52:55.327231 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3846/7263] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:52:55 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1551 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:52:56.841262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf8b0e4b-4cdc-4276-a483-8d50765a1251"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:52:56.843682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:52:56.850867 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:56.851350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:56.851791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:56.852490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:52:56.852955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:52:56.853375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:52:57.088404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:52:57.107599 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-743d25da-b392-4ee6-872b-67cb4a24528d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270317 Oct 12 09:52:57.108224 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3418/7264] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:52:56 2022] POST /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:07.902383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:07.902965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:07.906698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:07.907421 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=70 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:07.913578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:07.914089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:07.914530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:07.915255 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:07.915729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:07.916184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:08.067880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lazy-loading 'services' on Instance uuid ebe6a106-9b51-4165-9fbf-47998c2fdd6e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:53:08.142069 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9521d138-3d55-4739-bb2c-dbf1962b38a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments/cf8b0e4b-4cdc-4276-a483-8d50765a1251" status: 202 len: 0 microversion: 2.1 time: 0.243482 Oct 12 09:53:08.142887 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3847/7265] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:53:07 2022] DELETE /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments/cf8b0e4b-4cdc-4276-a483-8d50765a1251 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:53:08.149787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:08.151508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:08.158877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:08.161620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:08.169902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:08.170375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:08.170816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:08.171558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:08.172009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:08.172438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:08.206209 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9c8b810b-4ad1-49bf-afb2-00b8f1e94fcd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058668 Oct 12 09:53:08.206865 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3419/7266] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:08 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:53:09.221232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:09.223792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:09.230588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:09.231090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:09.231516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:09.232323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:09.232804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:09.233240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:09.264355 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9849ae4a-1bba-4b94-957b-3022a455b5a4 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048519 Oct 12 09:53:09.264918 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3848/7267] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:09 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:10.277002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:10.280037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:10.287871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:10.288427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:10.288850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:10.289504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:10.289963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:10.290419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:10.323548 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2c8fa2b7-744e-479b-bde8-085295274f79 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050786 Oct 12 09:53:10.324105 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3420/7268] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:10 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:11.336655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:11.338952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:11.346598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:11.347119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:11.347583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:11.348307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:11.348789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:11.349257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:11.380950 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bdc5d516-af53-415e-a7ac-508dfeece3a2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048350 Oct 12 09:53:11.381567 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3849/7269] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:11 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:12.394113 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:12.396338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:12.403440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:12.403924 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:12.404359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:12.405049 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:12.405528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:12.405951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:12.438056 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad5761bb-d748-44eb-93ea-0e0e0a02027b tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047910 Oct 12 09:53:12.438868 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3421/7270] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:12 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:13.455463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:13.459133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:13.468096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:13.468603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:13.469058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:13.469806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:13.470281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:13.470724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:13.501619 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3f535bfb-ed50-4189-a29a-6d4e6f5ebeb1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053018 Oct 12 09:53:13.502175 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3850/7271] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:13 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:53:13.516090 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:13.516752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:13.527511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:13.528005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:13.528452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:13.529153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:13.529655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:13.530096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:13.672288 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] HTTP exception thrown: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e is not attached to volume cf8b0e4b-4cdc-4276-a483-8d50765a1251 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Request method failure captured: Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments/cf8b0e4b-4cdc-4276-a483-8d50765a1251 HTTP/1.1 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo5AwLRlygbQ8SBLvuyYXaCcxHxAmBQ1GFfHoUYitbpJPhIm2Ayu5pQ3VV0NAhXEmjy5dua9TcCTar0GYdbZ8XD_qVMAToX_YkwcyGxs3edNI5XbHwubdYEntXm4UKFI2AKLJhcdz4KqItMCKgTj5lgmLuoJYww_LtHuEw3VrEgDwhs Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c07038af8a5249469d5cb828df3a643b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}] Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5e7bd92e366740c897a13339241517cf Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e is not attached to volume cf8b0e4b-4cdc-4276-a483-8d50765a1251 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': 'ebe6a106-9b51-4165-9fbf-47998c2fdd6e', 'id': 'cf8b0e4b-4cdc-4276-a483-8d50765a1251'} Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cf8b0e4b-4cdc-4276-a483-8d50765a1251. Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e is not attached to volume cf8b0e4b-4cdc-4276-a483-8d50765a1251 Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:53:13.674309 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:53:13.678995 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:53:13.678995 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:53:13.678995 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e is not attached to volume cf8b0e4b-4cdc-4276-a483-8d50765a1251 Oct 12 09:53:13.678995 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:13.678995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Returning 404 to user: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e is not attached to volume cf8b0e4b-4cdc-4276-a483-8d50765a1251 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:53:13.678995 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71100789-4203-4fb3-815c-ce358bf15dbd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments/cf8b0e4b-4cdc-4276-a483-8d50765a1251" status: 404 len: 154 microversion: 2.1 time: 0.166419 Oct 12 09:53:13.678995 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3422/7272] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:53:13 2022] DELETE /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e/os-volume_attachments/cf8b0e4b-4cdc-4276-a483-8d50765a1251 => generated 154 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:53:17.042826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:17.043381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:17.050717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:17.051247 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:17.051704 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:17.052534 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:17.053023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:17.053536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:17.084955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:53:17.185097 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8eb61bec-00fb-4cee-853f-141d11ace154 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 204 len: 0 microversion: 2.1 time: 0.146212 Oct 12 09:53:17.189698 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3851/7273] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:53:17 2022] DELETE /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 09:53:17.195662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:17.196294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:17.206856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:17.207356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:17.207801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:17.208516 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:17.208975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:17.209494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:17.350795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:17.359397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-efc6698c-5920-4942-b083-7559ea0cc468 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1557 microversion: 2.1 time: 0.168318 Oct 12 09:53:17.360006 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3423/7274] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:17 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:18.388819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:18.390143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:18.401803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:18.402718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:18.403469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:18.404623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:18.405406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:18.406124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:18.540590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:18.548947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e747efa5-ca9b-4411-aa98-c34b330920db tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1557 microversion: 2.1 time: 0.167960 Oct 12 09:53:18.549548 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3852/7275] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:18 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:19.382857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-5e29828b-b259-4230-92dd-0555fdf8f4c9 req-38f03001-0779-44d4-86d1-24f4fee5e1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe6a106-9b51-4165-9fbf-47998c2fdd6e", "name": "network-vif-deleted", "tag": "1a2b74ee-5c53-4f02-b1e0-689ca512f331"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:53:19.393984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5e29828b-b259-4230-92dd-0555fdf8f4c9 req-38f03001-0779-44d4-86d1-24f4fee5e1c7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:19.394464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5e29828b-b259-4230-92dd-0555fdf8f4c9 req-38f03001-0779-44d4-86d1-24f4fee5e1c7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:19.394997 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-5e29828b-b259-4230-92dd-0555fdf8f4c9 req-38f03001-0779-44d4-86d1-24f4fee5e1c7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:19.407062 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-5e29828b-b259-4230-92dd-0555fdf8f4c9 req-38f03001-0779-44d4-86d1-24f4fee5e1c7 service nova] Creating event network-vif-deleted:1a2b74ee-5c53-4f02-b1e0-689ca512f331 for instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e on n-h2-858383-10 Oct 12 09:53:19.412654 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-5e29828b-b259-4230-92dd-0555fdf8f4c9 req-38f03001-0779-44d4-86d1-24f4fee5e1c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033546 Oct 12 09:53:19.413260 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3424/7276] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:19.572258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:19.572888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:19.580762 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:19.581200 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:19.581713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:19.582429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:19.582980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:19.583489 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:19.616615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:19.617118 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:19.617635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:19.618086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lazy-loading 'fault' on Instance uuid ebe6a106-9b51-4165-9fbf-47998c2fdd6e {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:53:19.666453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:19.678201 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7254a203-edac-4b64-a7f6-c9d44f559c05 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 200 len: 1350 microversion: 2.1 time: 0.109508 Oct 12 09:53:19.678971 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3853/7277] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:19 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:20.711399 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:20.712558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: ebe6a106-9b51-4165-9fbf-47998c2fdd6e] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:20.723241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:20.724044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:20.724788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:20.726045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:20.726771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:20.727497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:20.745069 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] HTTP exception thrown: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e could not be found. Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Request method failure captured: Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e HTTP/1.1 Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo5AwLRlygbQ8SBLvuyYXaCcxHxAmBQ1GFfHoUYitbpJPhIm2Ayu5pQ3VV0NAhXEmjy5dua9TcCTar0GYdbZ8XD_qVMAToX_YkwcyGxs3edNI5XbHwubdYEntXm4UKFI2AKLJhcdz4KqItMCKgTj5lgmLuoJYww_LtHuEw3VrEgDwhs Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c07038af8a5249469d5cb828df3a643b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}] Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5e7bd92e366740c897a13339241517cf Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e could not be found. Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': 'ebe6a106-9b51-4165-9fbf-47998c2fdd6e'} Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e could not be found. Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e could not be found. Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:53:20.746764 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e could not be found. Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Returning 404 to user: Instance ebe6a106-9b51-4165-9fbf-47998c2fdd6e could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cdee8f37-8699-4766-bd05-eb7a2135d36f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e" status: 404 len: 111 microversion: 2.1 time: 0.045748 Oct 12 09:53:20.750925 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3425/7278] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:20 2022] GET /compute/v2.1/servers/ebe6a106-9b51-4165-9fbf-47998c2fdd6e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:53:20.760273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3c2354f5-0753-41df-9f34-6b4bcf833ca7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '.version_select at 0x7f9843c28670>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:20.784514 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3c2354f5-0753-41df-9f34-6b4bcf833ca7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-11697553" status: 202 len: 0 microversion: 2.1 time: 0.030858 Oct 12 09:53:20.785089 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3854/7279] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 09:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-11697553 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:53:20.802795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fc6ba6ed-b214-4d7d-b5ab-e85ebf65d936 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: .version_select at 0x7f9848891af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-924346614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMUESeSM8ds/LXki52pLvpsp8AQXu4C/ZodHVbeaHbr1Z8K1anjIWufk5H5rlF1T3hfEFZh+BFDJ5NGSSAwlexxBQ5XiPniAn7Ef83OfFE/BupXS9lm11YEiM9gZpzxNw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:53:20.818351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-fc6ba6ed-b214-4d7d-b5ab-e85ebf65d936 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for project c07038af8a5249469d5cb828df3a643b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:53:20.827226 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-fc6ba6ed-b214-4d7d-b5ab-e85ebf65d936 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for user 5e7bd92e366740c897a13339241517cf and project c07038af8a5249469d5cb828df3a643b. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:53:20.852879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fc6ba6ed-b214-4d7d-b5ab-e85ebf65d936 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054076 Oct 12 09:53:20.853503 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3426/7280] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:53:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:20.910401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1016604437", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-924346614", "networks": [{"uuid": "d54f67d2-3af3-438c-b090-519c97077050"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:53:20.963775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] validate_networks() for [('d54f67d2-3af3-438c-b090-519c97077050', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:53:21.348254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:53:21.348833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:53:21.349548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:53:21.350123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:53:21.350646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:53:21.364810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:21.365348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:21.365917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:21.366896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:21.367482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:21.368113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:21.389470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for project c07038af8a5249469d5cb828df3a643b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:53:21.395231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Getting quotas for user 5e7bd92e366740c897a13339241517cf and project c07038af8a5249469d5cb828df3a643b. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:53:21.408624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:53:21.410998 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:53:21.458994 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b9db9e96-8b58-4ca0-824d-95dc09a0d5a3 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552619 Oct 12 09:53:21.459802 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3855/7281] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:53:21.471451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-40fa770a-f34a-44dc-a4df-940890d8dee8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:21.472164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-40fa770a-f34a-44dc-a4df-940890d8dee8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:21.527107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-40fa770a-f34a-44dc-a4df-940890d8dee8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:21.534349 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-40fa770a-f34a-44dc-a4df-940890d8dee8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1262 microversion: 2.1 time: 0.066919 Oct 12 09:53:21.534933 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3427/7282] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:21 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:22.558125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:22.558693 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:22.566005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:22.566512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:22.566969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:22.567687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:22.568224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:22.568672 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:22.630677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:22.638996 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3a02ec4f-c6d2-4c58-b47b-ac1cfe3e61ea tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1314 microversion: 2.1 time: 0.086028 Oct 12 09:53:22.639572 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3856/7283] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:22 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1314 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:23.664439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:23.665265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:23.672552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:23.673191 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:23.673757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:23.674529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:23.675720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:23.676160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:23.921843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:23.930255 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d7c2e430-014b-449e-8557-a63536932e7f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1362 microversion: 2.1 time: 0.269905 Oct 12 09:53:23.930881 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3428/7284] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:23 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:24.381754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-818dac7f-6ba3-4f43-be6a-fc897a4ee380 req-c39d574d-1d75-4c3a-96e5-15bbd373abc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f453293-23d6-486f-921c-bab83efd0e8a", "tag": "9ba1223c-a6ed-43a7-81f6-1973c2eae13b"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:53:24.391780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-818dac7f-6ba3-4f43-be6a-fc897a4ee380 req-c39d574d-1d75-4c3a-96e5-15bbd373abc8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:24.391952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-818dac7f-6ba3-4f43-be6a-fc897a4ee380 req-c39d574d-1d75-4c3a-96e5-15bbd373abc8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:24.392397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-818dac7f-6ba3-4f43-be6a-fc897a4ee380 req-c39d574d-1d75-4c3a-96e5-15bbd373abc8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:24.404003 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-818dac7f-6ba3-4f43-be6a-fc897a4ee380 req-c39d574d-1d75-4c3a-96e5-15bbd373abc8 service nova] Creating event network-changed:9ba1223c-a6ed-43a7-81f6-1973c2eae13b for instance 2f453293-23d6-486f-921c-bab83efd0e8a on n-h2-858383-10 Oct 12 09:53:24.409031 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-818dac7f-6ba3-4f43-be6a-fc897a4ee380 req-c39d574d-1d75-4c3a-96e5-15bbd373abc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095120 Oct 12 09:53:24.409674 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3857/7285] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:24.959026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:24.960030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:24.970954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:24.971444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:24.971880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:24.972571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:24.973020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:24.973470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:25.104605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:25.112837 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0af37247-ac77-41a9-9e8e-1cd94dce3415 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1362 microversion: 2.1 time: 0.160397 Oct 12 09:53:25.113756 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3429/7286] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:24 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:26.136329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:26.137069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:26.145166 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:26.145705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:26.146201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:26.146927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:26.147395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:26.147831 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:26.283651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:26.291363 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-03410197-3282-468f-988a-ec5818a08508 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1362 microversion: 2.1 time: 0.159442 Oct 12 09:53:26.291928 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3858/7287] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:26 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 09:53:27.317370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:27.318024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:27.325405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:27.325932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:27.326380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:27.327082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:27.327541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:27.327975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:27.463882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:27.471952 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a5d9791-e808-4259-b625-9c0c18660814 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1362 microversion: 2.1 time: 0.160042 Oct 12 09:53:27.472529 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3430/7288] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:27 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:28.499272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:28.500306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:28.508583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:28.509072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:28.509548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:28.510264 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:28.510731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:28.511171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:28.652528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:28.661001 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6bcb6aef-08e9-4e53-a9d5-afad80ecf6e7 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1362 microversion: 2.1 time: 0.168319 Oct 12 09:53:28.661611 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3859/7289] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:28 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:29.699154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:29.700438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:29.709956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:29.710446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:29.710881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:29.711580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:29.712030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:29.712456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:29.856230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:29.864987 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-af632452-05d5-45f3-b8bf-88306bb33126 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1362 microversion: 2.1 time: 0.172519 Oct 12 09:53:29.865590 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3431/7290] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:29 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:30.888417 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:30.889029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:30.896120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:30.896611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:30.897057 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:30.897786 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:30.898261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:30.898699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:31.027543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-9ba6c49e-ace6-4565-894a-292e5db346a8 req-8e82b560-3efc-4b20-9c29-117bd53f3e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f453293-23d6-486f-921c-bab83efd0e8a", "name": "network-vif-plugged", "status": "completed", "tag": "9ba1223c-a6ed-43a7-81f6-1973c2eae13b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:53:31.038505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9ba6c49e-ace6-4565-894a-292e5db346a8 req-8e82b560-3efc-4b20-9c29-117bd53f3e04 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:31.038995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9ba6c49e-ace6-4565-894a-292e5db346a8 req-8e82b560-3efc-4b20-9c29-117bd53f3e04 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:31.039442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-9ba6c49e-ace6-4565-894a-292e5db346a8 req-8e82b560-3efc-4b20-9c29-117bd53f3e04 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:31.039656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:31.047867 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6c4fb43-957f-408e-bef4-2552291ceaaf tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1362 microversion: 2.1 time: 0.163468 Oct 12 09:53:31.048448 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3860/7291] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:30 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:31.051135 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-9ba6c49e-ace6-4565-894a-292e5db346a8 req-8e82b560-3efc-4b20-9c29-117bd53f3e04 service nova] Creating event network-vif-plugged:9ba1223c-a6ed-43a7-81f6-1973c2eae13b for instance 2f453293-23d6-486f-921c-bab83efd0e8a on n-h2-858383-10 Oct 12 09:53:31.061401 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-9ba6c49e-ace6-4565-894a-292e5db346a8 req-8e82b560-3efc-4b20-9c29-117bd53f3e04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106029 Oct 12 09:53:31.062060 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3432/7292] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:53:32.071703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:32.072305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:32.074373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:32.075132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:32.082278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:32.082774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:32.083228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:32.083933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:32.084403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:32.084845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:32.225632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:32.233938 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-95b6bfed-f1c1-4e8e-8f17-9209c45d22cb tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1362 microversion: 2.1 time: 0.166277 Oct 12 09:53:32.234534 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3861/7293] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:32 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:33.256932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:33.264678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:33.265840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:33.276202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:33.276927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:33.277652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:33.278745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:33.279413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:33.280060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:33.424882 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:33.435876 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1b64a7c9-8dcd-4b61-8744-808f63c5cd1c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1554 microversion: 2.1 time: 0.180576 Oct 12 09:53:33.436657 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3433/7294] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:33 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:33.465939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:33.466577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:33.473770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:33.474276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:33.474737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:33.475467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:33.475938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:33.476383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:33.613340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:33.621371 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-41a429fa-12f5-481d-951b-08d4777645dd tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1554 microversion: 2.1 time: 0.159467 Oct 12 09:53:33.621991 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3862/7295] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:33 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:35.138488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82e08f35-0e3c-496a-8740-376a2480aa79"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:53:35.140988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:35.148197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:35.148703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:35.149144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:35.149881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:35.150336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:35.150768 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:35.415201 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9d332f30-d6f6-4d1e-9671-c1e3fd8e619f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "POST /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280708 Oct 12 09:53:35.415887 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3434/7296] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:53:35 2022] POST /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:46.186661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:46.187326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:46.189917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:46.190608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:46.197176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:46.197726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:46.198179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:46.198904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:46.199376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:46.199814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:46.288481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lazy-loading 'services' on Instance uuid 2f453293-23d6-486f-921c-bab83efd0e8a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:53:46.375311 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c957b392-fc9f-477d-b72c-5db3bde7dd27 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments/82e08f35-0e3c-496a-8740-376a2480aa79" status: 202 len: 0 microversion: 2.1 time: 0.193024 Oct 12 09:53:46.376062 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3863/7297] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:53:46 2022] DELETE /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments/82e08f35-0e3c-496a-8740-376a2480aa79 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:53:46.382874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:46.383701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:53:46.388229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:46.390735 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:46.398939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:46.399446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:46.399957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:46.400906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:46.401386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:46.401837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:46.435333 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a3baffc7-e0aa-448f-9975-56af9e4ff15f tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054360 Oct 12 09:53:46.435898 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3435/7298] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:46 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:53:47.449077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:47.451622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:47.458410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:47.458940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:47.459395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:47.460120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:47.460597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:47.461046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:47.492239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-306db259-59dd-4c0a-af27-a60f45b6d215 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Oct 12 09:53:47.493056 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3864/7299] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:47 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:48.505038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:48.507551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:48.515912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:48.516478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:48.517180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:48.517825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:48.518551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:48.519286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:48.552181 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71e64cbe-152b-45eb-8514-36d6eac0f8da tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051380 Oct 12 09:53:48.553105 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3436/7300] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:48 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:49.565221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:49.567454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:49.575013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:49.575519 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:49.575971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:49.576695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:49.577167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:49.577676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:49.613477 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6d09ef58-548e-4a25-8a9f-8601b672219c tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052545 Oct 12 09:53:49.614376 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3865/7301] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:49 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:50.627088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:50.629423 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:50.637058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:50.637583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:50.638059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:50.638776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:50.639233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:50.639663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:50.671404 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee9cfe8c-3997-46cf-95d8-8b57b9e53370 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048376 Oct 12 09:53:50.672216 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3437/7302] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:50 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:51.689312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:51.692864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:51.700741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:51.701267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:51.701765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:51.702497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:51.702967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:51.703406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:51.735621 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29233350-11d3-4f74-8245-c3ea133761b8 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053408 Oct 12 09:53:51.736182 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3866/7303] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:53:51 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:53:51.747745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:51.748255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:51.755229 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:51.755724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:51.756274 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:51.756975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:51.757458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:51.757889 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:51.834917 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] HTTP exception thrown: Instance 2f453293-23d6-486f-921c-bab83efd0e8a is not attached to volume 82e08f35-0e3c-496a-8740-376a2480aa79 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Request method failure captured: Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: request: DELETE /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments/82e08f35-0e3c-496a-8740-376a2480aa79 HTTP/1.1 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo5AwLRlygbQ8SBLvuyYXaCcxHxAmBQ1GFfHoUYitbpJPhIm2Ayu5pQ3VV0NAhXEmjy5dua9TcCTar0GYdbZ8XD_qVMAToX_YkwcyGxs3edNI5XbHwubdYEntXm4UKFI2AKLJhcdz4KqItMCKgTj5lgmLuoJYww_LtHuEw3VrEgDwhs Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c07038af8a5249469d5cb828df3a643b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}] Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5e7bd92e366740c897a13339241517cf Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 2f453293-23d6-486f-921c-bab83efd0e8a is not attached to volume 82e08f35-0e3c-496a-8740-376a2480aa79 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'server_id': '2f453293-23d6-486f-921c-bab83efd0e8a', 'id': '82e08f35-0e3c-496a-8740-376a2480aa79'} Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 82e08f35-0e3c-496a-8740-376a2480aa79. Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f453293-23d6-486f-921c-bab83efd0e8a is not attached to volume 82e08f35-0e3c-496a-8740-376a2480aa79 Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:53:51.836580 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:53:51.840554 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:53:51.840554 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:53:51.840554 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f453293-23d6-486f-921c-bab83efd0e8a is not attached to volume 82e08f35-0e3c-496a-8740-376a2480aa79 Oct 12 09:53:51.840554 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:51.840554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Returning 404 to user: Instance 2f453293-23d6-486f-921c-bab83efd0e8a is not attached to volume 82e08f35-0e3c-496a-8740-376a2480aa79 {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:53:51.840554 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8c1a1bc-931a-4da2-b715-8c3305b690c1 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments/82e08f35-0e3c-496a-8740-376a2480aa79" status: 404 len: 154 microversion: 2.1 time: 0.094480 Oct 12 09:53:51.840554 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3438/7304] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:53:51 2022] DELETE /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a/os-volume_attachments/82e08f35-0e3c-496a-8740-376a2480aa79 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:53:55.200014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:55.200588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:55.208016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:55.208532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:55.209096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:55.209851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:55.210329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:55.210771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:55.238342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:53:55.327296 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e16ac5c-eac2-493d-a9a9-39a4ae67e699 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 204 len: 0 microversion: 2.1 time: 0.131308 Oct 12 09:53:55.328383 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3867/7305] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:53:55 2022] DELETE /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:53:55.336497 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:55.337116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:55.344963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:55.345480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:55.345957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:55.346655 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:55.347112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:55.347545 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:55.479680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:55.488206 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-397a242f-20e1-42e7-819c-ca1830b50ee2 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1560 microversion: 2.1 time: 0.155744 Oct 12 09:53:55.488784 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3439/7306] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:55 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:56.517727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:56.519079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:56.527504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:56.528038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:56.528486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:56.529196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:56.529713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:56.530154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:56.660593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:56.668580 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-028b6b89-7821-4f2f-8093-e2a2b9a81f2d tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1560 microversion: 2.1 time: 0.158820 Oct 12 09:53:56.669173 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3868/7307] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:56 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:57.496250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e8cc2c9d-926d-4e34-b538-e72e7f552dff req-fd19eaca-f2b7-463b-abbc-a5f865de7d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f453293-23d6-486f-921c-bab83efd0e8a", "name": "network-vif-deleted", "tag": "9ba1223c-a6ed-43a7-81f6-1973c2eae13b"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:53:57.507775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e8cc2c9d-926d-4e34-b538-e72e7f552dff req-fd19eaca-f2b7-463b-abbc-a5f865de7d4f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:57.508271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e8cc2c9d-926d-4e34-b538-e72e7f552dff req-fd19eaca-f2b7-463b-abbc-a5f865de7d4f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:57.508704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e8cc2c9d-926d-4e34-b538-e72e7f552dff req-fd19eaca-f2b7-463b-abbc-a5f865de7d4f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:57.524847 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e8cc2c9d-926d-4e34-b538-e72e7f552dff req-fd19eaca-f2b7-463b-abbc-a5f865de7d4f service nova] Creating event network-vif-deleted:9ba1223c-a6ed-43a7-81f6-1973c2eae13b for instance 2f453293-23d6-486f-921c-bab83efd0e8a on n-h2-858383-10 Oct 12 09:53:57.530525 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e8cc2c9d-926d-4e34-b538-e72e7f552dff req-fd19eaca-f2b7-463b-abbc-a5f865de7d4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038010 Oct 12 09:53:57.531154 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3440/7308] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:53:57.691755 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:57.692378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:57.699808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:57.700315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:57.700763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:57.701512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:57.701979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:57.702418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:57.734294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:57.734719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:57.735167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:57.735626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lazy-loading 'fault' on Instance uuid 2f453293-23d6-486f-921c-bab83efd0e8a {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:53:57.779566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7bd92e366740c897a13339241517cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07038af8a5249469d5cb828df3a643b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:53:57.787665 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa0b14ec-edb3-449c-94f1-3b4e07b5d282 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 200 len: 1352 microversion: 2.1 time: 0.099771 Oct 12 09:53:57.788233 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3869/7309] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:57 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:53:58.819263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:58.820286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] [instance: 2f453293-23d6-486f-921c-bab83efd0e8a] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:53:58.831755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:58.832544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:58.833275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:58.834569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:53:58.835017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:53:58.835448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:53:58.849549 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] HTTP exception thrown: Instance 2f453293-23d6-486f-921c-bab83efd0e8a could not be found. Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Request method failure captured: Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a HTTP/1.1 Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo5AwLRlygbQ8SBLvuyYXaCcxHxAmBQ1GFfHoUYitbpJPhIm2Ayu5pQ3VV0NAhXEmjy5dua9TcCTar0GYdbZ8XD_qVMAToX_YkwcyGxs3edNI5XbHwubdYEntXm4UKFI2AKLJhcdz4KqItMCKgTj5lgmLuoJYww_LtHuEw3VrEgDwhs Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c07038af8a5249469d5cb828df3a643b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c07038af8a5249469d5cb828df3a643b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c07038af8a5249469d5cb828df3a643b"}]}] Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: c07038af8a5249469d5cb828df3a643b Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-614416192 Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 5e7bd92e366740c897a13339241517cf Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestEncryptedCinderVolumes-614416192-project Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 2f453293-23d6-486f-921c-bab83efd0e8a could not be found. Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '2f453293-23d6-486f-921c-bab83efd0e8a'} Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f453293-23d6-486f-921c-bab83efd0e8a could not be found. Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f453293-23d6-486f-921c-bab83efd0e8a could not be found. Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:53:58.851247 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f453293-23d6-486f-921c-bab83efd0e8a could not be found. Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Returning 404 to user: Instance 2f453293-23d6-486f-921c-bab83efd0e8a could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4f7938be-351e-4b53-a318-1abe31b7bfa0 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a" status: 404 len: 111 microversion: 2.1 time: 0.044036 Oct 12 09:53:58.855316 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3441/7310] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:53:58 2022] GET /compute/v2.1/servers/2f453293-23d6-486f-921c-bab83efd0e8a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:53:58.863392 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66735b52-37aa-4935-942e-77e957487be6 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] Calling method '.version_select at 0x7f9848881e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:53:58.886810 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66735b52-37aa-4935-942e-77e957487be6 tempest-TestEncryptedCinderVolumes-614416192 tempest-TestEncryptedCinderVolumes-614416192-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-924346614" status: 202 len: 0 microversion: 2.1 time: 0.028860 Oct 12 09:53:58.887420 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3870/7311] 10.222.0.40 () {58 vars in 1275 bytes} [Wed Oct 12 09:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-924346614 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:54:25.454989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e50287a5-3bd3-478c-ac25-d21688a8eaff tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'create', calling method: .version_select at 0x7f9843f42280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-12605379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeerZWEE0QRkInpbdQ3rikn/ozuiHugkGLSgqYgj/fMVM8RSneBwndITCadMFhKdDok9h/sLfXifzd2lqf8Fo0A0c97P9LWVduAKEnKO6jTi0/LcJ6J8E2cek2CqVXwDw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:54:25.462544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=14 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:54:25.463594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=34 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:54:25.477533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e50287a5-3bd3-478c-ac25-d21688a8eaff tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Getting quotas for project 8a57a140a16c4bdcb38c8eaf9d0c3236. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:54:25.485403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-e50287a5-3bd3-478c-ac25-d21688a8eaff tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Getting quotas for user f2c12598c2d84f84a56e15e0adedea73 and project 8a57a140a16c4bdcb38c8eaf9d0c3236. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:54:25.515277 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e50287a5-3bd3-478c-ac25-d21688a8eaff tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.064496 Oct 12 09:54:25.515871 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3442/7312] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:54:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:54:25.573399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-480638704", "imageRef": "420a7154-58c7-4830-a4d0-df09db33502d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-12605379", "networks": [{"uuid": "bd5b9eac-db0f-44fb-ae66-85eb751acb54"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:54:25.583412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:54:25.584091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:54:25.634873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] validate_networks() for [('bd5b9eac-db0f-44fb-ae66-85eb751acb54', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:54:26.025454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:54:26.025901 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:54:26.026396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:54:26.026822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:54:26.027267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:54:26.036383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:26.036889 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:26.037350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:26.038135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:26.038609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:26.039049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:26.056174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Getting quotas for project 8a57a140a16c4bdcb38c8eaf9d0c3236. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:54:26.061856 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Getting quotas for user f2c12598c2d84f84a56e15e0adedea73 and project 8a57a140a16c4bdcb38c8eaf9d0c3236. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:54:26.074681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:54:26.076920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='420a7154-58c7-4830-a4d0-df09db33502d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:54:26.124033 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-498d2e39-2280-4e0f-a191-662230f71ccc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555032 Oct 12 09:54:26.124595 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3871/7313] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:54:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:54:26.136071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d357f5ad-0867-42a4-859c-5c822abcdf82 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:26.136688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d357f5ad-0867-42a4-859c-5c822abcdf82 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:26.192720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d357f5ad-0867-42a4-859c-5c822abcdf82 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:26.200072 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d357f5ad-0867-42a4-859c-5c822abcdf82 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1256 microversion: 2.1 time: 0.067996 Oct 12 09:54:26.200691 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3443/7314] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:26 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1256 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:27.225007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:27.225665 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:27.232521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:27.233037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:27.233538 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:27.234254 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:27.234761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:27.235210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:27.303476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:27.311492 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6e0ef05-9ebd-46f7-88f9-c2a19b173b42 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1308 microversion: 2.1 time: 0.092163 Oct 12 09:54:27.312071 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3872/7315] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:27 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:28.339676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:28.340540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:28.349312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:28.349920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:28.350359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:28.351067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:28.351520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:28.351947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:28.415825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:28.423963 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c124e790-0827-4c72-a6d7-b99ad523667d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1314 microversion: 2.1 time: 0.091764 Oct 12 09:54:28.424540 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3444/7316] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:28 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1314 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:29.448190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:29.449496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:29.456837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:29.457915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:29.458608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:29.459334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:29.459964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:29.460401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:29.525814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:29.533792 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-320c8c45-86f9-4e24-a283-706937bb46e0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1314 microversion: 2.1 time: 0.089462 Oct 12 09:54:29.534382 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3873/7317] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:29 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1314 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:30.558337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:30.560840 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:30.568210 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:30.568722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:30.569162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:30.569944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:30.570432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:30.570881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:30.635172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:30.643119 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa64fbd4-cc47-48d4-81f8-e4e7922b5744 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1314 microversion: 2.1 time: 0.090560 Oct 12 09:54:30.643703 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3445/7318] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:30 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1314 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:31.667040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:31.667713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:31.675147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:31.675656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:31.676114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:31.676838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:31.677313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:31.677788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:31.746770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:31.755570 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1fbfcbc-ab85-4c4b-8de8-54204f68b54d tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1314 microversion: 2.1 time: 0.092680 Oct 12 09:54:31.757469 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3874/7319] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:31 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1314 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:32.779303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:32.779915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:32.786479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:32.786965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:32.787368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:32.788094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:32.788538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:32.788930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:32.853956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:32.862169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e1a55483-85b7-4208-b281-0075d698b435 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1314 microversion: 2.1 time: 0.087102 Oct 12 09:54:32.862750 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3446/7320] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:32 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1314 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:33.884666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:33.885305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:33.893178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:33.893737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:33.894186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:33.895515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:33.896075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:33.896521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:33.965606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:33.974940 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-15374b4e-d01e-45ae-b447-2366373fd7ba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1314 microversion: 2.1 time: 0.094032 Oct 12 09:54:33.975965 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3875/7321] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:33 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1314 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:34.998346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:34.998943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:35.006438 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:35.006899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:35.007345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:35.008034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:35.008492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:35.008921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:35.088926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:35.103225 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fff36c2d-01cd-4efe-bf10-f4fb8f6fdbf8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1314 microversion: 2.1 time: 0.108801 Oct 12 09:54:35.103888 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3447/7322] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:34 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1314 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:36.127903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:36.128568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:36.132440 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:54:36.133249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:54:36.139993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:36.140486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:36.140944 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:36.141858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:36.142438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:36.142953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:36.321346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:36.329653 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-efc46fc3-9f4c-4a1b-bf15-fc78f9ae0a4f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1356 microversion: 2.1 time: 0.206338 Oct 12 09:54:36.330591 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3876/7323] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:36 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1356 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:36.912880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-c69c561d-e637-451b-ac8b-fc92d3be73d1 req-0c84e1ba-34f9-42bc-ab7b-999c0e1ba028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d", "tag": "48f385ba-7561-4513-8387-fa812332b4de"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:54:36.920600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:54:36.928877 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c69c561d-e637-451b-ac8b-fc92d3be73d1 req-0c84e1ba-34f9-42bc-ab7b-999c0e1ba028 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:36.929747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c69c561d-e637-451b-ac8b-fc92d3be73d1 req-0c84e1ba-34f9-42bc-ab7b-999c0e1ba028 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:36.930189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-c69c561d-e637-451b-ac8b-fc92d3be73d1 req-0c84e1ba-34f9-42bc-ab7b-999c0e1ba028 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:36.943483 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-c69c561d-e637-451b-ac8b-fc92d3be73d1 req-0c84e1ba-34f9-42bc-ab7b-999c0e1ba028 service nova] Creating event network-changed:48f385ba-7561-4513-8387-fa812332b4de for instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d on n-h2-858383-10 Oct 12 09:54:36.948753 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-c69c561d-e637-451b-ac8b-fc92d3be73d1 req-0c84e1ba-34f9-42bc-ab7b-999c0e1ba028 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040143 Oct 12 09:54:36.949582 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3448/7324] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:54:37.353556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:37.354273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:37.361957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:37.362466 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:37.362886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:37.364085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:37.364565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:37.365013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:37.838976 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:37.847541 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5e2f1c9d-a962-411c-bc62-7978ca30d4da tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1356 microversion: 2.1 time: 0.497930 Oct 12 09:54:37.848119 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3877/7325] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:37 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1356 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:38.872969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:38.873915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:38.880711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:38.881197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:38.881698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:38.882397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:38.882845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:38.883268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:39.029726 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:39.038283 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-517eb59c-dbc8-4b97-a5cd-fdb18790d9d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1356 microversion: 2.1 time: 0.171232 Oct 12 09:54:39.038872 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3449/7326] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:38 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:40.060946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:40.061630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:40.069177 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:40.069714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:40.070174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:40.070916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:40.071397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:40.071837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:40.202025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:40.210099 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fcb1b14f-6858-4606-a4a7-b9f6fa927ce6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1356 microversion: 2.1 time: 0.153273 Oct 12 09:54:40.210660 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3878/7327] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:40 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:41.232485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:41.233291 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:41.241015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:41.241541 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:41.241978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:41.242679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:41.243136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:41.243566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:41.375763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:41.383693 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-540c921c-11fc-4b35-b04b-5ac0ecd673d7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1356 microversion: 2.1 time: 0.155229 Oct 12 09:54:41.384271 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3450/7328] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:41 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:42.410890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:42.411933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:42.422703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:42.423527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:42.424272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:42.425604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:42.426381 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:42.427283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:42.568232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:42.576676 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-46e1d9bd-ae87-40d2-8008-8dfb25f0328c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1356 microversion: 2.1 time: 0.172616 Oct 12 09:54:42.577262 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3879/7329] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:42 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:43.280177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d824f556-a856-4a2f-81f9-b564849ae5ae req-1eb7a367-25b0-465f-8981-3559723e5308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d", "name": "network-vif-plugged", "status": "completed", "tag": "48f385ba-7561-4513-8387-fa812332b4de"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:54:43.290974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d824f556-a856-4a2f-81f9-b564849ae5ae req-1eb7a367-25b0-465f-8981-3559723e5308 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:43.291462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d824f556-a856-4a2f-81f9-b564849ae5ae req-1eb7a367-25b0-465f-8981-3559723e5308 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:43.291893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d824f556-a856-4a2f-81f9-b564849ae5ae req-1eb7a367-25b0-465f-8981-3559723e5308 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:43.303685 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d824f556-a856-4a2f-81f9-b564849ae5ae req-1eb7a367-25b0-465f-8981-3559723e5308 service nova] Creating event network-vif-plugged:48f385ba-7561-4513-8387-fa812332b4de for instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d on n-h2-858383-10 Oct 12 09:54:43.308845 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d824f556-a856-4a2f-81f9-b564849ae5ae req-1eb7a367-25b0-465f-8981-3559723e5308 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032557 Oct 12 09:54:43.309847 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3451/7330] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:54:43.602599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:43.603294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:43.611649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:43.612204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:43.612712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:43.613529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:43.614051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:43.614543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:43.755839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:43.767747 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1550e4b1-e45d-4a87-8915-fdd033766fd8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1356 microversion: 2.1 time: 0.170282 Oct 12 09:54:43.768434 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3880/7331] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:43 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:44.795009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:44.795931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:44.804598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:44.805241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:44.805896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:44.806821 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:44.807428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:44.808038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:44.944104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:44.952378 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a9d47a0f-52d3-4e53-bfb7-a0d13cd58eba tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1546 microversion: 2.1 time: 0.164211 Oct 12 09:54:44.952961 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3452/7332] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:44 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:44.975130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:44.975765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:44.983037 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:44.983550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:44.984011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:44.984740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:44.985209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:44.986031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:45.116667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:45.125018 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9e985099-1f99-4e19-86a2-55a111d948c4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1546 microversion: 2.1 time: 0.153913 Oct 12 09:54:45.125641 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3881/7333] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:44 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:45.147395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:45.152104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:45.152872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Searching by: {'deleted': False, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236'} {{(pid=127007) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:54:45.158662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:45.159128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:45.159561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:45.160278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:45.160728 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:45.161150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:45.185878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.multi_cell_list [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:54:45.213006 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-60f3c871-1e5d-47ab-8832-a67bd8285ba1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069562 Oct 12 09:54:45.213609 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3453/7334] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:54:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:54:45.225761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:54:45.226389 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:45.232825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:45.233323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:45.233777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:45.234486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:45.234965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:45.235409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:45.374220 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:54:45.382229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e42ee56b-bbfe-4a5e-bb25-078f1365e94c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1546 microversion: 2.1 time: 0.160705 Oct 12 09:54:45.382814 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3882/7335] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:54:45 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:54:46.952505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd966473-5118-49e2-b7a6-7077ded61fa4"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:54:46.954912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:54:46.961934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:46.962408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:46.962838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:46.963522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:54:46.963966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:54:46.964386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:54:47.221018 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9428e27-5a8c-4b35-9c25-43e02c6e76b6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272489 Oct 12 09:54:47.221699 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3454/7336] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:54:46 2022] POST /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:55:00.353853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:55:00.354544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:55:00.358064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:55:00.358737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=68 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:55:00.365683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:55:00.366206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:55:00.366656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:55:00.367399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:55:00.367868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:55:00.368311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:55:00.502272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:55:00.512189 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f993f5d1-f6c2-4d34-bdf7-69926a55af3e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1592 microversion: 2.1 time: 0.162775 Oct 12 09:55:00.512749 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3883/7337] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:55:00 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1592 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:55:02.232586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:55:02.233526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:55:02.235762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:55:02.240649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d50b707c-d147-4fd9-a1f4-03a2a0226abe req-a360aad6-69b5-4e63-ad21-ffd2b6fb3af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d", "tag": "48f385ba-7561-4513-8387-fa812332b4de"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:55:02.255525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d50b707c-d147-4fd9-a1f4-03a2a0226abe req-a360aad6-69b5-4e63-ad21-ffd2b6fb3af7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:55:02.256150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d50b707c-d147-4fd9-a1f4-03a2a0226abe req-a360aad6-69b5-4e63-ad21-ffd2b6fb3af7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:55:02.256658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d50b707c-d147-4fd9-a1f4-03a2a0226abe req-a360aad6-69b5-4e63-ad21-ffd2b6fb3af7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:55:02.270866 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d50b707c-d147-4fd9-a1f4-03a2a0226abe req-a360aad6-69b5-4e63-ad21-ffd2b6fb3af7 service nova] Creating event network-changed:48f385ba-7561-4513-8387-fa812332b4de for instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d on n-h2-858383-10 Oct 12 09:55:02.276308 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d50b707c-d147-4fd9-a1f4-03a2a0226abe req-a360aad6-69b5-4e63-ad21-ffd2b6fb3af7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045987 Oct 12 09:55:02.277187 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3455/7338] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:55:03.237217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-791012934"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:55:03.237891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:55:03.245365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:55:03.246003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:55:03.246533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:55:03.247340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:55:03.247883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:55:03.248676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:55:03.377936 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.network.security_group_api [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Adding security group c05c1897-b6b1-4934-9317-98c0ca3a2d7f to port 48f385ba-7561-4513-8387-fa812332b4de Oct 12 09:55:03.708399 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ee86e283-f3b5-434f-911c-9b335b871461 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/action" status: 202 len: 0 microversion: 2.1 time: 0.475810 Oct 12 09:55:03.709363 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3884/7339] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:55:03 2022] POST /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:55:03.717664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:55:03.718396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:55:03.724868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:55:03.725391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:55:03.725958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:55:03.726797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:55:03.727278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:55:03.727724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:55:03.883357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ea0ea346-2a2a-473c-ad4a-a71cd935b686 req-91a7c03d-49ee-4ad5-8fe8-efc83a11bb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d", "tag": "48f385ba-7561-4513-8387-fa812332b4de"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:55:03.893838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ea0ea346-2a2a-473c-ad4a-a71cd935b686 req-91a7c03d-49ee-4ad5-8fe8-efc83a11bb9b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:55:03.894472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ea0ea346-2a2a-473c-ad4a-a71cd935b686 req-91a7c03d-49ee-4ad5-8fe8-efc83a11bb9b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:55:03.895009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ea0ea346-2a2a-473c-ad4a-a71cd935b686 req-91a7c03d-49ee-4ad5-8fe8-efc83a11bb9b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:55:03.897982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:55:03.907057 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-097263fc-ebdc-482f-97cb-086f5aa13351 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1756 microversion: 2.1 time: 0.193367 Oct 12 09:55:03.908007 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3885/7340] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:55:03 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:55:03.911163 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ea0ea346-2a2a-473c-ad4a-a71cd935b686 req-91a7c03d-49ee-4ad5-8fe8-efc83a11bb9b service nova] Creating event network-changed:48f385ba-7561-4513-8387-fa812332b4de for instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d on n-h2-858383-10 Oct 12 09:55:03.916308 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ea0ea346-2a2a-473c-ad4a-a71cd935b686 req-91a7c03d-49ee-4ad5-8fe8-efc83a11bb9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203702 Oct 12 09:55:03.917485 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3456/7341] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:56:45.752099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:56:45.752875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=16 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:56:45.754086 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:56:45.754329 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:56:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/action (ip 10.222.0.40) !!! Oct 12 09:56:45.755812 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 12 09:56:45.756704 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 09:56:45.756825 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 09:56:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/action (ip 10.222.0.40) !!! Oct 12 09:56:45.762963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:56:45.766588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:56:45.779743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:56:45.780241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:56:45.780723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:56:45.781422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:56:45.781947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:56:45.782390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:56:45.866791 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1ab067e4-8a71-4cd2-90d2-b956b42908f3 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/action" status: 202 len: 0 microversion: 2.1 time: 0.117470 Oct 12 09:56:45.867627 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3886/7342] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:56:45 2022] POST /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:56:45.875880 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:56:45.876417 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:56:45.877163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:56:45.878631 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 09:56:45.878988 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 09:56:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d (ip 10.222.0.40) !!! Oct 12 09:56:45.887895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:56:45.888827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:56:45.899998 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:56:45.900492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:56:45.900934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:56:45.901667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:56:45.902133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:56:45.902564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:56:46.150488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:56:46.159557 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-97faa88a-0b13-4dc3-a198-788e42519153 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1758 microversion: 2.1 time: 0.287216 Oct 12 09:56:46.160171 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3457/7343] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:56:45 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1758 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:56:47.187516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:56:47.188226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:56:47.194916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:56:47.195394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:56:47.195843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:56:47.196553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:56:47.197014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:56:47.197470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:56:47.349533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:56:47.358755 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f042f13e-0462-4e14-b64b-9f6e852cfd07 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1756 microversion: 2.1 time: 0.177474 Oct 12 09:56:47.359324 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3887/7344] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:56:47 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:02.519066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:02.520273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:02.526830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-791012934"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:02.527356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:02.536641 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:02.537130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:02.537577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:02.538246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:02.538776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:02.539193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:02.542400 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 50190. Oct 12 09:58:02.674727 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.network.security_group_api [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Removing security group c05c1897-b6b1-4934-9317-98c0ca3a2d7f from port 48f385ba-7561-4513-8387-fa812332b4de Oct 12 09:58:02.996391 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-084fe0e2-d4a2-48a2-ae50-b833ee871547 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/action" status: 202 len: 0 microversion: 2.1 time: 0.481712 Oct 12 09:58:03.005757 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3458/7345] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:58:02 2022] POST /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:58:03.007165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ea4bfb5a-ae65-474b-87da-39d3771e9253 req-dbef76ca-d5ea-4700-a4d7-69bc49c324ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d", "tag": "48f385ba-7561-4513-8387-fa812332b4de"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:03.017720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:03.018418 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:03.021091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ea4bfb5a-ae65-474b-87da-39d3771e9253 req-dbef76ca-d5ea-4700-a4d7-69bc49c324ca service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:03.021811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ea4bfb5a-ae65-474b-87da-39d3771e9253 req-dbef76ca-d5ea-4700-a4d7-69bc49c324ca service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:03.022295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ea4bfb5a-ae65-474b-87da-39d3771e9253 req-dbef76ca-d5ea-4700-a4d7-69bc49c324ca service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:03.039999 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ea4bfb5a-ae65-474b-87da-39d3771e9253 req-dbef76ca-d5ea-4700-a4d7-69bc49c324ca service nova] Creating event network-changed:48f385ba-7561-4513-8387-fa812332b4de for instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d on n-h2-858383-10 Oct 12 09:58:03.047169 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ea4bfb5a-ae65-474b-87da-39d3771e9253 req-dbef76ca-d5ea-4700-a4d7-69bc49c324ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045289 Oct 12 09:58:03.048181 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3888/7346] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:04.363442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:04.363992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:04.370319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:04.370891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:04.371384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:04.372136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:04.372646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:04.373131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:04.453408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lazy-loading 'services' on Instance uuid 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 09:58:04.527129 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [24f74295-8ca6-4243-adba-9ea8d55c4ab7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:58:05.071492 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a462cc21-1dae-4b93-bb68-24171a754cd5 req-059ab8f6-fea2-42e4-9d60-ddf8effdfa03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d", "tag": "48f385ba-7561-4513-8387-fa812332b4de"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:05.081098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a462cc21-1dae-4b93-bb68-24171a754cd5 req-059ab8f6-fea2-42e4-9d60-ddf8effdfa03 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:05.081618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a462cc21-1dae-4b93-bb68-24171a754cd5 req-059ab8f6-fea2-42e4-9d60-ddf8effdfa03 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:05.082058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a462cc21-1dae-4b93-bb68-24171a754cd5 req-059ab8f6-fea2-42e4-9d60-ddf8effdfa03 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:05.093182 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a462cc21-1dae-4b93-bb68-24171a754cd5 req-059ab8f6-fea2-42e4-9d60-ddf8effdfa03 service nova] Creating event network-changed:48f385ba-7561-4513-8387-fa812332b4de for instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d on n-h2-858383-10 Oct 12 09:58:05.098464 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a462cc21-1dae-4b93-bb68-24171a754cd5 req-059ab8f6-fea2-42e4-9d60-ddf8effdfa03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032093 Oct 12 09:58:05.099072 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3889/7347] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:05.535662 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [24f74295-8ca6-4243-adba-9ea8d55c4ab7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 50218. Oct 12 09:58:05.539603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-16dae2cc-f080-4ff9-a7b6-fe11a699321c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments/fd966473-5118-49e2-b7a6-7077ded61fa4" status: 202 len: 0 microversion: 2.1 time: 1.181546 Oct 12 09:58:05.540238 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3459/7348] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:58:04 2022] DELETE /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments/fd966473-5118-49e2-b7a6-7077ded61fa4 => generated 0 bytes in 1183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:58:05.551839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:05.554398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:05.561087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:05.561698 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:05.562422 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:05.563827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:05.563827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:05.564267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:05.596229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cd352ecf-79d3-4d65-beff-beeb42344d11 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049644 Oct 12 09:58:05.596809 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3890/7349] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:58:05 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:06.610219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:06.612938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:06.620430 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:06.620915 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:06.621429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:06.622146 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:06.622615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:06.623045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:06.653334 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-daad8a6b-b65f-4e5b-bf0b-7662f2c0684b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048435 Oct 12 09:58:06.653900 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3460/7350] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:58:06 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:07.667058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:07.669579 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:07.677251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:07.677799 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:07.678258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:07.678988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:07.679475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:07.679924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:07.712156 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45ad31ad-6df6-45ac-9d47-4c960d92afcd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049366 Oct 12 09:58:07.712930 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3891/7351] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:58:07 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:08.724972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:08.727111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:08.734453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:08.734940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:08.735378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:08.736078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:08.736539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:08.737008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:08.768196 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c7d50cdd-6725-4a23-ac31-6606a06bec53 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Oct 12 09:58:08.768783 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3461/7352] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:58:08 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:09.780733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:09.782988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:09.790277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:09.790783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:09.791232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:09.791946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:09.792411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:09.792851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:09.823513 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0be59bfe-faa4-4c9c-9988-9f7d39758bc8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Oct 12 09:58:09.824062 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3892/7353] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:58:09 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:10.842651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:10.846058 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:10.855554 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:10.856022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:10.856470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:10.857499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:10.858280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:10.858748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:10.893512 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e16dce97-42db-4c69-97cb-9160ef21b9bc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058379 Oct 12 09:58:10.894089 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3462/7354] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 09:58:10 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 09:58:10.905409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:10.905966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:10.912965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:10.913463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:10.913947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:10.914654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:10.915128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:10.915568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:11.103516 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] HTTP exception thrown: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d is not attached to volume fd966473-5118-49e2-b7a6-7077ded61fa4 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Request method failure captured: Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments/fd966473-5118-49e2-b7a6-7077ded61fa4 HTTP/1.1 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRo7DvPNPXT8Ir3W9vZFlmJG5g2LE4Qr58rm8slh0jAT9aEIretrGRhO4lMLNm1MLV8c6brtshS7yQJo718_8jBNq7gJIqPYrG9-06bHSVqWDOeIfATdr2Z-jb2lwj4jeQ-HoTPef_Uv2r8kmwcVRX9fpaggFhSSuxFVj-aehTW86m2g Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8a57a140a16c4bdcb38c8eaf9d0c3236 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestMinimumBasicScenario-1416405885 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}] Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestMinimumBasicScenario-1416405885 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8a57a140a16c4bdcb38c8eaf9d0c3236 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1416405885 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestMinimumBasicScenario-1416405885-project Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f2c12598c2d84f84a56e15e0adedea73 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestMinimumBasicScenario-1416405885-project Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d is not attached to volume fd966473-5118-49e2-b7a6-7077ded61fa4 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': '2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d', 'id': 'fd966473-5118-49e2-b7a6-7077ded61fa4'} Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fd966473-5118-49e2-b7a6-7077ded61fa4. Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d is not attached to volume fd966473-5118-49e2-b7a6-7077ded61fa4 Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:58:11.105161 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:58:11.109988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:58:11.109988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:58:11.109988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d is not attached to volume fd966473-5118-49e2-b7a6-7077ded61fa4 Oct 12 09:58:11.109988 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:11.109988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Returning 404 to user: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d is not attached to volume fd966473-5118-49e2-b7a6-7077ded61fa4 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:58:11.109988 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-57907e1f-27a0-48c7-abb6-7800d82e3bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments/fd966473-5118-49e2-b7a6-7077ded61fa4" status: 404 len: 154 microversion: 2.1 time: 0.205572 Oct 12 09:58:11.109988 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3893/7355] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 09:58:10 2022] DELETE /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d/os-volume_attachments/fd966473-5118-49e2-b7a6-7077ded61fa4 => generated 154 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:58:14.366838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:14.367384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:14.374886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:14.375433 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:14.375871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:14.376567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:14.377018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:14.377475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:14.402987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 09:58:14.481809 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15d369f2-d96a-4c23-bc99-2060f28b67cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 204 len: 0 microversion: 2.1 time: 0.118584 Oct 12 09:58:14.482723 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3463/7356] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 09:58:14 2022] DELETE /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 09:58:14.492225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:14.492883 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:14.499977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:14.500493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:14.500945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:14.501716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:14.502322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:14.502753 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:14.646556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:14.654901 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04305980-7a4e-42dc-b306-553afe3b8c4a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1552 microversion: 2.1 time: 0.166971 Oct 12 09:58:14.655679 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3894/7357] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:14 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:15.680131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:15.680864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:15.688943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:15.689454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:15.689906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:15.690602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:15.691055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:15.691482 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:15.887255 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:15.895903 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d12a0430-7b92-4073-9cbd-8bd04794a3cb tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1552 microversion: 2.1 time: 0.220197 Oct 12 09:58:15.896487 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3464/7358] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:15 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1552 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:16.928344 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:16.928946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:16.937700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:16.938232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:16.938644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:16.939581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:16.940043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:16.940477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:17.073281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:17.083720 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d69547a0-800f-47e9-8e34-4c37e3e4f2dd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 200 len: 1552 microversion: 2.1 time: 0.159448 Oct 12 09:58:17.099368 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3895/7359] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:16 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:17.161103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-261d3c73-a24a-4a7a-8db8-bcaa8f89eb09 req-c618150c-bd97-4a83-8f54-f7a1d3c1ded7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d", "name": "network-vif-deleted", "tag": "48f385ba-7561-4513-8387-fa812332b4de"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:17.172560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-261d3c73-a24a-4a7a-8db8-bcaa8f89eb09 req-c618150c-bd97-4a83-8f54-f7a1d3c1ded7 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:17.173039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-261d3c73-a24a-4a7a-8db8-bcaa8f89eb09 req-c618150c-bd97-4a83-8f54-f7a1d3c1ded7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:17.173455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-261d3c73-a24a-4a7a-8db8-bcaa8f89eb09 req-c618150c-bd97-4a83-8f54-f7a1d3c1ded7 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:17.185184 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-261d3c73-a24a-4a7a-8db8-bcaa8f89eb09 req-c618150c-bd97-4a83-8f54-f7a1d3c1ded7 service nova] Creating event network-vif-deleted:48f385ba-7561-4513-8387-fa812332b4de for instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d on n-h2-858383-10 Oct 12 09:58:17.190562 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-261d3c73-a24a-4a7a-8db8-bcaa8f89eb09 req-c618150c-bd97-4a83-8f54-f7a1d3c1ded7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033328 Oct 12 09:58:17.191201 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3465/7360] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:18.114253 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:18.115270 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:18.127003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:18.127964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:18.128712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:18.129968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:18.130741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:18.131482 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:18.150568 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] HTTP exception thrown: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d could not be found. Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Request method failure captured: Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d HTTP/1.1 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRo7DvPNPXT8Ir3W9vZFlmJG5g2LE4Qr58rm8slh0jAT9aEIretrGRhO4lMLNm1MLV8c6brtshS7yQJo718_8jBNq7gJIqPYrG9-06bHSVqWDOeIfATdr2Z-jb2lwj4jeQ-HoTPef_Uv2r8kmwcVRX9fpaggFhSSuxFVj-aehTW86m2g Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8a57a140a16c4bdcb38c8eaf9d0c3236 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestMinimumBasicScenario-1416405885 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}] Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestMinimumBasicScenario-1416405885 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8a57a140a16c4bdcb38c8eaf9d0c3236 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1416405885 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestMinimumBasicScenario-1416405885-project Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f2c12598c2d84f84a56e15e0adedea73 Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestMinimumBasicScenario-1416405885-project Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d could not be found. Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d'} Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d could not be found. Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d could not be found. Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 09:58:18.152148 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d could not be found. Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Returning 404 to user: Instance 2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42df9fed-028e-4841-8b02-7b1ebef93cbd tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d" status: 404 len: 111 microversion: 2.1 time: 0.046966 Oct 12 09:58:18.156969 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3896/7361] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:18 2022] GET /compute/v2.1/servers/2f0e8f84-ed6e-4ac1-bcf7-1b7717d87e7d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 09:58:18.163300 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-41ce4e1d-d27c-4234-8246-d61caeda5660 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '.version_select at 0x7f9843f37f70>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:18.167858 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-41ce4e1d-d27c-4234-8246-d61caeda5660 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [48eb267c-766f-4d56-8a7b-e1a0ecc4f1b6] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:58:19.178845 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [None req-41ce4e1d-d27c-4234-8246-d61caeda5660 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [48eb267c-766f-4d56-8a7b-e1a0ecc4f1b6] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 50264. Oct 12 09:58:19.206653 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-41ce4e1d-d27c-4234-8246-d61caeda5660 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-12605379" status: 202 len: 0 microversion: 2.1 time: 1.047708 Oct 12 09:58:19.207256 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3466/7362] 10.222.0.40 () {58 vars in 1266 bytes} [Wed Oct 12 09:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-12605379 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:58:28.374657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-96fc3653-6dff-4104-b56e-41cda25c9431 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'create', calling method: .version_select at 0x7f98488fddc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1838851729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFguDacuoer0vtUIC3leT15J1TtJwp0Pi8/vnopNt/BTIXDYfBmZKryhe/hpJHaIVrWpirZtCORaPfbehKwVmUjmgooHaONxAcWjL/mHv/CSIJDMYUO4QUcbW/f6nAMmYw=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:28.382350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=18 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:28.383018 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=42 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:28.398143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-96fc3653-6dff-4104-b56e-41cda25c9431 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Getting quotas for project 8a57a140a16c4bdcb38c8eaf9d0c3236. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:58:28.403493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-96fc3653-6dff-4104-b56e-41cda25c9431 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Getting quotas for user f2c12598c2d84f84a56e15e0adedea73 and project 8a57a140a16c4bdcb38c8eaf9d0c3236. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:58:28.438089 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-96fc3653-6dff-4104-b56e-41cda25c9431 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.068674 Oct 12 09:58:28.438699 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3897/7363] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 09:58:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:28.494006 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:28.499556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2113975085", "imageRef": "9736e8f0-b7c2-4f3c-9b83-dfbe8c8fca91", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1838851729", "networks": [{"uuid": "bd5b9eac-db0f-44fb-ae66-85eb751acb54"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:28.563287 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] validate_networks() for [('bd5b9eac-db0f-44fb-ae66-85eb751acb54', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 09:58:29.001389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 09:58:29.001978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 09:58:29.002684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 09:58:29.003285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 09:58:29.003904 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 09:58:29.014701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:29.015490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:29.015937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:29.016667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:29.017124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:29.017919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:29.035367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Getting quotas for project 8a57a140a16c4bdcb38c8eaf9d0c3236. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 09:58:29.040937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Getting quotas for user f2c12598c2d84f84a56e15e0adedea73 and project 8a57a140a16c4bdcb38c8eaf9d0c3236. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 09:58:29.053883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 09:58:29.056249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9736e8f0-b7c2-4f3c-9b83-dfbe8c8fca91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 09:58:29.112524 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0e173650-d76d-46b2-ac83-fac552ac36e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621158 Oct 12 09:58:29.113340 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3467/7364] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 09:58:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 09:58:29.124802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b5714520-a2aa-41ef-b9b0-5c7399444962 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:29.125469 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b5714520-a2aa-41ef-b9b0-5c7399444962 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:29.183404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b5714520-a2aa-41ef-b9b0-5c7399444962 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:29.190659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b5714520-a2aa-41ef-b9b0-5c7399444962 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1259 microversion: 2.1 time: 0.069886 Oct 12 09:58:29.191237 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3898/7365] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:29 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:30.214826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:30.215455 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:30.223757 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:30.224246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:30.224687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:30.225410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:30.225876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:30.226409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:30.338706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:30.347104 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-299da4fb-a024-48fa-a9c0-d6b3fdbe16d4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1319 microversion: 2.1 time: 0.137264 Oct 12 09:58:30.361866 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3468/7366] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:30 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:31.371514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:31.372237 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:31.380428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:31.381245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:31.381983 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:31.383015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:31.383655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:31.384132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:31.530029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:31.538177 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-847d6cdb-c7a5-4f27-bc6c-d537ee0d3e09 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.170974 Oct 12 09:58:31.538766 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3899/7367] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:31 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:32.564574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:32.565200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:32.567462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:32.574004 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:32.574495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:32.574931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:32.575638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:32.576380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:32.576809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:32.723084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:32.732080 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-987a9ba3-ecfa-41af-880b-dc5bb6315295 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.171860 Oct 12 09:58:32.732773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3469/7368] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:32 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:33.755398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:33.755962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:33.763112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:33.763621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:33.764082 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:33.764804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:33.765267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:33.765729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:33.905055 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:33.913632 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d6944c92-5049-466d-ad10-5fa480d5326b tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.162166 Oct 12 09:58:33.914635 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3900/7369] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:33 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:34.936923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:34.937540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:34.944535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:34.945022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:34.945483 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:34.946258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:34.946930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:34.947659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:35.093051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:35.102147 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e3e2bc7-e786-4205-b84e-4a2c6fd621c7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.169026 Oct 12 09:58:35.102898 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3470/7370] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:34 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:36.126646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:36.127236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:36.134142 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:36.134644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:36.135093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:36.135815 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:36.136284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:36.136752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:36.278886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:36.286799 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8f19dfb6-1d66-446a-9bd9-734c16e318cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.164655 Oct 12 09:58:36.295120 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3901/7371] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:36 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:37.310061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:37.310828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:37.317826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:37.318310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:37.318745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:37.319450 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:37.321593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:37.322066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:37.463297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:37.471381 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ce8e6ea5-32a9-4c08-b180-1af1c18740d5 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.165287 Oct 12 09:58:37.471971 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3471/7372] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:37 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:38.495144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:38.496320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:38.504007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:38.504543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:38.505051 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:38.505849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:38.506349 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:38.506791 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:38.644429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:38.652982 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-75cd0313-f444-409f-80e7-68acc1aebcf0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.161874 Oct 12 09:58:38.653611 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3902/7373] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:38 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:38.852141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-85d22911-f5ee-4396-a456-675aceb5e7e0 req-0f47533f-98ad-4e85-88c5-bbe35717b0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125bfdc2-bfc0-4a71-b955-fec71cd88a92", "tag": "5b2555a2-b101-4883-9064-86c28285366a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:38.862102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-85d22911-f5ee-4396-a456-675aceb5e7e0 req-0f47533f-98ad-4e85-88c5-bbe35717b0c1 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:38.862659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-85d22911-f5ee-4396-a456-675aceb5e7e0 req-0f47533f-98ad-4e85-88c5-bbe35717b0c1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:38.863165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-85d22911-f5ee-4396-a456-675aceb5e7e0 req-0f47533f-98ad-4e85-88c5-bbe35717b0c1 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:38.874540 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-85d22911-f5ee-4396-a456-675aceb5e7e0 req-0f47533f-98ad-4e85-88c5-bbe35717b0c1 service nova] Creating event network-changed:5b2555a2-b101-4883-9064-86c28285366a for instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 on n-h2-858383-10 Oct 12 09:58:38.879630 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-85d22911-f5ee-4396-a456-675aceb5e7e0 req-0f47533f-98ad-4e85-88c5-bbe35717b0c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125948 Oct 12 09:58:38.880380 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3472/7374] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:39.680475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:39.681485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:39.683840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:39.690163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:39.690662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:39.691109 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:39.691809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:39.692277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:39.692714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:39.836242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:39.844803 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ddfe9631-3c0c-4eb8-b271-e3c95d736033 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.170838 Oct 12 09:58:39.845431 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3903/7375] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:39 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:40.869275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:40.870021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:40.872091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:40.872795 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:58:40.880100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:40.880605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:40.881069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:40.881814 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:40.882286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:40.882729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:41.035815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:41.043651 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4dbb7ad0-c0d5-4a40-99de-4d1a53aa03dc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.178963 Oct 12 09:58:41.044230 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3473/7376] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:40 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:42.071666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:42.072801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:42.083624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:42.084448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:42.085195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:42.086433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:42.087207 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:42.087971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:42.221385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:42.229625 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-16719c40-8384-45d0-92cb-9280d17a2db7 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.164955 Oct 12 09:58:42.230242 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3904/7377] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:42 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:43.253026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:43.254598 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:43.262334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:43.262830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:43.263276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:43.264013 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:43.264469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:43.264899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:43.403432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:43.411419 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5541735-c02f-411e-9d9b-1502899a8d30 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.162859 Oct 12 09:58:43.412044 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3474/7378] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:43 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:44.434845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:44.435488 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:44.442585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:44.443074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:44.443552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:44.444273 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:44.444746 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:44.445186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:44.532336 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-86b7acd3-9997-457a-9c1c-29a6da190859 req-bebc129a-4dda-4ada-8f43-d2fb20084633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125bfdc2-bfc0-4a71-b955-fec71cd88a92", "name": "network-vif-plugged", "status": "completed", "tag": "5b2555a2-b101-4883-9064-86c28285366a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:44.543754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-86b7acd3-9997-457a-9c1c-29a6da190859 req-bebc129a-4dda-4ada-8f43-d2fb20084633 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:44.544324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-86b7acd3-9997-457a-9c1c-29a6da190859 req-bebc129a-4dda-4ada-8f43-d2fb20084633 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:44.544751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-86b7acd3-9997-457a-9c1c-29a6da190859 req-bebc129a-4dda-4ada-8f43-d2fb20084633 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:44.557004 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-86b7acd3-9997-457a-9c1c-29a6da190859 req-bebc129a-4dda-4ada-8f43-d2fb20084633 service nova] Creating event network-vif-plugged:5b2555a2-b101-4883-9064-86c28285366a for instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 on n-h2-858383-10 Oct 12 09:58:44.563787 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-86b7acd3-9997-457a-9c1c-29a6da190859 req-bebc129a-4dda-4ada-8f43-d2fb20084633 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093278 Oct 12 09:58:44.564553 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3475/7379] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:58:44.582734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:44.590617 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6c1fc663-7b07-44bc-9262-41ba65a3a8cc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.159791 Oct 12 09:58:44.591263 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3905/7380] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:44 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:45.615359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:45.616064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:45.623088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:45.623599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:45.624038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:45.624736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:45.625194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:45.625673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:45.780687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:45.788838 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6c317c2f-2bf1-4269-8608-9cb05a8c4716 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1359 microversion: 2.1 time: 0.178748 Oct 12 09:58:45.789456 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3476/7381] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:45 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:46.816103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:46.817095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:46.827855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:46.828354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:46.828806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:46.829545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:46.830025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:46.830453 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:46.965371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:46.973536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-287728ed-b281-4f87-8b1f-904938924217 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1548 microversion: 2.1 time: 0.164032 Oct 12 09:58:46.974093 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3906/7382] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:46 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:46.995833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:46.996452 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:47.003917 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:47.004392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:47.004855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:47.010233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:47.010233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:47.010233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:47.150116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:47.158704 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2ce93c6-bdb0-4dee-b35f-ba199741029c tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1548 microversion: 2.1 time: 0.166823 Oct 12 09:58:47.159319 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3477/7383] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:46 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:47.180730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:47.185622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:47.186302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Searching by: {'deleted': False, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236'} {{(pid=127006) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 09:58:47.192027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:47.192521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:47.192977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:47.193760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:47.194233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:47.194675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:47.220324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.multi_cell_list [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 09:58:47.246924 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c32c2e10-0d3b-4592-aa95-38f802a878d0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070037 Oct 12 09:58:47.247496 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3907/7384] 10.222.0.40 () {58 vars in 1125 bytes} [Wed Oct 12 09:58:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:58:47.259957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:58:47.260854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:47.270084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:47.270762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:47.271360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:47.272831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:47.273502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:47.274081 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:47.410393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:58:47.418587 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-39a6dcfb-d117-4f7b-a85a-244acc40492f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1548 microversion: 2.1 time: 0.162835 Oct 12 09:58:47.419136 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3478/7385] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:58:47 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:58:48.944628 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaf9e76b-0f68-4a14-b399-e35420dc2806"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:58:48.947097 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:58:48.954450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:48.954961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:48.955420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:48.956138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:58:48.956615 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:58:48.957061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:58:49.219201 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5754159-f2f2-466f-8a8a-89ce2f3c8919 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278599 Oct 12 09:58:49.219916 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3908/7386] 10.222.0.40 () {60 vars in 1323 bytes} [Wed Oct 12 09:58:48 2022] POST /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 09:59:00.055168 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:00.055782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:00.058909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=19 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:00.059567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=60 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:00.065603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:00.066098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:00.066540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:00.067375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:00.067830 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:00.068262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:00.210329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:00.218819 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0b6a08ab-a4e0-4595-ad91-f4878f870fc6 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1594 microversion: 2.1 time: 0.167737 Oct 12 09:59:00.219397 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3479/7387] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:00 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:01.869532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:01.870803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:01.871533 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:01.876692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a15eac5c-c6a1-4153-a5a1-630d4ad2acbb req-163e6ba8-18be-4bf7-ba4b-7ab2c852a789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125bfdc2-bfc0-4a71-b955-fec71cd88a92", "tag": "5b2555a2-b101-4883-9064-86c28285366a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:59:01.889824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a15eac5c-c6a1-4153-a5a1-630d4ad2acbb req-163e6ba8-18be-4bf7-ba4b-7ab2c852a789 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:01.890409 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a15eac5c-c6a1-4153-a5a1-630d4ad2acbb req-163e6ba8-18be-4bf7-ba4b-7ab2c852a789 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:01.890910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a15eac5c-c6a1-4153-a5a1-630d4ad2acbb req-163e6ba8-18be-4bf7-ba4b-7ab2c852a789 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:01.906321 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a15eac5c-c6a1-4153-a5a1-630d4ad2acbb req-163e6ba8-18be-4bf7-ba4b-7ab2c852a789 service nova] Creating event network-changed:5b2555a2-b101-4883-9064-86c28285366a for instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 on n-h2-858383-10 Oct 12 09:59:01.911482 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a15eac5c-c6a1-4153-a5a1-630d4ad2acbb req-163e6ba8-18be-4bf7-ba4b-7ab2c852a789 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043911 Oct 12 09:59:01.912376 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3909/7388] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:59:02.960519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1060077477"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:59:02.961072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:02.967874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:02.968367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:02.968815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:02.969584 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:02.970031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:02.970458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:03.100664 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.network.security_group_api [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Adding security group 5c210e9f-9967-45fc-b6b8-8810ee5fb4e5 to port 5b2555a2-b101-4883-9064-86c28285366a Oct 12 09:59:03.429667 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d4c81df6-36bd-4562-a92e-db497505e430 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/action" status: 202 len: 0 microversion: 2.1 time: 0.473308 Oct 12 09:59:03.430601 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3480/7389] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:59:02 2022] POST /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:59:03.443571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:03.446187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-00d8c43d-67d5-4904-a6d6-ada585e37663 req-91811cad-032d-43f2-a73e-98032f8e30c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125bfdc2-bfc0-4a71-b955-fec71cd88a92", "tag": "5b2555a2-b101-4883-9064-86c28285366a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:59:03.452861 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:03.460743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:03.461237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:03.461705 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:03.462416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:03.462881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:03.463318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:03.466387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-00d8c43d-67d5-4904-a6d6-ada585e37663 req-91811cad-032d-43f2-a73e-98032f8e30c9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:03.467076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-00d8c43d-67d5-4904-a6d6-ada585e37663 req-91811cad-032d-43f2-a73e-98032f8e30c9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:03.467677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-00d8c43d-67d5-4904-a6d6-ada585e37663 req-91811cad-032d-43f2-a73e-98032f8e30c9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:03.481640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-00d8c43d-67d5-4904-a6d6-ada585e37663 req-91811cad-032d-43f2-a73e-98032f8e30c9 service nova] Creating event network-changed:5b2555a2-b101-4883-9064-86c28285366a for instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 on n-h2-858383-10 Oct 12 09:59:03.492730 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-00d8c43d-67d5-4904-a6d6-ada585e37663 req-91811cad-032d-43f2-a73e-98032f8e30c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054219 Oct 12 09:59:03.493942 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3910/7390] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 09:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 09:59:03.750816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:03.759673 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-134a8ecf-0c65-495d-b076-dd6ae24a1dd1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1759 microversion: 2.1 time: 0.319941 Oct 12 09:59:03.760323 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3481/7391] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:03 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1759 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:26.498075 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 09:59:26.498990 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:26.500099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:26.560402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 09:59:26.563003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:26.569474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:26.569985 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:26.570441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:26.571158 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:26.571696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:26.572139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:26.650126 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68287a2e-f2ea-406d-89ef-9c74550d0e38 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/action" status: 202 len: 0 microversion: 2.1 time: 0.155061 Oct 12 09:59:26.650842 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3911/7392] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 09:59:26 2022] POST /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 09:59:26.659855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:26.660498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:26.663570 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:26.664373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=16 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 09:59:26.670765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:26.671273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:26.671729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:26.672449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:26.672906 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:26.673330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:26.907016 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:26.915893 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ad623c61-5ba3-4d79-b822-82cb2c82440a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1751 microversion: 2.1 time: 0.260355 Oct 12 09:59:26.916484 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3482/7393] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:26 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:27.943549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:27.944268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:27.951740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:27.952242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:27.952694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:27.953403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:27.953919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:27.954358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:27.958791 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 50540. Oct 12 09:59:28.104290 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:28.113653 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b541da8f-d7d6-41fd-a0ea-34bf080e0bae tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.175799 Oct 12 09:59:28.114266 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3912/7394] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:27 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:29.139265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:29.139928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:29.148466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:29.149015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:29.149495 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:29.150216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:29.150669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:29.151092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:29.304193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:29.315974 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ea5511d8-86c8-4e01-aed5-e299a9699ab0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.180917 Oct 12 09:59:29.316712 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3483/7395] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:29 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:30.343444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:30.344074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:30.351411 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:30.351911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:30.352379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:30.353067 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:30.353568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:30.354014 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:30.509292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:30.518503 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-09cb8d9d-178c-4818-8034-016a7cf1eb32 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.180059 Oct 12 09:59:30.519103 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3913/7396] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:30 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:31.545713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:31.546334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:31.553741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:31.554241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:31.554710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:31.555529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:31.555976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:31.556493 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:31.704107 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:31.713026 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1431cfaa-e3e1-4bcb-a923-868b76b6fd06 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.172981 Oct 12 09:59:31.713611 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3484/7397] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:31 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:32.740727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:32.741749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:32.751917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:32.752415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:32.752864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:32.753602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:32.754069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:32.754505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:32.905702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:32.915095 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3ef87715-e63e-4af8-9ebf-56711713eed4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.180932 Oct 12 09:59:32.915674 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3914/7398] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:32 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:33.943416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:33.944544 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:33.954360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:33.954823 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:33.955278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:33.955968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:33.956421 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:33.956875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:34.107279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:34.120299 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d9323f80-bbde-499a-89ec-1fce1476891a tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.183357 Oct 12 09:59:34.120982 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3485/7399] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:33 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:35.148800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:35.149733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:35.159968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:35.160486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:35.160950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:35.161722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:35.162353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:35.162804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:35.326553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:35.335541 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06d9ee56-cbf8-4ae3-be13-b53452f6460f tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.193648 Oct 12 09:59:35.336105 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3915/7400] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:35 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:36.363951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:36.365083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:36.376233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:36.376727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:36.377169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:36.377907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:36.378366 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:36.378799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:36.523537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:36.532115 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d894b388-4b63-4b8f-9433-adc46133101e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.175012 Oct 12 09:59:36.532699 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3486/7401] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:36 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:37.556195 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:37.557064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:37.564921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:37.565451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:37.565911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:37.566926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:37.567438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:37.567881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:37.712028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:37.720916 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e509e693-4c65-4138-be87-1e968b33bce1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.169235 Oct 12 09:59:37.721550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3916/7402] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:37 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:38.748992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:38.750132 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:38.758281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:38.758827 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:38.759315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:38.760088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:38.760604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:38.761115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:38.907783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:38.917188 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f2defa6-0b0e-4720-a0d2-2efd58fcbdec tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.174786 Oct 12 09:59:38.917820 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3487/7403] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:38 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:39.944839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:39.945953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:39.956149 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:39.956680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:39.957131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:39.957880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:39.958373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:39.958818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:40.108323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:40.116904 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a3d19242-82e3-487a-a54c-56dcbffa0cdc tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.178631 Oct 12 09:59:40.117405 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3917/7404] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:39 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:41.144818 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:41.145783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:41.157294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:41.157809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:41.158249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:41.159313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:41.159794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:41.160224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:41.324865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:41.333821 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f04568f2-6957-48e9-ab6f-04732dab6715 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.195923 Oct 12 09:59:41.334403 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3488/7405] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:41 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:42.360502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:42.361509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:42.372808 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:42.373694 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:42.374463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:42.375735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:42.376217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:42.376656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:42.526170 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:42.535136 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d07ce907-1786-4ce5-88d2-c17e558256c0 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1756 microversion: 2.1 time: 0.181265 Oct 12 09:59:42.535716 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3918/7406] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:42 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 09:59:43.558943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 09:59:43.559607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 09:59:43.567606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:43.568094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:43.568534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:43.569252 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 09:59:43.569738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 09:59:43.570167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 09:59:43.713977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 09:59:43.722835 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1ff24701-2971-4463-beac-90a591e5784e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1759 microversion: 2.1 time: 0.168320 Oct 12 09:59:43.723423 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3489/7407] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 09:59:43 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:16.942556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1060077477"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:16.943501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:16.946777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=16 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:16.948063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:16.949206 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:00:16.949610 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:00:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/action (ip 10.222.0.40) !!! Oct 12 10:00:16.962277 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:16.962778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:16.963226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:16.963958 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:16.964420 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:16.964852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:17.098780 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.network.security_group_api [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Removing security group 5c210e9f-9967-45fc-b6b8-8810ee5fb4e5 from port 5b2555a2-b101-4883-9064-86c28285366a Oct 12 10:00:17.418877 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a71d7e6c-eb07-4492-b19b-0a18825472aa tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "POST /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/action" status: 202 len: 0 microversion: 2.1 time: 0.483532 Oct 12 10:00:17.419619 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3919/7408] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:00:16 2022] POST /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:00:17.429403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=16 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:17.430178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=48 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:17.486683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-b00db342-f13e-4d38-a90e-268554384286 req-345e0254-9775-40b3-b4cd-3d464b524fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125bfdc2-bfc0-4a71-b955-fec71cd88a92", "tag": "5b2555a2-b101-4883-9064-86c28285366a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:17.496334 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b00db342-f13e-4d38-a90e-268554384286 req-345e0254-9775-40b3-b4cd-3d464b524fee service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:17.496838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b00db342-f13e-4d38-a90e-268554384286 req-345e0254-9775-40b3-b4cd-3d464b524fee service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:17.497244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-b00db342-f13e-4d38-a90e-268554384286 req-345e0254-9775-40b3-b4cd-3d464b524fee service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:17.510138 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-b00db342-f13e-4d38-a90e-268554384286 req-345e0254-9775-40b3-b4cd-3d464b524fee service nova] Creating event network-changed:5b2555a2-b101-4883-9064-86c28285366a for instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 on n-h2-858383-10 Oct 12 10:00:17.517763 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-b00db342-f13e-4d38-a90e-268554384286 req-345e0254-9775-40b3-b4cd-3d464b524fee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092141 Oct 12 10:00:17.518953 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3490/7409] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:18.857259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:18.857907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:18.864211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:18.864713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:18.865164 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:18.865918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:18.866387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:18.866832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:18.950407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lazy-loading 'services' on Instance uuid 125bfdc2-bfc0-4a71-b955-fec71cd88a92 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:00:19.024827 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de2bd7b1-60da-46c4-b9c6-ed1cca0a0be1 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments/eaf9e76b-0f68-4a14-b399-e35420dc2806" status: 202 len: 0 microversion: 2.1 time: 0.172723 Oct 12 10:00:19.025656 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3920/7410] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 10:00:18 2022] DELETE /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments/eaf9e76b-0f68-4a14-b399-e35420dc2806 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:00:19.035398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:19.037782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:19.045530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:19.046033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:19.046501 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:19.047228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:19.047679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:19.048708 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:19.086398 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7e16dbbf-8af7-42cd-bcc6-2b23d208f4b4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055734 Oct 12 10:00:19.091691 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3491/7411] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 10:00:19 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:19.538671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-35e61f2a-a61e-4270-a1f1-6e903c10bafa req-224b3304-ce97-4a46-83d8-66bfbd553a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125bfdc2-bfc0-4a71-b955-fec71cd88a92", "tag": "5b2555a2-b101-4883-9064-86c28285366a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:19.549267 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-35e61f2a-a61e-4270-a1f1-6e903c10bafa req-224b3304-ce97-4a46-83d8-66bfbd553a3d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:19.549792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-35e61f2a-a61e-4270-a1f1-6e903c10bafa req-224b3304-ce97-4a46-83d8-66bfbd553a3d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:19.560203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-35e61f2a-a61e-4270-a1f1-6e903c10bafa req-224b3304-ce97-4a46-83d8-66bfbd553a3d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:19.576881 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-35e61f2a-a61e-4270-a1f1-6e903c10bafa req-224b3304-ce97-4a46-83d8-66bfbd553a3d service nova] Creating event network-changed:5b2555a2-b101-4883-9064-86c28285366a for instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 on n-h2-858383-10 Oct 12 10:00:19.582083 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-35e61f2a-a61e-4270-a1f1-6e903c10bafa req-224b3304-ce97-4a46-83d8-66bfbd553a3d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047168 Oct 12 10:00:19.582705 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3921/7412] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:20.099608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:20.102202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:20.109268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:20.109788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:20.110221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:20.111074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:20.111527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:20.111956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:20.148138 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ecf5c91-4434-4356-85eb-e2cece6e6259 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052581 Oct 12 10:00:20.148720 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3492/7413] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 10:00:20 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:21.162370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:21.164744 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:21.171921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:21.172451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:21.172903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:21.173669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:21.174141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:21.174584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:21.205130 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a515afb4-8875-4ecc-9b13-ab0c71faca1e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048120 Oct 12 10:00:21.205993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3922/7414] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 10:00:21 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:22.218967 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:22.221097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:22.230099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:22.230593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:22.231037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:22.231753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:22.232213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:22.232648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:22.263570 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aaa76348-177a-44e3-91f1-b9012e65f643 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048804 Oct 12 10:00:22.264148 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3493/7415] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 10:00:22 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:23.276822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:23.278974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:23.286402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:23.286897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:23.287354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:23.288075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:23.288548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:23.288993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:23.319962 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ca2a28ab-b0a0-4cc3-912a-47bd215865e2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047363 Oct 12 10:00:23.320746 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3923/7416] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 10:00:23 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:24.336695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:24.339911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:24.347161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:24.347648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:24.348083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:24.348773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:24.349221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:24.349681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:24.379325 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6ef98c09-48d6-433a-93db-5199a6ae7ba2 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049396 Oct 12 10:00:24.379896 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3494/7417] 10.222.0.40 () {58 vars in 1302 bytes} [Wed Oct 12 10:00:24 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 10:00:24.391569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:24.392079 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:24.399372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:24.399879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:24.400335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:24.401053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:24.401664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:24.402240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:24.485693 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] HTTP exception thrown: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 is not attached to volume eaf9e76b-0f68-4a14-b399-e35420dc2806 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Request method failure captured: Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: request: DELETE /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments/eaf9e76b-0f68-4a14-b399-e35420dc2806 HTTP/1.1 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRo7DvPNPXT8Ir3W9vZFlmJG5g2LE4Qr58rm8slh0jAT9aEIretrGRhO4lMLNm1MLV8c6brtshS7yQJo718_8jBNq7gJIqPYrG9-06bHSVqWDOeIfATdr2Z-jb2lwj4jeQ-HoTPef_Uv2r8kmwcVRX9fpaggFhSSuxFVj-aehTW86m2g Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: 8a57a140a16c4bdcb38c8eaf9d0c3236 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestMinimumBasicScenario-1416405885 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}] Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestMinimumBasicScenario-1416405885 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: 8a57a140a16c4bdcb38c8eaf9d0c3236 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1416405885 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestMinimumBasicScenario-1416405885-project Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: f2c12598c2d84f84a56e15e0adedea73 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestMinimumBasicScenario-1416405885-project Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 is not attached to volume eaf9e76b-0f68-4a14-b399-e35420dc2806 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'server_id': '125bfdc2-bfc0-4a71-b955-fec71cd88a92', 'id': 'eaf9e76b-0f68-4a14-b399-e35420dc2806'} Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eaf9e76b-0f68-4a14-b399-e35420dc2806. Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 is not attached to volume eaf9e76b-0f68-4a14-b399-e35420dc2806 Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:00:24.488065 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:00:24.492294 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:00:24.492294 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:00:24.492294 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 is not attached to volume eaf9e76b-0f68-4a14-b399-e35420dc2806 Oct 12 10:00:24.492294 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:00:24.492294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Returning 404 to user: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 is not attached to volume eaf9e76b-0f68-4a14-b399-e35420dc2806 {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:00:24.492294 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0776369f-27e7-4383-b6b1-0c496df2103e tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments/eaf9e76b-0f68-4a14-b399-e35420dc2806" status: 404 len: 154 microversion: 2.1 time: 0.102131 Oct 12 10:00:24.492294 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3924/7418] 10.222.0.40 () {58 vars in 1416 bytes} [Wed Oct 12 10:00:24 2022] DELETE /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92/os-volume_attachments/eaf9e76b-0f68-4a14-b399-e35420dc2806 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:00:27.750243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:27.750770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:27.757894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:27.758384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:27.758853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:27.759534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:27.759982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:27.760405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:27.785699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:00:27.868443 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fb620fbf-895c-46e0-b6bf-d7a823b813ac tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "DELETE /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 204 len: 0 microversion: 2.1 time: 0.121554 Oct 12 10:00:27.869616 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3495/7419] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:00:27 2022] DELETE /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:00:27.878734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:27.880038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:27.888682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:27.889201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:27.889689 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:27.890423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:27.890898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:27.891562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:28.028880 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:28.037608 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c5b60e35-fd46-48d2-8881-79136d48b0a8 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1554 microversion: 2.1 time: 0.163228 Oct 12 10:00:28.038297 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3925/7420] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:27 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:29.072039 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:29.073203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:29.084733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:29.085574 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:29.086349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:29.087505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:29.088261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:29.088986 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:29.229057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:29.237420 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-693fb529-dff0-4888-91a3-65807981daa9 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1554 microversion: 2.1 time: 0.172592 Oct 12 10:00:29.238029 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3496/7421] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:29 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:30.260379 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:30.261006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:30.268897 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:30.269407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:30.270038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:30.270783 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:30.271232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:30.271841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:30.297047 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-4b4dc283-bc73-450c-8709-c5b514a0b077 req-0bc1d777-2ba2-449b-8528-4de880789c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125bfdc2-bfc0-4a71-b955-fec71cd88a92", "name": "network-vif-deleted", "tag": "5b2555a2-b101-4883-9064-86c28285366a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:30.308839 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4b4dc283-bc73-450c-8709-c5b514a0b077 req-0bc1d777-2ba2-449b-8528-4de880789c21 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:30.309176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4b4dc283-bc73-450c-8709-c5b514a0b077 req-0bc1d777-2ba2-449b-8528-4de880789c21 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:30.309502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-4b4dc283-bc73-450c-8709-c5b514a0b077 req-0bc1d777-2ba2-449b-8528-4de880789c21 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:30.322042 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-4b4dc283-bc73-450c-8709-c5b514a0b077 req-0bc1d777-2ba2-449b-8528-4de880789c21 service nova] Creating event network-vif-deleted:5b2555a2-b101-4883-9064-86c28285366a for instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 on n-h2-858383-10 Oct 12 10:00:30.327623 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-4b4dc283-bc73-450c-8709-c5b514a0b077 req-0bc1d777-2ba2-449b-8528-4de880789c21 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Oct 12 10:00:30.328237 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3497/7422] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:00:30.346286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c12598c2d84f84a56e15e0adedea73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a57a140a16c4bdcb38c8eaf9d0c3236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:30.357657 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1af903b4-d6b2-471f-83ae-1bb10b8130f4 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 200 len: 1512 microversion: 2.1 time: 0.100610 Oct 12 10:00:30.358679 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3926/7423] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:30 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 1512 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:31.383994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:31.384523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] [instance: 125bfdc2-bfc0-4a71-b955-fec71cd88a92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:31.391250 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:31.391741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:31.392239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:31.392958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:31.393393 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:31.394122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:31.407996 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] HTTP exception thrown: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 could not be found. Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Request method failure captured: Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 HTTP/1.1 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRo7DvPNPXT8Ir3W9vZFlmJG5g2LE4Qr58rm8slh0jAT9aEIretrGRhO4lMLNm1MLV8c6brtshS7yQJo718_8jBNq7gJIqPYrG9-06bHSVqWDOeIfATdr2Z-jb2lwj4jeQ-HoTPef_Uv2r8kmwcVRX9fpaggFhSSuxFVj-aehTW86m2g Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 8a57a140a16c4bdcb38c8eaf9d0c3236 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestMinimumBasicScenario-1416405885 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a57a140a16c4bdcb38c8eaf9d0c3236"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a57a140a16c4bdcb38c8eaf9d0c3236"}]}] Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestMinimumBasicScenario-1416405885 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 8a57a140a16c4bdcb38c8eaf9d0c3236 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1416405885 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestMinimumBasicScenario-1416405885-project Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: f2c12598c2d84f84a56e15e0adedea73 Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestMinimumBasicScenario-1416405885-project Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 could not be found. Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '125bfdc2-bfc0-4a71-b955-fec71cd88a92'} Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 could not be found. Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 could not be found. Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:00:31.409776 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 could not be found. Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Returning 404 to user: Instance 125bfdc2-bfc0-4a71-b955-fec71cd88a92 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d72a7f2e-5b37-4ff9-b07e-d13daf75b4ad tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92" status: 404 len: 111 microversion: 2.1 time: 0.032726 Oct 12 10:00:31.414596 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3498/7424] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:31 2022] GET /compute/v2.1/servers/125bfdc2-bfc0-4a71-b955-fec71cd88a92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:00:31.421107 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e81f5e6c-b63b-4f44-8abe-1578c9bd7d59 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] Calling method '.version_select at 0x7f9848881e50>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:31.442652 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e81f5e6c-b63b-4f44-8abe-1578c9bd7d59 tempest-TestMinimumBasicScenario-1416405885 tempest-TestMinimumBasicScenario-1416405885-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1838851729" status: 202 len: 0 microversion: 2.1 time: 0.026170 Oct 12 10:00:31.443241 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3927/7425] 10.222.0.40 () {58 vars in 1272 bytes} [Wed Oct 12 10:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1838851729 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:00:40.658859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8b84a084-5359-4ce5-86f2-9e66f2b90366 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: .version_select at 0x7f9848c85940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1822560822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXKlcsrBJOqbRI3j4jp+9m2xGcl46XMOBZXfZeE2jkgD9TMlPr5slCw1bcznOO25sX6wIWb9B6gd5BNvwQlStSCsyRe/vVZnYcQwJ7nBT5LF1hRPhrp2DUZ+PTBPhQOEw=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:40.676073 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-8b84a084-5359-4ce5-86f2-9e66f2b90366 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:00:40.681956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-8b84a084-5359-4ce5-86f2-9e66f2b90366 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:00:40.708456 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8b84a084-5359-4ce5-86f2-9e66f2b90366 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.227935 Oct 12 10:00:40.709072 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3499/7426] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 10:00:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:47.088801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:47.089629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:47.095187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1845323866", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "cb268404-19da-4c64-aac7-11a22961daf5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1822560822", "security_groups": [{"name": "tempest-secgroup-smoke-1631326083"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:47.217963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] validate_networks() for [('cb268404-19da-4c64-aac7-11a22961daf5', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:00:47.705969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:00:47.706705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:00:47.707575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:00:47.708002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:00:47.708433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:00:47.718711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:47.719449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:47.720103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:47.720827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:47.721638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:47.722271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:47.741188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:00:47.748463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:00:47.761997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:00:47.764352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:00:47.814483 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c5f447c5-b855-4446-85a9-0e1b3efb57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727265 Oct 12 10:00:47.815669 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3928/7427] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:00:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:00:47.827028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-366b67e5-4a42-4575-b01f-7e3f35ebdf12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:47.827750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-366b67e5-4a42-4575-b01f-7e3f35ebdf12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:47.829847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:47.833358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:47.960441 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-366b67e5-4a42-4575-b01f-7e3f35ebdf12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:47.977666 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-366b67e5-4a42-4575-b01f-7e3f35ebdf12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1267 microversion: 2.1 time: 0.154516 Oct 12 10:00:47.979401 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3500/7428] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:47 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:49.003156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:49.003926 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:49.013315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:49.014126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:49.014800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:49.015501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:49.016313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:49.016759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:49.095221 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:49.104811 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c125c825-863f-41b4-92bb-7ecea73cd35e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1319 microversion: 2.1 time: 0.106335 Oct 12 10:00:49.105654 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3929/7429] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:48 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:50.128855 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:50.129561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:50.136604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:50.137097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:50.137561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:50.138264 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:50.138727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:50.139228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:50.362169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:50.370817 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8acb0cde-7342-4609-ae3e-35d57afe6b41 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1393 microversion: 2.1 time: 0.246265 Oct 12 10:00:50.371903 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3501/7430] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:50 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:50.749876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e7e74ad8-4184-4235-b159-7249e1837c6e req-c11c93a1-5c2a-4e07-bd01-00d9b2c5856a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4", "tag": "18fbac80-b5fc-4ea5-9966-49c7dfb76dd9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:50.763507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7e74ad8-4184-4235-b159-7249e1837c6e req-c11c93a1-5c2a-4e07-bd01-00d9b2c5856a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:50.763999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7e74ad8-4184-4235-b159-7249e1837c6e req-c11c93a1-5c2a-4e07-bd01-00d9b2c5856a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:50.764644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e7e74ad8-4184-4235-b159-7249e1837c6e req-c11c93a1-5c2a-4e07-bd01-00d9b2c5856a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:50.779052 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e7e74ad8-4184-4235-b159-7249e1837c6e req-c11c93a1-5c2a-4e07-bd01-00d9b2c5856a service nova] Creating event network-changed:18fbac80-b5fc-4ea5-9966-49c7dfb76dd9 for instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 on n-h2-858383-10 Oct 12 10:00:50.784102 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e7e74ad8-4184-4235-b159-7249e1837c6e req-c11c93a1-5c2a-4e07-bd01-00d9b2c5856a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038043 Oct 12 10:00:50.785081 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3930/7431] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:51.399115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:51.400046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:51.411634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:51.412122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:51.412558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:51.413261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:51.413754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:51.414177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:51.556957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:51.565489 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-75873969-da97-474e-bd92-0392c91aa076 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1393 microversion: 2.1 time: 0.173215 Oct 12 10:00:51.566075 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3502/7432] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:51 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:52.595969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:52.596476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:52.603095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:52.603599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:52.604023 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:52.604731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:52.605201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:52.605666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:52.740090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:52.747901 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-23df9682-59dc-4cf0-83b3-202b5348324b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1393 microversion: 2.1 time: 0.157390 Oct 12 10:00:52.748479 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3931/7433] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:52 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:53.771234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:53.771858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:53.779200 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:53.779697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:53.780126 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:53.780850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:53.781302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:53.781782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:53.919512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:53.928431 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4127545-0b3e-40b1-b096-87a0bf3f2235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1393 microversion: 2.1 time: 0.161309 Oct 12 10:00:53.929045 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3503/7434] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:53 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:54.951922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:54.952581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:54.960005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:54.960491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:54.960959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:54.961702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:54.962172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:54.962642 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:55.096910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:55.105116 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-41d6c181-91f2-4b8d-a29e-441fc22b98ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1393 microversion: 2.1 time: 0.157197 Oct 12 10:00:55.105756 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3932/7435] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:54 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:55.290163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-28db03fc-57b4-4545-96ea-713f399eb375 req-5303cca6-c8de-48da-a6a7-c55988b19723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4", "name": "network-vif-plugged", "status": "completed", "tag": "18fbac80-b5fc-4ea5-9966-49c7dfb76dd9"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:55.301123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-28db03fc-57b4-4545-96ea-713f399eb375 req-5303cca6-c8de-48da-a6a7-c55988b19723 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:55.301636 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-28db03fc-57b4-4545-96ea-713f399eb375 req-5303cca6-c8de-48da-a6a7-c55988b19723 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:55.302072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-28db03fc-57b4-4545-96ea-713f399eb375 req-5303cca6-c8de-48da-a6a7-c55988b19723 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:55.313646 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-28db03fc-57b4-4545-96ea-713f399eb375 req-5303cca6-c8de-48da-a6a7-c55988b19723 service nova] Creating event network-vif-plugged:18fbac80-b5fc-4ea5-9966-49c7dfb76dd9 for instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 on n-h2-858383-10 Oct 12 10:00:55.318901 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-28db03fc-57b4-4545-96ea-713f399eb375 req-5303cca6-c8de-48da-a6a7-c55988b19723 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032538 Oct 12 10:00:55.319570 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3504/7436] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:56.132736 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:56.133647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:56.145129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:56.146026 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:56.146778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:56.147955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:56.148790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:56.149597 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:56.295643 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:56.303845 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-698eef29-664c-4744-9fa7-5bcdcdd6966c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1393 microversion: 2.1 time: 0.178083 Oct 12 10:00:56.304422 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3933/7437] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:56 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:57.333059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:57.334254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:57.344601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:57.345414 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:57.346196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:57.347361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:57.348106 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:57.348833 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:57.489202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:57.497758 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3648cc3e-63bd-45fc-9e72-57c6644503e4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1564 microversion: 2.1 time: 0.173239 Oct 12 10:00:57.498336 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3505/7438] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:57 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:57.519829 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:57.520451 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:57.527840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:57.528347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:57.528800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:57.529547 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:57.530025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:57.530610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:57.664993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:57.673664 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c9ad7b63-65fa-41b5-9a4e-2ddad261dd79 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1564 microversion: 2.1 time: 0.157683 Oct 12 10:00:57.674217 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3934/7439] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:57 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:00:59.283862 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cfb7bdd7-3605-4a07-bf60-f9457265fb12 req-ebd9abda-eb9b-4ded-abd0-700482ee577c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4", "tag": "18fbac80-b5fc-4ea5-9966-49c7dfb76dd9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:00:59.289065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:59.291246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:00:59.291876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:00:59.293912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:59.300392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:59.300883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:59.301327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:59.301934 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:00:59.309012 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cfb7bdd7-3605-4a07-bf60-f9457265fb12 req-ebd9abda-eb9b-4ded-abd0-700482ee577c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:59.309536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cfb7bdd7-3605-4a07-bf60-f9457265fb12 req-ebd9abda-eb9b-4ded-abd0-700482ee577c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:59.309981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cfb7bdd7-3605-4a07-bf60-f9457265fb12 req-ebd9abda-eb9b-4ded-abd0-700482ee577c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:59.314196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:00:59.314673 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:00:59.315111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:00:59.326985 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cfb7bdd7-3605-4a07-bf60-f9457265fb12 req-ebd9abda-eb9b-4ded-abd0-700482ee577c service nova] Creating event network-changed:18fbac80-b5fc-4ea5-9966-49c7dfb76dd9 for instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 on n-h2-858383-10 Oct 12 10:00:59.332386 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cfb7bdd7-3605-4a07-bf60-f9457265fb12 req-ebd9abda-eb9b-4ded-abd0-700482ee577c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052210 Oct 12 10:00:59.333351 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3935/7440] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:00:59.547595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:00:59.556452 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6dc7ef0c-e711-4397-b1ad-23b60110e955 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1564 microversion: 2.1 time: 0.280176 Oct 12 10:00:59.570842 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3506/7441] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:00:59 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1564 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:22.936892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:01:22.937818 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=36 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:01:22.942347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:22.944661 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:22.952104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:22.952564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:22.953019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:22.953759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:22.954234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:22.954673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:23.009858 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f73787c1-3e1b-4a05-a091-c0530a558166 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action" status: 200 len: 24563 microversion: 2.1 time: 0.074788 Oct 12 10:01:23.010486 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3936/7442] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:01:22 2022] POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action => generated 24563 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:01:33.920514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:33.921242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:33.923384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=15 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:01:33.924093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=32 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:01:33.930448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:33.930933 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:33.931371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:33.932084 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:33.932514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:33.932937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:34.003565 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a2f30dd-66e9-46a5-ba8c-89bd0a195834 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action" status: 202 len: 0 microversion: 2.1 time: 0.089082 Oct 12 10:01:34.007749 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3507/7443] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:01:33 2022] POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:01:34.015779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:34.016491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:34.019130 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:01:34.019898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:01:34.028261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:34.028821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:34.029587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:34.030338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:34.030843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:34.031279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:34.176751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:34.186358 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b257695e-aa6f-4b8c-9012-f98d03d4c61d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1686 microversion: 2.1 time: 0.176761 Oct 12 10:01:34.186965 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3937/7444] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:34 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:35.218439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:35.219183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:35.226059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:35.226548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:35.226987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:35.227683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:35.228138 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:35.228567 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:35.364028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:35.372551 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c5cce820-f360-4842-9ae7-ccd6c2c8c965 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1666 microversion: 2.1 time: 0.163311 Oct 12 10:01:35.373171 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3508/7445] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:35 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:36.484351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:36.487917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:36.500997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:36.501804 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:36.502262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:36.502974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:36.503450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:36.503891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:36.573785 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3484429a-7d59-4cd9-aba3-a56e1fbd3dec tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action" status: 200 len: 32629 microversion: 2.1 time: 0.095631 Oct 12 10:01:36.574682 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3938/7446] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:01:36 2022] POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action => generated 32629 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:01:36.592942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:36.593841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:36.602057 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:36.602548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:36.602988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:36.603686 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:36.604154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:36.604583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:36.681318 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-25f9801c-f5e9-4e29-838f-bbbc65fc23d3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action" status: 202 len: 0 microversion: 2.1 time: 0.094077 Oct 12 10:01:36.682239 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3509/7447] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:01:36 2022] POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:01:36.693324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:36.694080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:36.701348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:36.701899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:36.702355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:36.703042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:36.703731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:36.704144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:36.841384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:36.850298 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13467afe-f193-48db-bfcf-918735b61e84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1673 microversion: 2.1 time: 0.162554 Oct 12 10:01:36.850966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3939/7448] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:36 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:37.876947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:37.877696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:37.884597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:37.885076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:37.885548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:37.886240 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:37.886692 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:37.887121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:38.025234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:38.033230 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-83c13aa1-077f-466e-b109-3c2637f11724 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1681 microversion: 2.1 time: 0.161627 Oct 12 10:01:38.033866 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3510/7449] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:37 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:38.134588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:38.136773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:38.144816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:38.145346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:38.145822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:38.146532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:38.147002 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:38.147438 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:38.199900 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-70afb01d-03eb-4b5d-819a-6a83c9ccf8ba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action" status: 200 len: 37246 microversion: 2.1 time: 0.069339 Oct 12 10:01:38.200565 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3940/7450] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:01:38 2022] POST /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4/action => generated 37246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:01:39.564345 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:39.564898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:39.566809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e71a7dcd-d299-42c6-962c-fe8b927331d6 req-06e373ce-ac49-4113-ac38-dcee304d181e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4", "tag": "18fbac80-b5fc-4ea5-9966-49c7dfb76dd9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:39.572447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:39.573027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:39.573575 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:39.574397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:39.574913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:39.575436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:39.579825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e71a7dcd-d299-42c6-962c-fe8b927331d6 req-06e373ce-ac49-4113-ac38-dcee304d181e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:39.580320 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e71a7dcd-d299-42c6-962c-fe8b927331d6 req-06e373ce-ac49-4113-ac38-dcee304d181e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:39.580939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e71a7dcd-d299-42c6-962c-fe8b927331d6 req-06e373ce-ac49-4113-ac38-dcee304d181e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:39.593039 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e71a7dcd-d299-42c6-962c-fe8b927331d6 req-06e373ce-ac49-4113-ac38-dcee304d181e service nova] Creating event network-changed:18fbac80-b5fc-4ea5-9966-49c7dfb76dd9 for instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 on n-h2-858383-10 Oct 12 10:01:39.600174 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e71a7dcd-d299-42c6-962c-fe8b927331d6 req-06e373ce-ac49-4113-ac38-dcee304d181e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037537 Oct 12 10:01:39.600787 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3941/7451] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:01:39.604413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:01:39.685346 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a35156fa-2327-4426-94d6-6330adc1bd96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 204 len: 0 microversion: 2.1 time: 0.124729 Oct 12 10:01:39.689149 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3511/7452] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:01:39 2022] DELETE /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:01:39.697872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:39.698596 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:39.706092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:39.706750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:39.707208 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:39.708143 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:39.708782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:39.709231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:39.849549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:39.857683 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-651a4d00-e69b-4bdd-b25f-f7c815f23d5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1687 microversion: 2.1 time: 0.166523 Oct 12 10:01:39.858451 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3942/7453] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:39 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:40.884514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:40.885225 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:40.892590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:40.893116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:40.893597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:40.894294 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:40.894752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:40.895182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:41.032476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:41.040556 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-53291f6c-9e2c-4a7e-9ed0-73047e128c2d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1687 microversion: 2.1 time: 0.160526 Oct 12 10:01:41.041181 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3512/7454] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:40 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:41.897961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f7ae4ffa-6bd5-4548-ac7c-407c6674bc95 req-7fae37ca-b39e-451a-a757-d817ea812c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4", "name": "network-vif-deleted", "tag": "18fbac80-b5fc-4ea5-9966-49c7dfb76dd9"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:41.908730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f7ae4ffa-6bd5-4548-ac7c-407c6674bc95 req-7fae37ca-b39e-451a-a757-d817ea812c97 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:41.909292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f7ae4ffa-6bd5-4548-ac7c-407c6674bc95 req-7fae37ca-b39e-451a-a757-d817ea812c97 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:41.909813 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f7ae4ffa-6bd5-4548-ac7c-407c6674bc95 req-7fae37ca-b39e-451a-a757-d817ea812c97 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:41.924547 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f7ae4ffa-6bd5-4548-ac7c-407c6674bc95 req-7fae37ca-b39e-451a-a757-d817ea812c97 service nova] Creating event network-vif-deleted:18fbac80-b5fc-4ea5-9966-49c7dfb76dd9 for instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 on n-h2-858383-10 Oct 12 10:01:41.930097 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f7ae4ffa-6bd5-4548-ac7c-407c6674bc95 req-7fae37ca-b39e-451a-a757-d817ea812c97 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035905 Oct 12 10:01:41.931369 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3943/7455] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:01:42.064253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:42.064850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:42.071505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:42.072095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:42.072527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:42.073234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:42.073801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:42.074234 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:42.108968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:42.109373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:42.109847 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:42.110296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lazy-loading 'fault' on Instance uuid 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:01:42.162761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:42.171030 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-162efd44-b17c-44f3-a8fb-49af7b3a5dbf tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 200 len: 1357 microversion: 2.1 time: 0.110611 Oct 12 10:01:42.171594 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3513/7456] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:42 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 1357 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:43.200319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:43.201339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:43.210655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:43.211387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:43.212050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:43.213040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:43.213825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:43.214468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:43.230749 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] HTTP exception thrown: Instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 could not be found. Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Request method failure captured: Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 HTTP/1.1 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRpBHD-xTVJekQiIxmzBL_ZmHdujIReTsnkh8w3vZqiT0Sw2bmC8RzIcukoU2U7M5adAGnXomv3ehbMxTUyD97Mbr605rfqgWR2AIMudQIJ-43iKqPG3Vuofc7sHld3hslEEEg-QcaHKihpozn7dyltjUflcnWJOsQCWLiMpeK_eiPIs Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}] Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 34018159bab84f6a959d7ac98814d158 Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 could not be found. Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4'} Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 could not be found. Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 could not be found. Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:01:43.232404 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 could not be found. Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Returning 404 to user: Instance 3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45ce1eb0-e6c2-452b-97f5-239daec54cf7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4" status: 404 len: 111 microversion: 2.1 time: 0.041840 Oct 12 10:01:43.237550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3944/7457] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:43 2022] GET /compute/v2.1/servers/3d161eb4-ad4d-4fc3-a020-5ac5e968f2f4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:01:46.883387 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ddf70795-10b7-46ab-bf3c-650bb3de7ec7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '.version_select at 0x7f9843f920d0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:46.906019 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ddf70795-10b7-46ab-bf3c-650bb3de7ec7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1822560822" status: 202 len: 0 microversion: 2.1 time: 0.026604 Oct 12 10:01:46.910353 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3514/7458] 10.222.0.40 () {58 vars in 1284 bytes} [Wed Oct 12 10:01:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1822560822 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 10:01:46.931773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d375a7ad-adec-4405-b3a5-7c9975bebb84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: .version_select at 0x7f9843f6ef70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1239411034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/qaELaJr/9/0vOUBmtlb+g2SHdAsoBo2NlaVT5HWf5tWai2H7KernEDgfQIFFwNAdIWUwin+QJLFJ3nI9QLIXg8MpCpRSzHmlvdlqRRv944sbb4pXBiKRbtSrGNCU9qw=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:46.948836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d375a7ad-adec-4405-b3a5-7c9975bebb84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:01:46.955427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-d375a7ad-adec-4405-b3a5-7c9975bebb84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:01:46.980669 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d375a7ad-adec-4405-b3a5-7c9975bebb84 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053475 Oct 12 10:01:46.981308 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3945/7459] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 10:01:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:01:52.594094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:01:52.598587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-887738196", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "047ba77d-af95-4a45-8c7f-eed1bfb8a5a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1239411034", "security_groups": [{"name": "tempest-secgroup-smoke-1586688567"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:52.729826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] validate_networks() for [('047ba77d-af95-4a45-8c7f-eed1bfb8a5a0', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:01:53.124512 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:01:53.124960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:01:53.125458 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:01:53.125866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:01:53.126281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:01:53.135392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:53.135878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:53.136315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:53.137044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:53.137552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:53.137984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:53.154911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:01:53.160663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:01:53.174288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:01:53.176666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:01:53.223077 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [cfa2cd62-3aaf-48ff-b652-d79bef6fd6f6] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 10:01:54.232842 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [cfa2cd62-3aaf-48ff-b652-d79bef6fd6f6] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 50988. Oct 12 10:01:54.238408 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-33331fdb-2524-4cf5-ad01-5d5ef173fe93 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.646185 Oct 12 10:01:54.245639 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3515/7460] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:01:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:01:54.248657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=32 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:01:54.254337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aa0e8aeb-1af5-4dd2-90c3-ea802104c017 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:54.255367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aa0e8aeb-1af5-4dd2-90c3-ea802104c017 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:54.317144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aa0e8aeb-1af5-4dd2-90c3-ea802104c017 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:54.325597 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aa0e8aeb-1af5-4dd2-90c3-ea802104c017 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1266 microversion: 2.1 time: 0.078690 Oct 12 10:01:54.326707 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3946/7461] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:54 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:55.358666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:55.359333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:55.374251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:55.374760 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:55.375216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:55.377131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:55.377637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:55.389109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:55.472885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:55.484366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ff4ab4f4-5757-4d76-a2a8-516da91cba59 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1326 microversion: 2.1 time: 0.139659 Oct 12 10:01:55.485241 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3516/7462] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:55 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1326 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:01:56.510549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:56.511163 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:56.519230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:56.519729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:56.520242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:56.520968 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:56.521467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:56.521928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:56.656735 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:56.664947 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-774f2269-ef87-4c73-9515-f1bce22f426b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1392 microversion: 2.1 time: 0.158497 Oct 12 10:01:56.665551 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3947/7463] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:56 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:56.983220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-09571d9c-413f-4fe9-8ba4-c50ced24c25e req-6e62857e-253a-4521-917f-1e3fc14a9093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c90085d-e460-4c47-8465-a7105429a739", "tag": "6c01360a-608f-41b1-8426-cf31debf0aca"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:01:56.995844 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-09571d9c-413f-4fe9-8ba4-c50ced24c25e req-6e62857e-253a-4521-917f-1e3fc14a9093 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:56.996412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-09571d9c-413f-4fe9-8ba4-c50ced24c25e req-6e62857e-253a-4521-917f-1e3fc14a9093 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:56.996923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-09571d9c-413f-4fe9-8ba4-c50ced24c25e req-6e62857e-253a-4521-917f-1e3fc14a9093 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:57.008836 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-09571d9c-413f-4fe9-8ba4-c50ced24c25e req-6e62857e-253a-4521-917f-1e3fc14a9093 service nova] Creating event network-changed:6c01360a-608f-41b1-8426-cf31debf0aca for instance 5c90085d-e460-4c47-8465-a7105429a739 on n-h1-858383-10 Oct 12 10:01:57.014025 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-09571d9c-413f-4fe9-8ba4-c50ced24c25e req-6e62857e-253a-4521-917f-1e3fc14a9093 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035086 Oct 12 10:01:57.014887 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3517/7464] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:01:57.689688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:57.690348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:57.698201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:57.698711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:57.699169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:57.699898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:57.700370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:57.700819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:57.840758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:57.849380 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f256728b-99df-499b-8d81-6f9e65328308 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1392 microversion: 2.1 time: 0.163739 Oct 12 10:01:57.850005 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3948/7465] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:57 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:01:58.874466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:01:58.875204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:01:58.882024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:58.882517 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:58.882962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:58.883660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:01:58.884128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:01:58.884560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:01:59.057169 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:01:59.068997 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b78c5603-4bd8-40d2-ba58-901d67ae0e37 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1392 microversion: 2.1 time: 0.200329 Oct 12 10:01:59.069613 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3518/7466] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:01:58 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1392 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:00.096456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:00.097577 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:00.108695 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:00.109552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:00.110324 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:00.111494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:00.112284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:00.113019 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:00.256571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:00.264788 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d0ecab63-1daf-4922-9dff-ff6b503b02c0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1392 microversion: 2.1 time: 0.175097 Oct 12 10:02:00.265426 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3949/7467] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:00 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:01.292313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:01.293233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:01.304341 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:01.305124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:01.305886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:01.307379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:01.308117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:01.308797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:01.445914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:01.454394 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a87f9d38-540e-4cc9-98d7-a4e2500efc0e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1392 microversion: 2.1 time: 0.168791 Oct 12 10:02:01.454950 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3519/7468] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:01 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:02.477365 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:02.478005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:02.485362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:02.485907 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:02.486356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:02.487074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:02.487541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:02.487979 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:02.513475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-f5357468-09bd-42cb-8223-912bd63b6bd9 req-680a60cf-5409-46e3-9bd2-647b64e13ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c90085d-e460-4c47-8465-a7105429a739", "name": "network-vif-plugged", "status": "completed", "tag": "6c01360a-608f-41b1-8426-cf31debf0aca"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:02:02.527114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f5357468-09bd-42cb-8223-912bd63b6bd9 req-680a60cf-5409-46e3-9bd2-647b64e13ac4 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:02.527888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f5357468-09bd-42cb-8223-912bd63b6bd9 req-680a60cf-5409-46e3-9bd2-647b64e13ac4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:02.528540 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-f5357468-09bd-42cb-8223-912bd63b6bd9 req-680a60cf-5409-46e3-9bd2-647b64e13ac4 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:02.541315 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-f5357468-09bd-42cb-8223-912bd63b6bd9 req-680a60cf-5409-46e3-9bd2-647b64e13ac4 service nova] Creating event network-vif-plugged:6c01360a-608f-41b1-8426-cf31debf0aca for instance 5c90085d-e460-4c47-8465-a7105429a739 on n-h1-858383-10 Oct 12 10:02:02.546889 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-f5357468-09bd-42cb-8223-912bd63b6bd9 req-680a60cf-5409-46e3-9bd2-647b64e13ac4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038083 Oct 12 10:02:02.547752 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3520/7469] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:02:02.632611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:02.641028 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3cdbe5da-14d0-4da7-b276-92b7483d1889 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1392 microversion: 2.1 time: 0.167702 Oct 12 10:02:02.641641 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3950/7470] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:02 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:03.661174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:03.662099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:03.667391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:03.668096 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:03.675342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:03.675831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:03.676272 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:03.676972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:03.677422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:03.677869 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:03.827928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:03.836125 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cbb1ca25-98bd-4c71-8607-ed81d40cf7c9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1392 microversion: 2.1 time: 0.175804 Oct 12 10:02:03.836696 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3521/7471] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:03 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:04.860397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:04.860970 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:04.863874 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:04.864594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:04.871248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:04.871801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:04.872276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:04.873041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:04.873571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:04.874045 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:05.017125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:05.025742 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-80021959-fd1b-41ad-9d1d-2b536a3a1e12 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1563 microversion: 2.1 time: 0.169721 Oct 12 10:02:05.026367 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3951/7472] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:04 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:05.048405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:05.049066 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:05.051782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:05.057699 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:05.058186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:05.058658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:05.059361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:05.059824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:05.060262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:05.197386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:05.209828 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-13a6f687-740f-4a57-a3a7-283b41f8e0a1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1563 microversion: 2.1 time: 0.165059 Oct 12 10:02:05.210478 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3522/7473] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:05 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:06.839186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:06.845130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-97e0e1e7-5a4a-4979-864c-9051e8f99dbe req-52a5a5ac-fda8-40b9-b068-221a60bb1436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c90085d-e460-4c47-8465-a7105429a739", "tag": "6c01360a-608f-41b1-8426-cf31debf0aca"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:02:06.846706 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:06.861606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:06.865664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97e0e1e7-5a4a-4979-864c-9051e8f99dbe req-52a5a5ac-fda8-40b9-b068-221a60bb1436 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:06.866198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97e0e1e7-5a4a-4979-864c-9051e8f99dbe req-52a5a5ac-fda8-40b9-b068-221a60bb1436 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:06.866624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-97e0e1e7-5a4a-4979-864c-9051e8f99dbe req-52a5a5ac-fda8-40b9-b068-221a60bb1436 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:06.867890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:06.868400 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:06.869178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:06.869719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:06.870188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:06.878317 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-97e0e1e7-5a4a-4979-864c-9051e8f99dbe req-52a5a5ac-fda8-40b9-b068-221a60bb1436 service nova] Creating event network-changed:6c01360a-608f-41b1-8426-cf31debf0aca for instance 5c90085d-e460-4c47-8465-a7105429a739 on n-h1-858383-10 Oct 12 10:02:06.883646 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-97e0e1e7-5a4a-4979-864c-9051e8f99dbe req-52a5a5ac-fda8-40b9-b068-221a60bb1436 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042441 Oct 12 10:02:06.884453 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3523/7474] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:02:07.011131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:07.019308 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-12aa9aa5-cc26-4d28-ac9f-38e2a8c685fa tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1563 microversion: 2.1 time: 0.184131 Oct 12 10:02:07.020100 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3952/7475] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:06 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:30.326966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:30.328162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=38 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:30.335374 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:02:30.338681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:30.345729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:30.346208 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:30.346635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:30.347323 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:30.347767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:30.348183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:30.405579 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8174c8c2-485f-4e18-95a3-9faea039ad8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739/action" status: 200 len: 24569 microversion: 2.1 time: 0.081768 Oct 12 10:02:30.406222 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3524/7476] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:02:30 2022] POST /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739/action => generated 24569 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:02:41.360606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:02:41.364309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:41.368069 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:41.369363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=36 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:41.377522 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:41.377980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:41.378441 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:41.379165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:41.379638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:41.380078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:41.458954 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-067d6267-d289-45e7-90ee-459540cb2030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739/action" status: 202 len: 0 microversion: 2.1 time: 0.104670 Oct 12 10:02:41.459944 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3953/7477] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:02:41 2022] POST /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:02:41.470617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:41.471318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:41.474185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:41.474813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:02:41.480231 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:41.480720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:41.481161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:41.481895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:41.482377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:41.482796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:41.702552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:41.710563 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-226cae4b-42e3-4df4-80ea-219acf6ad235 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1674 microversion: 2.1 time: 0.245634 Oct 12 10:02:41.711148 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3525/7478] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:41 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:42.741567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:42.742632 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:42.751701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:42.752210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:42.752669 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:42.753391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:42.753896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:42.754353 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:42.896562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:42.905024 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-69709ee0-495b-4613-8f2b-6d9085788eb0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.172646 Oct 12 10:02:42.905637 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3954/7479] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:42 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:43.934662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:43.935478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:43.949389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:43.950251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:43.950976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:43.952149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:43.952601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:43.953023 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:44.087759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:44.096438 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-995dd893-9e89-4105-8316-d458cedbe748 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.169009 Oct 12 10:02:44.097039 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3526/7480] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:43 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:45.124478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:45.126280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:45.133840 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:45.134351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:45.134802 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:45.135524 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:45.136007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:45.136448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:45.275942 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:45.283979 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9251c39f-f304-498e-95b5-d936ae42fe7d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.166399 Oct 12 10:02:45.284562 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3955/7481] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:45 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:46.312407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:46.313357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:46.325220 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:46.326074 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:46.326803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:46.327935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:46.328961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:46.329648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:46.470429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:46.478701 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1fc96f80-408e-45a1-bab3-a403b283714c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.173400 Oct 12 10:02:46.479283 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3527/7482] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:46 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:47.506743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:47.507690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:47.518450 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:47.518955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:47.519403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:47.520112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:47.520586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:47.521025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:47.661473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:47.670023 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cdadca32-d4c4-4793-bb8d-d56a7230f4f4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.169897 Oct 12 10:02:47.670607 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3956/7483] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:47 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:48.694504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:48.695075 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:48.702419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:48.702908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:48.703347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:48.704053 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:48.704514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:48.704954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:48.844845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:48.853228 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-879986e2-87b2-4b9d-b8c1-988487316c91 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.162882 Oct 12 10:02:48.854149 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3528/7484] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:48 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:49.881391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:49.882059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:49.889548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:49.890078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:49.890536 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:49.891251 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:49.891730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:49.892218 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:50.028318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:50.036825 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85e447ed-44fc-49f6-9c1c-236aed79c3ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.159466 Oct 12 10:02:50.037400 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3957/7485] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:49 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:51.064973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:51.065746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:51.074675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:51.075279 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:51.075820 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:51.076681 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:51.077242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:51.077813 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:51.218808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:51.227174 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-26c128b3-9f2d-4f4d-8b05-a493545293bd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.169282 Oct 12 10:02:51.227760 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3529/7486] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:51 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:52.255289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:52.256333 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:52.267988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:52.268501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:52.268967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:52.269723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:52.270202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:52.270644 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:52.419052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:52.428710 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9821492a-0d23-4133-8842-6e63309de741 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1679 microversion: 2.1 time: 0.180293 Oct 12 10:02:52.429537 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3958/7487] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:52 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:02:53.452754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:02:53.453394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:02:53.460951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:53.461462 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:53.461914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:53.462621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:02:53.463082 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:02:53.463511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:02:53.607243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:02:53.615381 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-08424c3a-f627-4ee7-afce-989004d6562e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1682 microversion: 2.1 time: 0.166744 Oct 12 10:02:53.615990 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3530/7488] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:02:53 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:19.864751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:03:19.867061 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:19.869330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=12 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:19.870042 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:19.876000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:19.876509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:19.876965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:19.877715 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:19.878201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:19.878648 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:19.937967 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-7f3d6209-1657-4079-9b4b-106a4b8da8e7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739/action" status: 200 len: 69081 microversion: 2.1 time: 0.077324 Oct 12 10:03:19.938532 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3959/7489] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:03:19 2022] POST /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739/action => generated 69081 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:03:26.993945 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:26.995108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:26.996298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6f826832-aac2-4857-a13b-86e2d9b88bda req-de7b8e09-9b13-4669-9587-f355045d5961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c90085d-e460-4c47-8465-a7105429a739", "tag": "6c01360a-608f-41b1-8426-cf31debf0aca"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:03:26.998714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=12 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:26.999534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=36 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:27.003866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:27.004391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:27.004876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:27.005599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:27.006442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:27.006600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:27.009660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6f826832-aac2-4857-a13b-86e2d9b88bda req-de7b8e09-9b13-4669-9587-f355045d5961 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:27.010723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6f826832-aac2-4857-a13b-86e2d9b88bda req-de7b8e09-9b13-4669-9587-f355045d5961 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:27.010723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6f826832-aac2-4857-a13b-86e2d9b88bda req-de7b8e09-9b13-4669-9587-f355045d5961 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:27.022937 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6f826832-aac2-4857-a13b-86e2d9b88bda req-de7b8e09-9b13-4669-9587-f355045d5961 service nova] Creating event network-changed:6c01360a-608f-41b1-8426-cf31debf0aca for instance 5c90085d-e460-4c47-8465-a7105429a739 on n-h1-858383-10 Oct 12 10:03:27.028870 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6f826832-aac2-4857-a13b-86e2d9b88bda req-de7b8e09-9b13-4669-9587-f355045d5961 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036609 Oct 12 10:03:27.029717 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3960/7490] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:03:27.033977 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:03:27.117613 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-298664fb-83a1-4a0b-940f-24721cd69519 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 204 len: 0 microversion: 2.1 time: 0.127681 Oct 12 10:03:27.121837 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3531/7491] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:03:26 2022] DELETE /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:03:27.129861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:27.130900 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:27.137887 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:27.138639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:27.139294 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:27.140235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:27.140718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:27.141145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:27.393617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:27.401536 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cf11a75b-6ea4-4428-951c-74af6b15335b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1688 microversion: 2.1 time: 0.277809 Oct 12 10:03:27.402115 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3961/7492] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:27 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1688 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:28.430825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:28.431987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:28.439807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:28.440288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:28.440731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:28.441851 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:28.442308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:28.442739 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:28.689092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:28.698008 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42ae4e41-aebb-4b4d-b014-cbfde187da52 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1688 microversion: 2.1 time: 0.274389 Oct 12 10:03:28.698683 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3532/7493] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:28 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1688 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:29.287681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-df5351b1-d5a3-4875-b67a-adba3dde81d1 req-0a2fc0ee-c06a-44b7-96ef-a16e904aa378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c90085d-e460-4c47-8465-a7105429a739", "name": "network-vif-deleted", "tag": "6c01360a-608f-41b1-8426-cf31debf0aca"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:03:29.300054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df5351b1-d5a3-4875-b67a-adba3dde81d1 req-0a2fc0ee-c06a-44b7-96ef-a16e904aa378 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:29.300541 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df5351b1-d5a3-4875-b67a-adba3dde81d1 req-0a2fc0ee-c06a-44b7-96ef-a16e904aa378 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:29.301084 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df5351b1-d5a3-4875-b67a-adba3dde81d1 req-0a2fc0ee-c06a-44b7-96ef-a16e904aa378 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:29.314455 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-df5351b1-d5a3-4875-b67a-adba3dde81d1 req-0a2fc0ee-c06a-44b7-96ef-a16e904aa378 service nova] Creating event network-vif-deleted:6c01360a-608f-41b1-8426-cf31debf0aca for instance 5c90085d-e460-4c47-8465-a7105429a739 on n-h1-858383-10 Oct 12 10:03:29.321348 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-df5351b1-d5a3-4875-b67a-adba3dde81d1 req-0a2fc0ee-c06a-44b7-96ef-a16e904aa378 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037575 Oct 12 10:03:29.321993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3962/7494] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:03:29.722116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:29.722722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:29.729926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:29.730411 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:29.730891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:29.731582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:29.732036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:29.732463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:29.763601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:29.764061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:29.764498 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:29.764942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lazy-loading 'fault' on Instance uuid 5c90085d-e460-4c47-8465-a7105429a739 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:03:29.805714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:29.813953 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0020e904-7416-471b-8388-1de50b8f2763 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 200 len: 1356 microversion: 2.1 time: 0.095903 Oct 12 10:03:29.814461 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3533/7495] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:29 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 1356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:30.842174 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:30.843068 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c90085d-e460-4c47-8465-a7105429a739] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:30.851624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:30.852169 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:30.852657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:30.853501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:30.854063 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:30.854529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:30.868784 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] HTTP exception thrown: Instance 5c90085d-e460-4c47-8465-a7105429a739 could not be found. Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Request method failure captured: Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 HTTP/1.1 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRpBHD-xTVJekQiIxmzBL_ZmHdujIReTsnkh8w3vZqiT0Sw2bmC8RzIcukoU2U7M5adAGnXomv3ehbMxTUyD97Mbr605rfqgWR2AIMudQIJ-43iKqPG3Vuofc7sHld3hslEEEg-QcaHKihpozn7dyltjUflcnWJOsQCWLiMpeK_eiPIs Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}] Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 34018159bab84f6a959d7ac98814d158 Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 5c90085d-e460-4c47-8465-a7105429a739 could not be found. Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '5c90085d-e460-4c47-8465-a7105429a739'} Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c90085d-e460-4c47-8465-a7105429a739 could not be found. Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c90085d-e460-4c47-8465-a7105429a739 could not be found. Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:03:30.870511 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c90085d-e460-4c47-8465-a7105429a739 could not be found. Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Returning 404 to user: Instance 5c90085d-e460-4c47-8465-a7105429a739 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b43bcd0a-9fb2-4739-9b11-b4234df7abb1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739" status: 404 len: 111 microversion: 2.1 time: 0.035895 Oct 12 10:03:30.877867 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3963/7496] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:30 2022] GET /compute/v2.1/servers/5c90085d-e460-4c47-8465-a7105429a739 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:03:34.318453 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-cf475653-d6e5-4d97-86f5-2c414a803484 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '.version_select at 0x7f9848e131f0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:34.345560 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-cf475653-d6e5-4d97-86f5-2c414a803484 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1239411034" status: 202 len: 0 microversion: 2.1 time: 0.031241 Oct 12 10:03:34.346298 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3534/7497] 10.222.0.40 () {58 vars in 1284 bytes} [Wed Oct 12 10:03:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1239411034 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:03:34.371286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0f7ce543-96df-40e8-9d17-9255c863f4fb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: .version_select at 0x7f98489c38b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2028505064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwtpEIR3Mesa5wWfYb/N1ENQQnyScBpOHZ1z/KjDdn7PHkn1izOPrMumEVGfGZ31k4+tDr5uPkrK4aA8sp3UgNhz6blOYP2vmtrwHtmba4KUDaV2GpJ4GHvRWoV/y1MgQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:03:34.388608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0f7ce543-96df-40e8-9d17-9255c863f4fb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:03:34.394103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-0f7ce543-96df-40e8-9d17-9255c863f4fb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:03:34.419204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0f7ce543-96df-40e8-9d17-9255c863f4fb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051855 Oct 12 10:03:34.419841 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3964/7498] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 10:03:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:03:40.323157 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-616087909", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "d10e6a29-778d-480c-b7e0-a539a167d523"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2028505064", "security_groups": [{"name": "tempest-secgroup-smoke-470390677"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:03:40.343807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:40.477319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] validate_networks() for [('d10e6a29-778d-480c-b7e0-a539a167d523', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:03:40.983080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:03:40.983503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:03:40.983973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:03:40.984376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:03:40.985012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:03:40.994435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:40.994918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:40.995351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:40.996067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:40.996671 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:40.997214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:41.015722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:03:41.022688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:03:41.037059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:03:41.039456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:03:41.090821 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-44fe9287-e916-41d5-af25-85a1a3fc2adb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.781260 Oct 12 10:03:41.092277 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3535/7499] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:03:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:03:41.101643 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:03:41.102212 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:03:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f (ip 10.222.0.40) !!! Oct 12 10:03:41.103152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=16 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:41.108666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-da6210c5-ef73-4162-a9c4-b7e12d89ef27 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:41.112402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-da6210c5-ef73-4162-a9c4-b7e12d89ef27 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:41.183351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-da6210c5-ef73-4162-a9c4-b7e12d89ef27 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:41.193766 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-da6210c5-ef73-4162-a9c4-b7e12d89ef27 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1266 microversion: 2.1 time: 0.094200 Oct 12 10:03:41.194477 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3965/7500] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:41 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:42.217897 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:42.218514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:42.236278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:42.236809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:42.237349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:42.238079 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:42.238535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:42.238969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:42.307112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:42.315603 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d1b5ce9d-94c1-4cdd-a189-7adb9b12e660 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1326 microversion: 2.1 time: 0.102675 Oct 12 10:03:42.316870 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3536/7501] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:42 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:43.340120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:43.340732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:43.348240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:43.348752 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:43.349224 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:43.350117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:43.350593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:43.351059 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:43.598997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:43.607456 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-580f0ecb-dbc8-4961-9364-61aa1422dcc6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1391 microversion: 2.1 time: 0.271334 Oct 12 10:03:43.608118 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3966/7502] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:43 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1391 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:43.805496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-8ed6937e-e329-4c06-96a1-6213e87db4ea req-06fa30b8-46d4-43dc-a015-0ed5d49202ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "525567f0-2b65-4ccf-9a69-c6dea8c0d96f", "tag": "3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:03:43.818601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8ed6937e-e329-4c06-96a1-6213e87db4ea req-06fa30b8-46d4-43dc-a015-0ed5d49202ed service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:43.819288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8ed6937e-e329-4c06-96a1-6213e87db4ea req-06fa30b8-46d4-43dc-a015-0ed5d49202ed service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:43.819891 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-8ed6937e-e329-4c06-96a1-6213e87db4ea req-06fa30b8-46d4-43dc-a015-0ed5d49202ed service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:43.831795 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-8ed6937e-e329-4c06-96a1-6213e87db4ea req-06fa30b8-46d4-43dc-a015-0ed5d49202ed service nova] Creating event network-changed:3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71 for instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f on n-h2-858383-10 Oct 12 10:03:43.837288 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-8ed6937e-e329-4c06-96a1-6213e87db4ea req-06fa30b8-46d4-43dc-a015-0ed5d49202ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037171 Oct 12 10:03:43.838318 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3537/7503] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:03:44.631445 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:44.632074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:44.639043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:44.639894 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:44.640678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:44.641923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:44.642793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:44.643454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:44.782437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:44.790288 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-615c30aa-f2c0-4299-94cd-37fd60794145 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1391 microversion: 2.1 time: 0.162811 Oct 12 10:03:44.790866 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3967/7504] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:44 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:45.814155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:45.814715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:45.821589 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:45.822045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:45.822484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:45.823174 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:45.823661 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:45.824078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:45.959868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:45.967907 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1cbeecfb-e7fa-41f2-b24f-fd03d8e6b4e5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1391 microversion: 2.1 time: 0.159343 Oct 12 10:03:45.968491 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3538/7505] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:45 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:46.992187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:46.992810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:46.999512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:47.000017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:47.000471 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:47.001223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:47.001726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:47.002172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:47.143367 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:47.151429 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b1aa036f-2b94-4bea-93b3-abdf90edcfb4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1391 microversion: 2.1 time: 0.164429 Oct 12 10:03:47.152019 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3968/7506] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:46 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:48.176144 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:48.176733 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:48.184209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:48.184856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:48.185318 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:48.186035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:48.186505 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:48.186932 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:48.333629 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:48.341350 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3cb6b8fb-c0a4-4108-a359-0fa5f33ee0b6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1391 microversion: 2.1 time: 0.169524 Oct 12 10:03:48.341956 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3539/7507] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:48 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:49.368915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:49.369858 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:49.379038 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:49.379550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:49.380008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:49.380726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:49.381203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:49.381687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:49.515961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:49.523956 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9deade09-38b7-4d33-b22b-3e6edc7ccbd1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1391 microversion: 2.1 time: 0.161867 Oct 12 10:03:49.524550 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3969/7508] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:49 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:50.301556 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-bf1179b1-f51d-493c-9205-b3e710b688ec req-71b6212e-34d1-4ac2-a9a6-2b585aa42a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "525567f0-2b65-4ccf-9a69-c6dea8c0d96f", "name": "network-vif-plugged", "status": "completed", "tag": "3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:03:50.311520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf1179b1-f51d-493c-9205-b3e710b688ec req-71b6212e-34d1-4ac2-a9a6-2b585aa42a1e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:50.312005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf1179b1-f51d-493c-9205-b3e710b688ec req-71b6212e-34d1-4ac2-a9a6-2b585aa42a1e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:50.312479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-bf1179b1-f51d-493c-9205-b3e710b688ec req-71b6212e-34d1-4ac2-a9a6-2b585aa42a1e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:50.324123 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-bf1179b1-f51d-493c-9205-b3e710b688ec req-71b6212e-34d1-4ac2-a9a6-2b585aa42a1e service nova] Creating event network-vif-plugged:3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71 for instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f on n-h2-858383-10 Oct 12 10:03:50.329346 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-bf1179b1-f51d-493c-9205-b3e710b688ec req-71b6212e-34d1-4ac2-a9a6-2b585aa42a1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088819 Oct 12 10:03:50.329997 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3540/7509] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:03:50.553257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:50.554306 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:50.558609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:50.567516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:50.568710 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:50.569509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:50.570711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:50.571500 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:50.572213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:50.712093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:50.720696 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ab9a563f-ea72-4e5a-92eb-dd3ea1fdbfa6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1391 microversion: 2.1 time: 0.173879 Oct 12 10:03:50.721620 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3970/7510] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:50 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:51.741182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:51.741965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:51.747604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:51.748312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:51.756122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:51.756593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:51.757024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:51.757750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:51.758183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:51.758605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:51.892153 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:51.900147 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9673bf37-2651-4c36-8191-144db865d74e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1563 microversion: 2.1 time: 0.160011 Oct 12 10:03:51.900720 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3541/7511] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:51 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:03:51.922775 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:51.923402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:51.925313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:03:51.931801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:51.932296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:51.932745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:51.933467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:51.933937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:51.934372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:52.073056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:52.082554 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f2c1f6f2-b145-44c5-8495-64376f871502 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1563 microversion: 2.1 time: 0.163882 Oct 12 10:03:52.083164 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3971/7512] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:51 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:03:54.043221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:03:54.043837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:03:54.057422 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:54.057971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:54.058410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:54.059111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:54.059783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:54.060211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:54.116629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-690c5cd8-3126-44a8-b596-07392f0736a8 req-60471060-6ec6-4b5f-be94-aa8b7af857b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "525567f0-2b65-4ccf-9a69-c6dea8c0d96f", "tag": "3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:03:54.128103 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-690c5cd8-3126-44a8-b596-07392f0736a8 req-60471060-6ec6-4b5f-be94-aa8b7af857b2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:03:54.128843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-690c5cd8-3126-44a8-b596-07392f0736a8 req-60471060-6ec6-4b5f-be94-aa8b7af857b2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:03:54.129288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-690c5cd8-3126-44a8-b596-07392f0736a8 req-60471060-6ec6-4b5f-be94-aa8b7af857b2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:03:54.143008 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-690c5cd8-3126-44a8-b596-07392f0736a8 req-60471060-6ec6-4b5f-be94-aa8b7af857b2 service nova] Creating event network-changed:3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71 for instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f on n-h2-858383-10 Oct 12 10:03:54.150646 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-690c5cd8-3126-44a8-b596-07392f0736a8 req-60471060-6ec6-4b5f-be94-aa8b7af857b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100092 Oct 12 10:03:54.151437 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3972/7513] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:03:54.203615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:03:54.214434 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f1dd000f-fde6-4549-bbf6-4ad40518768e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1563 microversion: 2.1 time: 0.175161 Oct 12 10:03:54.215042 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3542/7514] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:03:54 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:17.558603 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=5 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:04:17.559581 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=38 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:04:17.565473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:04:17.568543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:17.577211 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:17.577742 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:17.578173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:17.578908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:17.579373 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:17.579847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:17.636269 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-74c3e29d-c198-4aac-adb2-d0b3a54b74ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f/action" status: 200 len: 24573 microversion: 2.1 time: 0.080240 Oct 12 10:04:17.636988 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3973/7515] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:04:17 2022] POST /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f/action => generated 24573 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:04:28.522238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:04:28.524714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:28.527203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:04:28.527896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=36 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:04:28.535070 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:28.535729 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:28.536192 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:28.536962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:28.537463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:28.537925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:28.580664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:28.587116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Old instance type m1.heat2, new instance type m1.heat {{(pid=127007) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 12 10:04:28.594213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:04:28.594670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:04:28.595150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:04:28.595623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:04:28.596111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:04:28.664858 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d26fd322-e453-4e22-8725-d4a98eb517b4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f/action" status: 202 len: 0 microversion: 2.1 time: 0.146828 Oct 12 10:04:28.665494 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3543/7516] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:04:28 2022] POST /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:04:28.674598 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:28.675343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:28.677904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:04:28.678608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:04:28.686034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:28.686814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:28.687332 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:28.688295 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:28.688823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:28.689276 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:28.843303 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:28.851847 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-06c182b8-a8b0-450f-80ac-91be96eca622 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1691 microversion: 2.1 time: 0.181776 Oct 12 10:04:28.852453 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3974/7517] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:28 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:29.881308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:29.882176 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:29.890880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:29.891380 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:29.891836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:29.892539 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:29.893003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:29.893465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:30.037093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:30.045387 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-17519b19-1e7c-4b7e-8499-c67a80b8318c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1691 microversion: 2.1 time: 0.171902 Oct 12 10:04:30.046036 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3544/7518] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:29 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:31.074036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:31.074635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:31.082106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:31.082612 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:31.083071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:31.083796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:31.084271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:31.084716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:31.221555 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:31.229722 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-387993f2-5f04-4ae5-9039-40c86e4376ce tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1691 microversion: 2.1 time: 0.162123 Oct 12 10:04:31.230308 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3975/7519] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:31 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:32.260868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:32.261488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:32.268315 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:32.268788 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:32.269223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:32.269939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:32.270383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:32.270802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:32.401479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:32.410047 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b2b600b5-e001-4083-97ff-3e31abda57ed tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1691 microversion: 2.1 time: 0.153177 Oct 12 10:04:32.410598 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3545/7520] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:32 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:33.437923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:33.438996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:33.450593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:33.451105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:33.451564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:33.452288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:33.452792 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:33.453238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:33.586040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:33.594068 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6fdf83e5-ee22-41d6-b585-cd065f131451 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1691 microversion: 2.1 time: 0.162894 Oct 12 10:04:33.594760 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3976/7521] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:33 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:34.619893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:34.620459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:34.627841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:34.628368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:34.628807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:34.629779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:34.630233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:34.630652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:34.768087 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:34.776288 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-96129486-d2d1-45cc-8cec-a984ecf0c1fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1691 microversion: 2.1 time: 0.160375 Oct 12 10:04:34.776871 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3546/7522] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:34 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:35.800179 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:35.800793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:35.808112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:35.808649 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:35.809136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:35.809881 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:35.810356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:35.810806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:35.964296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:35.972643 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-598656de-e624-4efc-b245-eadcb455be89 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1691 microversion: 2.1 time: 0.176532 Oct 12 10:04:35.973233 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3977/7523] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:35 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:36.999177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:36.999819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:37.010459 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:37.011205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:37.011922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:37.012898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:37.013347 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:37.013799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:37.162353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:37.177588 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bdb13e91-5ca6-4f75-b15d-db959081977d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.183740 Oct 12 10:04:37.178456 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3547/7524] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:36 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:38.207147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:38.208241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:38.219937 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:38.220774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:38.221566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:38.222781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:38.223570 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:38.224317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:38.363416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:38.375338 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f357ec0c-615e-4614-a1aa-a30eb330913a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.174783 Oct 12 10:04:38.376046 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3978/7525] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:38 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:39.406076 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:39.406801 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:39.415871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:39.416470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:39.417015 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:39.417921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:39.418485 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:39.419017 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:39.562360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:39.570634 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-42a623b2-087c-40fa-93a2-61562924cae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.170604 Oct 12 10:04:39.571257 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3548/7526] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:39 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:40.600433 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:40.601586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:40.611245 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:40.611761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:40.612260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:40.612977 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:40.613467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:40.613952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:40.762760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:40.771253 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-680d20c7-f2f4-476e-b8ed-a994294a05a3 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.178498 Oct 12 10:04:40.771861 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3979/7527] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:40 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:41.794894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:41.795509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:41.802907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:41.803392 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:41.803828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:41.804519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:41.804976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:41.805386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:41.951143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:41.959399 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-bb0f1927-4b31-454c-aceb-cda419a90a54 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.168542 Oct 12 10:04:41.959987 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3549/7528] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:41 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:42.986891 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:42.987560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:42.996133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:42.996726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:42.997261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:42.998132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:42.998685 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:42.999385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:43.133151 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:43.141342 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd0d1e93-e2ac-4680-9d45-984ead27d419 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.159427 Oct 12 10:04:43.141934 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3980/7529] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:42 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:44.170415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:44.171018 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:44.178608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:44.179091 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:44.179522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:44.180218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:44.180664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:44.181094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:44.321114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:44.329970 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e5c7be97-beb8-452e-b62b-38e6d4ee38fd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.165661 Oct 12 10:04:44.330554 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3550/7530] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:44 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:45.357733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:45.358772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:45.370604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:45.371454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:45.372213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:45.373395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:45.374233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:45.374876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:45.514953 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:45.522968 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de69080f-8d32-45d4-abc9-90249262d668 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.171884 Oct 12 10:04:45.523579 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3981/7531] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:45 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:46.550916 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:46.551979 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:46.563816 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:46.564623 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:46.565346 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:46.566529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:46.567311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:46.568007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:46.718750 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:46.726945 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-50376eca-b43b-4db5-9e6f-901c369b9a31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.182818 Oct 12 10:04:46.727529 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3551/7532] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:46 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:47.752810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:47.753474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:47.760835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:47.761346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:47.761833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:47.762564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:47.763041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:47.763493 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:47.938716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:47.947490 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6f184b99-0294-4270-a59b-8ae810efdb8d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1696 microversion: 2.1 time: 0.199869 Oct 12 10:04:47.948324 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3982/7533] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:47 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:48.549755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-7e6cfa87-d4d6-4b8c-87fa-0786a6468575 req-0aa3e124-b50e-43cf-930b-73f3ba4ffdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "525567f0-2b65-4ccf-9a69-c6dea8c0d96f", "name": "network-vif-unplugged", "status": "completed", "tag": "3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:04:48.561027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7e6cfa87-d4d6-4b8c-87fa-0786a6468575 req-0aa3e124-b50e-43cf-930b-73f3ba4ffdad service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:48.561528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7e6cfa87-d4d6-4b8c-87fa-0786a6468575 req-0aa3e124-b50e-43cf-930b-73f3ba4ffdad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:48.562032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7e6cfa87-d4d6-4b8c-87fa-0786a6468575 req-0aa3e124-b50e-43cf-930b-73f3ba4ffdad service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:48.576890 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7e6cfa87-d4d6-4b8c-87fa-0786a6468575 req-0aa3e124-b50e-43cf-930b-73f3ba4ffdad service nova] Creating event network-vif-unplugged:3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71 for instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f on n-h1-858383-10 Oct 12 10:04:48.582900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [req-7e6cfa87-d4d6-4b8c-87fa-0786a6468575 req-0aa3e124-b50e-43cf-930b-73f3ba4ffdad service nova] Instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127007) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 10:04:48.594712 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-7e6cfa87-d4d6-4b8c-87fa-0786a6468575 req-0aa3e124-b50e-43cf-930b-73f3ba4ffdad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048913 Oct 12 10:04:48.595346 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3552/7534] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:04:48.971622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:48.972240 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:48.979368 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:48.979878 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:48.980307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:48.981032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:48.981539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:48.981989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:49.251681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:49.259726 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-42f41037-a84a-4e86-a4b3-1de0430844f1 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1695 microversion: 2.1 time: 0.292117 Oct 12 10:04:49.260336 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3983/7535] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:48 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:50.292606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:50.293807 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:50.302624 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:50.303120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:50.303565 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:50.304269 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:50.304730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:50.305164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:50.441388 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:50.449879 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3f0d2569-20d2-463c-a24f-539339264b2a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1693 microversion: 2.1 time: 0.166433 Oct 12 10:04:50.450470 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3553/7536] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:50 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:50.635768 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-14fc001e-06a2-44a6-b9f9-a3f330340a23 req-f24b7b9a-90c2-4e1b-9098-7211d6866e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "525567f0-2b65-4ccf-9a69-c6dea8c0d96f", "tag": "3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:04:50.646673 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14fc001e-06a2-44a6-b9f9-a3f330340a23 req-f24b7b9a-90c2-4e1b-9098-7211d6866e9a service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:50.647192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14fc001e-06a2-44a6-b9f9-a3f330340a23 req-f24b7b9a-90c2-4e1b-9098-7211d6866e9a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:50.647631 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-14fc001e-06a2-44a6-b9f9-a3f330340a23 req-f24b7b9a-90c2-4e1b-9098-7211d6866e9a service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:50.659735 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-14fc001e-06a2-44a6-b9f9-a3f330340a23 req-f24b7b9a-90c2-4e1b-9098-7211d6866e9a service nova] Creating event network-changed:3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71 for instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f on n-h1-858383-10 Oct 12 10:04:50.666257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [req-14fc001e-06a2-44a6-b9f9-a3f330340a23 req-f24b7b9a-90c2-4e1b-9098-7211d6866e9a service nova] Instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-10', 'n-h2-858383-10'} {{(pid=127006) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 12 10:04:50.677473 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-14fc001e-06a2-44a6-b9f9-a3f330340a23 req-f24b7b9a-90c2-4e1b-9098-7211d6866e9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045596 Oct 12 10:04:50.678082 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3984/7537] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:04:51.473743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:51.474340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:51.481011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:51.481523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:51.481969 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:51.482695 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:51.483151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:51.483585 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:51.621400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:51.629604 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ab36b144-1dce-452c-aba7-7d01e1c9aab8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1690 microversion: 2.1 time: 0.160253 Oct 12 10:04:51.630587 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3554/7538] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:51 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:51.653298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:04:51.654080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:51.661292 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:51.661962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:51.662487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:51.663271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:51.663822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:51.664337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:51.726370 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6982e10c-957b-4505-adba-dea6681bee96 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f/action" status: 204 len: 0 microversion: 2.1 time: 0.077251 Oct 12 10:04:51.727034 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3985/7539] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:04:51 2022] POST /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:04:51.736130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:51.736936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:51.743271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:51.743826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:51.744357 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:51.745119 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:51.745731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:51.746221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:51.890533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:51.898917 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-13e995da-7ddc-4bad-a420-73172fda7aa0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1690 microversion: 2.1 time: 0.166885 Oct 12 10:04:51.899440 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3555/7540] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:51 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:51.922048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:51.922871 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:51.929286 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:51.929825 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:51.930315 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:51.931091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:51.931511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:51.931959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:52.152832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:52.161182 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-33699749-88b7-400f-836b-1795303e8327 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1690 microversion: 2.1 time: 0.243759 Oct 12 10:04:52.161818 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3986/7541] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:51 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:53.184232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:04:53.185494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:04:53.193196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:53.194028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:53.194529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:53.195183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:53.195662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:53.196167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:53.336716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:04:53.344739 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-085b8a0f-9d33-4786-9554-d8dfe8bcfd34 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1682 microversion: 2.1 time: 0.164389 Oct 12 10:04:53.345285 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3556/7542] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:04:53 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:04:55.244566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c0efec29-9b34-40dd-9fd0-ca4436bcf0a3 req-5fe8c8a3-40e3-40e9-974d-33d5c1a1f3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "525567f0-2b65-4ccf-9a69-c6dea8c0d96f", "name": "network-vif-plugged", "status": "completed", "tag": "3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:04:55.255384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c0efec29-9b34-40dd-9fd0-ca4436bcf0a3 req-5fe8c8a3-40e3-40e9-974d-33d5c1a1f3ff service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:04:55.255865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c0efec29-9b34-40dd-9fd0-ca4436bcf0a3 req-5fe8c8a3-40e3-40e9-974d-33d5c1a1f3ff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:04:55.256436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c0efec29-9b34-40dd-9fd0-ca4436bcf0a3 req-5fe8c8a3-40e3-40e9-974d-33d5c1a1f3ff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:04:55.268275 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c0efec29-9b34-40dd-9fd0-ca4436bcf0a3 req-5fe8c8a3-40e3-40e9-974d-33d5c1a1f3ff service nova] Creating event network-vif-plugged:3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71 for instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f on n-h1-858383-10 Oct 12 10:04:55.273555 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c0efec29-9b34-40dd-9fd0-ca4436bcf0a3 req-5fe8c8a3-40e3-40e9-974d-33d5c1a1f3ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Oct 12 10:04:55.274175 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3987/7543] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:05:17.582386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:05:17.584657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:17.586887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=32 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:17.587559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:17.593011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:17.593532 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:17.593972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:17.594675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:17.595131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:17.595559 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:17.657599 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-30ef25f4-effb-4e7a-add4-dd49eae62f9a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f/action" status: 200 len: 24530 microversion: 2.1 time: 0.079359 Oct 12 10:05:17.658247 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3557/7544] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:05:17 2022] POST /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f/action => generated 24530 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:05:24.879680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=28 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:24.880467 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:24.883416 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e9521430-9dcb-4720-8605-7094409515aa req-aac435e9-a1b1-47bd-98a1-d2c14e7067cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "525567f0-2b65-4ccf-9a69-c6dea8c0d96f", "tag": "3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:05:24.886616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:24.887225 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:24.895838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:24.896365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e9521430-9dcb-4720-8605-7094409515aa req-aac435e9-a1b1-47bd-98a1-d2c14e7067cf service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:24.896591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:24.896843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e9521430-9dcb-4720-8605-7094409515aa req-aac435e9-a1b1-47bd-98a1-d2c14e7067cf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:24.897226 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:24.897344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e9521430-9dcb-4720-8605-7094409515aa req-aac435e9-a1b1-47bd-98a1-d2c14e7067cf service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:24.898141 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:24.898731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:24.899402 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:24.909910 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e9521430-9dcb-4720-8605-7094409515aa req-aac435e9-a1b1-47bd-98a1-d2c14e7067cf service nova] Creating event network-changed:3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71 for instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f on n-h1-858383-10 Oct 12 10:05:24.915309 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e9521430-9dcb-4720-8605-7094409515aa req-aac435e9-a1b1-47bd-98a1-d2c14e7067cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035957 Oct 12 10:05:24.915978 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3558/7545] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:05:24.930305 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:05:25.011467 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-814ab6da-38e6-4e4c-89bb-157d79048af2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 204 len: 0 microversion: 2.1 time: 0.133929 Oct 12 10:05:25.012292 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3988/7546] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:05:24 2022] DELETE /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:05:25.022001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:25.022697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:25.029001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:25.029515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:25.029951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:25.030652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:25.031102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:25.031646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:25.167456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:25.176122 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7803cf39-65f8-4673-aae3-697b6d06684d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1688 microversion: 2.1 time: 0.158689 Oct 12 10:05:25.176550 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3559/7547] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:25 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:26.201623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:26.203241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:26.210606 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:26.211113 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:26.211575 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:26.212291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:26.212759 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:26.213364 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:26.374504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:26.382722 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-47d02fd5-8732-4e6b-ba46-5214ba829cfd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 200 len: 1688 microversion: 2.1 time: 0.185933 Oct 12 10:05:26.383305 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3989/7548] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:26 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:26.954092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-300dd69a-8cde-4dfd-8be1-f79e643196e3 req-224313e8-bfa8-4582-9479-8f099b06d466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "525567f0-2b65-4ccf-9a69-c6dea8c0d96f", "name": "network-vif-deleted", "tag": "3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:05:26.964725 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-300dd69a-8cde-4dfd-8be1-f79e643196e3 req-224313e8-bfa8-4582-9479-8f099b06d466 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:26.965222 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-300dd69a-8cde-4dfd-8be1-f79e643196e3 req-224313e8-bfa8-4582-9479-8f099b06d466 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:26.965715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-300dd69a-8cde-4dfd-8be1-f79e643196e3 req-224313e8-bfa8-4582-9479-8f099b06d466 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:26.978031 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-300dd69a-8cde-4dfd-8be1-f79e643196e3 req-224313e8-bfa8-4582-9479-8f099b06d466 service nova] Creating event network-vif-deleted:3f17c1ef-2a27-42ef-9c73-32e3bd1b0e71 for instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f on n-h1-858383-10 Oct 12 10:05:26.983239 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-300dd69a-8cde-4dfd-8be1-f79e643196e3 req-224313e8-bfa8-4582-9479-8f099b06d466 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 Oct 12 10:05:26.983896 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3560/7549] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:05:27.406917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:27.407532 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 525567f0-2b65-4ccf-9a69-c6dea8c0d96f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:27.414960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:27.415461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:27.415946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:27.416656 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:27.417131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:27.417610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:27.431590 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] HTTP exception thrown: Instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f could not be found. Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Request method failure captured: Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f HTTP/1.1 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRpBHD-xTVJekQiIxmzBL_ZmHdujIReTsnkh8w3vZqiT0Sw2bmC8RzIcukoU2U7M5adAGnXomv3ehbMxTUyD97Mbr605rfqgWR2AIMudQIJ-43iKqPG3Vuofc7sHld3hslEEEg-QcaHKihpozn7dyltjUflcnWJOsQCWLiMpeK_eiPIs Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}] Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 34018159bab84f6a959d7ac98814d158 Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f could not be found. Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '525567f0-2b65-4ccf-9a69-c6dea8c0d96f'} Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f could not be found. Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f could not be found. Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:05:27.433246 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f could not be found. Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Returning 404 to user: Instance 525567f0-2b65-4ccf-9a69-c6dea8c0d96f could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ffa8e4b4-4b1c-4071-80e2-3195e6198e08 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f" status: 404 len: 111 microversion: 2.1 time: 0.031979 Oct 12 10:05:27.438229 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3990/7550] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:27 2022] GET /compute/v2.1/servers/525567f0-2b65-4ccf-9a69-c6dea8c0d96f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:05:30.844960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e4b52c21-b223-465e-9033-6fe3e5d2f162 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '.version_select at 0x7f9843ddc310>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:30.866942 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e4b52c21-b223-465e-9033-6fe3e5d2f162 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2028505064" status: 202 len: 0 microversion: 2.1 time: 0.027353 Oct 12 10:05:30.867767 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3561/7551] 10.222.0.40 () {58 vars in 1284 bytes} [Wed Oct 12 10:05:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2028505064 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:05:30.892369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-272ab17b-c282-4313-984c-1d1b6c22e030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: .version_select at 0x7f9843a87790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2095324287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZFZUi1gBRy82xiEPJ19GMLUDl5VEZNZhxbiEyNVAxHe9dsMkBZrf4Fs7H7eU7kkCcrdn3si6K9L2Ba2O2jie+Je2WF3tooc7FKR2OVoveVj6RI+SBgXgD2pAHcgePvkQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:05:30.908729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-272ab17b-c282-4313-984c-1d1b6c22e030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:05:30.914726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-272ab17b-c282-4313-984c-1d1b6c22e030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:05:30.938530 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-272ab17b-c282-4313-984c-1d1b6c22e030 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050243 Oct 12 10:05:30.939140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3991/7552] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 10:05:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:05:36.568614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1886471537", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "3ed9c2d1-39d4-45c6-93a9-918e977c197a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2095324287", "security_groups": [{"name": "tempest-secgroup-smoke-495144697"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:05:36.709167 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] validate_networks() for [('3ed9c2d1-39d4-45c6-93a9-918e977c197a', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:05:36.970606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=14 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:37.130446 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:05:37.130872 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:05:37.131356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:05:37.131756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:05:37.132403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:05:37.142856 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:37.143614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:37.144125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:37.144975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:37.145663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:37.146159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:37.169491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:05:37.175510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:05:37.189177 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:05:37.191943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:05:37.243244 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-45b8e074-d768-4eed-a74e-86a2bf879cd2 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.679669 Oct 12 10:05:37.244415 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3562/7553] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:05:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:05:37.257106 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8e8d83c0-fe35-4a67-a5c4-cc6d622073af tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:37.258080 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8e8d83c0-fe35-4a67-a5c4-cc6d622073af tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:37.317298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8e8d83c0-fe35-4a67-a5c4-cc6d622073af tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:37.327160 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8e8d83c0-fe35-4a67-a5c4-cc6d622073af tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1267 microversion: 2.1 time: 0.073848 Oct 12 10:05:37.327833 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3992/7554] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:37 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:38.352926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:38.354464 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:38.362217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:38.370568 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:38.371243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:38.372186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:38.375549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:38.376209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:38.465379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:38.477585 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ab9ce704-a7ae-4b78-b83a-4d43d3767fe4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1327 microversion: 2.1 time: 0.129584 Oct 12 10:05:38.478526 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3563/7555] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:38 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:05:39.501148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:39.502546 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:39.504701 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:39.514298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:39.514789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:39.515604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:39.516399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:39.517066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:39.517714 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:39.731996 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:39.741379 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5e9715e6-720a-4f14-989a-a068b9d58b31 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1392 microversion: 2.1 time: 0.244425 Oct 12 10:05:39.742031 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3993/7556] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:39 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:40.072992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-cf781d80-0ce6-4062-b138-f3af1977e9c4 req-06ae11d1-c37d-440b-8814-183d3a269af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c71d1e9-f910-48f1-9a79-0e23ee91cfd4", "tag": "9886c6a9-eae6-408e-b968-ccf5220caa53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:05:40.086125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cf781d80-0ce6-4062-b138-f3af1977e9c4 req-06ae11d1-c37d-440b-8814-183d3a269af9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:40.086667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cf781d80-0ce6-4062-b138-f3af1977e9c4 req-06ae11d1-c37d-440b-8814-183d3a269af9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:40.087403 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-cf781d80-0ce6-4062-b138-f3af1977e9c4 req-06ae11d1-c37d-440b-8814-183d3a269af9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:40.102139 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-cf781d80-0ce6-4062-b138-f3af1977e9c4 req-06ae11d1-c37d-440b-8814-183d3a269af9 service nova] Creating event network-changed:9886c6a9-eae6-408e-b968-ccf5220caa53 for instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 on n-h2-858383-10 Oct 12 10:05:40.107416 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-cf781d80-0ce6-4062-b138-f3af1977e9c4 req-06ae11d1-c37d-440b-8814-183d3a269af9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107215 Oct 12 10:05:40.108067 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3564/7557] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:05:40.824726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:40.825358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:40.832190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:40.832691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:40.833168 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:40.833918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:40.834383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:40.834823 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:40.983599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:40.991819 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d664cee3-7312-4178-a648-3213e0b1bfa5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1392 microversion: 2.1 time: 0.230036 Oct 12 10:05:40.992410 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3994/7558] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:40 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:42.023633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:42.024324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:42.032832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:42.033350 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:42.033831 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:42.034602 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:42.035056 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:42.035491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:42.171826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:42.179962 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8e2a2e9d-2c49-4cd0-b19b-446af8a28ce5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1392 microversion: 2.1 time: 0.160777 Oct 12 10:05:42.180531 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3565/7559] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:42 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:43.203339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:43.204093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:43.211033 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:43.211528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:43.212193 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:43.212919 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:43.213387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:43.213938 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:43.345796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:43.353910 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a5aadcf4-facc-4359-a511-f2ce52c626a9 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1392 microversion: 2.1 time: 0.154906 Oct 12 10:05:43.354485 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3995/7560] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:43 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:44.378025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:44.378683 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:44.386190 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:44.386676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:44.387117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:44.387808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:44.388258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:44.388684 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:44.538751 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:44.550550 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-62680d7d-2bb9-44e7-b11c-518b24c5a426 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1392 microversion: 2.1 time: 0.177051 Oct 12 10:05:44.551255 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3566/7561] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:44 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:44.755032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-df4eb349-5594-4bd4-a022-8f80bddb1763 req-01c10d3a-5f6e-4383-ace4-db914ae4dc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c71d1e9-f910-48f1-9a79-0e23ee91cfd4", "name": "network-vif-plugged", "status": "completed", "tag": "9886c6a9-eae6-408e-b968-ccf5220caa53"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:05:44.768551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df4eb349-5594-4bd4-a022-8f80bddb1763 req-01c10d3a-5f6e-4383-ace4-db914ae4dc60 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:44.769112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df4eb349-5594-4bd4-a022-8f80bddb1763 req-01c10d3a-5f6e-4383-ace4-db914ae4dc60 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:44.769691 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-df4eb349-5594-4bd4-a022-8f80bddb1763 req-01c10d3a-5f6e-4383-ace4-db914ae4dc60 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:44.781234 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-df4eb349-5594-4bd4-a022-8f80bddb1763 req-01c10d3a-5f6e-4383-ace4-db914ae4dc60 service nova] Creating event network-vif-plugged:9886c6a9-eae6-408e-b968-ccf5220caa53 for instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 on n-h2-858383-10 Oct 12 10:05:44.786365 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-df4eb349-5594-4bd4-a022-8f80bddb1763 req-01c10d3a-5f6e-4383-ace4-db914ae4dc60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035394 Oct 12 10:05:44.786966 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3996/7562] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:05:45.578613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:45.579198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:45.586612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:45.587111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:45.587551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:45.588251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:45.588711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:45.589142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:45.724862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:45.733401 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ee7ceb68-6af3-4a9e-9ab1-1facf128c8fc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1392 microversion: 2.1 time: 0.159217 Oct 12 10:05:45.734021 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3567/7563] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:45 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:46.763186 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:46.764359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:46.775098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:46.775962 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:46.776760 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:46.777986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:46.778779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:46.779520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:46.923182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:46.931673 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aba6b8f5-2289-4d05-a346-ad4955bc4100 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1564 microversion: 2.1 time: 0.177157 Oct 12 10:05:46.932251 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3997/7564] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:46 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:46.954841 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:46.955448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:46.962510 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:46.962978 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:46.963409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:46.964122 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:46.964571 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:46.964991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:47.107538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:47.115547 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aa79922a-6bbf-40e4-8769-8a6966086761 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1564 microversion: 2.1 time: 0.164997 Oct 12 10:05:47.116168 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3568/7565] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:46 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:05:49.148213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-e3f15e65-efa0-4bd4-8988-4fe677adc56b req-edd7fcc0-2dc0-4d9a-be41-e16370cf6e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c71d1e9-f910-48f1-9a79-0e23ee91cfd4", "tag": "9886c6a9-eae6-408e-b968-ccf5220caa53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:05:49.152920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:05:49.153616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:05:49.155789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:49.165810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:49.166484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:49.167972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:05:49.170635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e3f15e65-efa0-4bd4-8988-4fe677adc56b req-edd7fcc0-2dc0-4d9a-be41-e16370cf6e5f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:49.171127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e3f15e65-efa0-4bd4-8988-4fe677adc56b req-edd7fcc0-2dc0-4d9a-be41-e16370cf6e5f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:49.171555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-e3f15e65-efa0-4bd4-8988-4fe677adc56b req-edd7fcc0-2dc0-4d9a-be41-e16370cf6e5f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:49.177285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:49.177859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:49.178317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:49.179250 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:05:49.179726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:05:49.180352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:05:49.191399 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-e3f15e65-efa0-4bd4-8988-4fe677adc56b req-edd7fcc0-2dc0-4d9a-be41-e16370cf6e5f service nova] Creating event network-changed:9886c6a9-eae6-408e-b968-ccf5220caa53 for instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 on n-h2-858383-10 Oct 12 10:05:49.197080 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-e3f15e65-efa0-4bd4-8988-4fe677adc56b req-edd7fcc0-2dc0-4d9a-be41-e16370cf6e5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052591 Oct 12 10:05:49.198023 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3569/7566] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:05:49.399071 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:05:49.409358 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bb072395-89f5-4886-9a94-136cda12a0cc tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1564 microversion: 2.1 time: 0.267158 Oct 12 10:05:49.410231 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3998/7567] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:05:49 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:12.758693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=36 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:06:12.764251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:06:12.766794 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:12.774646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:12.775182 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:12.775663 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:12.776428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:12.776931 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:12.777402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:12.835166 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5e79b7bb-5e1e-44fa-8627-708569bcb4ea tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action" status: 200 len: 24570 microversion: 2.1 time: 0.078619 Oct 12 10:06:12.835806 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3570/7568] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:06:12 2022] POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action => generated 24570 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:06:24.062526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-55d3557b-193f-48a1-9131-9fe3f8d11d4d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:06:24.064923 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:06:24.065725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=32 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:06:24.071803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55d3557b-193f-48a1-9131-9fe3f8d11d4d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:24.072311 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55d3557b-193f-48a1-9131-9fe3f8d11d4d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:24.072766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-55d3557b-193f-48a1-9131-9fe3f8d11d4d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:24.096213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-55d3557b-193f-48a1-9131-9fe3f8d11d4d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Going to try to stop instance {{(pid=127006) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 10:06:24.147855 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-55d3557b-193f-48a1-9131-9fe3f8d11d4d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action" status: 202 len: 0 microversion: 2.1 time: 0.089216 Oct 12 10:06:24.148459 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 3999/7569] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:06:24 2022] POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:06:24.157283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:24.158010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:24.160883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:06:24.161595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:06:24.167051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:24.167537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:24.167989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:24.168746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:24.169198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:24.169653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:24.305921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:24.317234 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-53a3a28b-f52b-4818-a5ca-97f7aeea6566 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.163803 Oct 12 10:06:24.317947 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3571/7570] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:24 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:25.354072 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:25.355239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:25.366056 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:25.366918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:25.367687 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:25.368866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:25.369703 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:25.370449 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:25.513988 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:25.525349 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c5e5cae0-aaf7-4d2b-9a04-12e1d02e2ffe tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.180268 Oct 12 10:06:25.526177 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4000/7571] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:25 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:26.556451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:26.557397 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:26.569356 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:26.570228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:26.570964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:26.572116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:26.572876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:26.573633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:26.719437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:26.727845 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-04d32b61-d1a6-461b-a60a-9027307760bb tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.178167 Oct 12 10:06:26.728398 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3572/7572] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:26 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:27.755298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:27.756000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:27.764824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:27.765426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:27.766004 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:27.766838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:27.767399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:27.767922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:27.909052 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:27.917634 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-923b7ed4-83cd-4c80-99d7-1b31f5e439e8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.168467 Oct 12 10:06:27.918199 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4001/7573] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:27 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:28.944437 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:28.945033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:28.952640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:28.953180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:28.953679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:28.954406 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:28.955199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:28.955642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:29.092060 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:29.100337 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d613d07f-56d8-49a0-bfe8-7c73cc9ca03b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.160977 Oct 12 10:06:29.100915 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3573/7574] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:28 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:30.128543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:30.129607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:30.140846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:30.141726 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:30.142474 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:30.143647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:30.144427 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:30.144872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:30.291743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:30.299902 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-138833f4-7e6d-4f2c-bf95-288e21869f99 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.178242 Oct 12 10:06:30.300582 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4002/7575] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:30 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:31.334857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:31.335822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:31.347339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:31.347826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:31.348263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:31.348956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:31.349447 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:31.349885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:31.481616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:31.493292 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c350d7e1-73e7-449c-aead-4a0933358ecd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.165246 Oct 12 10:06:31.494127 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3574/7576] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:31 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:32.524750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:32.525766 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:32.537307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:32.538202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:32.538964 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:32.540145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:32.540935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:32.541723 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:32.681313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:32.689233 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fc0a3868-6a35-4df0-a93d-2c8e86e27672 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.171457 Oct 12 10:06:32.689837 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4003/7577] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:32 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:33.718799 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:33.719822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:33.728722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:33.729207 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:33.729756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:33.730448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:33.730899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:33.731320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:33.888443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:33.896778 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f2775d29-7c00-4f0d-b8f5-2d9f50b4b42d tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1692 microversion: 2.1 time: 0.184693 Oct 12 10:06:33.897342 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3575/7578] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:33 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:34.924914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:34.926001 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:34.938009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:34.938859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:34.939626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:34.940873 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:34.941740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:34.942509 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:35.078941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:35.087204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a7dac360-fb60-4787-bc47-d21c27091176 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1669 microversion: 2.1 time: 0.168902 Oct 12 10:06:35.087771 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4004/7579] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:34 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:36.190674 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:06:36.194478 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:36.206509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:36.207319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:36.208031 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:36.209219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:36.210014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:36.210408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:36.276530 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-69ce748f-bc13-4f54-84b0-0204c636162e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action" status: 200 len: 38132 microversion: 2.1 time: 0.092043 Oct 12 10:06:36.277419 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3576/7580] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:06:36 2022] POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action => generated 38132 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:06:36.294337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-13180958-14d9-4e81-8054-c55408c59353 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:06:36.304340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13180958-14d9-4e81-8054-c55408c59353 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:36.304844 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13180958-14d9-4e81-8054-c55408c59353 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:36.305296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-13180958-14d9-4e81-8054-c55408c59353 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:36.328156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-13180958-14d9-4e81-8054-c55408c59353 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Going to try to start instance {{(pid=127006) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 10:06:36.375004 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-13180958-14d9-4e81-8054-c55408c59353 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action" status: 202 len: 0 microversion: 2.1 time: 0.086251 Oct 12 10:06:36.375590 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4005/7581] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:06:36 2022] POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:06:36.384822 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:36.385552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:36.392360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:36.392811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:36.393290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:36.394025 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:36.394471 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:36.394899 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:36.529620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:36.537641 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-64ae0030-b18f-4044-a6f9-eac63343dee6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1678 microversion: 2.1 time: 0.157246 Oct 12 10:06:36.538297 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3577/7582] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:36 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:06:37.564044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:06:37.565770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:06:37.573406 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:37.574029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:37.574539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:37.575355 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:06:37.575906 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:06:37.576413 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:06:37.788363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:06:37.796740 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68c28779-bf08-454a-9db5-63a40316b8c7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1682 microversion: 2.1 time: 0.237210 Oct 12 10:06:37.797274 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4006/7583] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:06:37 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:04.032308 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:07:04.034608 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:04.037358 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=14 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:04.038083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=40 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:04.044277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:04.044774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:04.045286 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:04.045961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:04.046420 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:04.046875 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:04.110803 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4d8f3f6e-2842-4818-8c26-9f89f26e3df7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action" status: 200 len: 62689 microversion: 2.1 time: 0.082605 Oct 12 10:07:04.111463 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3578/7584] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:07:04 2022] POST /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4/action => generated 62689 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:07:11.203684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:11.209710 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d277beed-d4d1-4010-a770-59590d716975 req-31d07b35-ecad-4771-b0b4-4b3675ae1f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c71d1e9-f910-48f1-9a79-0e23ee91cfd4", "tag": "9886c6a9-eae6-408e-b968-ccf5220caa53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:07:11.214058 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:11.216468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=16 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:11.217145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:11.218344 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:07:11.218484 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 (ip 10.222.0.40) !!! Oct 12 10:07:11.230407 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d277beed-d4d1-4010-a770-59590d716975 req-31d07b35-ecad-4771-b0b4-4b3675ae1f0f service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:11.230883 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d277beed-d4d1-4010-a770-59590d716975 req-31d07b35-ecad-4771-b0b4-4b3675ae1f0f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:11.231310 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d277beed-d4d1-4010-a770-59590d716975 req-31d07b35-ecad-4771-b0b4-4b3675ae1f0f service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:11.238241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:11.238743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:11.239187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:11.239915 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:11.240378 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:11.240810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:11.256338 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d277beed-d4d1-4010-a770-59590d716975 req-31d07b35-ecad-4771-b0b4-4b3675ae1f0f service nova] Creating event network-changed:9886c6a9-eae6-408e-b968-ccf5220caa53 for instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 on n-h2-858383-10 Oct 12 10:07:11.262101 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d277beed-d4d1-4010-a770-59590d716975 req-31d07b35-ecad-4771-b0b4-4b3675ae1f0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056891 Oct 12 10:07:11.263412 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3579/7585] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:07:11.274607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:07:11.359076 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-43749d85-8e49-4eec-8f18-16a5303dd066 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 204 len: 0 microversion: 2.1 time: 0.159154 Oct 12 10:07:11.360223 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4007/7586] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:07:11 2022] DELETE /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:07:11.370737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:11.371923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:11.378668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:11.379150 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:11.379824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:11.380523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:11.381152 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:11.381610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:11.521738 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:11.530685 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f5c128b7-f695-4f8e-9608-8c959c3bdc71 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1688 microversion: 2.1 time: 0.165038 Oct 12 10:07:11.530685 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3580/7587] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:11 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:07:12.560096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:12.561283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:12.571646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:12.572148 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:12.572594 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:12.573298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:12.573797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:12.574234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:12.707352 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:12.715880 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f44a3461-04bb-4dde-9063-301ca5f16911 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1688 microversion: 2.1 time: 0.163214 Oct 12 10:07:12.716459 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4008/7588] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:12 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:13.535635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-0f95c401-7488-42d6-ae56-1272fe6ab36a req-a24c30a9-8d36-4901-ba9c-b07f95a86cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c71d1e9-f910-48f1-9a79-0e23ee91cfd4", "name": "network-vif-deleted", "tag": "9886c6a9-eae6-408e-b968-ccf5220caa53"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:07:13.545694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0f95c401-7488-42d6-ae56-1272fe6ab36a req-a24c30a9-8d36-4901-ba9c-b07f95a86cff service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:13.546179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0f95c401-7488-42d6-ae56-1272fe6ab36a req-a24c30a9-8d36-4901-ba9c-b07f95a86cff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:13.546612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-0f95c401-7488-42d6-ae56-1272fe6ab36a req-a24c30a9-8d36-4901-ba9c-b07f95a86cff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:13.558169 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-0f95c401-7488-42d6-ae56-1272fe6ab36a req-a24c30a9-8d36-4901-ba9c-b07f95a86cff service nova] Creating event network-vif-deleted:9886c6a9-eae6-408e-b968-ccf5220caa53 for instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 on n-h2-858383-10 Oct 12 10:07:13.563425 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-0f95c401-7488-42d6-ae56-1272fe6ab36a req-a24c30a9-8d36-4901-ba9c-b07f95a86cff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Oct 12 10:07:13.564044 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3581/7589] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:07:13.744278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:13.744863 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:13.752246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:13.752748 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:13.753202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:13.753949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:13.754419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:13.754861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:13.786902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:13.787326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:13.787779 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:13.788248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lazy-loading 'fault' on Instance uuid 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:07:13.834088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:13.842396 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e391c4e6-f89f-44f3-8e2c-5ebeedb14fd0 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 200 len: 1357 microversion: 2.1 time: 0.102321 Oct 12 10:07:13.842993 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4009/7590] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:13 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:14.871395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:14.872327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:14.882590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:14.883324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:14.883879 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:14.884713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:14.885165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:14.885611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:14.899319 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] HTTP exception thrown: Instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 could not be found. Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Request method failure captured: Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 HTTP/1.1 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRpBHD-xTVJekQiIxmzBL_ZmHdujIReTsnkh8w3vZqiT0Sw2bmC8RzIcukoU2U7M5adAGnXomv3ehbMxTUyD97Mbr605rfqgWR2AIMudQIJ-43iKqPG3Vuofc7sHld3hslEEEg-QcaHKihpozn7dyltjUflcnWJOsQCWLiMpeK_eiPIs Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}] Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 34018159bab84f6a959d7ac98814d158 Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 could not be found. Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '5c71d1e9-f910-48f1-9a79-0e23ee91cfd4'} Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 could not be found. Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 could not be found. Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:07:14.900923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 could not be found. Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Returning 404 to user: Instance 5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-73695dc9-0c8d-4b80-8bb5-72b0d5c46b1b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4" status: 404 len: 111 microversion: 2.1 time: 0.039229 Oct 12 10:07:14.905923 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3582/7591] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:14 2022] GET /compute/v2.1/servers/5c71d1e9-f910-48f1-9a79-0e23ee91cfd4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:07:18.283528 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2a9249cd-e2cb-43b9-89f4-8b16b25e7bbd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '.version_select at 0x7f9843da3d30>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:18.306780 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2a9249cd-e2cb-43b9-89f4-8b16b25e7bbd tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2095324287" status: 202 len: 0 microversion: 2.1 time: 0.027185 Oct 12 10:07:18.307499 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4010/7592] 10.222.0.40 () {58 vars in 1284 bytes} [Wed Oct 12 10:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2095324287 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:07:18.336928 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-40e41d68-2898-4c19-9c7b-d68555dd36a4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: .version_select at 0x7f9843d3b160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-249828879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAADMoPkmeuxbAyMUjxdLSYvz1TriJcOya2uBL6d0lNZvJw2BQaUtXkRk/aK9sDun5H0pWYBmXgUpcd+LyW5++q8ykWSyAC5gCA2Oaa2vAXVcQX4ZodgTchLLNvKk0V89g=="}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:07:18.354961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-40e41d68-2898-4c19-9c7b-d68555dd36a4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:07:18.360492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-40e41d68-2898-4c19-9c7b-d68555dd36a4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'key_pairs'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:07:18.386165 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-40e41d68-2898-4c19-9c7b-d68555dd36a4 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053577 Oct 12 10:07:18.386706 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3583/7593] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 10:07:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:07:23.948377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:23.952729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1649156377", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "networks": [{"uuid": "fc8125e8-1b25-46ee-880a-d3525b0e1337"}], "key_name": "tempest-TestNetworkAdvancedServerOps-249828879", "security_groups": [{"name": "tempest-secgroup-smoke-1052108058"}]}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:07:24.081194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.network.neutron [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] validate_networks() for [('fc8125e8-1b25-46ee-880a-d3525b0e1337', None, None, None, None, None)] {{(pid=127006) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:07:24.541745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:07:24.542192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image limits 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:07:24.542688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Flavor pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:07:24.544903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Image pref 0:0:0 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:07:24.546722 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.virt.hardware [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:07:24.564318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:24.565184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:24.565847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:24.566819 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:24.567501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:24.568916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:24.593601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:07:24.602377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Getting quotas for user 34018159bab84f6a959d7ac98814d158 and project ce4587e375fa4018867b63db4eaf9860. Resources: {'ram', 'instances', 'cores'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:07:24.622213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Going to run 1 instances... {{(pid=127006) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:07:24.625416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:07:24.684742 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3db22243-5b7e-48a8-8eb4-c6535a885561 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.738178 Oct 12 10:07:24.685506 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4011/7594] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:07:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:07:24.698230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-62de4de7-e4b7-4e2e-a31c-38486c6cb28a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:24.699408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-62de4de7-e4b7-4e2e-a31c-38486c6cb28a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:24.766558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-62de4de7-e4b7-4e2e-a31c-38486c6cb28a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:24.779328 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-62de4de7-e4b7-4e2e-a31c-38486c6cb28a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1266 microversion: 2.1 time: 0.086179 Oct 12 10:07:24.781165 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3584/7595] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:24 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:25.804017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:25.804720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:25.811732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:25.812233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:25.812882 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:25.813638 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:25.814834 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:25.815800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:25.906971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:25.933422 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b1d1701-bd5e-4f1b-bd74-b07b5585e77c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1326 microversion: 2.1 time: 0.134138 Oct 12 10:07:25.953683 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4012/7596] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:25 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:26.962114 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:26.963732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:26.967007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=16 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:26.984396 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:26.984947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:26.985912 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:26.986133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:26.986771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:26.987198 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:27.246999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:27.255948 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2b5cebc6-9e8c-4234-8c0f-75c5350d76b5 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1392 microversion: 2.1 time: 0.298603 Oct 12 10:07:27.256902 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3585/7597] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:26 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1392 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:27.804236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-0071a607-5ef5-4b7d-8e03-8c762d65f195 req-9153bb5d-4748-428d-a739-6ec6bd5f9d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5979a0-18a8-4770-8823-c11d2c529f92", "tag": "d6cbea42-5da2-4ad1-85a2-4f87166cf7e8"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:07:27.817006 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0071a607-5ef5-4b7d-8e03-8c762d65f195 req-9153bb5d-4748-428d-a739-6ec6bd5f9d1b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:27.818201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0071a607-5ef5-4b7d-8e03-8c762d65f195 req-9153bb5d-4748-428d-a739-6ec6bd5f9d1b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:27.818835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-0071a607-5ef5-4b7d-8e03-8c762d65f195 req-9153bb5d-4748-428d-a739-6ec6bd5f9d1b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:27.832395 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-0071a607-5ef5-4b7d-8e03-8c762d65f195 req-9153bb5d-4748-428d-a739-6ec6bd5f9d1b service nova] Creating event network-changed:d6cbea42-5da2-4ad1-85a2-4f87166cf7e8 for instance 3b5979a0-18a8-4770-8823-c11d2c529f92 on n-h2-858383-10 Oct 12 10:07:27.838529 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-0071a607-5ef5-4b7d-8e03-8c762d65f195 req-9153bb5d-4748-428d-a739-6ec6bd5f9d1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038316 Oct 12 10:07:27.839127 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4013/7598] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:07:28.280395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:28.281034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:28.289026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:28.289528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:28.289966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:28.290703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:28.291141 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:28.291576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:28.439041 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:28.447286 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-82b4b6a6-3329-4679-a9ca-09e6d8fcf46a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1392 microversion: 2.1 time: 0.170823 Oct 12 10:07:28.447937 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3586/7599] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:28 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:29.484505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:29.485718 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:29.495565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:29.496093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:29.496545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:29.497257 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:29.497750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:29.498191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:29.643167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:29.651195 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b4c5a41e-b53b-4177-a9ab-5ea8571bbbae tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1392 microversion: 2.1 time: 0.174956 Oct 12 10:07:29.651796 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4014/7600] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:29 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:30.679600 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:30.680560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:30.692136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:30.692929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:30.693754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:30.694857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:30.695621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:30.696327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:30.840975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:30.848922 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ba502975-e0a9-4990-b211-07fded70955c tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1392 microversion: 2.1 time: 0.176433 Oct 12 10:07:30.849503 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3587/7601] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:30 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:31.872700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:31.873326 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:31.880830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:31.881335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:31.881814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:31.882525 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:31.882993 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:31.883436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:32.023641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:32.032455 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1365c0c2-b00e-47ba-878b-8562fbb97dba tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1392 microversion: 2.1 time: 0.163816 Oct 12 10:07:32.033007 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4015/7602] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:31 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:33.060302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:33.061104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:33.068265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:33.068755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:33.069196 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:33.069950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:33.070410 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:33.070842 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:33.211024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:33.219489 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a4cf37d0-6389-4f60-b27a-afdb053eec2e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1392 microversion: 2.1 time: 0.165852 Oct 12 10:07:33.219984 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3588/7603] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:33 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:33.288588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-315e3ec4-0a26-4046-8773-0f672df1f580 req-320bacee-b675-4cf4-889f-16bfca034f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5979a0-18a8-4770-8823-c11d2c529f92", "name": "network-vif-plugged", "status": "completed", "tag": "d6cbea42-5da2-4ad1-85a2-4f87166cf7e8"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:07:33.299415 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-315e3ec4-0a26-4046-8773-0f672df1f580 req-320bacee-b675-4cf4-889f-16bfca034f02 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:33.299910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-315e3ec4-0a26-4046-8773-0f672df1f580 req-320bacee-b675-4cf4-889f-16bfca034f02 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:33.300338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-315e3ec4-0a26-4046-8773-0f672df1f580 req-320bacee-b675-4cf4-889f-16bfca034f02 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:33.314152 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-315e3ec4-0a26-4046-8773-0f672df1f580 req-320bacee-b675-4cf4-889f-16bfca034f02 service nova] Creating event network-vif-plugged:d6cbea42-5da2-4ad1-85a2-4f87166cf7e8 for instance 3b5979a0-18a8-4770-8823-c11d2c529f92 on n-h2-858383-10 Oct 12 10:07:33.319176 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-315e3ec4-0a26-4046-8773-0f672df1f580 req-320bacee-b675-4cf4-889f-16bfca034f02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034372 Oct 12 10:07:33.319775 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4016/7604] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:07:34.242696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:34.243320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:34.246078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:34.251573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:34.252042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:34.252491 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:34.253185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:34.253660 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:34.254086 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:34.395481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:34.403501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7afae2c5-4cb6-4ae3-ac1b-ca444490757e tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1392 microversion: 2.1 time: 0.164777 Oct 12 10:07:34.404077 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3589/7605] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:34 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:35.425233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:35.426020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:35.430285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:35.431011 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:35.438587 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:35.439098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:35.439531 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:35.440258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:35.440793 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:35.441266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:35.578578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:35.587337 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8fc932f5-eae0-403d-84d8-18f4654758ca tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1564 microversion: 2.1 time: 0.164004 Oct 12 10:07:35.587926 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4017/7606] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:35 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:35.609951 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:35.610588 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:35.612466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:07:35.619984 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:35.620555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:35.621172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:35.622130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:35.622580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:35.623003 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:35.771020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:35.782813 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-939bb2ac-84f1-430d-9e94-52654a39ce1f tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1564 microversion: 2.1 time: 0.176577 Oct 12 10:07:35.783579 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3590/7607] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:35 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:07:37.408756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:07:37.409343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:07:37.411843 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-2c9a2fa3-ec10-42d9-9025-3b63a3f01cea req-d66e0cf9-4c00-40b7-b9ce-2c7f1e91fa46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5979a0-18a8-4770-8823-c11d2c529f92", "tag": "d6cbea42-5da2-4ad1-85a2-4f87166cf7e8"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:07:37.417129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:37.417910 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:37.418366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:37.419086 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:37.419553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:37.419972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:37.426973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2c9a2fa3-ec10-42d9-9025-3b63a3f01cea req-d66e0cf9-4c00-40b7-b9ce-2c7f1e91fa46 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:07:37.427461 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2c9a2fa3-ec10-42d9-9025-3b63a3f01cea req-d66e0cf9-4c00-40b7-b9ce-2c7f1e91fa46 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:07:37.427862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-2c9a2fa3-ec10-42d9-9025-3b63a3f01cea req-d66e0cf9-4c00-40b7-b9ce-2c7f1e91fa46 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:07:37.442479 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-2c9a2fa3-ec10-42d9-9025-3b63a3f01cea req-d66e0cf9-4c00-40b7-b9ce-2c7f1e91fa46 service nova] Creating event network-changed:d6cbea42-5da2-4ad1-85a2-4f87166cf7e8 for instance 3b5979a0-18a8-4770-8823-c11d2c529f92 on n-h2-858383-10 Oct 12 10:07:37.448501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-2c9a2fa3-ec10-42d9-9025-3b63a3f01cea req-d66e0cf9-4c00-40b7-b9ce-2c7f1e91fa46 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040353 Oct 12 10:07:37.449799 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3591/7608] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:07:37.557739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:07:37.566184 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2fc8fa7d-c7b0-4c58-89bf-c48980391315 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1564 microversion: 2.1 time: 0.161527 Oct 12 10:07:37.567140 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4018/7609] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:07:37 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:00.869164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:00.871811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:00.874873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=5 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:00.875549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=38 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:00.882440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:00.882957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:00.883395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:00.884095 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:00.884543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:00.884965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:00.940840 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e5a76fcd-287c-40da-bf31-c7426f552690 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action" status: 200 len: 24570 microversion: 2.1 time: 0.078759 Oct 12 10:08:00.941489 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3592/7610] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:08:00 2022] POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action => generated 24570 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:08:11.869178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:11.869754 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:11.872261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:11.872965 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=36 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:11.879272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:11.879771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:11.880238 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:11.881046 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:11.881601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:11.882030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:11.915077 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lazy-loading 'flavor' on Instance uuid 3b5979a0-18a8-4770-8823-c11d2c529f92 {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:08:11.988746 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9a2b63ff-dae8-4ab7-ab95-302cf5d1f30a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action" status: 202 len: 0 microversion: 2.1 time: 0.123538 Oct 12 10:08:11.989483 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4019/7611] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:08:11 2022] POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:08:11.998811 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:11.999502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:12.003276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:12.003929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=4 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:12.008534 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:12.009109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:12.009490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:12.010197 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:12.010651 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:12.011125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:12.149100 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:12.157292 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe990ccb-242f-43db-bdd8-2d2fde221989 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1690 microversion: 2.1 time: 0.162670 Oct 12 10:08:12.157897 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3593/7612] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:11 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:08:13.190075 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:13.190797 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:13.197571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:13.198060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:13.198518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:13.199227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:13.199700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:13.200138 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:13.344192 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:13.352459 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4dc4a2a5-dd29-466f-9549-cbe3fb0e8b72 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1673 microversion: 2.1 time: 0.167677 Oct 12 10:08:13.353035 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4020/7613] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:13 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:14.457613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:14.460706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:14.468724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:14.469211 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:14.469696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:14.470395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:14.470849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:14.471275 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:14.534633 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a8e3f6be-840f-478c-91e2-2d3ad93664f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action" status: 200 len: 38353 microversion: 2.1 time: 0.083652 Oct 12 10:08:14.535247 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3594/7614] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:08:14 2022] POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action => generated 38353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:08:14.547885 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:14.548465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:14.555896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:14.556407 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:14.556859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:14.557626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:14.558104 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:14.558550 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:14.630575 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-39a9ac24-5c72-4beb-93ca-2919ca4c1d92 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action" status: 202 len: 0 microversion: 2.1 time: 0.086371 Oct 12 10:08:14.631210 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4021/7615] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:08:14 2022] POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:08:14.640619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:14.641712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:14.648881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:14.649408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:14.649910 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:14.650616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:14.651125 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:14.651522 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:14.869249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:14.877113 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-67ca7ffe-9a0f-48ac-9f36-b545ad422814 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1679 microversion: 2.1 time: 0.240996 Oct 12 10:08:14.877701 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3595/7616] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:14 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:15.902702 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:15.903457 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:15.910091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:15.910593 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:15.911030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:15.911751 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:15.912261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:15.912700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:16.051167 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:16.059514 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8ad2a1d4-f955-4003-bbec-9b670a8c2b5b tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1679 microversion: 2.1 time: 0.162096 Oct 12 10:08:16.060099 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4022/7617] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:15 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:17.087914 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:17.088973 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:17.100278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:17.100763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:17.101199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:17.101927 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:17.102373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:17.102797 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:17.247548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:17.256345 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-092b238e-467b-4505-8944-92d735bceae6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1682 microversion: 2.1 time: 0.175738 Oct 12 10:08:17.256930 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3596/7618] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:17 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:17.360496 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:17.362796 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:17.370132 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:17.370627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:17.371076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:17.371811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:17.372275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:17.372712 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:17.416290 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-60506b2e-858b-470d-b847-7dfda7f255b7 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action" status: 200 len: 38353 microversion: 2.1 time: 0.059299 Oct 12 10:08:17.417239 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4023/7619] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:08:17 2022] POST /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92/action => generated 38353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 10:08:18.451950 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:18.458213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4fc6c5f1-4ba2-45a0-996c-81259cd916ce req-79b42624-f305-4623-adb8-d29f6e24d3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5979a0-18a8-4770-8823-c11d2c529f92", "tag": "d6cbea42-5da2-4ad1-85a2-4f87166cf7e8"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:18.458713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:18.466527 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:18.467378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:18.467921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:18.468714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:18.469284 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:18.469829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:18.470639 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4fc6c5f1-4ba2-45a0-996c-81259cd916ce req-79b42624-f305-4623-adb8-d29f6e24d3e2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:18.471094 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4fc6c5f1-4ba2-45a0-996c-81259cd916ce req-79b42624-f305-4623-adb8-d29f6e24d3e2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:18.471763 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4fc6c5f1-4ba2-45a0-996c-81259cd916ce req-79b42624-f305-4623-adb8-d29f6e24d3e2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:18.485533 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4fc6c5f1-4ba2-45a0-996c-81259cd916ce req-79b42624-f305-4623-adb8-d29f6e24d3e2 service nova] Creating event network-changed:d6cbea42-5da2-4ad1-85a2-4f87166cf7e8 for instance 3b5979a0-18a8-4770-8823-c11d2c529f92 on n-h2-858383-10 Oct 12 10:08:18.491306 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4fc6c5f1-4ba2-45a0-996c-81259cd916ce req-79b42624-f305-4623-adb8-d29f6e24d3e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037273 Oct 12 10:08:18.491925 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4024/7620] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:08:18.497712 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:08:18.589893 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-36b6fc61-1572-44c3-be21-b15188010d20 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 204 len: 0 microversion: 2.1 time: 0.141200 Oct 12 10:08:18.595277 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3597/7621] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:08:18 2022] DELETE /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:08:18.602101 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:18.602842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:18.611770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:18.612371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:18.612902 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:18.613739 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:18.614309 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:18.614824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:18.776401 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:18.785300 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0c035787-377c-4e0b-8cf9-40314ed8c4f8 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1688 microversion: 2.1 time: 0.188634 Oct 12 10:08:18.786083 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4025/7622] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:18 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:19.815756 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:19.816939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:19.828475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:19.829282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:19.830212 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:19.831370 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:19.832128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:19.832838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:19.972309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:19.981725 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f9f7058d-08b8-4bad-bbcf-5e61e692169a tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1688 microversion: 2.1 time: 0.173324 Oct 12 10:08:19.982316 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3598/7623] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:19 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:20.796328 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-02de46ad-00bf-466f-94ee-b22f7bf3afe2 req-ba31f873-5695-4d36-aea1-9315a45ae337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5979a0-18a8-4770-8823-c11d2c529f92", "name": "network-vif-deleted", "tag": "d6cbea42-5da2-4ad1-85a2-4f87166cf7e8"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:20.809730 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-02de46ad-00bf-466f-94ee-b22f7bf3afe2 req-ba31f873-5695-4d36-aea1-9315a45ae337 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:20.810282 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-02de46ad-00bf-466f-94ee-b22f7bf3afe2 req-ba31f873-5695-4d36-aea1-9315a45ae337 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:20.810917 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-02de46ad-00bf-466f-94ee-b22f7bf3afe2 req-ba31f873-5695-4d36-aea1-9315a45ae337 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:20.824381 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-02de46ad-00bf-466f-94ee-b22f7bf3afe2 req-ba31f873-5695-4d36-aea1-9315a45ae337 service nova] Creating event network-vif-deleted:d6cbea42-5da2-4ad1-85a2-4f87166cf7e8 for instance 3b5979a0-18a8-4770-8823-c11d2c529f92 on n-h2-858383-10 Oct 12 10:08:20.829468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-02de46ad-00bf-466f-94ee-b22f7bf3afe2 req-ba31f873-5695-4d36-aea1-9315a45ae337 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036851 Oct 12 10:08:20.830079 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4026/7624] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:08:21.007942 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:21.008466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:21.015687 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:21.016178 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:21.016620 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:21.017316 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:21.017805 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:21.018233 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:21.049484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:21.049971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:21.050402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:21.050845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lazy-loading 'fault' on Instance uuid 3b5979a0-18a8-4770-8823-c11d2c529f92 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:08:21.097696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34018159bab84f6a959d7ac98814d158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4587e375fa4018867b63db4eaf9860', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:21.106217 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8bbe7df9-668a-43cf-b946-a8ba6d5b0a45 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 200 len: 1356 microversion: 2.1 time: 0.104868 Oct 12 10:08:21.106829 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3599/7625] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:21 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:22.136816 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:22.137956 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] [instance: 3b5979a0-18a8-4770-8823-c11d2c529f92] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:22.148651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:22.149157 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:22.149646 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:22.150363 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:22.150833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:22.151274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:22.164771 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] HTTP exception thrown: Instance 3b5979a0-18a8-4770-8823-c11d2c529f92 could not be found. Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Request method failure captured: Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 HTTP/1.1 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRpBHD-xTVJekQiIxmzBL_ZmHdujIReTsnkh8w3vZqiT0Sw2bmC8RzIcukoU2U7M5adAGnXomv3ehbMxTUyD97Mbr605rfqgWR2AIMudQIJ-43iKqPG3Vuofc7sHld3hslEEEg-QcaHKihpozn7dyltjUflcnWJOsQCWLiMpeK_eiPIs Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ce4587e375fa4018867b63db4eaf9860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ce4587e375fa4018867b63db4eaf9860"}]}] Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: ce4587e375fa4018867b63db4eaf9860 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2040989721 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 34018159bab84f6a959d7ac98814d158 Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2040989721-project Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 3b5979a0-18a8-4770-8823-c11d2c529f92 could not be found. Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '3b5979a0-18a8-4770-8823-c11d2c529f92'} Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5979a0-18a8-4770-8823-c11d2c529f92 could not be found. Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5979a0-18a8-4770-8823-c11d2c529f92 could not be found. Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:08:22.166431 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5979a0-18a8-4770-8823-c11d2c529f92 could not be found. Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Returning 404 to user: Instance 3b5979a0-18a8-4770-8823-c11d2c529f92 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a184749-e5cd-4121-bdc8-bf5517aa38f6 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92" status: 404 len: 111 microversion: 2.1 time: 0.040211 Oct 12 10:08:22.171244 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4027/7626] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:22 2022] GET /compute/v2.1/servers/3b5979a0-18a8-4770-8823-c11d2c529f92 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:08:25.551503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7b3ecabe-2266-4961-8abd-9d20a7347952 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] Calling method '.version_select at 0x7f984cb74e50>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:25.576358 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7b3ecabe-2266-4961-8abd-9d20a7347952 tempest-TestNetworkAdvancedServerOps-2040989721 tempest-TestNetworkAdvancedServerOps-2040989721-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-249828879" status: 202 len: 0 microversion: 2.1 time: 0.028777 Oct 12 10:08:25.577217 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3600/7627] 10.222.0.40 () {58 vars in 1281 bytes} [Wed Oct 12 10:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-249828879 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 10:08:36.628543 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=18 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:36.629313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:36.816398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-3615007d-d76a-4bd2-aac9-4d43779c6572 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Action: 'create', calling method: .version_select at 0x7f9843c11dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-379578966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPondZC7uBxcaQ/gTx820psI5bBvlqdQQx7zKEMhJQTDFNog+LM3sbVF6BABe/TXE+czQ32jU/2juB92pJVC4O1CjvT1D9kG9uJDEl79iAGJNMInhuQFmGs3Pf9xzbvWwQ=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:36.832571 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3615007d-d76a-4bd2-aac9-4d43779c6572 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Getting quotas for project d909bf4dc14d4aaa83d7ba6a75e0bedf. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:08:36.842765 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-3615007d-d76a-4bd2-aac9-4d43779c6572 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Getting quotas for user 667c4a7a54e94e2fb31b31a4f3465a97 and project d909bf4dc14d4aaa83d7ba6a75e0bedf. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:08:36.873468 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-3615007d-d76a-4bd2-aac9-4d43779c6572 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.251154 Oct 12 10:08:36.874100 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4028/7628] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 10:08:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:08:37.900555 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:37.901662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:37.906479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1718144097", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-379578966", "security_groups": [{"name": "tempest-secgroup-smoke-93175673"}], "networks": [{"uuid": "a0f2dae5-8837-4db4-afa4-8e7357cad498"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:38.209506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] validate_networks() for [('a0f2dae5-8837-4db4-afa4-8e7357cad498', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:08:38.598938 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:08:38.599499 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:08:38.600246 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:08:38.600702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:08:38.601127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:08:38.610578 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:38.611142 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:38.611764 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:38.612742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:38.613204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:38.613678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:38.631868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Getting quotas for project d909bf4dc14d4aaa83d7ba6a75e0bedf. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:08:38.637199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Getting quotas for user 667c4a7a54e94e2fb31b31a4f3465a97 and project d909bf4dc14d4aaa83d7ba6a75e0bedf. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:08:38.649745 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:08:38.652184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:08:38.698712 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [cfa2cd62-3aaf-48ff-b652-d79bef6fd6f6] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 10:08:39.707582 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [cfa2cd62-3aaf-48ff-b652-d79bef6fd6f6] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 51842. Oct 12 10:08:39.713208 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f72ffcc4-e0f0-4946-90e1-dfdf094c8218 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.814499 Oct 12 10:08:39.714145 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3601/7629] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:08:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:08:39.725675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f5cfd6b5-9235-44d1-bc16-10e1799050e2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:39.726395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f5cfd6b5-9235-44d1-bc16-10e1799050e2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:40.006340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f5cfd6b5-9235-44d1-bc16-10e1799050e2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:40.020229 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f5cfd6b5-9235-44d1-bc16-10e1799050e2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1246 microversion: 2.1 time: 0.298580 Oct 12 10:08:40.020931 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4029/7630] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:39 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1246 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:41.047773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:41.048427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:41.055893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:41.056773 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:41.057270 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:41.058104 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:41.058617 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:41.059101 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:41.128810 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:41.137076 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ceaadcf0-a974-49c2-a402-f2604c2c53f8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1298 microversion: 2.1 time: 0.095195 Oct 12 10:08:41.137722 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3602/7631] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:41 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:42.159896 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:42.162165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:42.176720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:42.177586 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:42.178152 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:42.179279 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:42.179830 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:42.180369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:42.415419 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:42.430073 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-326e5e70-4d7d-46de-b605-c12640f436d2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1370 microversion: 2.1 time: 0.274129 Oct 12 10:08:42.430689 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4030/7632] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:42 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:42.750232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d4037946-0eb9-48f4-8b1c-1be3edc6bb78 req-f0c5048a-7099-4de7-b24b-8a7352c10f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:42.761702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d4037946-0eb9-48f4-8b1c-1be3edc6bb78 req-f0c5048a-7099-4de7-b24b-8a7352c10f55 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:42.768690 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d4037946-0eb9-48f4-8b1c-1be3edc6bb78 req-f0c5048a-7099-4de7-b24b-8a7352c10f55 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:42.769160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d4037946-0eb9-48f4-8b1c-1be3edc6bb78 req-f0c5048a-7099-4de7-b24b-8a7352c10f55 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:42.780913 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d4037946-0eb9-48f4-8b1c-1be3edc6bb78 req-f0c5048a-7099-4de7-b24b-8a7352c10f55 service nova] Creating event network-changed:cad119c4-f199-4846-bebf-9be9d9e7f4bf for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 on n-h2-858383-10 Oct 12 10:08:42.786237 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d4037946-0eb9-48f4-8b1c-1be3edc6bb78 req-f0c5048a-7099-4de7-b24b-8a7352c10f55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039671 Oct 12 10:08:42.786831 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3603/7633] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:08:43.453842 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:43.454475 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:43.462683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:43.463125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:43.463576 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:43.464297 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:43.464770 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:43.465188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:43.620916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:43.629647 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-fad29e0a-e208-408a-a7cd-8a2991bb9e42 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1370 microversion: 2.1 time: 0.179934 Oct 12 10:08:43.630246 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4031/7634] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:43 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:44.653962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:44.654670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:44.661116 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:44.661619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:44.662024 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:44.662736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:44.663154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:44.663716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:44.800444 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:44.808364 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c35e1f9d-564f-47a3-ab1b-e72e8866350d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1370 microversion: 2.1 time: 0.159626 Oct 12 10:08:44.808975 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3604/7635] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:44 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:45.833549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:45.838003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:45.842025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:45.842705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:45.843182 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:45.844050 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:45.844529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:45.845133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:45.990125 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:45.998731 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b00e04bf-7e6b-478f-938a-ae2c98c742d4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1370 microversion: 2.1 time: 0.170559 Oct 12 10:08:45.999297 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4032/7636] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:45 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:08:47.023697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:47.024383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:47.032758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:47.033523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:47.034011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:47.034854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:47.035619 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:47.036098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:47.176694 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:47.184621 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0a1e02bf-5e58-479c-98e2-e65f64f5dc52 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1370 microversion: 2.1 time: 0.165265 Oct 12 10:08:47.185205 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3605/7637] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:47 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:47.657650 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-5d79d3d4-ff2c-499e-81ae-2883629a17ac req-3bb99b0f-58da-487e-b546-6375114ac8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "name": "network-vif-plugged", "status": "completed", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:47.668175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5d79d3d4-ff2c-499e-81ae-2883629a17ac req-3bb99b0f-58da-487e-b546-6375114ac8e0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:47.668676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5d79d3d4-ff2c-499e-81ae-2883629a17ac req-3bb99b0f-58da-487e-b546-6375114ac8e0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:47.669122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-5d79d3d4-ff2c-499e-81ae-2883629a17ac req-3bb99b0f-58da-487e-b546-6375114ac8e0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:47.680481 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-5d79d3d4-ff2c-499e-81ae-2883629a17ac req-3bb99b0f-58da-487e-b546-6375114ac8e0 service nova] Creating event network-vif-plugged:cad119c4-f199-4846-bebf-9be9d9e7f4bf for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 on n-h2-858383-10 Oct 12 10:08:47.685595 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-5d79d3d4-ff2c-499e-81ae-2883629a17ac req-3bb99b0f-58da-487e-b546-6375114ac8e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031660 Oct 12 10:08:47.686196 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4033/7638] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:08:48.207782 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:48.208351 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:48.215993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:48.216474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:48.216894 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:48.217625 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:48.218071 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:48.218496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:48.354338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:48.362581 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b062eb3a-626b-44bc-834a-c62f6e3516a1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1370 microversion: 2.1 time: 0.158873 Oct 12 10:08:48.363153 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3606/7639] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:48 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:49.392013 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:49.392697 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:49.400015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:49.400544 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:49.401022 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:49.401821 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:49.402313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:49.402776 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:49.543404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:49.551538 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4c38e4bf-6cfa-4b78-abf6-45dab4bcb105 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1554 microversion: 2.1 time: 0.168089 Oct 12 10:08:49.552122 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4034/7640] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:49 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:49.574239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:08:49.574819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:08:49.576837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:49.577513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:49.585468 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:49.586033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:49.586488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:49.587519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:49.587972 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:49.588439 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:49.720558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:08:49.730928 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-157231b2-ab8e-4018-a8a7-bc1bbdf7638e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1554 microversion: 2.1 time: 0.160263 Oct 12 10:08:49.738133 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3607/7641] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:08:49 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:08:51.710875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-c906a310-9b0a-4ff0-91b1-88c5e7e3129d req-aba7a77e-70b0-4d30-9c54-e869f698e8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:08:51.716318 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:08:51.725497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c906a310-9b0a-4ff0-91b1-88c5e7e3129d req-aba7a77e-70b0-4d30-9c54-e869f698e8fe service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:08:51.726074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c906a310-9b0a-4ff0-91b1-88c5e7e3129d req-aba7a77e-70b0-4d30-9c54-e869f698e8fe service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:08:51.726609 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-c906a310-9b0a-4ff0-91b1-88c5e7e3129d req-aba7a77e-70b0-4d30-9c54-e869f698e8fe service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:08:51.737974 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-c906a310-9b0a-4ff0-91b1-88c5e7e3129d req-aba7a77e-70b0-4d30-9c54-e869f698e8fe service nova] Creating event network-changed:cad119c4-f199-4846-bebf-9be9d9e7f4bf for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 on n-h2-858383-10 Oct 12 10:08:51.743477 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-c906a310-9b0a-4ff0-91b1-88c5e7e3129d req-aba7a77e-70b0-4d30-9c54-e869f698e8fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036405 Oct 12 10:08:51.744091 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4035/7642] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:10:48.031953 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [69519c9e-db2a-456c-87f5-913be80c5911] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 10:10:48.033678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:10:48.034702 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=34 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:10:48.038713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:10:48.039247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:48.046638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:48.047121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:48.047594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:48.048298 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:48.048747 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:48.049165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:48.073372 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lazy-loading 'flavor' on Instance uuid 2156e73f-e1ec-498d-b312-794a5d76a3a1 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:10:48.264811 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c21bc38b-58de-4346-913e-2246fd118e04 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "POST /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.234560 Oct 12 10:10:48.265406 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3608/7643] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:10:48 2022] POST /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:10:48.274454 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 10:10:48.276250 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 10:10:48.277088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:10:48.278156 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=28 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:10:48.279296 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:10:48.279587 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 (ip 10.222.0.40) !!! Oct 12 10:10:48.281074 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:10:48.281258 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 (ip 10.222.0.40) !!! Oct 12 10:10:48.287480 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:48.288545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:48.300325 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:48.301146 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:48.301876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:48.302790 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:48.303265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:48.303837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:48.456235 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:48.465415 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-66ee44d4-2a51-49ef-b405-edc9c015844e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.193067 Oct 12 10:10:48.466190 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4036/7644] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:48 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:49.499371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:49.500348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:49.511251 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:49.511742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:49.512183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:49.512871 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:49.513327 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:49.513780 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:49.519208 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [69519c9e-db2a-456c-87f5-913be80c5911] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 51950. Oct 12 10:10:49.648155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:49.656012 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-38b8bb6f-c2bd-4320-8bfa-797b4418cd66 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.166901 Oct 12 10:10:49.656583 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3609/7645] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:49 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:50.679302 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:50.679939 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:50.691941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:50.692486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:50.692951 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:50.693682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:50.694135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:50.694568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:50.698408 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 51956. Oct 12 10:10:50.701468 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 51958. Oct 12 10:10:50.842835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:50.853005 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6ff170ec-96c5-4bf0-ad20-8f92c89013d1 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.177833 Oct 12 10:10:50.853781 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4037/7646] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:50 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:51.876742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:51.877716 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:51.885887 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:51.886377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:51.886817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:51.887509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:51.887961 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:51.888385 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:52.034050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:52.042134 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-54b2a91a-e0a1-474b-9f48-e5f40828c2cb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.169450 Oct 12 10:10:52.042737 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3610/7647] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:51 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:53.070343 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:53.071334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:53.079242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:53.079767 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:53.080217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:53.080922 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:53.081384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:53.081853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:53.221265 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:53.230102 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-bbc1278d-3479-4443-aae8-a90935b557e4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.167128 Oct 12 10:10:53.230686 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4038/7648] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:53 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:54.266204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:54.267103 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:54.277402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:54.277921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:54.278362 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:54.279059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:54.279518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:54.279947 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:54.418120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:54.430107 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-37375cb4-4bf3-418c-a8b1-bd851aef3514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.170439 Oct 12 10:10:54.430940 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3611/7649] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:54 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:55.458486 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:55.459473 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:55.472359 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:55.473175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:55.474017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:55.475212 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:55.476007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:55.476747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:55.621078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:55.632710 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ff420720-6501-4110-97b9-27ced4312e21 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.180806 Oct 12 10:10:55.633555 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4039/7650] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:55 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:56.662798 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:56.663552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:56.671506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:56.671995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:56.672432 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:56.673124 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:56.673691 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:56.674123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:56.807194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:56.819403 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-429abe0c-5cca-4c53-8bb5-0a5468837d38 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.160995 Oct 12 10:10:56.820097 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3612/7651] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:56 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:57.849354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:57.850435 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:57.862369 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:57.863213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:57.863999 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:57.865641 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:57.866060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:57.866809 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:58.007662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:58.015649 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-aff38f13-ca59-4b23-ae1e-53df5c166674 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.173032 Oct 12 10:10:58.016268 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4040/7652] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:57 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:10:59.043371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:10:59.044367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:10:59.052154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:59.052675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:59.053143 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:59.053909 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:10:59.054398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:10:59.054878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:10:59.207672 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:10:59.220822 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-908442c6-d3b3-4a01-ad52-39f6fead3812 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1700 microversion: 2.1 time: 0.183802 Oct 12 10:10:59.221737 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3613/7653] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:10:59 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1700 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:00.245458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:00.246114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:00.254331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:00.254843 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:00.255296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:00.256005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:00.256477 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:00.256921 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:00.395135 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:00.403209 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e84caf31-7e71-4951-af63-a011c2ed9d88 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1700 microversion: 2.1 time: 0.161858 Oct 12 10:11:00.403758 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4041/7654] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:00 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:01.427593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:01.428338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:01.435886 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:01.436767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:01.437542 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:01.438400 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:01.438957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:01.439612 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:01.601044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:01.609559 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-611e0830-0d17-4f07-8ab5-73ec76c7592f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1695 microversion: 2.1 time: 0.186493 Oct 12 10:11:01.610343 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3614/7655] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:01 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:02.635741 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:02.637175 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:02.645590 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:02.646481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:02.647248 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:02.648223 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:02.648930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:02.649616 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:02.801452 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:02.810692 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b969db0c-6615-42af-b884-ec69033f7a01 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1695 microversion: 2.1 time: 0.179696 Oct 12 10:11:02.812361 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4042/7656] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:02 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:11:03.836179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:03.837696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:03.846046 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:03.846550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:03.846995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:03.847761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:03.848194 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:03.848662 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:04.002963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:04.011445 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-02bd5629-da25-4994-aa6d-e43f20a748c0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1695 microversion: 2.1 time: 0.179271 Oct 12 10:11:04.012036 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3615/7657] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:03 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:04.436526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-ba6de509-afef-4a3d-b8c7-437e85b6f2e7 req-ed2271b0-e035-4e36-8ced-86442b3bce56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "name": "network-vif-plugged", "status": "completed", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:11:04.458196 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ba6de509-afef-4a3d-b8c7-437e85b6f2e7 req-ed2271b0-e035-4e36-8ced-86442b3bce56 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:04.458757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ba6de509-afef-4a3d-b8c7-437e85b6f2e7 req-ed2271b0-e035-4e36-8ced-86442b3bce56 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:04.459342 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-ba6de509-afef-4a3d-b8c7-437e85b6f2e7 req-ed2271b0-e035-4e36-8ced-86442b3bce56 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:04.473304 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-ba6de509-afef-4a3d-b8c7-437e85b6f2e7 req-ed2271b0-e035-4e36-8ced-86442b3bce56 service nova] Creating event network-vif-plugged:cad119c4-f199-4846-bebf-9be9d9e7f4bf for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 on n-h2-858383-10 Oct 12 10:11:04.478783 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-ba6de509-afef-4a3d-b8c7-437e85b6f2e7 req-ed2271b0-e035-4e36-8ced-86442b3bce56 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117880 Oct 12 10:11:04.479894 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4043/7658] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:11:05.035530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:05.036149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:05.044032 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:05.044637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:05.045110 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:05.045952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:05.046743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:05.047285 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:05.198781 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:05.209076 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a4072ca4-a20f-4e87-9ae6-d4e100e910d8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1695 microversion: 2.1 time: 0.177487 Oct 12 10:11:05.209797 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3616/7659] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:05 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:06.235293 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:06.236231 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:06.243048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:06.243849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:06.244465 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:06.245527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:06.246197 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:06.246839 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:06.393875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:06.402923 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-eb708ba0-203f-4af8-81d1-fe90ff904c8e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1695 microversion: 2.1 time: 0.172977 Oct 12 10:11:06.403543 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4044/7660] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:06 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:07.429755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:07.431436 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:07.441227 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:07.441758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:07.442202 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:07.442893 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:07.443605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:07.444204 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:07.603163 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:07.611926 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-88aded0c-be30-4959-adfb-fcacaa0c6875 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1695 microversion: 2.1 time: 0.187052 Oct 12 10:11:07.612528 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3617/7661] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:07 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:08.636307 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:08.637184 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:08.645952 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:08.646564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:08.647275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:08.648144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:08.648684 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:08.649345 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:08.804338 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:08.814224 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e3f46328-8c02-4a9f-995e-cd49e1d9303c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1695 microversion: 2.1 time: 0.182387 Oct 12 10:11:08.815089 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4045/7662] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:08 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:11:09.839719 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:09.840330 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:09.848557 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:09.849042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:09.849469 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:09.850195 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:09.850644 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:09.851051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:09.984635 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:09.992568 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e62d50e6-e3b1-44c1-b8f3-6487057548ba tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1695 microversion: 2.1 time: 0.157007 Oct 12 10:11:09.993156 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3618/7663] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:09 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:11.016604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:11.017246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:11.024659 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:11.025194 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:11.025671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:11.026393 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:11.026861 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:11.027301 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:11.164504 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:11.174107 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-49f71d15-f856-43b2-ae94-dd6d61409612 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1677 microversion: 2.1 time: 0.161698 Oct 12 10:11:11.174695 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4046/7664] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:11 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:12.201785 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:12.202670 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:12.214282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:12.215080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:12.215812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:12.216987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:12.218130 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:12.218837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:12.349727 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:12.358196 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-688ee1f0-baa0-4c7d-9a7b-34672219674f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1677 microversion: 2.1 time: 0.163121 Oct 12 10:11:12.358783 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3619/7665] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:12 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:13.392817 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:13.393398 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:13.400788 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:13.401291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:13.401773 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:13.402487 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:13.402959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:13.403399 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:13.536133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:13.544315 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d37fb47e-27ad-4c97-b7ca-fb6b5f131740 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1620 microversion: 2.1 time: 0.158337 Oct 12 10:11:13.544906 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4047/7666] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:13 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1620 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:13.567283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:11:13.567874 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:13.574845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:13.575339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:13.575789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:13.576492 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:13.576948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:13.577375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:13.667537 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127007) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 12 10:11:13.737636 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-46859b50-6188-43c5-9aad-2e0a61524446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "POST /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.174292 Oct 12 10:11:13.741424 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3620/7667] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:11:13 2022] POST /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:11:13.746838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:13.747591 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:13.754259 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:13.754849 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:13.755410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:13.756239 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:13.756782 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:13.757209 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:13.893095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:13.901661 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4863ba49-4756-4ff1-a21d-5fc071f439fe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1628 microversion: 2.1 time: 0.158763 Oct 12 10:11:13.902220 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4048/7668] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:13 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1628 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:14.343646 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-135b9a06-c132-4312-9d60-861cfa30985a req-06144b27-60b5-435f-ab3e-7c70639748e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "name": "network-vif-unplugged", "status": "completed", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:11:14.354991 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-135b9a06-c132-4312-9d60-861cfa30985a req-06144b27-60b5-435f-ab3e-7c70639748e9 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:14.355528 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-135b9a06-c132-4312-9d60-861cfa30985a req-06144b27-60b5-435f-ab3e-7c70639748e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:14.356199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-135b9a06-c132-4312-9d60-861cfa30985a req-06144b27-60b5-435f-ab3e-7c70639748e9 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:14.370296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.compute.server_external_events [req-135b9a06-c132-4312-9d60-861cfa30985a req-06144b27-60b5-435f-ab3e-7c70639748e9 service nova] Unable to find a host for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1. Dropping event network-vif-unplugged {{(pid=127007) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 10:11:14.371199 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-135b9a06-c132-4312-9d60-861cfa30985a req-06144b27-60b5-435f-ab3e-7c70639748e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032260 Oct 12 10:11:14.371798 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3621/7669] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 10:11:14.925520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:14.926242 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:14.933690 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:14.934185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:14.934629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:14.935329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:14.935794 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:14.936227 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:15.074266 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:15.084807 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-68dea0db-e2ee-417a-acbf-418afd4fa88c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.163227 Oct 12 10:11:15.085401 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4049/7670] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:14 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:16.078587 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-36c05d47-ed0e-4b91-ba2c-33f3b549b88e req-0152983d-3f32-4b21-9390-d98727b29b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:11:16.088765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36c05d47-ed0e-4b91-ba2c-33f3b549b88e req-0152983d-3f32-4b21-9390-d98727b29b34 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:16.089164 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36c05d47-ed0e-4b91-ba2c-33f3b549b88e req-0152983d-3f32-4b21-9390-d98727b29b34 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:16.089615 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36c05d47-ed0e-4b91-ba2c-33f3b549b88e req-0152983d-3f32-4b21-9390-d98727b29b34 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:16.094159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:11:16.103642 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-36c05d47-ed0e-4b91-ba2c-33f3b549b88e req-0152983d-3f32-4b21-9390-d98727b29b34 service nova] Creating event network-changed:cad119c4-f199-4846-bebf-9be9d9e7f4bf for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 on n-h1-858383-10 Oct 12 10:11:16.108898 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-36c05d47-ed0e-4b91-ba2c-33f3b549b88e req-0152983d-3f32-4b21-9390-d98727b29b34 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098162 Oct 12 10:11:16.109521 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3622/7671] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:11:16.110298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:16.110954 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:16.120978 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:16.121539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:16.121997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:16.122721 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:16.123189 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:16.123626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:16.257924 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:16.265919 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-79105a3a-749d-48b4-b7a1-1151a54f8e48 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.159696 Oct 12 10:11:16.266512 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4050/7672] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:16 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:17.294758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:17.295496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:17.303837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:17.304335 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:17.305061 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:17.305878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:17.306566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:17.307223 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:17.461616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:17.470424 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6bd2188-25d2-4816-a5e0-8d7ef15e60c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.180055 Oct 12 10:11:17.470972 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3623/7673] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:17 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:18.494801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:18.495448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:18.498426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=31 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:11:18.503737 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:18.504296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:18.504738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:18.505666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:18.506133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:18.506614 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:18.509838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=87 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:11:18.645372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:18.658461 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dece92a6-5d25-43ce-9d8a-2c2a23f665a9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.167266 Oct 12 10:11:18.659307 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4051/7674] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:18 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:19.687348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:19.687995 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:19.695184 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:11:19.697160 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:19.698128 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:19.698803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:19.699742 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:19.700288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:19.700758 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:19.851238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:19.860591 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fe68169a-7db1-4021-92ef-bef37b55b49f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.176538 Oct 12 10:11:19.860591 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3624/7675] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:19 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:20.888627 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:20.889284 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:20.896460 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:20.896972 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:20.897429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:20.898187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:20.898664 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:20.899147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:21.050728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:21.059324 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-73de526b-778c-4796-8dfd-993571f3d6fa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.176926 Oct 12 10:11:21.073972 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4052/7676] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:20 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:22.087577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:22.088569 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:22.100069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:22.100563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:22.101005 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:22.101744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:22.102215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:22.102642 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:22.241123 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:22.249128 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-840894ab-d311-48d8-84ea-364078ddebdf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.168282 Oct 12 10:11:22.249743 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3625/7677] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:22 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:23.272947 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:23.273567 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:23.280618 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:23.281139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:23.281625 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:23.282358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:23.282826 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:23.283278 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:23.422123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:23.430339 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a59d2a82-133e-4bf4-aab4-8db7951b3faf tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.161654 Oct 12 10:11:23.430921 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4053/7678] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:23 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:24.456331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:24.456964 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:24.465027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:24.465548 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:24.465996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:24.466999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:24.468007 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:24.468449 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:24.602348 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:24.628262 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ed21e46f-6433-44de-97ab-4e2e568e203a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.177928 Oct 12 10:11:24.629217 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3626/7679] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:24 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:25.654185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:25.655105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:25.662692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:25.663458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:25.663909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:25.664662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:25.665136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:25.665602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:25.796558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:25.804738 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-85f8964a-49fa-4bd9-9f6d-aad197e9a8c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.154880 Oct 12 10:11:25.805399 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4054/7680] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:25 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:26.828349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:26.828921 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:26.835987 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:26.836479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:26.836944 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:26.837718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:26.838518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:26.838658 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:27.010030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:27.018333 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fa4a56f3-716e-4f42-9d15-a02d27326de2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.194033 Oct 12 10:11:27.018953 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3627/7681] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:26 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:28.045629 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:28.046709 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:28.058501 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:28.059340 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:28.060096 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:28.061271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:28.062102 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:28.062877 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:28.216003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:28.224369 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8bc3481-88f1-4f75-a9a5-29fd9b23fdc2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.185431 Oct 12 10:11:28.224930 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4055/7682] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:28 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:29.261715 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:29.262753 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:29.274853 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:29.275262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:29.275704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:29.276440 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:29.276911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:29.277360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:29.427524 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:29.435916 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f3b9f9d7-0601-4c28-b3df-4b1b3356abcc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.190081 Oct 12 10:11:29.436480 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3628/7683] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:29 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:30.464950 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:30.465865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:30.475637 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:30.476314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:30.476941 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:30.477700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:30.478176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:30.478623 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:30.616957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:30.625244 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-64805428-9d9e-46dc-b69c-e79ed8c9bea9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.165734 Oct 12 10:11:30.625864 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4056/7684] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:30 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:31.189993 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-7a0d7bc2-b1dc-4840-8564-c5bb69854eef req-28ab2331-a6fe-48f8-bad7-4c1f66fe1760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "name": "network-vif-plugged", "status": "completed", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:11:31.202083 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7a0d7bc2-b1dc-4840-8564-c5bb69854eef req-28ab2331-a6fe-48f8-bad7-4c1f66fe1760 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:31.202573 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7a0d7bc2-b1dc-4840-8564-c5bb69854eef req-28ab2331-a6fe-48f8-bad7-4c1f66fe1760 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:31.203008 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-7a0d7bc2-b1dc-4840-8564-c5bb69854eef req-28ab2331-a6fe-48f8-bad7-4c1f66fe1760 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:31.214755 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-7a0d7bc2-b1dc-4840-8564-c5bb69854eef req-28ab2331-a6fe-48f8-bad7-4c1f66fe1760 service nova] Creating event network-vif-plugged:cad119c4-f199-4846-bebf-9be9d9e7f4bf for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 on n-h1-858383-10 Oct 12 10:11:31.220906 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-7a0d7bc2-b1dc-4840-8564-c5bb69854eef req-28ab2331-a6fe-48f8-bad7-4c1f66fe1760 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035293 Oct 12 10:11:31.221535 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3629/7685] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:11:31.653112 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:31.654241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:31.665374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:31.665925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:31.666384 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:31.667110 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:31.667588 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:31.668035 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:31.819604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:31.827901 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-16e705d1-8e69-4290-887a-a0aa21339386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.181827 Oct 12 10:11:31.828480 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4057/7686] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:31 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:32.852463 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:32.853216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:32.861484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:32.861484 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:32.861806 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:32.862508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:32.862954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:32.863378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:33.011409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:33.019773 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c6acd92b-6acf-403c-bf4c-08023b10c76e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1686 microversion: 2.1 time: 0.171820 Oct 12 10:11:33.020336 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3630/7687] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:32 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:11:34.046025 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:11:34.046738 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:11:34.053749 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:34.054246 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:34.054692 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:34.055376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:11:34.055838 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:11:34.056271 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:11:34.192089 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:11:34.204666 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-cb0a18fa-9da9-4e9b-8af4-c29ecb7390a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1673 microversion: 2.1 time: 0.163517 Oct 12 10:11:34.205482 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4058/7688] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:11:34 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:12:48.233783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=13 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:12:48.235159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=44 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:12:48.236337 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:12:48.236529 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 10:12:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 (ip 10.222.0.40) !!! Oct 12 10:12:48.239478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-48d47dd0-d953-4d87-b39c-97d886d886dd req-59a605d3-4ccd-4d5f-bf80-831d377fb806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:12:48.245811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=15 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:12:48.246503 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=47 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:12:48.250193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:12:48.250697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:12:48.253065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-48d47dd0-d953-4d87-b39c-97d886d886dd req-59a605d3-4ccd-4d5f-bf80-831d377fb806 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:48.253630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-48d47dd0-d953-4d87-b39c-97d886d886dd req-59a605d3-4ccd-4d5f-bf80-831d377fb806 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:48.254085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-48d47dd0-d953-4d87-b39c-97d886d886dd req-59a605d3-4ccd-4d5f-bf80-831d377fb806 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:48.266589 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-48d47dd0-d953-4d87-b39c-97d886d886dd req-59a605d3-4ccd-4d5f-bf80-831d377fb806 service nova] Creating event network-changed:cad119c4-f199-4846-bebf-9be9d9e7f4bf for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 on n-h1-858383-10 Oct 12 10:12:48.271097 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:48.271869 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-48d47dd0-d953-4d87-b39c-97d886d886dd req-59a605d3-4ccd-4d5f-bf80-831d377fb806 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037830 Oct 12 10:12:48.272547 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:48.273518 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:48.275760 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4059/7689] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:12:48.275989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:48.276657 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:48.277102 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:48.306558 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:12:48.407195 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-eb92c13a-52ef-4fa7-b785-eacb652290ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 204 len: 0 microversion: 2.1 time: 0.175098 Oct 12 10:12:48.408437 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3631/7690] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:12:48 2022] DELETE /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:12:48.418030 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:12:48.419129 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:12:48.426092 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:48.426914 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:48.427372 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:48.428289 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:48.428764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:48.429234 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:48.589666 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:12:48.599022 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ec8615be-14b9-412d-9a0a-f7ad45e97ba9 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.185728 Oct 12 10:12:48.616580 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4060/7691] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:12:48 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:12:49.626676 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:12:49.627263 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:12:49.634564 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:49.635044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:49.635511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:49.636189 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:49.637033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:49.637033 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:49.796324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:12:49.804578 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-91ac3b9c-a0fb-4968-81bd-a5eb498d636e tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1679 microversion: 2.1 time: 0.182519 Oct 12 10:12:49.805399 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3632/7692] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:12:49 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:12:50.472879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-baed2213-c431-4f2e-8615-91520d7e3b56 req-df84c2c7-c99e-4b37-837b-b7f9a8b02c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2156e73f-e1ec-498d-b312-794a5d76a3a1", "name": "network-vif-deleted", "tag": "cad119c4-f199-4846-bebf-9be9d9e7f4bf"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:12:50.482851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-baed2213-c431-4f2e-8615-91520d7e3b56 req-df84c2c7-c99e-4b37-837b-b7f9a8b02c62 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:50.483336 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-baed2213-c431-4f2e-8615-91520d7e3b56 req-df84c2c7-c99e-4b37-837b-b7f9a8b02c62 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:50.483884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-baed2213-c431-4f2e-8615-91520d7e3b56 req-df84c2c7-c99e-4b37-837b-b7f9a8b02c62 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:50.495297 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-baed2213-c431-4f2e-8615-91520d7e3b56 req-df84c2c7-c99e-4b37-837b-b7f9a8b02c62 service nova] Creating event network-vif-deleted:cad119c4-f199-4846-bebf-9be9d9e7f4bf for instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 on n-h1-858383-10 Oct 12 10:12:50.500199 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-baed2213-c431-4f2e-8615-91520d7e3b56 req-df84c2c7-c99e-4b37-837b-b7f9a8b02c62 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095831 Oct 12 10:12:50.500791 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4061/7693] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:12:50.828448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:12:50.829064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:12:50.836307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:50.836774 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:50.837214 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:50.837935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:50.838391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:50.838873 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:50.870895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:50.871368 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:50.871802 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:50.872289 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lazy-loading 'fault' on Instance uuid 2156e73f-e1ec-498d-b312-794a5d76a3a1 {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:12:50.914494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:12:50.923351 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5ccba7b2-9216-4af2-8df8-fc097e7daac2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 200 len: 1336 microversion: 2.1 time: 0.098836 Oct 12 10:12:50.923903 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3633/7694] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:12:50 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:12:51.959734 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:12:51.960961 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: 2156e73f-e1ec-498d-b312-794a5d76a3a1] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:12:51.973008 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:51.973578 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:51.974034 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:51.974772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:12:51.975243 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:12:51.975699 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:12:51.992908 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] HTTP exception thrown: Instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 could not be found. Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Request method failure captured: Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 HTTP/1.1 Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRpIf2m37NsaLMvGjjEJyeAT8WVILjkVRmReijv4rFlhx1c9SLQpke4YjfQaOUNAeeVi_DCS6VoSlGkSGY0Lg9hkYcCRJWBCbTia_BY9V62KbjqddUz3IDNW8bHY-pz2EiQSTijIjR--Unr2id-oZMo9g4p-8_CpbZ0MtMrYcz-ucrCw Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: d909bf4dc14d4aaa83d7ba6a75e0bedf Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestShelveInstance-229299558 Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d909bf4dc14d4aaa83d7ba6a75e0bedf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d909bf4dc14d4aaa83d7ba6a75e0bedf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d909bf4dc14d4aaa83d7ba6a75e0bedf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d909bf4dc14d4aaa83d7ba6a75e0bedf"}]}] Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestShelveInstance-229299558 Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: d909bf4dc14d4aaa83d7ba6a75e0bedf Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestShelveInstance-229299558 Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestShelveInstance-229299558-project Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 667c4a7a54e94e2fb31b31a4f3465a97 Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestShelveInstance-229299558-project Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 could not be found. Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': '2156e73f-e1ec-498d-b312-794a5d76a3a1'} Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 could not be found. Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 could not be found. Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:12:51.994611 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 could not be found. Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Returning 404 to user: Instance 2156e73f-e1ec-498d-b312-794a5d76a3a1 could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-a4a28558-5de3-4ecd-9e08-e80e67a4bbe7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1" status: 404 len: 111 microversion: 2.1 time: 0.050672 Oct 12 10:12:51.999491 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4062/7695] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:12:51 2022] GET /compute/v2.1/servers/2156e73f-e1ec-498d-b312-794a5d76a3a1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:12:52.171312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ef51b531-b146-4c2d-8017-bb55ef43bf3d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '.version_select at 0x7f9843d3b4c0>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:12:52.199614 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ef51b531-b146-4c2d-8017-bb55ef43bf3d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-379578966" status: 202 len: 0 microversion: 2.1 time: 0.032096 Oct 12 10:12:52.200219 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3634/7696] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 10:12:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-379578966 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:12:52.224181 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9c233b43-b818-4ad0-8d4b-e8b1c9778b26 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Action: 'create', calling method: .version_select at 0x7f98434d33a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-331154952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZ/hpYCqD45ilIEbBISwrB2461TZouqrze3pOjJmkEaiiXfJDp4Hlf87Op2bNzQOI21Z6ITxfAJhYG5Qo51itlWsEvRb6uyIv1XDVwJV6vNTPCkybpq6d/WXlD20ctc3w=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:12:52.240351 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9c233b43-b818-4ad0-8d4b-e8b1c9778b26 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Getting quotas for project d909bf4dc14d4aaa83d7ba6a75e0bedf. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:12:52.245584 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9c233b43-b818-4ad0-8d4b-e8b1c9778b26 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Getting quotas for user 667c4a7a54e94e2fb31b31a4f3465a97 and project d909bf4dc14d4aaa83d7ba6a75e0bedf. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:12:52.274211 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9c233b43-b818-4ad0-8d4b-e8b1c9778b26 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054347 Oct 12 10:12:52.274823 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4063/7697] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 10:12:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:13:08.490456 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:13:08.491217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:13:08.496055 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1881900915", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-331154952", "security_groups": [{"name": "tempest-secgroup-smoke-1912897932"}], "networks": [{"uuid": "a0f2dae5-8837-4db4-afa4-8e7357cad498"}], "block_device_mapping_v2": [{"uuid": "7a6e2a7f-8c9c-4b22-8c71-670c1823f708", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:13:08.614980 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] validate_networks() for [('a0f2dae5-8837-4db4-afa4-8e7357cad498', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:13:09.001812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:13:09.002244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:13:09.002724 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:13:09.003139 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:13:09.003553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:13:09.013404 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:09.013925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:09.014371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:09.015216 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:09.015678 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:09.016080 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:09.035324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Getting quotas for project d909bf4dc14d4aaa83d7ba6a75e0bedf. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:13:09.044230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Getting quotas for user 667c4a7a54e94e2fb31b31a4f3465a97 and project d909bf4dc14d4aaa83d7ba6a75e0bedf. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:13:09.104326 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:13:09.106511 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a6e2a7f-8c9c-4b22-8c71-670c1823f708',volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:13:09.245397 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-59e8d648-bd27-4e9d-8418-765fbf1c180b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756909 Oct 12 10:13:09.246092 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3635/7698] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:13:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:13:09.255485 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=12 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:13:09.256350 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=4 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:13:09.257502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:13:09.262918 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4716b828-1e5f-410d-ad7a-d5c15742f4c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:09.263549 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4716b828-1e5f-410d-ad7a-d5c15742f4c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:09.322036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4716b828-1e5f-410d-ad7a-d5c15742f4c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:09.330684 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4716b828-1e5f-410d-ad7a-d5c15742f4c4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1088 microversion: 2.1 time: 0.077047 Oct 12 10:13:09.331612 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4064/7699] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:09 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:10.355896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:10.356621 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:10.364273 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:10.364743 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:10.365165 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:10.365913 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:10.366360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:10.366808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:10.432378 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:10.444119 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f2e9b7b2-c925-485d-adee-3436a22d6f22 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1194 microversion: 2.1 time: 0.093180 Oct 12 10:13:10.444731 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3636/7700] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:10 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:11.468521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:11.469159 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:11.478383 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:11.478933 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:11.479397 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:11.480499 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:11.480617 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:11.481040 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:11.705171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:11.713654 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-629222a4-40f2-4c10-8b25-9898fec2fd87 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1272 microversion: 2.1 time: 0.249764 Oct 12 10:13:11.714346 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4065/7701] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:11 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:11.868340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d5782abb-6621-44a9-b533-1569cf5b764f req-5eeaa050-067e-4939-aaed-40d3e65bd52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf", "tag": "4d4bc262-c122-4224-b17b-b1deab42971a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:13:11.879859 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d5782abb-6621-44a9-b533-1569cf5b764f req-5eeaa050-067e-4939-aaed-40d3e65bd52e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:11.880448 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d5782abb-6621-44a9-b533-1569cf5b764f req-5eeaa050-067e-4939-aaed-40d3e65bd52e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:11.891675 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d5782abb-6621-44a9-b533-1569cf5b764f req-5eeaa050-067e-4939-aaed-40d3e65bd52e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:11.904324 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d5782abb-6621-44a9-b533-1569cf5b764f req-5eeaa050-067e-4939-aaed-40d3e65bd52e service nova] Creating event network-changed:4d4bc262-c122-4224-b17b-b1deab42971a for instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf on n-h2-858383-10 Oct 12 10:13:11.912396 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d5782abb-6621-44a9-b533-1569cf5b764f req-5eeaa050-067e-4939-aaed-40d3e65bd52e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050657 Oct 12 10:13:11.913288 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3637/7702] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:13:12.738675 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:12.740261 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:12.747957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:12.748903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:12.749512 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:12.750348 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:12.750911 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:12.751429 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:12.951039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:12.959402 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45d74094-4839-4f7b-a15c-e015fa5ad530 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1272 microversion: 2.1 time: 0.224819 Oct 12 10:13:12.959955 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4066/7703] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:12 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:13.984776 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:13.985431 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:13.992876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:13.994108 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:13.994553 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:13.995243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:13.995696 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:13.996112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:14.148962 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:14.157224 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-049d38e2-d84b-4f91-9d0c-3fefbb162044 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1272 microversion: 2.1 time: 0.177588 Oct 12 10:13:14.157936 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3638/7704] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:13 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:15.180020 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:15.180655 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:15.188120 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:15.188630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:15.189144 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:15.189892 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:15.190370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:15.190811 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:15.330095 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:15.341394 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-14770845-aaf4-4d41-b940-9d81b7e5a05d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1272 microversion: 2.1 time: 0.165511 Oct 12 10:13:15.342620 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4067/7705] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:15 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:16.368331 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:16.369069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:16.377918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:16.378519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:16.379052 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:16.379925 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:16.380486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:16.381001 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:16.514975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:16.523269 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-65c3f8a0-f9b0-48d9-b48b-9455500c3168 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.160373 Oct 12 10:13:16.523848 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3639/7706] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:16 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:17.551908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:17.552966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:17.564803 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:17.565683 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:17.566430 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:17.567604 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:17.568335 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:17.568774 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:17.703213 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:17.711378 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d8aeabcc-625c-4be0-aaa3-857917baa401 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.166216 Oct 12 10:13:17.711932 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4068/7707] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:17 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:18.734890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:18.735467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:18.742825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:18.743333 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:18.743796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:18.744475 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:18.744920 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:18.745344 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:18.888118 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:18.896429 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c232f3bc-16ff-449b-9a1a-1f1154cdbdf0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.165521 Oct 12 10:13:18.896988 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3640/7708] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:18 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:19.923822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:19.924677 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:19.928506 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:13:19.934463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:19.934945 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:19.935385 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:19.936088 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:19.936558 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:19.936997 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:20.075062 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:20.083093 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-83fdab4e-959e-4a20-836b-ef1ebc81a386 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.166023 Oct 12 10:13:20.083768 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4069/7709] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:19 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:21.111183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:21.112268 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:21.115958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:13:21.116999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:13:21.127611 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:21.128429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:21.129131 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:21.130312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:21.131149 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:21.131580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:21.264424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:21.272361 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-71eab663-9dd6-4adf-a439-992aa6ac0fb4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.168118 Oct 12 10:13:21.272942 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3641/7710] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:21 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:22.300955 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:22.301992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:22.309711 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:22.310210 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:22.310660 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:22.311374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:22.311837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:22.312275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:22.460136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:22.468209 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d20f6d16-1d92-4c1e-8c2b-5e1373837a62 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.174498 Oct 12 10:13:22.468792 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4070/7711] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:22 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:23.495626 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:23.496667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:23.508325 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:23.508808 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:23.509249 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:23.509970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:23.510429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:23.510858 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:23.646117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:23.654393 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1f1fdc62-252b-4fd5-a938-08646630e3b2 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.165347 Oct 12 10:13:23.654971 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3642/7712] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:23 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:24.681319 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:24.682003 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:24.689339 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:24.689875 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:24.690331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:24.691043 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:24.691514 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:24.691957 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:24.828717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:24.840166 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-dd14895d-3c0f-44f0-800c-9e822818de6b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.164749 Oct 12 10:13:24.840766 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4071/7713] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:24 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:25.867796 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:25.868413 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:25.875926 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:25.876408 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:25.876838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:25.877607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:25.878038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:25.878409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:26.016185 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:26.024366 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-080e4345-5943-4231-8b61-873e0d9041bb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.162970 Oct 12 10:13:26.024944 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3643/7714] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:25 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:27.047909 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:27.048548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:27.055886 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:27.056390 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:27.056845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:27.057601 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:27.058074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:27.058518 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:27.084193 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-efdbb73e-90e4-4fce-a649-e739bc75ea18 req-efe12e4a-6830-42b5-a6f1-34e3fe47e885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf", "name": "network-vif-plugged", "status": "completed", "tag": "4d4bc262-c122-4224-b17b-b1deab42971a"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:13:27.097077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-efdbb73e-90e4-4fce-a649-e739bc75ea18 req-efe12e4a-6830-42b5-a6f1-34e3fe47e885 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:27.097590 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-efdbb73e-90e4-4fce-a649-e739bc75ea18 req-efe12e4a-6830-42b5-a6f1-34e3fe47e885 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:27.098306 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-efdbb73e-90e4-4fce-a649-e739bc75ea18 req-efe12e4a-6830-42b5-a6f1-34e3fe47e885 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:27.115423 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-efdbb73e-90e4-4fce-a649-e739bc75ea18 req-efe12e4a-6830-42b5-a6f1-34e3fe47e885 service nova] Creating event network-vif-plugged:4d4bc262-c122-4224-b17b-b1deab42971a for instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf on n-h2-858383-10 Oct 12 10:13:27.120428 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-efdbb73e-90e4-4fce-a649-e739bc75ea18 req-efe12e4a-6830-42b5-a6f1-34e3fe47e885 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040250 Oct 12 10:13:27.121258 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3644/7715] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:13:27.200865 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:27.209041 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-de7c25d4-95ae-40f8-93e3-1691eff59efe tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.165335 Oct 12 10:13:27.209657 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4072/7716] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:27 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:28.238970 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:28.240034 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:28.248579 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:28.249069 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:28.249546 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:28.250248 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:28.250704 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:28.251133 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:28.387880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:28.395960 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-53ab6e16-614a-446a-95d5-a96e1e429c0c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1260 microversion: 2.1 time: 0.165773 Oct 12 10:13:28.396537 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3645/7717] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:28 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:29.423847 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:29.424967 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:29.436545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:29.437377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:29.438206 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:29.439376 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:29.440162 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:29.440899 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:29.577780 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:29.585881 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b2f7d073-9314-4325-b5f5-02082bcd29ea tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1444 microversion: 2.1 time: 0.168484 Oct 12 10:13:29.586485 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4073/7718] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:29 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:29.608752 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:13:29.609669 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:13:29.616817 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:29.617367 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:29.617824 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:29.618519 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:29.618974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:29.619405 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:29.755117 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:13:29.763068 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b58f93e3-7742-46a6-8619-5f2bdd487be7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1444 microversion: 2.1 time: 0.158334 Oct 12 10:13:29.763650 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3646/7719] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:13:29 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:13:31.720280 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-68ca936e-9430-4adb-adaa-c347547533cf req-5876ed41-67fe-4467-8dbc-b4a60cf4bed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf", "tag": "4d4bc262-c122-4224-b17b-b1deab42971a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:13:31.731099 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-68ca936e-9430-4adb-adaa-c347547533cf req-5876ed41-67fe-4467-8dbc-b4a60cf4bed0 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:13:31.731602 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-68ca936e-9430-4adb-adaa-c347547533cf req-5876ed41-67fe-4467-8dbc-b4a60cf4bed0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:13:31.732049 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-68ca936e-9430-4adb-adaa-c347547533cf req-5876ed41-67fe-4467-8dbc-b4a60cf4bed0 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:13:31.743520 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-68ca936e-9430-4adb-adaa-c347547533cf req-5876ed41-67fe-4467-8dbc-b4a60cf4bed0 service nova] Creating event network-changed:4d4bc262-c122-4224-b17b-b1deab42971a for instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf on n-h2-858383-10 Oct 12 10:13:31.748667 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-68ca936e-9430-4adb-adaa-c347547533cf req-5876ed41-67fe-4467-8dbc-b4a60cf4bed0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032206 Oct 12 10:13:31.749373 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4074/7720] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:15:29.077177 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 10:15:29.078159 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:15:29.079283 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=60 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:15:29.170443 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:15:29.171244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:29.180502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:29.181205 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:29.181828 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:29.182880 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:29.183481 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:29.184050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:29.207467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lazy-loading 'flavor' on Instance uuid f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:15:29.286951 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-15479b1e-54a3-4403-91aa-608fc2974d8f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "POST /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.213573 Oct 12 10:15:29.287549 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3647/7721] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:15:29 2022] POST /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:15:29.294093 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 10:15:29.294952 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 10:15:29.295556 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=24 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:15:29.296313 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=56 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:15:29.297564 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:15:29.297730 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:15:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf (ip 10.222.0.40) !!! Oct 12 10:15:29.303913 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:29.304633 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:29.312984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:29.313508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:29.313960 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:29.314680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:29.315187 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:29.315608 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:29.499039 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:29.507239 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-1ed880b9-95fe-4ca2-8d63-26f1d52b7df4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.215016 Oct 12 10:15:29.507819 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4075/7722] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:29 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:30.539664 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:30.540850 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:30.556385 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 52476. Oct 12 10:15:30.562321 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:30.562786 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:30.563218 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:30.563911 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:30.564371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:30.564790 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:30.752158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:30.764869 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d5195b40-caec-4d48-845f-fbc87ff108aa tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.235826 Oct 12 10:15:30.765632 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3648/7723] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:30 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:31.798204 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:31.799188 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:31.826042 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 52484. Oct 12 10:15:31.828044 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:31.828731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:31.829124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:31.829867 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:31.830377 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:31.830835 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:31.838412 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 52486. Oct 12 10:15:31.965115 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:31.974614 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e6f6e17d-72cc-46c9-ad69-6296517d91a8 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.183317 Oct 12 10:15:31.975239 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4076/7724] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:31 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:15:33.002765 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:33.003792 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:33.015514 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:33.016329 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:33.017067 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:33.018312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:33.019088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:33.019812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:33.157221 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:33.165305 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aae8ce55-b179-47a8-999e-48712802855b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.169389 Oct 12 10:15:33.165917 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3649/7725] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:32 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:34.192969 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:34.193884 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:34.203394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:34.203890 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:34.204334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:34.205036 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:34.205526 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:34.205963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:34.356412 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:34.366414 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-5cea6238-268d-41d5-9ad0-4b476a1bc79a tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.179094 Oct 12 10:15:34.366950 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4077/7726] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:34 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:35.392607 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:35.393312 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:35.401775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:35.402342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:35.402868 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:35.403682 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:35.404215 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:35.404720 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:35.552930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:35.565097 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d10abbab-6d7b-4274-b123-8b545801913c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.178164 Oct 12 10:15:35.565912 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3650/7727] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:35 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:36.596747 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:36.597414 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:36.605074 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:36.605635 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:36.606085 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:36.606806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:36.607287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:36.607729 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:36.748323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:36.756891 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-90151a65-3b99-4080-88a3-0809845c8a7c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.166447 Oct 12 10:15:36.757506 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4078/7728] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:36 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:37.784502 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:37.785601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:37.797155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:37.798002 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:37.798594 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:37.799288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:37.799737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:37.800161 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:37.939324 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:37.947276 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1aadc67e-dcee-4619-8a62-6e9f4c57ade5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.169419 Oct 12 10:15:37.947858 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3651/7729] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:37 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:38.976054 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:38.977081 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:38.988984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:38.989864 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:38.990651 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:38.991859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:38.992676 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:38.993404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:39.131172 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:39.139640 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0aba41fd-c7c7-43a1-9c3a-3b6d8a446ff3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.170535 Oct 12 10:15:39.140219 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4079/7730] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:38 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:40.162888 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:40.163520 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:40.170566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:40.171045 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:40.171472 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:40.172156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:40.172604 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:40.173026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:40.313854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:40.322774 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-9ace1b99-17f7-4a70-b503-260780562ff0 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.163847 Oct 12 10:15:40.323386 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3652/7731] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:40 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:41.350347 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:41.351416 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:41.363217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:41.363724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:41.364176 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:41.364879 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:41.365346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:41.365810 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:41.512850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:41.521481 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-29ea2406-6501-41d0-941a-a8d790ec4e4c tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.178051 Oct 12 10:15:41.522060 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4080/7732] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:41 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:42.545470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:42.546224 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:42.553763 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:42.554254 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:42.554693 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:42.555360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:42.555846 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:42.556304 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:42.692148 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:42.700325 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-87ad38ee-7b59-4012-aded-a9c1f95f4443 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.158895 Oct 12 10:15:42.713457 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3653/7733] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:42 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:43.724552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:43.725119 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:43.734437 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:43.734927 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:43.735375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:43.736114 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:43.736561 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:43.737091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:43.873470 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:43.881861 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6a63e01c-d845-4401-80de-665c44e1db6d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.161418 Oct 12 10:15:43.882444 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4081/7734] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:43 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:44.905940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:44.906551 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:44.914037 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:44.914442 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:44.914884 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:44.915577 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:44.916038 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:44.916474 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:45.065580 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:45.074190 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4e8220d4-b8a7-4435-a4a7-61bcfb401d95 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1509 microversion: 2.1 time: 0.172202 Oct 12 10:15:45.074788 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3654/7735] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:44 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:45.098105 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:15:45.098705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:45.106029 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:45.106527 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:45.106974 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:45.107680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:45.108147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:45.108585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:45.239031 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127006) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 12 10:15:45.313138 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-8b12cacd-03f0-4433-9403-286154e16e37 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "POST /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.218879 Oct 12 10:15:45.313769 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4082/7736] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:15:45 2022] POST /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:15:45.322342 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:45.322960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:45.329175 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:45.329706 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:45.330155 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:45.330934 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:45.331314 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:45.331784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:45.478373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:45.486475 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b326ad29-23a6-445c-846e-c12242e3d1d7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1517 microversion: 2.1 time: 0.168101 Oct 12 10:15:45.487091 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3655/7737] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:45 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 10:15:45.672093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-2e3522ed-287e-4cde-b04d-b2545e4da70b req-dc5fcbdf-9384-4db5-9628-f8d9dc1ff2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf", "name": "network-vif-unplugged", "status": "completed", "tag": "4d4bc262-c122-4224-b17b-b1deab42971a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:15:45.684233 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2e3522ed-287e-4cde-b04d-b2545e4da70b req-dc5fcbdf-9384-4db5-9628-f8d9dc1ff2a6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:45.684903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2e3522ed-287e-4cde-b04d-b2545e4da70b req-dc5fcbdf-9384-4db5-9628-f8d9dc1ff2a6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:45.685360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-2e3522ed-287e-4cde-b04d-b2545e4da70b req-dc5fcbdf-9384-4db5-9628-f8d9dc1ff2a6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:45.700728 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.compute.server_external_events [req-2e3522ed-287e-4cde-b04d-b2545e4da70b req-dc5fcbdf-9384-4db5-9628-f8d9dc1ff2a6 service nova] Unable to find a host for instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf. Dropping event network-vif-unplugged {{(pid=127006) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 10:15:45.701667 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-2e3522ed-287e-4cde-b04d-b2545e4da70b req-dc5fcbdf-9384-4db5-9628-f8d9dc1ff2a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035701 Oct 12 10:15:45.702237 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4083/7738] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 10:15:46.511652 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:46.512262 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:46.519395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:46.519878 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:46.520309 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:46.520996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:46.521496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:46.521941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:46.660829 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:46.672501 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ce73ee05-bda5-4e28-9dee-08d9e1a563b5 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1517 microversion: 2.1 time: 0.164579 Oct 12 10:15:46.673257 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3656/7739] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:46 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:47.697505 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:47.698131 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:47.705743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:47.706232 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:47.706663 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:47.707370 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:47.707814 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:47.708314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:47.853833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:47.862122 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0bb96111-42b0-43dc-937c-95ade5d33514 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1517 microversion: 2.1 time: 0.168461 Oct 12 10:15:47.862866 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4084/7740] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:47 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:48.892036 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:48.892613 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:48.900188 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:48.900679 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:48.901121 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:48.901865 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:48.902359 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:48.902787 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:49.041339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:49.050279 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3985c85-59d5-4883-a0bf-b8a2c5773f05 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1517 microversion: 2.1 time: 0.162136 Oct 12 10:15:49.050891 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3657/7741] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:48 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:50.074274 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:50.074908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:50.081943 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:50.082562 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:50.083015 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:50.083720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:50.084185 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:50.084624 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:50.222126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:50.230165 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-c1f70c7b-61eb-490b-bad0-e56298572e70 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1519 microversion: 2.1 time: 0.159861 Oct 12 10:15:50.230746 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4085/7742] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:50 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:51.254666 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:51.255282 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:51.262990 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:51.263486 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:51.263918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:51.264610 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:51.265065 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:51.265535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:51.407698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:51.416226 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-229b9964-54d6-4a43-9fb7-36b802115103 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1519 microversion: 2.1 time: 0.165590 Oct 12 10:15:51.416808 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3658/7743] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:51 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:52.440801 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:52.441375 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:52.448928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:52.449428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:52.449888 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:52.450626 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:52.451093 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:52.451535 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:52.583800 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:52.592704 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f2412099-22c9-4e95-be8c-eb9164636d2b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1519 microversion: 2.1 time: 0.156068 Oct 12 10:15:52.593314 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4086/7744] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:52 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:53.616338 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:53.616958 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:53.624361 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:53.624974 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:53.625415 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:53.626145 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:53.626599 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:53.627030 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:53.764999 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:53.773562 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a2e8fd6e-1313-418d-bdbc-17878c0b979b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1519 microversion: 2.1 time: 0.161126 Oct 12 10:15:53.774183 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3659/7745] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:53 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:54.797027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:54.797679 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:54.805298 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:54.805963 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:54.806539 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:54.807330 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:54.807876 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:54.808391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:54.949145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:54.958076 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-989a31a9-f3fe-4bda-862a-b07fc4294446 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1519 microversion: 2.1 time: 0.165469 Oct 12 10:15:54.958664 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4087/7746] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:54 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:55.983563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:55.984172 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:55.991390 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:55.991866 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:55.992303 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:55.993010 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:55.993427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:55.994120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:56.129424 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:56.137856 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e8f03fad-b217-4b32-a788-1d2e42ba80a4 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.158284 Oct 12 10:15:56.138406 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3660/7747] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:55 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:57.165495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:57.166436 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:57.177904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:57.178403 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:57.178852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:57.179557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:57.180048 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:57.180484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:57.318622 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:57.326642 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-83e987c2-f5de-4cb1-9b86-8f9b073db851 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.168031 Oct 12 10:15:57.327228 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4088/7748] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:57 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:58.360180 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:58.361247 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:58.372848 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:58.373748 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:58.374566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:58.375601 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:58.376339 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:58.377043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:58.396583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:15:58.519616 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:58.528275 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-136f0daa-30bc-40ed-89b0-2c6bc652793b tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.174685 Oct 12 10:15:58.528823 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3661/7749] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:58 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:15:59.564560 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:15:59.565548 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:15:59.569986 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:15:59.578621 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:59.579448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:59.580201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:59.581395 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:15:59.582236 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:15:59.582959 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:15:59.586740 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:15:59.728366 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:15:59.741847 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-45326510-1900-4a21-97a2-f0221a0ddd03 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.183832 Oct 12 10:15:59.742566 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4089/7750] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:15:59 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:16:00.769836 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:16:00.770854 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:16:00.774737 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=31 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:16:00.784112 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:00.784937 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:00.785688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:00.786835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:00.787586 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:00.788288 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:00.931027 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:16:00.942808 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a960fdad-7eb7-412f-adb5-0200d9e025ac tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.179284 Oct 12 10:16:00.943635 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3662/7751] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:16:00 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:16:01.972484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:16:01.973610 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:16:01.983994 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:01.984833 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:01.985743 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:01.986925 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:01.987853 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:01.988552 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:02.122657 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:16:02.130777 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ee2b05cf-0267-49dc-a87b-e3ac5835790f tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.165897 Oct 12 10:16:02.131361 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4090/7752] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:16:01 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:16:03.159022 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:16:03.159918 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:16:03.169258 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:03.169779 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:03.170217 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:03.170905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:03.171360 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:03.171784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:03.320732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:16:03.333716 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-93dad98b-7395-4c36-b845-5c711e483c28 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.181132 Oct 12 10:16:03.334598 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3663/7753] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:16:03 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:16:04.359559 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:16:04.360191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:16:04.367551 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:04.368064 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:04.368481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:04.369201 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:04.369733 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:04.370173 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:04.505128 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:16:04.513204 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6764e511-e792-4518-9e76-fa4ea5301894 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.158266 Oct 12 10:16:04.513822 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4091/7754] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:16:04 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:16:05.540838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:16:05.541885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:16:05.553583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:05.554383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:05.555147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:05.555994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:05.556454 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:05.556881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:05.699905 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:16:05.707980 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a7d57460-24c8-4cac-a42e-d9f9c36b44d3 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.173766 Oct 12 10:16:05.708576 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3664/7755] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:16:05 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:16:06.024720 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-e1b908ed-4eda-423b-9265-1fc9c91daeb4 req-0f2cc47d-2140-4126-b47b-8b01bcd9662c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf", "name": "network-vif-plugged", "status": "completed", "tag": "4d4bc262-c122-4224-b17b-b1deab42971a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:16:06.034716 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e1b908ed-4eda-423b-9265-1fc9c91daeb4 req-0f2cc47d-2140-4126-b47b-8b01bcd9662c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:06.035448 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e1b908ed-4eda-423b-9265-1fc9c91daeb4 req-0f2cc47d-2140-4126-b47b-8b01bcd9662c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:06.035905 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-e1b908ed-4eda-423b-9265-1fc9c91daeb4 req-0f2cc47d-2140-4126-b47b-8b01bcd9662c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:06.047170 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-e1b908ed-4eda-423b-9265-1fc9c91daeb4 req-0f2cc47d-2140-4126-b47b-8b01bcd9662c service nova] Creating event network-vif-plugged:4d4bc262-c122-4224-b17b-b1deab42971a for instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf on n-h2-858383-10 Oct 12 10:16:06.050715 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [req-e1b908ed-4eda-423b-9265-1fc9c91daeb4 req-0f2cc47d-2140-4126-b47b-8b01bcd9662c service nova] [f2007ade-b44f-4b88-b7b3-5042d8f4f6e0] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 10:16:06.733864 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:16:06.734770 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:16:06.744302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:06.744955 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:06.745603 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:06.746552 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:06.747158 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:06.747741 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:06.889895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:16:06.898160 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-471b0292-2d60-4c74-8b48-d8bdb6e20dcb tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.169819 Oct 12 10:16:06.898734 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3665/7756] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:16:06 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:16:07.063283 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [req-e1b908ed-4eda-423b-9265-1fc9c91daeb4 req-0f2cc47d-2140-4126-b47b-8b01bcd9662c service nova] [f2007ade-b44f-4b88-b7b3-5042d8f4f6e0] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 52582. Oct 12 10:16:07.069696 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-e1b908ed-4eda-423b-9265-1fc9c91daeb4 req-0f2cc47d-2140-4126-b47b-8b01bcd9662c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.100890 Oct 12 10:16:07.070668 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4092/7757] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:16:07.925895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:16:07.926885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:16:07.936151 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:07.936634 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:07.937072 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:07.937791 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:07.938242 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:07.938668 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:08.067508 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:16:08.075830 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6a054c36-234d-4fbd-9777-6a269b28e085 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1575 microversion: 2.1 time: 0.156489 Oct 12 10:16:08.076415 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3666/7758] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:16:07 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:16:09.105564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:16:09.106394 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:16:09.114323 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:09.114832 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:09.115358 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:09.116190 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:16:09.116732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:16:09.117241 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:16:09.252216 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:16:09.260258 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d13cbaff-0a90-480f-a890-1e6da04d2330 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1562 microversion: 2.1 time: 0.162811 Oct 12 10:16:09.260811 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4093/7759] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:16:09 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:28.935230 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=9 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:17:28.939087 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=9 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:17:28.940217 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=25 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:17:28.940606 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=32 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:17:28.941597 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:17:28.943189 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:17:28.943334 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 12 10:17:28.945278 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 10:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf (ip 10.222.0.40) !!! Oct 12 10:17:28.947034 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:17:28.947352 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 10:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf (ip 10.222.0.40) !!! Oct 12 10:17:28.951700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:28.952235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:28.958310 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-f096dc6a-91b0-447b-819d-79abe99a679e req-29338a48-d95c-4b4c-8bb1-cbcde2790cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf", "tag": "4d4bc262-c122-4224-b17b-b1deab42971a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:17:28.969931 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f096dc6a-91b0-447b-819d-79abe99a679e req-29338a48-d95c-4b4c-8bb1-cbcde2790cec service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:28.970778 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f096dc6a-91b0-447b-819d-79abe99a679e req-29338a48-d95c-4b4c-8bb1-cbcde2790cec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:28.971439 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-f096dc6a-91b0-447b-819d-79abe99a679e req-29338a48-d95c-4b4c-8bb1-cbcde2790cec service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:28.981384 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:28.981922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:28.982373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:28.983228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:28.983688 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:28.984115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:28.984688 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-f096dc6a-91b0-447b-819d-79abe99a679e req-29338a48-d95c-4b4c-8bb1-cbcde2790cec service nova] Creating event network-changed:4d4bc262-c122-4224-b17b-b1deab42971a for instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf on n-h2-858383-10 Oct 12 10:17:28.989852 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-f096dc6a-91b0-447b-819d-79abe99a679e req-29338a48-d95c-4b4c-8bb1-cbcde2790cec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052536 Oct 12 10:17:28.990448 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4094/7760] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:17:29.015232 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:17:29.103548 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-c38a2ed9-73d8-4f33-a9f9-c8408f64ef65 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 204 len: 0 microversion: 2.1 time: 0.170006 Oct 12 10:17:29.104613 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3667/7761] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:17:28 2022] DELETE /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:17:29.113846 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:29.114935 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:29.121585 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:29.122098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:29.122553 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:29.123272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:29.123750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:29.124191 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:29.272912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:29.281136 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-4b48efbd-e841-4b36-af25-75f15fb9e73d tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.171834 Oct 12 10:17:29.281753 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4095/7762] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:29 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:30.309389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:30.310583 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:30.321885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:30.322375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:30.322812 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:30.323513 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:30.323971 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:30.324402 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:30.466379 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:30.474748 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6029aa19-36b9-45d7-a6ba-3fb148ea3203 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1568 microversion: 2.1 time: 0.172233 Oct 12 10:17:30.476037 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3668/7763] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:30 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:31.403268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-6ea5e674-4756-41dc-ba32-ad407a2158c3 req-02c3006e-eb8c-42c1-8a78-4c0dce188cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf", "name": "network-vif-deleted", "tag": "4d4bc262-c122-4224-b17b-b1deab42971a"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:17:31.412916 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6ea5e674-4756-41dc-ba32-ad407a2158c3 req-02c3006e-eb8c-42c1-8a78-4c0dce188cff service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:31.413410 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6ea5e674-4756-41dc-ba32-ad407a2158c3 req-02c3006e-eb8c-42c1-8a78-4c0dce188cff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:31.413895 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-6ea5e674-4756-41dc-ba32-ad407a2158c3 req-02c3006e-eb8c-42c1-8a78-4c0dce188cff service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:31.425686 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-6ea5e674-4756-41dc-ba32-ad407a2158c3 req-02c3006e-eb8c-42c1-8a78-4c0dce188cff service nova] Creating event network-vif-deleted:4d4bc262-c122-4224-b17b-b1deab42971a for instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf on n-h2-858383-10 Oct 12 10:17:31.430711 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-6ea5e674-4756-41dc-ba32-ad407a2158c3 req-02c3006e-eb8c-42c1-8a78-4c0dce188cff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087405 Oct 12 10:17:31.433869 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4096/7764] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:17:31.499265 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:31.499845 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:31.506895 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:31.507389 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:31.507815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:31.508504 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:31.508952 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:31.509373 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:31.572496 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:31.580702 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-ac53a13e-e4ca-40c0-8e39-113c324deb59 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1219 microversion: 2.1 time: 0.085451 Oct 12 10:17:31.581271 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3669/7765] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:31 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:32.606529 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:32.607215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:32.614027 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:32.614520 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:32.614966 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:32.615671 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:32.616136 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:32.616564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:32.682700 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:32.691662 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-f87697b6-252b-424f-b08a-2482f0ba7def tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1219 microversion: 2.1 time: 0.090635 Oct 12 10:17:32.692486 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4097/7766] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:32 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:33.714834 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:33.715509 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:33.722838 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:33.723319 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:33.723755 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:33.724473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:33.724929 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:33.725371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:33.792908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:33.801192 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-1653f2e4-52e0-4909-98f7-15c658ec37af tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1219 microversion: 2.1 time: 0.090871 Oct 12 10:17:33.801773 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3670/7767] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:33 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:34.824837 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:34.825463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:34.832681 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:34.833281 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:34.833850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:34.834719 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:34.834898 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:34.835331 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:34.899654 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:34.909251 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-96bbc548-1f70-4f49-81e1-9ea8133aafbc tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1219 microversion: 2.1 time: 0.088506 Oct 12 10:17:34.909881 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4098/7768] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:34 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:35.933281 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:35.934021 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:35.941943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:35.942488 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:35.943186 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:35.944419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:35.945062 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:35.945701 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:35.982451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:35.982935 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:35.983375 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:35.983825 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.objects.instance [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lazy-loading 'fault' on Instance uuid f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf {{(pid=127007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:17:36.030638 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667c4a7a54e94e2fb31b31a4f3465a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909bf4dc14d4aaa83d7ba6a75e0bedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:36.039261 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5f203dfc-8880-442b-bb81-00e1ccbf90f6 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 200 len: 1224 microversion: 2.1 time: 0.110691 Oct 12 10:17:36.039982 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3671/7769] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:35 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:37.063275 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:37.063904 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] [instance: f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:37.071322 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:37.071820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:37.072268 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:37.072980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:37.073458 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:37.073908 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:37.087750 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.wsgi [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] HTTP exception thrown: Instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf could not be found. Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Request method failure captured: Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: request: GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf HTTP/1.1 Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: Accept: application/json Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: Accept-Encoding: identity Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: Connection: close Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: Content-Length: 0 Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: Content-Type: application/json Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: Host: 10.222.0.40 Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: Openstack-System-Scope: None Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: User-Agent: python-urllib3/1.26.12 Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Auth-Token: gAAAAABjRpIf2m37NsaLMvGjjEJyeAT8WVILjkVRmReijv4rFlhx1c9SLQpke4YjfQaOUNAeeVi_DCS6VoSlGkSGY0Lg9hkYcCRJWBCbTia_BY9V62KbjqddUz3IDNW8bHY-pz2EiQSTijIjR--Unr2id-oZMo9g4p-8_CpbZ0MtMrYcz-ucrCw Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Id: None Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Domain-Name: None Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Identity-Status: Confirmed Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Is-Admin-Project: True Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Id: default Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Domain-Name: Default Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Id: d909bf4dc14d4aaa83d7ba6a75e0bedf Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Project-Name: tempest-TestShelveInstance-229299558 Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Role: reader,member Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Roles: reader,member Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d909bf4dc14d4aaa83d7ba6a75e0bedf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d909bf4dc14d4aaa83d7ba6a75e0bedf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d909bf4dc14d4aaa83d7ba6a75e0bedf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d909bf4dc14d4aaa83d7ba6a75e0bedf"}]}] Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant: tempest-TestShelveInstance-229299558 Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Id: d909bf4dc14d4aaa83d7ba6a75e0bedf Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-Tenant-Name: tempest-TestShelveInstance-229299558 Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-User: tempest-TestShelveInstance-229299558-project Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Id: default Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-User-Domain-Name: Default Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-User-Id: 667c4a7a54e94e2fb31b31a4f3465a97 Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: X-User-Name: tempest-TestShelveInstance-229299558-project Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: method: > Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: exception: Instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf could not be found. Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: action_args: {'id': 'f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf'} Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf could not be found. Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf could not be found. Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:17:37.089836 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf could not be found. Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: ERROR nova.api.openstack.wsgi Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Returning 404 to user: Instance f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf could not be found. {{(pid=127006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-46307ccd-0ec1-4b92-a86b-d07932bd83c7 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf" status: 404 len: 111 microversion: 2.1 time: 0.032339 Oct 12 10:17:37.094680 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4099/7770] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:37 2022] GET /compute/v2.1/servers/f7d8c213-2c7c-4ca0-9c83-f7ea52f81ebf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:17:37.262783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-aeb0d7ec-8461-4f33-8dad-4fee75a93698 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] Calling method '.version_select at 0x7f9848b9d820>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:37.294486 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-aeb0d7ec-8461-4f33-8dad-4fee75a93698 tempest-TestShelveInstance-229299558 tempest-TestShelveInstance-229299558-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-331154952" status: 202 len: 0 microversion: 2.1 time: 0.035502 Oct 12 10:17:37.301081 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3672/7771] 10.222.0.40 () {58 vars in 1251 bytes} [Wed Oct 12 10:17:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-331154952 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 10:17:55.298515 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=12 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:17:55.299272 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=24 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:17:55.470066 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-9855aa8f-9f38-46da-bfd6-ef642214c30c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Action: 'create', calling method: .version_select at 0x7f984355e940>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1546068801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKhE8MjYsx+zZhffPSDEupDyGFbnH8jjwvGvsBOntCdpWvPHoFnMPos+zyyu/UGKWXUw9mhrwXf213w7OZSBHU6ZIEHYCpZYVJplOx418YBW7uZ724W5L2hGFwh6uMzfA=="}} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:17:55.485827 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9855aa8f-9f38-46da-bfd6-ef642214c30c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Getting quotas for project 6f51760c67024009bbf60d05e75419b3. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:17:55.492134 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.quota [None req-9855aa8f-9f38-46da-bfd6-ef642214c30c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Getting quotas for user 98cd45bec33b488fae104a928c136711 and project 6f51760c67024009bbf60d05e75419b3. Resources: {'key_pairs'} {{(pid=127006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:17:55.521263 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-9855aa8f-9f38-46da-bfd6-ef642214c30c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.228433 Oct 12 10:17:55.528003 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4100/7772] 10.222.0.40 () {60 vars in 1159 bytes} [Wed Oct 12 10:17:55 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:17:56.548494 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:17:56.549257 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:17:56.553526 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-863521565", "imageRef": "3816cc90-eecd-445f-9498-be8ec212c308", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1546068801", "security_groups": [{"name": "tempest-secgroup-smoke-222512762"}], "networks": [{"uuid": "119c1d46-0484-45ca-a8cf-ae4573ac83d0"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:17:56.678549 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] validate_networks() for [('119c1d46-0484-45ca-a8cf-ae4573ac83d0', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:17:57.157235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:17:57.158035 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:17:57.158700 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:17:57.159115 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:17:57.159529 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:17:57.168832 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:57.169320 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:57.169761 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:57.170490 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:57.170943 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:57.171377 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:57.189596 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Getting quotas for project 6f51760c67024009bbf60d05e75419b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:17:57.195026 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Getting quotas for user 98cd45bec33b488fae104a928c136711 and project 6f51760c67024009bbf60d05e75419b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:17:57.208014 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:17:57.210340 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3816cc90-eecd-445f-9498-be8ec212c308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:17:57.260527 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-3b45af84-7ef3-4dcd-8c4d-866e4e965167 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713808 Oct 12 10:17:57.267138 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3673/7773] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:17:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:17:57.273334 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-b3201be9-06a0-4db7-8aa6-804c4ad45c2d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:57.274007 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-b3201be9-06a0-4db7-8aa6-804c4ad45c2d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:57.331866 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-b3201be9-06a0-4db7-8aa6-804c4ad45c2d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:57.340268 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-b3201be9-06a0-4db7-8aa6-804c4ad45c2d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1248 microversion: 2.1 time: 0.071691 Oct 12 10:17:57.341169 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4101/7774] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:57 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:58.363576 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:58.364311 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:58.371898 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:58.372633 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:58.373261 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:58.374199 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:58.374648 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:58.375068 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:58.445213 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:58.454674 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-b12b91c3-8727-4832-a7de-07f1978f479c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1300 microversion: 2.1 time: 0.094971 Oct 12 10:17:58.470971 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3674/7775] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:58 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:59.478946 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:17:59.479731 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:17:59.487599 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:59.488117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:59.488566 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:59.489291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:17:59.489824 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:17:59.490249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:17:59.632464 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:17:59.640540 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0e0d0843-e997-4943-8a25-fd053d3588ae tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1373 microversion: 2.1 time: 0.165699 Oct 12 10:17:59.641092 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4102/7776] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:17:59 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:17:59.998775 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-36b56d5d-e24c-4341-8fe8-40d70f7f0957 req-74c812f1-961e-4119-9f98-4e53ec279ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61daf1e7-f19b-4d9e-846b-c39af5f9440f", "tag": "003d7b43-0d9a-46a3-ba0c-07ee5636005e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:18:00.010470 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36b56d5d-e24c-4341-8fe8-40d70f7f0957 req-74c812f1-961e-4119-9f98-4e53ec279ee6 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:00.011044 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36b56d5d-e24c-4341-8fe8-40d70f7f0957 req-74c812f1-961e-4119-9f98-4e53ec279ee6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:00.011713 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-36b56d5d-e24c-4341-8fe8-40d70f7f0957 req-74c812f1-961e-4119-9f98-4e53ec279ee6 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:00.023214 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-36b56d5d-e24c-4341-8fe8-40d70f7f0957 req-74c812f1-961e-4119-9f98-4e53ec279ee6 service nova] Creating event network-changed:003d7b43-0d9a-46a3-ba0c-07ee5636005e for instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f on n-h2-858383-10 Oct 12 10:18:00.028365 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-36b56d5d-e24c-4341-8fe8-40d70f7f0957 req-74c812f1-961e-4119-9f98-4e53ec279ee6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033572 Oct 12 10:18:00.028960 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3675/7777] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:18:00.665032 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:18:00.665727 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:18:00.674150 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:00.674662 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:00.675111 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:00.675845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:00.676312 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:00.676745 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:00.820980 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:18:00.829265 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2446a366-39c2-4b2d-adee-8c286875013c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1373 microversion: 2.1 time: 0.168626 Oct 12 10:18:00.829909 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4103/7778] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:18:00 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:18:01.854099 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:18:01.855480 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:18:01.862382 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:01.862953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:01.863465 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:01.864228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:01.864744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:01.865259 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:02.024467 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:18:02.032601 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d738ca89-fc94-4af4-bb80-97dc8a8e86d2 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1373 microversion: 2.1 time: 0.183878 Oct 12 10:18:02.033231 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3676/7779] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:18:01 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:18:03.056387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:18:03.057230 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:18:03.063982 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:03.064495 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:03.064949 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:03.065688 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:03.066178 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:03.066605 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:03.205291 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:18:03.213978 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-410d4595-70cd-48cd-b2a9-722129c10e70 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1373 microversion: 2.1 time: 0.161796 Oct 12 10:18:03.214505 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4104/7780] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:18:03 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:18:04.237605 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:18:04.238181 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:18:04.245466 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:04.245965 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:04.246398 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:04.247093 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:04.247543 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:04.247963 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:04.384628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:18:04.394731 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-11e2e069-b13b-4ad3-b0df-e2c0bb066c4b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1373 microversion: 2.1 time: 0.161236 Oct 12 10:18:04.395331 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3677/7781] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:18:04 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:18:04.408750 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-cd5ede97-17b8-4d7f-a50d-b0f85fd03f80 req-40a2815e-2d75-48fd-ac31-c57863154a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61daf1e7-f19b-4d9e-846b-c39af5f9440f", "name": "network-vif-plugged", "status": "completed", "tag": "003d7b43-0d9a-46a3-ba0c-07ee5636005e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:18:04.421361 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cd5ede97-17b8-4d7f-a50d-b0f85fd03f80 req-40a2815e-2d75-48fd-ac31-c57863154a32 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:04.422317 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cd5ede97-17b8-4d7f-a50d-b0f85fd03f80 req-40a2815e-2d75-48fd-ac31-c57863154a32 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:04.422771 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-cd5ede97-17b8-4d7f-a50d-b0f85fd03f80 req-40a2815e-2d75-48fd-ac31-c57863154a32 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:04.434659 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-cd5ede97-17b8-4d7f-a50d-b0f85fd03f80 req-40a2815e-2d75-48fd-ac31-c57863154a32 service nova] Creating event network-vif-plugged:003d7b43-0d9a-46a3-ba0c-07ee5636005e for instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f on n-h2-858383-10 Oct 12 10:18:04.440419 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-cd5ede97-17b8-4d7f-a50d-b0f85fd03f80 req-40a2815e-2d75-48fd-ac31-c57863154a32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Oct 12 10:18:04.441256 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4105/7782] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:18:05.422203 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:18:05.423235 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:18:05.434721 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:05.435530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:05.436260 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:05.437419 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:05.438237 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:05.438957 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:05.574890 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:18:05.583409 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-053bbb0a-3ae8-4cba-999f-df2ca768f672 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1373 microversion: 2.1 time: 0.167935 Oct 12 10:18:05.583994 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3678/7783] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:18:05 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:18:06.622016 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:18:06.623283 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:18:06.629920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:06.630423 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:06.630868 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:06.631574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:06.632041 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:06.632502 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:06.774391 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:18:06.782635 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ad4116db-a11d-4563-ac0f-8a897145c591 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1558 microversion: 2.1 time: 0.169365 Oct 12 10:18:06.783220 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4106/7784] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:18:06 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:18:06.805698 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:18:06.806349 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:18:06.813479 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:06.813975 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:06.814412 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:06.815111 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:06.815535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:06.815968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:06.960968 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:18:06.970285 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-283a61bb-5822-4d3b-8678-f8edb4c60f2a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1558 microversion: 2.1 time: 0.168669 Oct 12 10:18:06.970842 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3679/7785] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:18:06 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:18:08.678426 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=6 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:18:08.734589 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-b7ab37ca-6f34-4b83-a06e-2ca3f7ce583b req-2c4ba968-edda-4e1b-a46f-3d573cef81a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61daf1e7-f19b-4d9e-846b-c39af5f9440f", "tag": "003d7b43-0d9a-46a3-ba0c-07ee5636005e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:18:08.744314 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b7ab37ca-6f34-4b83-a06e-2ca3f7ce583b req-2c4ba968-edda-4e1b-a46f-3d573cef81a2 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:18:08.744812 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b7ab37ca-6f34-4b83-a06e-2ca3f7ce583b req-2c4ba968-edda-4e1b-a46f-3d573cef81a2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:18:08.745260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-b7ab37ca-6f34-4b83-a06e-2ca3f7ce583b req-2c4ba968-edda-4e1b-a46f-3d573cef81a2 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:18:08.757078 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-b7ab37ca-6f34-4b83-a06e-2ca3f7ce583b req-2c4ba968-edda-4e1b-a46f-3d573cef81a2 service nova] Creating event network-changed:003d7b43-0d9a-46a3-ba0c-07ee5636005e for instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f on n-h2-858383-10 Oct 12 10:18:08.762598 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-b7ab37ca-6f34-4b83-a06e-2ca3f7ce583b req-2c4ba968-edda-4e1b-a46f-3d573cef81a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090941 Oct 12 10:18:08.763202 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4107/7786] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:20:06.131847 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 10:20:06.133187 n-d-858383-10 devstack@n-api.service[127007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [69519c9e-db2a-456c-87f5-913be80c5911] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 12 10:20:06.133778 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:06.134900 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:06.135992 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:06.137147 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=34 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:06.139126 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 12 10:20:06.139374 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 10:20:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f/action (ip 10.222.0.40) !!! Oct 12 10:20:06.147803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-112787052"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:20:06.150209 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:06.161297 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:06.161809 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:06.162244 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:06.162939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:06.163395 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:06.163819 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:06.380049 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-4fb35284-3031-4a14-a00f-adcb78de209c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "POST /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f/action" status: 202 len: 0 microversion: 2.1 time: 0.251900 Oct 12 10:20:06.380710 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3680/7787] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:20:06 2022] POST /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 10:20:11.046031 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 10:20:11.046863 n-d-858383-10 devstack@n-api.service[127006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 10:20:11.047758 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:11.048859 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=28 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:11.050000 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:20:11.050372 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 12 10:20:11.056481 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-d5071dab-a849-45f3-a01f-12e4074832ee req-6e747a55-6efd-4041-a6ea-fca4cba1f11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61daf1e7-f19b-4d9e-846b-c39af5f9440f", "name": "network-vif-plugged", "status": "completed", "tag": "003d7b43-0d9a-46a3-ba0c-07ee5636005e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:20:11.072667 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d5071dab-a849-45f3-a01f-12e4074832ee req-6e747a55-6efd-4041-a6ea-fca4cba1f11b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:11.073732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d5071dab-a849-45f3-a01f-12e4074832ee req-6e747a55-6efd-4041-a6ea-fca4cba1f11b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:11.074971 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-d5071dab-a849-45f3-a01f-12e4074832ee req-6e747a55-6efd-4041-a6ea-fca4cba1f11b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:11.089687 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-d5071dab-a849-45f3-a01f-12e4074832ee req-6e747a55-6efd-4041-a6ea-fca4cba1f11b service nova] Creating event network-vif-plugged:003d7b43-0d9a-46a3-ba0c-07ee5636005e for instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f on n-h2-858383-10 Oct 12 10:20:11.097890 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-d5071dab-a849-45f3-a01f-12e4074832ee req-6e747a55-6efd-4041-a6ea-fca4cba1f11b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053497 Oct 12 10:20:11.099139 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4108/7788] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:20:19.965637 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:19.966451 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:19.971409 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1322075237", "imageRef": "cd03ce61-0121-4fb2-90ca-0f6d0bd52aca", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1546068801", "security_groups": [{"name": "tempest-secgroup-smoke-222512762"}], "networks": [{"uuid": "119c1d46-0484-45ca-a8cf-ae4573ac83d0"}]}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:20:19.996572 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [69519c9e-db2a-456c-87f5-913be80c5911] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 53000. Oct 12 10:20:19.997769 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] [237daebc-fe9c-4908-8fc1-d59a5cb02b1c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 52998. Oct 12 10:20:20.089953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.network.neutron [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] validate_networks() for [('119c1d46-0484-45ca-a8cf-ae4573ac83d0', None, None, None, None, None)] {{(pid=127007) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 10:20:20.482881 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Flavor limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 10:20:20.483302 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Image limits 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 10:20:20.483835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Flavor pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 10:20:20.484245 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Image pref 0:0:0 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 10:20:20.484659 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.virt.hardware [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 10:20:20.494477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:20.494959 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:20.495391 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:20.496109 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:20.496561 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:20.496982 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:20.514956 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Getting quotas for project 6f51760c67024009bbf60d05e75419b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 10:20:20.520530 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.quota [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Getting quotas for user 98cd45bec33b488fae104a928c136711 and project 6f51760c67024009bbf60d05e75419b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 10:20:20.534094 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Going to run 1 instances... {{(pid=127007) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 10:20:20.536563 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd03ce61-0121-4fb2-90ca-0f6d0bd52aca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 10:20:20.589877 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0ac084ce-e52f-4f7c-958a-185e16e60960 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.626232 Oct 12 10:20:20.590584 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3681/7789] 10.222.0.40 () {60 vars in 1147 bytes} [Wed Oct 12 10:20:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 10:20:20.605090 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-6768fe29-e4fd-44ad-9dd1-829481417a74 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:20.606461 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-6768fe29-e4fd-44ad-9dd1-829481417a74 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:20.625170 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [fdf28761-9cea-4388-ac5a-ef605e20ee64] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 53012. Oct 12 10:20:20.626571 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30b2e5d-8be8-42a1-b497-cc866ca096b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 53014. Oct 12 10:20:20.676017 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-6768fe29-e4fd-44ad-9dd1-829481417a74 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:20.683755 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-6768fe29-e4fd-44ad-9dd1-829481417a74 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1249 microversion: 2.1 time: 0.085427 Oct 12 10:20:20.684332 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4109/7790] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:20 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:21.707435 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:21.708276 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:21.715301 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:21.715784 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:21.716219 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:21.716919 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:21.717371 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:21.717815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:21.783908 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:21.793002 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-2703cf09-01fd-45b6-8b03-87462373b68b tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1301 microversion: 2.1 time: 0.090525 Oct 12 10:20:21.793796 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3682/7791] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:21 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:22.817346 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:22.818781 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:22.828476 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:22.834147 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:22.835098 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:22.835822 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:22.836789 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:22.837511 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:22.843228 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:22.997126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:23.007744 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-e7a2e68f-4411-4076-8449-d2ec491b8434 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.194744 Oct 12 10:20:23.008639 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4110/7792] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:22 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:24.031835 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:24.032614 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:24.040241 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:24.040789 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:24.041239 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:24.042012 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:24.042473 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:24.042953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:24.182428 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:24.190413 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fccd0e7e-b4b5-4751-93f7-5197b6a9fa1d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.162802 Oct 12 10:20:24.191001 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3683/7793] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:24 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:25.107852 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-4c9865df-b516-49f8-8c34-9992467c4826 req-3da5dcf3-c79a-4c88-8442-aa3062f78a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61daf1e7-f19b-4d9e-846b-c39af5f9440f", "name": "network-vif-unplugged", "status": "completed", "tag": "003d7b43-0d9a-46a3-ba0c-07ee5636005e"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:20:25.120425 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4c9865df-b516-49f8-8c34-9992467c4826 req-3da5dcf3-c79a-4c88-8442-aa3062f78a6e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:25.120930 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4c9865df-b516-49f8-8c34-9992467c4826 req-3da5dcf3-c79a-4c88-8442-aa3062f78a6e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:25.121530 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-4c9865df-b516-49f8-8c34-9992467c4826 req-3da5dcf3-c79a-4c88-8442-aa3062f78a6e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:25.133260 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-4c9865df-b516-49f8-8c34-9992467c4826 req-3da5dcf3-c79a-4c88-8442-aa3062f78a6e service nova] Creating event network-vif-unplugged:003d7b43-0d9a-46a3-ba0c-07ee5636005e for instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f on n-h2-858383-10 Oct 12 10:20:25.138863 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-4c9865df-b516-49f8-8c34-9992467c4826 req-3da5dcf3-c79a-4c88-8442-aa3062f78a6e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034827 Oct 12 10:20:25.139958 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4111/7794] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:20:25.214896 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:25.216353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:25.223989 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:25.225120 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:25.225849 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:25.226988 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:25.227653 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:25.228292 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:25.722523 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:25.730972 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e431be74-e477-466f-8a52-060f80b3f0af tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.520610 Oct 12 10:20:25.731966 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3684/7795] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:25 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:26.755717 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:26.756444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:26.763249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:26.763756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:26.764203 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:26.764920 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:26.765387 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:26.765855 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:26.906404 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:26.915174 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-ced4f574-ef43-403c-9f25-0d801277cc76 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.164513 Oct 12 10:20:26.929917 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4112/7796] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:26 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:27.941043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:27.956376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:27.956376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:27.956376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:27.956376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:27.956376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:27.956376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:27.956376 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:28.096939 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:28.107118 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-a344d476-512e-405c-a8af-272ad889731f tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.171090 Oct 12 10:20:28.108051 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3685/7797] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:27 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:29.130705 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:29.131374 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:29.138521 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:29.139287 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:29.139732 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:29.140463 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:29.140928 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:29.141362 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:29.368850 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:29.377682 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-31d49727-fcfd-4ed0-a159-ad675cb371f9 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.250810 Oct 12 10:20:29.393640 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4113/7798] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:29 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:30.400533 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:30.401173 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:30.408353 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:30.408857 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:30.409290 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:30.410051 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:30.410503 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:30.410930 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:30.505369 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:30.528236 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell0:SELECT=6 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:30.545771 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:30.553912 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-f4753636-dab8-4573-9434-2558e38c8257 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.157367 Oct 12 10:20:30.554500 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3686/7799] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:30 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:30.943154 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-9a30ce9c-5be6-486d-98b3-b2d4edac17c0 req-2f115c7f-f471-4154-a7de-8c4796687cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b6a4e5-087a-4b71-9e9b-a72db6b8235d", "tag": "20d4f098-2fcb-407c-a20d-73ff7467c460"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:20:30.951371 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell0:SELECT=2 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:30.959126 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9a30ce9c-5be6-486d-98b3-b2d4edac17c0 req-2f115c7f-f471-4154-a7de-8c4796687cab service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:30.960145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9a30ce9c-5be6-486d-98b3-b2d4edac17c0 req-2f115c7f-f471-4154-a7de-8c4796687cab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:30.960583 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-9a30ce9c-5be6-486d-98b3-b2d4edac17c0 req-2f115c7f-f471-4154-a7de-8c4796687cab service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:30.974642 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-9a30ce9c-5be6-486d-98b3-b2d4edac17c0 req-2f115c7f-f471-4154-a7de-8c4796687cab service nova] Creating event network-changed:20d4f098-2fcb-407c-a20d-73ff7467c460 for instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d on n-h1-858383-10 Oct 12 10:20:30.980590 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-9a30ce9c-5be6-486d-98b3-b2d4edac17c0 req-2f115c7f-f471-4154-a7de-8c4796687cab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042403 Oct 12 10:20:30.981668 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4114/7800] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:20:31.581162 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:31.582266 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:31.594271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:31.595077 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:31.595803 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:31.596954 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:31.597783 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:31.598507 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:31.792560 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:31.804446 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-99a1ce5e-6ce1-48c4-9d6b-713e58d675d3 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.229586 Oct 12 10:20:31.805213 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3687/7801] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:31 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:32.831674 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:32.832354 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:32.839630 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:32.840396 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:32.840820 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:32.841595 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:32.842065 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:32.842516 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:32.978857 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:32.986811 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d470f503-b6a6-453c-a01d-39b9e60c99eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.160321 Oct 12 10:20:32.987404 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4115/7802] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:32 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:34.014697 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:34.015649 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:34.027127 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:34.027948 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:34.028732 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:34.029936 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:34.030730 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:34.031426 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:34.176078 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:34.185417 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-952bebd8-876d-432f-947d-69d7e756b28a tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.177542 Oct 12 10:20:34.185998 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3688/7803] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:34 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:35.211557 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:35.212180 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:35.220260 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:35.220860 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:35.221341 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:35.222123 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:35.222636 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:35.223117 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:35.360160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:35.368598 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-364fa915-0291-4b5f-bb2c-0f5644143809 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.163556 Oct 12 10:20:35.369169 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4116/7804] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:35 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:36.395762 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:36.396767 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:36.404815 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:36.405296 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:36.405766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:36.406457 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:36.406940 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:36.407364 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:36.540238 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:36.553166 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-5759a37e-d83b-4d3d-b82d-56a88c888168 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.163702 Oct 12 10:20:36.554121 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3689/7805] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:36 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:37.576940 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:37.577682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:37.585100 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:37.585713 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:37.586171 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:37.586903 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:37.587329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:37.587981 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:37.629386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-ad2516ce-cca3-428f-bcff-b14ad28c4418 req-b8b2a75e-4552-4415-bd7a-7eaa2827cb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b6a4e5-087a-4b71-9e9b-a72db6b8235d", "name": "network-vif-plugged", "status": "completed", "tag": "20d4f098-2fcb-407c-a20d-73ff7467c460"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:20:37.640418 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ad2516ce-cca3-428f-bcff-b14ad28c4418 req-b8b2a75e-4552-4415-bd7a-7eaa2827cb6e service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:37.640907 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ad2516ce-cca3-428f-bcff-b14ad28c4418 req-b8b2a75e-4552-4415-bd7a-7eaa2827cb6e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:37.641394 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-ad2516ce-cca3-428f-bcff-b14ad28c4418 req-b8b2a75e-4552-4415-bd7a-7eaa2827cb6e service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:37.653547 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-ad2516ce-cca3-428f-bcff-b14ad28c4418 req-b8b2a75e-4552-4415-bd7a-7eaa2827cb6e service nova] Creating event network-vif-plugged:20d4f098-2fcb-407c-a20d-73ff7467c460 for instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d on n-h1-858383-10 Oct 12 10:20:37.658998 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-ad2516ce-cca3-428f-bcff-b14ad28c4418 req-b8b2a75e-4552-4415-bd7a-7eaa2827cb6e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033510 Oct 12 10:20:37.659603 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3690/7806] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 10:20:37.751215 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:37.759135 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-04acd60a-f415-48a0-a466-2bc3a6c21bf4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.186236 Oct 12 10:20:37.759710 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4117/7807] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:37 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:38.788525 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:38.789711 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:38.800307 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:38.801098 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:38.801902 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:38.803042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:38.803793 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:38.804515 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:38.947862 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:38.956259 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-8742eb39-28c1-4ebd-9efa-79428d6d8582 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1374 microversion: 2.1 time: 0.176337 Oct 12 10:20:38.956847 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3691/7808] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:38 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:39.984725 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:39.985845 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:39.997508 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:39.998337 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:39.999076 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:40.000249 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:40.001028 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:40.001806 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:40.150772 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:40.158692 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-91322880-708b-40de-a166-372fe54658c4 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1560 microversion: 2.1 time: 0.180526 Oct 12 10:20:40.159271 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4118/7809] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:39 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:40.181088 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:20:40.181714 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:20:40.189228 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:40.189744 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:40.190183 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:40.190876 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:40.191322 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:40.191746 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:40.343365 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:20:40.351610 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-41199033-7beb-47b5-9b69-693bde11cb8d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1560 microversion: 2.1 time: 0.174506 Oct 12 10:20:40.352157 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3692/7810] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:20:40 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:20:41.973360 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-7e77ccdc-ba13-4816-8202-1a8fa0c98461 req-b16a14aa-5bb6-4c19-8c34-87e8d5f1290c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b6a4e5-087a-4b71-9e9b-a72db6b8235d", "tag": "20d4f098-2fcb-407c-a20d-73ff7467c460"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:20:41.979454 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=25 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:20:41.985405 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7e77ccdc-ba13-4816-8202-1a8fa0c98461 req-b16a14aa-5bb6-4c19-8c34-87e8d5f1290c service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:20:41.985912 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7e77ccdc-ba13-4816-8202-1a8fa0c98461 req-b16a14aa-5bb6-4c19-8c34-87e8d5f1290c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:20:41.986356 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-7e77ccdc-ba13-4816-8202-1a8fa0c98461 req-b16a14aa-5bb6-4c19-8c34-87e8d5f1290c service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:20:41.997880 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-7e77ccdc-ba13-4816-8202-1a8fa0c98461 req-b16a14aa-5bb6-4c19-8c34-87e8d5f1290c service nova] Creating event network-changed:20d4f098-2fcb-407c-a20d-73ff7467c460 for instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d on n-h1-858383-10 Oct 12 10:20:42.002924 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-7e77ccdc-ba13-4816-8202-1a8fa0c98461 req-b16a14aa-5bb6-4c19-8c34-87e8d5f1290c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033298 Oct 12 10:20:42.003519 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4119/7811] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:22:09.129994 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:22:09.131092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=64 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:22:09.132895 n-d-858383-10 devstack@n-api.service[127007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:22:09.133181 n-d-858383-10 devstack@n-api.service[127007]: Wed Oct 12 10:22:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d/action (ip 10.222.0.40) !!! Oct 12 10:22:09.139243 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1525145020"}} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:22:09.141593 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:09.150772 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:09.151253 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:09.151689 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:09.152383 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:09.152837 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:09.153293 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:09.372620 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-6da629ed-0e35-488d-8a00-a3bee26cb018 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "POST /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d/action" status: 202 len: 0 microversion: 2.1 time: 0.246205 Oct 12 10:22:09.373280 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3693/7812] 10.222.0.40 () {60 vars in 1278 bytes} [Wed Oct 12 10:22:09 2022] POST /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 12 10:22:14.132444 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_api:SELECT=1 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:22:14.134288 n-d-858383-10 devstack@n-api.service[127006]: DEBUG dbcounter [-] [127006] Writing DB stats nova_cell1:SELECT=48 {{(pid=127006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:22:14.134542 n-d-858383-10 devstack@n-api.service[127006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 10:22:14.134738 n-d-858383-10 devstack@n-api.service[127006]: Wed Oct 12 10:22:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 12 10:22:14.246517 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-19138ada-6a3b-41d9-9c00-44fb498e92e4 req-b6da36ec-e611-4d7b-9187-dba38e43b00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b6a4e5-087a-4b71-9e9b-a72db6b8235d", "name": "network-vif-plugged", "status": "completed", "tag": "20d4f098-2fcb-407c-a20d-73ff7467c460"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:22:14.259468 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-19138ada-6a3b-41d9-9c00-44fb498e92e4 req-b6da36ec-e611-4d7b-9187-dba38e43b00b service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:14.260053 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-19138ada-6a3b-41d9-9c00-44fb498e92e4 req-b6da36ec-e611-4d7b-9187-dba38e43b00b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:14.260569 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-19138ada-6a3b-41d9-9c00-44fb498e92e4 req-b6da36ec-e611-4d7b-9187-dba38e43b00b service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:14.272445 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-19138ada-6a3b-41d9-9c00-44fb498e92e4 req-b6da36ec-e611-4d7b-9187-dba38e43b00b service nova] Creating event network-vif-plugged:20d4f098-2fcb-407c-a20d-73ff7467c460 for instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d on n-h1-858383-10 Oct 12 10:22:14.278062 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-19138ada-6a3b-41d9-9c00-44fb498e92e4 req-b6da36ec-e611-4d7b-9187-dba38e43b00b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148249 Oct 12 10:22:14.278691 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4120/7813] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:22:24.067280 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_api:SELECT=2 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:22:24.069050 n-d-858383-10 devstack@n-api.service[127007]: DEBUG dbcounter [-] [127007] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 10:22:24.073296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-bf696201-4b4e-48d4-9753-d385c780709c req-2e2e54de-9153-464e-bf49-346ced6a54cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b6a4e5-087a-4b71-9e9b-a72db6b8235d", "tag": "20d4f098-2fcb-407c-a20d-73ff7467c460"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:22:24.075042 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:24.075953 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:24.083647 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bf696201-4b4e-48d4-9753-d385c780709c req-2e2e54de-9153-464e-bf49-346ced6a54cc service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:24.084165 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bf696201-4b4e-48d4-9753-d385c780709c req-2e2e54de-9153-464e-bf49-346ced6a54cc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:24.084477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:24.084607 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-bf696201-4b4e-48d4-9753-d385c780709c req-2e2e54de-9153-464e-bf49-346ced6a54cc service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:24.085299 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:24.085976 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:24.086941 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:24.087595 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:24.088278 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:24.096448 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-bf696201-4b4e-48d4-9753-d385c780709c req-2e2e54de-9153-464e-bf49-346ced6a54cc service nova] Creating event network-changed:20d4f098-2fcb-407c-a20d-73ff7467c460 for instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d on n-h1-858383-10 Oct 12 10:22:24.101906 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-bf696201-4b4e-48d4-9753-d385c780709c req-2e2e54de-9153-464e-bf49-346ced6a54cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034301 Oct 12 10:22:24.102732 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4121/7814] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:22:24.120538 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Going to try to terminate instance {{(pid=127007) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:22:24.203845 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-fea1bda8-992d-4d52-a5be-e79831eb57c8 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 204 len: 0 microversion: 2.1 time: 0.138951 Oct 12 10:22:24.205595 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3694/7815] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:22:24 2022] DELETE /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:22:24.222145 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:24.222872 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:24.229484 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:24.229992 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:24.230456 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:24.231219 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:24.231686 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:24.232122 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:24.393428 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:22:24.401546 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-67215f27-3e59-4e25-b0fc-faf4bd0d0d24 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1685 microversion: 2.1 time: 0.188645 Oct 12 10:22:24.402201 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4122/7816] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:22:24 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:22:25.429766 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:25.430922 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:25.442477 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:25.443277 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:25.444011 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:25.445154 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:25.445960 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:25.446680 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:25.592535 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:22:25.600950 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-0dbfd268-4fd3-439c-b677-d0df0ce41473 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1685 microversion: 2.1 time: 0.178517 Oct 12 10:22:25.601659 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3695/7817] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:22:25 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:22:26.085139 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [req-a73eef28-b31f-4a6a-b559-7cd443e33eff req-61ee27a7-645b-41eb-bcf5-a1c68ceaedb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b6a4e5-087a-4b71-9e9b-a72db6b8235d", "name": "network-vif-unplugged", "status": "completed", "tag": "20d4f098-2fcb-407c-a20d-73ff7467c460"}]} {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:22:26.102564 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a73eef28-b31f-4a6a-b559-7cd443e33eff req-61ee27a7-645b-41eb-bcf5-a1c68ceaedb8 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:26.103060 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a73eef28-b31f-4a6a-b559-7cd443e33eff req-61ee27a7-645b-41eb-bcf5-a1c68ceaedb8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:26.103497 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [req-a73eef28-b31f-4a6a-b559-7cd443e33eff req-61ee27a7-645b-41eb-bcf5-a1c68ceaedb8 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:26.116647 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.compute.server_external_events [req-a73eef28-b31f-4a6a-b559-7cd443e33eff req-61ee27a7-645b-41eb-bcf5-a1c68ceaedb8 service nova] Creating event network-vif-unplugged:20d4f098-2fcb-407c-a20d-73ff7467c460 for instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d on n-h1-858383-10 Oct 12 10:22:26.121877 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [req-a73eef28-b31f-4a6a-b559-7cd443e33eff req-61ee27a7-645b-41eb-bcf5-a1c68ceaedb8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049398 Oct 12 10:22:26.122710 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4123/7818] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:22:26.462429 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d2dd3358-87aa-403d-bda7-212c3e886667 req-60352de7-ac82-4deb-9708-2e64c0c09e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b6a4e5-087a-4b71-9e9b-a72db6b8235d", "name": "network-vif-deleted", "tag": "20d4f098-2fcb-407c-a20d-73ff7467c460"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:22:26.473064 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d2dd3358-87aa-403d-bda7-212c3e886667 req-60352de7-ac82-4deb-9708-2e64c0c09e47 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:26.473566 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d2dd3358-87aa-403d-bda7-212c3e886667 req-60352de7-ac82-4deb-9708-2e64c0c09e47 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:26.473996 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d2dd3358-87aa-403d-bda7-212c3e886667 req-60352de7-ac82-4deb-9708-2e64c0c09e47 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:26.485145 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d2dd3358-87aa-403d-bda7-212c3e886667 req-60352de7-ac82-4deb-9708-2e64c0c09e47 service nova] Creating event network-vif-deleted:20d4f098-2fcb-407c-a20d-73ff7467c460 for instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d on n-h1-858383-10 Oct 12 10:22:26.490414 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d2dd3358-87aa-403d-bda7-212c3e886667 req-60352de7-ac82-4deb-9708-2e64c0c09e47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 Oct 12 10:22:26.490996 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3696/7819] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:22:26.625222 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:26.626091 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:26.632756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:26.633262 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:26.633757 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:26.634494 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:26.634989 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:26.635424 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:26.668124 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:26.668545 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:26.668984 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:26.669472 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lazy-loading 'fault' on Instance uuid 79b6a4e5-087a-4b71-9e9b-a72db6b8235d {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:22:26.711761 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:22:26.719572 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-40f29c6f-e698-41ae-9915-a6d4298165eb tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 200 len: 1339 microversion: 2.1 time: 0.098730 Oct 12 10:22:26.720238 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4124/7820] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:22:26 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:22:27.751597 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:27.752718 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 79b6a4e5-087a-4b71-9e9b-a72db6b8235d] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:27.763092 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:27.763572 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:27.764009 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:27.764703 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:27.765136 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:27.765582 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:27.779025 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] HTTP exception thrown: Instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d could not be found. Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Request method failure captured: Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d HTTP/1.1 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRpRNNoDkYqeyxKQEz8xW8aPBuZdoJmxF_XTDj3_IOQbUPcuDGh9fK2M8HxeEiOKY2SaK3mJqjD_w67ShJ0hK9ZhDhmF8noeUpzSy2Dj_UJHGwwfg0P-Vd0-diZPfW0BWK2_omjirzvJGD2BMajnQGqzGPpPGEyN9gR9_gtswUTXdkBE Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 6f51760c67024009bbf60d05e75419b3 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestSnapshotPattern-1057973661 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f51760c67024009bbf60d05e75419b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6f51760c67024009bbf60d05e75419b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6f51760c67024009bbf60d05e75419b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f51760c67024009bbf60d05e75419b3"}]}] Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestSnapshotPattern-1057973661 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 6f51760c67024009bbf60d05e75419b3 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestSnapshotPattern-1057973661 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestSnapshotPattern-1057973661-project Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 98cd45bec33b488fae104a928c136711 Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestSnapshotPattern-1057973661-project Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d could not be found. Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '79b6a4e5-087a-4b71-9e9b-a72db6b8235d'} Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d could not be found. Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d could not be found. Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:22:27.780640 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d could not be found. Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Returning 404 to user: Instance 79b6a4e5-087a-4b71-9e9b-a72db6b8235d could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-7d673db4-dc5e-4187-96c5-33dba9379551 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d" status: 404 len: 111 microversion: 2.1 time: 0.039030 Oct 12 10:22:27.785476 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3697/7821] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:22:27 2022] GET /compute/v2.1/servers/79b6a4e5-087a-4b71-9e9b-a72db6b8235d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:22:29.494133 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:29.494724 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:29.496271 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d3c2fb04-2b56-4d95-88a3-92ac6a03a556 req-61029546-1a35-4b86-a684-8d8941b61077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61daf1e7-f19b-4d9e-846b-c39af5f9440f", "tag": "003d7b43-0d9a-46a3-ba0c-07ee5636005e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:22:29.501777 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:29.503005 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:29.503696 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:29.504540 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:29.505009 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:29.505682 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:29.507826 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3c2fb04-2b56-4d95-88a3-92ac6a03a556 req-61029546-1a35-4b86-a684-8d8941b61077 service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:29.508550 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3c2fb04-2b56-4d95-88a3-92ac6a03a556 req-61029546-1a35-4b86-a684-8d8941b61077 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:29.509043 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d3c2fb04-2b56-4d95-88a3-92ac6a03a556 req-61029546-1a35-4b86-a684-8d8941b61077 service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:29.519917 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d3c2fb04-2b56-4d95-88a3-92ac6a03a556 req-61029546-1a35-4b86-a684-8d8941b61077 service nova] Creating event network-changed:003d7b43-0d9a-46a3-ba0c-07ee5636005e for instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f on n-h2-858383-10 Oct 12 10:22:29.525516 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d3c2fb04-2b56-4d95-88a3-92ac6a03a556 req-61029546-1a35-4b86-a684-8d8941b61077 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033534 Oct 12 10:22:29.526351 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3698/7822] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:22:29.535841 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Going to try to terminate instance {{(pid=127006) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 10:22:29.627280 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-d68e46b2-3caa-46e8-820d-077fd0ea823d tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "DELETE /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 204 len: 0 microversion: 2.1 time: 0.137215 Oct 12 10:22:29.628215 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4125/7823] 10.222.0.40 () {58 vars in 1239 bytes} [Wed Oct 12 10:22:29 2022] DELETE /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 10:22:29.637020 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:29.637731 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:29.644667 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:29.645506 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:29.646134 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:29.647059 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:29.647722 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:29.648337 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:29.804966 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.policy [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127007) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:22:29.813280 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-d22f2cb0-6b37-416f-a6b1-06fc5875a953 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1683 microversion: 2.1 time: 0.180498 Oct 12 10:22:29.813879 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3699/7824] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:22:29 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:22:30.837507 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:30.838256 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:30.845478 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:30.846000 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:30.846483 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:30.847160 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:30.847851 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:30.848296 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:30.984785 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:22:30.993277 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-432ea498-d9e7-486c-994b-8ffed875ba47 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1683 microversion: 2.1 time: 0.160486 Oct 12 10:22:30.993897 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4126/7825] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:22:30 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:22:31.851386 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [req-d25b7d59-ed0d-4ea7-9434-cd81bdeaf361 req-899fcd70-dd44-4f07-bb63-95d2745e897d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61daf1e7-f19b-4d9e-846b-c39af5f9440f", "name": "network-vif-deleted", "tag": "003d7b43-0d9a-46a3-ba0c-07ee5636005e"}]} {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 10:22:31.862885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d25b7d59-ed0d-4ea7-9434-cd81bdeaf361 req-899fcd70-dd44-4f07-bb63-95d2745e897d service nova] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:31.862885 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d25b7d59-ed0d-4ea7-9434-cd81bdeaf361 req-899fcd70-dd44-4f07-bb63-95d2745e897d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:31.863427 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [req-d25b7d59-ed0d-4ea7-9434-cd81bdeaf361 req-899fcd70-dd44-4f07-bb63-95d2745e897d service nova] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:31.874952 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.compute.server_external_events [req-d25b7d59-ed0d-4ea7-9434-cd81bdeaf361 req-899fcd70-dd44-4f07-bb63-95d2745e897d service nova] Creating event network-vif-deleted:003d7b43-0d9a-46a3-ba0c-07ee5636005e for instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f on n-h2-858383-10 Oct 12 10:22:31.879971 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [req-d25b7d59-ed0d-4ea7-9434-cd81bdeaf361 req-899fcd70-dd44-4f07-bb63-95d2745e897d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032375 Oct 12 10:22:31.880572 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3700/7826] 10.222.0.40 () {64 vars in 1317 bytes} [Wed Oct 12 10:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 10:22:32.016828 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:32.017565 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.compute.api [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127006) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:32.024574 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:32.025078 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:32.025568 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:32.026285 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:32.026756 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:32.027202 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:32.059258 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:32.059764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:32.060214 n-d-858383-10 devstack@n-api.service[127006]: DEBUG oslo_concurrency.lockutils [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:32.060678 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.objects.instance [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lazy-loading 'fault' on Instance uuid 61daf1e7-f19b-4d9e-846b-c39af5f9440f {{(pid=127006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 10:22:32.102764 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.policy [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd45bec33b488fae104a928c136711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51760c67024009bbf60d05e75419b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127006) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 10:22:32.110821 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-2f422c18-8ec0-4f72-9538-6a2a3dd63c53 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 200 len: 1338 microversion: 2.1 time: 0.098229 Oct 12 10:22:32.111396 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4127/7827] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:22:32 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 10:22:33.140754 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '>' {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:33.141685 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.compute.api [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] [instance: 61daf1e7-f19b-4d9e-846b-c39af5f9440f] Fetching instance by UUID {{(pid=127007) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 10:22:33.148677 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:33.149156 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:33.149628 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:33.150313 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Acquiring lock "0f322b3e-f876-4e6b-8fd7-70274045db25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 10:22:33.150759 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 10:22:33.151179 n-d-858383-10 devstack@n-api.service[127007]: DEBUG oslo_concurrency.lockutils [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Lock "0f322b3e-f876-4e6b-8fd7-70274045db25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 10:22:33.168073 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.wsgi [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] HTTP exception thrown: Instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f could not be found. Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Request method failure captured: Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: request: GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f HTTP/1.1 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: Accept: application/json Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: Accept-Encoding: identity Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: Connection: close Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: Content-Length: 0 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: Content-Type: application/json Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: Host: 10.222.0.40 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: Openstack-System-Scope: None Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: User-Agent: python-urllib3/1.26.12 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Auth-Token: gAAAAABjRpRNNoDkYqeyxKQEz8xW8aPBuZdoJmxF_XTDj3_IOQbUPcuDGh9fK2M8HxeEiOKY2SaK3mJqjD_w67ShJ0hK9ZhDhmF8noeUpzSy2Dj_UJHGwwfg0P-Vd0-diZPfW0BWK2_omjirzvJGD2BMajnQGqzGPpPGEyN9gR9_gtswUTXdkBE Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Id: None Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Domain-Name: None Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Identity-Status: Confirmed Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Is-Admin-Project: True Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Id: default Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Domain-Name: Default Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Id: 6f51760c67024009bbf60d05e75419b3 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Project-Name: tempest-TestSnapshotPattern-1057973661 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Role: reader,member Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Roles: reader,member Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f51760c67024009bbf60d05e75419b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6f51760c67024009bbf60d05e75419b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6f51760c67024009bbf60d05e75419b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f51760c67024009bbf60d05e75419b3"}]}] Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant: tempest-TestSnapshotPattern-1057973661 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Id: 6f51760c67024009bbf60d05e75419b3 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-Tenant-Name: tempest-TestSnapshotPattern-1057973661 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-User: tempest-TestSnapshotPattern-1057973661-project Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Id: default Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-User-Domain-Name: Default Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-User-Id: 98cd45bec33b488fae104a928c136711 Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: X-User-Name: tempest-TestSnapshotPattern-1057973661-project Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: method: > Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: exception: Instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f could not be found. Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: action_args: {'id': '61daf1e7-f19b-4d9e-846b-c39af5f9440f'} Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: {{(pid=127007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f could not be found. Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f could not be found. Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 10:22:33.169736 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f could not be found. Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: ERROR nova.api.openstack.wsgi Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: DEBUG nova.api.openstack.wsgi [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Returning 404 to user: Instance 61daf1e7-f19b-4d9e-846b-c39af5f9440f could not be found. {{(pid=127007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: INFO nova.api.openstack.requestlog [None req-e3762418-0cc2-4178-938f-a92806adab12 tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f" status: 404 len: 111 microversion: 2.1 time: 0.039081 Oct 12 10:22:33.175028 n-d-858383-10 devstack@n-api.service[127007]: [pid: 127007|app: 0|req: 3701/7828] 10.222.0.40 () {58 vars in 1236 bytes} [Wed Oct 12 10:22:33 2022] GET /compute/v2.1/servers/61daf1e7-f19b-4d9e-846b-c39af5f9440f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 10:22:33.335329 n-d-858383-10 devstack@n-api.service[127006]: DEBUG nova.api.openstack.wsgi [None req-0a1ba941-6512-4e3f-9d17-719c993e587c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] Calling method '.version_select at 0x7f984040b700>' {{(pid=127006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 10:22:33.364775 n-d-858383-10 devstack@n-api.service[127006]: INFO nova.api.openstack.requestlog [None req-0a1ba941-6512-4e3f-9d17-719c993e587c tempest-TestSnapshotPattern-1057973661 tempest-TestSnapshotPattern-1057973661-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1546068801" status: 202 len: 0 microversion: 2.1 time: 0.033689 Oct 12 10:22:33.365396 n-d-858383-10 devstack@n-api.service[127006]: [pid: 127006|app: 0|req: 4128/7829] 10.222.0.40 () {58 vars in 1257 bytes} [Wed Oct 12 10:22:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1546068801 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)